Trainable Bilateral Filter Layer (PyTorch)

Last update: Dec 25, 2022

Overview

Trainable Bilateral Filter Layer (PyTorch)

This repository contains our GPU-accelerated trainable bilateral filter layer (three spatial and one range filter dimension) that can be directly included in any Pytorch graph, just as any conventional layer (FCL, CNN, ...). By calculating the analytical derivative of the bilateral filter with respect to its parameters and its input, the (so far) hyperparameters can be automatically optimized via backpropagation for a calculated loss.

Our corresponding paper Ultra low-parameter denoising: Trainable bilateral filter layers in computed tomography can be found on arXiv.

Implementation:

The general structure of the implementation follows the PyTorch documentation for creating custom C++ and CUDA extensions. The forward pass implementation of the layer is based on code from the Project MONAI framework, originally published under the Apache License, Version 2.0. The correct implementation of the analytical forward and backward pass can be verified by running the gradcheck.py script, comparing numerical gradients with the derived analytical gradient using the PyTorch built-in gradcheck function.

Setup:

The C++/CUDA implemented forward and backward functions are compiled via the setup.py script using setuptools:

Create and activate a python environment (python>=3.7).
Install Torch (tested versions: 1.7.1, 1.9.0).
Navigate into the extracted repo.
Compile/install the bilateral filter layer by calling

python setup.py install

Example scripts:

Try out the forward pass by running the example_filter.py (requires Matplotlib and scikit-image).
Run the gradcheck.py script to verify the correct gradient implementation.
Run example_optimization.py to optimize the parameters of a bilateral filter layer to automatically denoise an image.

Optimized bilateral filter prediction:

Citation:

If you find our code useful, please cite our work

@article{wagner2022ultra,
  title={Ultra low-parameter denoising: Trainable bilateral filter layers in computed tomography},
  author={Wagner, Fabian and Thies, Mareike and Gu, Mingxuan and Huang, Yixing and Pechmann, Sabrina and Patwari, Mayank and Ploner, Stefan and Aust, Oliver and Uderhardt, Stefan and Schett, Georg and Christiansen, Silke and Maier, Andreas},
  journal={arXiv preprint arXiv:2201.10345},
  year={2022}
}

You might also like...

📦 PyTorch based visualization package for generating layer-wise explanations for CNNs.

Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones

HaloNet - Pytorch Implementation of the Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones. This re

189 Nov 22, 2022

Comments

3D case example

Hi, I am grateful that you have shared such awesome codes. I have downloaded the codes and tested 2D case. It works well. But when I used 3D images, the results seemed weird. As shown below.

The input 3D image is like this:

Could you provide 3D demo case? Thank you very much!

opened by cs123951 2

Trainable Bilateral Filter Layer (PyTorch)

Related tags

Overview

Trainable Bilateral Filter Layer (PyTorch)

Implementation:

Setup:

Example scripts:

Optimized bilateral filter prediction:

Citation:

You might also like...

📦 PyTorch based visualization package for generating layer-wise explanations for CNNs.

PyTorch Implementation of NCSOFT's FastPitchFormant: Source-filter based Decomposed Modeling for Speech Synthesis

[CVPR 2021] Official PyTorch Implementation for "Iterative Filter Adaptive Network for Single Image Defocus Deblurring"

Pytorch Implementation of Continual Learning With Filter Atom Swapping (ICLR'22 Spolight) Paper

Predictive AI layer for existing databases.

Predictive AI layer for existing databases.

An abstraction layer for mathematical optimization solvers.

Understanding and Improving Encoder Layer Fusion in Sequence-to-Sequence Learning (ICLR 2021)

Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones

Comments

3D case example

Releases(1.1.0)

1.1.0(Aug 1, 2022)

Owner

FabianWagner

Machine Learning Model deployment for Container (TensorFlow Serving)

ISNAS-DIP: Image Specific Neural Architecture Search for Deep Image Prior [CVPR 2022]

The official implementation of You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Nature Gradient.

A Tensorflow implementation of CapsNet based on Geoffrey Hinton's paper Dynamic Routing Between Capsules

The Incredible PyTorch: a curated list of tutorials, papers, projects, communities and more relating to PyTorch.

ComPhy: Compositional Physical Reasoning ofObjects and Events from Videos

This repository contains all source code, pre-trained models related to the paper "An Empirical Study on GANs with Margin Cosine Loss and Relativistic Discriminator"

CapsuleVOS: Semi-Supervised Video Object Segmentation Using Capsule Routing

This repository compare a selfie with images from identity documents and response if the selfie match.

Tgbox-bench - Simple TGBOX upload speed benchmark

GeoTransformer - Geometric Transformer for Fast and Robust Point Cloud Registration

AI Based Smart Exam Proctoring Package

CVPR 2021: "The Spatially-Correlative Loss for Various Image Translation Tasks"

Identifying a Training-Set Attack’s Target Using Renormalized Influence Estimation

Tensorflow 2.x implementation of Vision-Transformer model

QueryDet: Cascaded Sparse Query for Accelerating High-Resolution SmallObject Detection

Spectrum is an AI that uses machine learning to generate Rap song lyrics

2021 CCF BDCI 全国信息检索挑战杯（CCIR-Cup）智能人机交互自然语言理解赛道第二名参赛解决方案

Yggdrasil - A simplistic bot designed to streamline your server experience

SegNet-like Autoencoders in TensorFlow