Code for the paper: Fusformer: A Transformer-based Fusion Approach for Hyperspectral Image Super-resolution

Last update: Dec 12, 2022

Related tags

Computer Vision Fusformer

Overview

Fusformer

Code for the paper: "Fusformer: A Transformer-based Fusion Approach for Hyperspectral Image Super-resolution"

Plateform

Python 3.8.5 + Pytorch 1.7.1

Data

demo_cave.h5: A testing image from the CAVE dataset, containing "GT" ( 512x512x31), "RGB" (128x128x3) and "LRHSI" (128x128x31).
demo_cave_patches_h5: If your GPU memory is too small to run with the whole testing image, we cut the testing image into 64 patches with the size 64x64x31 of GT, 63x64x3 of RGB, and 16x16x31 of LRHSI, respectively.

Download link: https://github.com/J-FHu/Fusformer/releases/tag/Pytorch

Code

data.py: The dataloader of the training and testing data.
main.py: The training and testing function of our Fusformer.
model.py: The whole model of our Fusformer.
reshape2big.m : If you use the "demo_cave_patches.h5" as the testing data, the output ("PatchOutput-cave.mat") generated by the network will be 64 patches with the size of 64x64x31, which should be reshaped to the original size of 512x512x31.

Comments

HSI-->MSI

Thanks for sharing, it is a really great job! This paper claims that HR-MSI is obtained by Canon EOS 5D Mark II coupled with the HR-HSI. Although we can get the spectral response function of Canon EOS 5D Mark II, the band range represented by each channel of the HSI is not available. As a result, how I can get the HR-MSI? I am looking forward to your reply. Thank you very much!

opened by ZhilingGuo 1

Releases(Pytorch)

Pytorch(Jan 4, 2022)
Testing data for "Fusformer: A Transformer-based Fusion Approach for Hyperspectral Image Super-resolution"

demo_cave.h5: A testing image from the CAVE dataset, containing "GT" ( 512x512x31), "RGB" (128x128x3) and "LRHSI" (128x128x31).

demo_cave_patches_h5: If your GPU memory is too small to run with the whole testing image, we cut the testing image into 64 patches with the size 64x64x31 of GT, 63x64x3 of RGB, and 16x16x31 of LRHSI, respectively.

Source code(tar.gz)
Source code(zip)
demo_cave.h5(71.87 MB)
demo_cave_patches.h5(71.87 MB)

This is the official PyTorch implementation of the paper "TransFG: A Transformer Architecture for Fine-grained Recognition" (Ju He, Jie-Neng Chen, Shuai Liu, Adam Kortylewski, Cheng Yang, Yutong Bai, Changhu Wang, Alan Yuille).

TransFG: A Transformer Architecture for Fine-grained Recognition Official PyTorch code for the paper: TransFG: A Transformer Architecture for Fine-gra

307 Jan 3, 2023

Code for the paper "DewarpNet: Single-Image Document Unwarping With Stacked 3D and 2D Regression Networks" (ICCV '19)

DewarpNet This repository contains the codes for DewarpNet training. Recent Updates [May, 2020] Added evaluation images and an important note about Ma

354 Jan 1, 2023

Code for CVPR'2022 paper ✨ "Predict, Prevent, and Evaluate: Disentangled Text-Driven Image Manipulation Empowered by Pre-Trained Vision-Language Model"

PPE ✨ Repository for our CVPR'2022 paper: Predict, Prevent, and Evaluate: Disentangled Text-Driven Image Manipulation Empowered by Pre-Trained Vision-

34 Nov 28, 2022

Source code of our TPAMI'21 paper Dual Encoding for Video Retrieval by Text and CVPR'19 paper Dual Encoding for Zero-Example Video Retrieval.

Dual Encoding for Video Retrieval by Text Source code of our TPAMI'21 paper Dual Encoding for Video Retrieval by Text and CVPR'19 paper Dual Encoding

81 Dec 1, 2022

Code for paper "Role-based network embedding via structural features reconstruction with degree-regularized constraint"

Role-based network embedding via structural features reconstruction with degree-regularized constraint Train python main.py --dataset brazil-flights

1 Jun 28, 2022

Deskew is a command line tool for deskewing scanned text documents. It uses Hough transform to detect "text lines" in the image. As an output, you get an image rotated so that the lines are horizontal.

Deskew by Marek Mauder https://galfar.vevb.net/deskew https://github.com/galfar/deskew v1.30 2019-06-07 Overview Deskew is a command line tool for des

127 Dec 3, 2022

A facial recognition device is a device that takes an image or a video of a human face and compares it to another image faces in a database.

A facial recognition device is a device that takes an image or a video of a human face and compares it to another image faces in a database. The structure, shape and proportions of the faces are compared during the face recognition steps.

4 Mar 19, 2022

An advanced 2D image manipulation with features such as edge detection and image segmentation built using OpenCV

OpenCV-ToothPaint3-Advanced-Digital-Image-Editor This application named ‘Tooth Paint’ version TP_2020.3 (64-bit) or version 3 was developed within a w

1 Nov 5, 2021

This pyhton script converts a pdf to Image then using tesseract as OCR engine converts Image to Text

Script_Convertir_PDF_IMG_TXT Este script de pyhton convierte un pdf en Imagen luego utilizando tesseract como motor OCR convierte la Imagen a Texto. p

1 Jan 27, 2022

Code for the paper: Fusformer: A Transformer-based Fusion Approach for Hyperspectral Image Super-resolution

Related tags

Overview

Fusformer

You might also like...

This is the official PyTorch implementation of the paper "TransFG: A Transformer Architecture for Fine-grained Recognition" (Ju He, Jie-Neng Chen, Shuai Liu, Adam Kortylewski, Cheng Yang, Yutong Bai, Changhu Wang, Alan Yuille).

Code for the paper "DewarpNet: Single-Image Document Unwarping With Stacked 3D and 2D Regression Networks" (ICCV '19)

Code for CVPR'2022 paper ✨ "Predict, Prevent, and Evaluate: Disentangled Text-Driven Image Manipulation Empowered by Pre-Trained Vision-Language Model"

Source code of our TPAMI'21 paper Dual Encoding for Video Retrieval by Text and CVPR'19 paper Dual Encoding for Zero-Example Video Retrieval.

Code for paper "Role-based network embedding via structural features reconstruction with degree-regularized constraint"

Deskew is a command line tool for deskewing scanned text documents. It uses Hough transform to detect "text lines" in the image. As an output, you get an image rotated so that the lines are horizontal.

A facial recognition device is a device that takes an image or a video of a human face and compares it to another image faces in a database.

An advanced 2D image manipulation with features such as edge detection and image segmentation built using OpenCV

This pyhton script converts a pdf to Image then using tesseract as OCR engine converts Image to Text

Comments

HSI-->MSI

Releases(Pytorch)

Pytorch(Jan 4, 2022)

Owner

Jin-Fan Hu (胡锦帆)

Responsive Doc. scanner using U^2-Net, Textcleaner and Tesseract

An unofficial package help developers to implement ZATCA (Fatoora) QR code easily which required for e-invoicing

chineseocr/table_line 表格线检测模型pytorch版

Resizing Canny Countour In Python

A pkg stiching around view images(4-6cameras) to generate bird's eye view.

Character Segmentation using TensorFlow

QuanTaichi: A Compiler for Quantized Simulations (SIGGRAPH 2021)

This repository contains codes on how to handle mouse event using OpenCV

Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation, CVPR 2020 (Oral)

OpenCVを用いたカメラキャリブレーションのサンプルです。2021/06/21時点でPython実装のある3種類(通常カメラ向け、魚眼レンズ向け(fisheyeモジュール)、全方位カメラ向け(omnidirモジュール))について用意しています。

Repository for Scene Text Detection with Supervised Pyramid Context Network with tensorflow.

Text page dewarping using a "cubic sheet" model

Framework for the Complete Gaze Tracking Pipeline

Python library to extract tabular data from images and scanned PDFs

The CIS OCR PostCorrectionTool

Handwritten Text Recognition (HTR) system implemented with TensorFlow (TF) and trained on the IAM off-line HTR dataset. This Neural Network (NN) model recognizes the text contained in the images of segmented words.

Repository of conference publications and source code for first-/ second-authored papers published at NeurIPS, ICML, and ICLR.

🔎 Like Chardet. 🚀 Package for encoding & language detection. Charset detection.

A fastai/PyTorch package for unpaired image-to-image translation.