This repo supplements our Survey on Transformers in Medical Imaging

Fahad Shamshad, Salman Khan, Syed Waqas Zamir, Muhammad Haris Khan, Munawar Hayat, Fahad Shahbaz Khan, and Huazhu Fu

Awesome Transformers in Medical Imaging

A curated list of awesome Transformers resources in medical imaging, inspired by the other awesome-initiatives. We intend to regularly update the relevant latest papers and their open-source implementations on this page. If you find some overlooked papers, please open an issue or contact at [email protected].

Overview

• Survey papers
• Medical Image Segmentation
• Medical Image Classification
• Medical Image Reconstruction
• Medical Image Registration
• Medical Image Synthesis
• Medical Image Detection
• Clinical Report Generation
• Others

Survey

Transformer in Medical Imaging: A survey. [25th Jan., 2022]
Fahad Shamshad, Salman Khan, Syed Waqas Zamir, Muhammad Haris Khan, Munawar Hayat, Fahad Shahbaz Khan, and Huazhu Fu.
[PDF]

Application of Transformer in Medical Image Segmentation. [25th Oct., 2021].
Wenyin Zhang, Weijie Hao, Yuan Qi and Yong Wu.
[PDF]

Segmentation

Attention-Based Transformers for Instance Segmentation of Cells in Microstructures. [20th Nov., 2021].
Tim Prangemeier, Christoph Reich, Heinz Koeppl.
[PDF]

TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation. [8th Feb., 2021].
Jieneng Chen, Yongyi Lu, Qihang Yu, Xiangde Luo, Ehsan Adeli, Yan Wang, Le Lu, Alan L. Yuille, Yuyin Zhou.
[PDF] [Github]

TransFuse: Fusing Transformers and CNNs for Medical Image Segmentation. [16th Feb., 2021] [ ⚡ MICCAI, 2021].
Yundong Zhang, Huiye Liu, Qiang Hu.
[PDF] [Github]

Convolution-Free Medical Image Segmentation using Transformers. [26th Feb., 2021] [ ⚡ MICCAI, 2021].
Davood Karimi, Serge Vasylechko, Ali Gholipour.
[PDF]

CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentation. [4th March, 2021] [ ⚡ MICCAI, 2021].
Yutong Xie, Jianpeng Zhang, Chunhua Shen, Yong Xia.
[PDF] [Github]

SpecTr: Spectral Transformer for Hyperspectral Pathology Image Segmentation. [5th March, 2021].
Boxiang Yun, Yan Wang, Jieneng Chen, Huiyu Wang, Wei Shen, Qingli Li.
[PDF] [Github]

TransBTS: Multimodal Brain Tumor Segmentation Using Transformer. [7th March, 2021] [ ⚡ MICCAI, 2021].
Wenxuan Wang, Chen Chen, Meng Ding, Jiangyun Li, Hong Yu, Sen Zha.
[PDF] [Github]

U-Net Transformer: Self and Cross Attention for Medical Image Segmentation. [10th March, 2021].
Olivier Petit, Nicolas Thome, Clément Rambour, Luc Soler.
[PDF] [Github]

UNETR: Transformers for 3D Medical Image Segmentation . [18th March, 2021].
Ali Hatamizadeh, Yucheng Tang, Vishwesh Nath, Dong Yang, Andriy Myronenko, Bennett Landman, Holger Roth, Daguang Xu.
[PDF] [Github]

Medical Transformer: Universal Brain Encoder for 3D MRI Analysis. [28th April, 2021].
Eunji Jun, Seungwoo Jeong, Da-Woon Heo, Heung-Il Suk.
[PDF]

Pyramid Medical Transformer for Medical Image Segmentation . [29th April, 2021].
Zhuangzhuang Zhang, Baozhou Sun, Weixiong Zhang.
[PDF]

GasHis-Transformer: A Multi-scale Visual Transformer Approach for Gastric Histopathology Image Classification. [29th April, 2021].
Haoyuan Chen, Chen Li, Xiaoyan Li, Ge Wang, Weiming Hu, Yixin Li, Wanli Liu, Changhao Sun, Yudong Yao, Yueyang Teng, Marcin Grzegorzek.
[PDF]

Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationr. [12th May, 2021].
Hu Cao, Yueyue Wang, Joy Chen, Dongsheng Jiang, Xiaopeng Zhang, Qi Tian, Manning Wang.
[PDF]

Medical Image Segmentation Using Squeeze-and-Expansion Transformers. [20th May, 2021] [ ⚡ IJCAI, 2021].
Shaohua Li, Xiuchao Sui, Xiangde Luo, Xinxing Xu, Yong Liu, Rick Goh.
[PDF] [Github]

A Multi-Branch Hybrid Transformer Network for Corneal Endothelial Cell Segmentation. [21st May, 2021] [ ⚡ MICCAI, 2021].
Yinglin Zhang, Risa Higashita, Huazhu Fu, Yanwu Xu, Yang Zhang, Haofeng Liu, Jian Zhang, Jiang Liu.
[PDF]

DS-TransUNet:Dual Swin Transformer U-Net for Medical Image Segmentation. [12 June, 2021].
Ailiang Lin, Bingzhi Chen, Jiayu Xu, Zheng Zhang, Guangming Lu.
[PDF]

More than Encoder: Introducing Transformer Decoder to Upsample. [20th June, 2021].
Yijiang Li, Wentian Cai, Ying Gao, Xiping Hu.
[PDF]

Multi-Compound Transformer for Accurate Biomedical Image Segmentation. [28th June, 2021] [ ⚡ MICCAI, 2021].
Yuanfeng Ji, Ruimao Zhang, Huijie Wang, Zhen Li, Lingyun Wu, Shaoting Zhang, Ping Luo.
[PDF] [Github]

UTNet: A Hybrid Transformer Architecture for Medical Image Segmentation. [2nd July, 2021] [ ⚡ MICCAI, 2021].
Yunhe Gao, Mu Zhou, Dimitris Metaxas.
[PDF] [Github]

Few-Shot Domain Adaptation with Polymorphic Transformers. [10th July, 2021] [ ⚡ MICCAI, 2021].
Shaohua Li, Xiuchao Sui, Jie Fu, Huazhu Fu, Xiangde Luo, Yangqin Feng, Xinxing Xu, Yong Liu, Daniel Ting, Rick Siow Mong Goh.
[PDF] [Github]

TransClaw U-Net: Claw U-Net with Transformers for Medical Image Segmentation. [12th July, 2021].
Yao Chang, Hu Menghan, Zhai Guangtao, Zhang Xiao-Ping.
[PDF]

TransAttUnet: Multi-level Attention-guided U-Net with Transformer for Medical Image Segmentation. [12th July, 2021].
Bingzhi Chen, Yishu Liu, Zheng Zhang, Guangming Lu, David Zhang.
[PDF]

LeViT-UNet: Make Faster Encoders with Transformer for Medical Image Segmentation. [19th July, 2021].
Guoping Xu, Xingrong Wu, Xuan Zhang, Xinwei He.
[PDF] [Github]

Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformers. [16th August, 2021].
Bo Dong, Wenhai Wang, Deng-Ping Fan, Jinpeng Li, Huazhu Fu, Ling Shao.
[PDF] [Github]

Evaluating Transformer-based Semantic Segmentation Networks for Pathological Image Segmentation. [26th August, 2021].
Cam Nguyen, Zuhayr Asad, Yuankai Huo.
[PDF]

Automated Kidney Tumor Segmentation with Convolution and Transformer Network. [30th August, 2021] [ 👍 MICCAI KiTS Challenge, 2021].
Zhiqiang Shen, Zhiqiang_Shen, Hua Yang, Zhen Zhang, Shaohua Zheng.
[PDF]

nnFormer: Interleaved Transformer for Volumetric Segmentation. [7th Sep., 2021].
Hong-Yu Zhou, Jiansen Guo, Yinghao Zhang, Lequan Yu, Liansheng Wang, Yizhou Yu.
[PDF] [Github]

UCTransNet: Rethinking the Skip Connections in U-Net from a Channel-wise Perspective with Transformer. [9th, Sep.,].
Haonan Wang, Peng Cao, Jiaqi Wang, Osmar R.Zaiane.
[PDF] [Github]

MISSFormer: An Effective Medical Image Segmentation Transformer. [15th, Sep. 2021].
Xiaohong Huang, Zhifang Deng, Dandan Li, Xueguang Yuan.
[PDF]

TransBridge: A Lightweight Transformer for Left Ventricle Segmentation in Echocardiography. [21st Sep., 2021] [ 👍 MICCAI Simplifying Medical Ultrasound Workshop, 2021].
Kaizhong DengYanda MengDongxu GaoJoshua BridgeYaochun ShenGregory LipYitian ZhaoYalin Zheng.
[PDF]

BiTr-Unet: a CNN-Transformer Combined Network for MRI Brain Tumor Segmentation. [25th Sep., 2021] [ 👍 MICCAI BraTS DREAM Challenge ShuLab, 2021].
Qiran Jia, Hai Shu.
[PDF]

GT U-Net: A U-Net Like Group Transformer Network for Tooth Root Segmentation . [30th Sep., 2021] [ 👍 MICCAI MLMI Workshop, 2021].
Yunxiang Li, Shuai Wang, Jun Wang, Guodong Zeng, Wenjun Liu, Qianni Zhang, Qun Jin, Yaqi Wang.
[PDF] [Github]

Transformer Assisted Convolutional Network for Cell Instance Segmentation. [5th Oct., 2021] [ 👍 ISBI Workshop, 2021].
Deepanshu Pandey, Pradyumna Gupta, Sumit Bhattacharya, Aman Sinha, Rohit Agarwal.
[PDF] [Github]

Boundary-aware Transformers for Skin Lesion Segmentation. [8th Oct., 2021] [ ⚡ MICCAI, 2021].
Jiacheng Wang, Lan Wei, Liansheng Wang, Qichao Zhou, Lei Zhu, Jing Qin.
[PDF] [Github]

Spine-transformers: Vertebra labeling and segmentation in arbitrary field-of-view spine CTs via 3D transformers. [10th Oct., 2021] [ ⚡ MIA, 2021].
Rong Taoa, Wenyong Liub, Guoyan Zheng.
[PDF]

AFTer-UNet: Axial Fusion Transformer UNet for Medical Image Segmentation. [20th Oct., 2021].
Xiangyi Yan, Hao Tang, Shanlin Sun, Haoyu Ma, Deying Kong, Xiaohui Xie.
[PDF]

Hepatic vessel segmentation based on 3D swin-transformer with inductive biased multi-head self-attention. [5th Nov., 2021].
Mian Wu, Yinling Qian, Xiangyun Liao, Qiong Wang, Pheng-Ann Heng.
[PDF]

Mixed Transformer U-Net For Medical Image Segmentation. [8th, Nov. 2021].
Hongyi Wang, Shiao Xie, Lanfen Lin, Yutaro Iwamoto, Xian-Hua Han, Yen-Wei Chen, Ruofeng Tong.
[PDF] [Github]

T-AutoML: Automated Machine Learning for Lesion Segmentation using Transformers in 3D Medical Imaging. [15th Nov., 2021] [ ⚡ ICCV, 2021].
Dong Yang, Andriy Myronenko, Xiaosong Wang, Ziyue Xu, Holger R. Roth, Daguang Xu.
[PDF]

A Volumetric Transformer for Accurate 3D Tumor Segmentation. [26th Nov., 2021].
Himashi Peiris, Munawar Hayat, Zhaolin Chen, Gary Egan, Mehrtash Harandi.
[PDF] [Github]

Exploiting full Resolution Feature Context for Liver Tumor and Vessel Segmentation via Fusion Encoder: Application to Liver Tumor and Vessel 3D reconstruction. [26th Nov., 2021].
Xiangyu Meng, Xudong Zhang, Gan Wang, Ying Zhang, Xin Shi, Huanhuan Dai, Zixuan Wang, Xun Wang.
[PDF]

Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis. [29th Nov., 2021].
Yucheng Tang, Dong Yang, Wenqi Li, Holger Roth, Bennett Landman, Daguang Xu, Vishwesh Nath, Ali Hatamizadeh.
[PDF] [Github]

MT-TransUNet: Mediating Multi-Task Tokens in Transformers for Skin Lesion Segmentation and Classification. [3rd Dec., 2021].
Jingye Chen, Jieneng Chen, Zongwei Zhou, Bin Li, Alan Yuille, Yongyi Lu.
[PDF] [Github]

FAT-Net: Feature Adaptive Transformers for Automated Skin Lesion Segmentation. [4th Dec., 2021] [ ⚡ MIA, 2021].
Huisi Wu, Shihuai Chen, Guilian Chen, Wei Wang, Baiying Lei, Zhenkun Wen.
[PDF] [Github]

Semi-Supervised Medical Image Segmentation via Cross Teaching between CNN and Transformer. [9th Dec., 2021].
Xiangde Luo, Minhao Hu, Tao Song, Guotai Wang, Shaoting Zhang.
[PDF] [Github]

D-Former: A U-shaped Dilated Transformer for 3D Medical Image Segmentation. [3rd Jan., 2022].
Yixuan Wu, Kuanlun Liao, Jintai Chen, Jinhong Wang, Danny Z. Chen, Honghao Gao, Jian Wu.
[PDF]

Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images. [4th Jan., 2022].
Ali Hatamizadeh, Vishwesh Nath, Yucheng Tang, Dong Yang, Holger Roth, Daguang Xu.
[PDF] [Github]

Classification

TransMed: Transformers Advance Multi-modal Medical Image Classification. [10th March, 2021].
Yin Dai, Yifan Gao.
[PDF]

Medical Transformer: Universal Brain Encoder for 3D MRI Analysis. [28th April, 2021].
Eunji Jun, Seungwoo Jeong, Da-Woon Heo, Heung-Il Suk.
[PDF]

TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classification. [2nd June, 2021] [ ⚡ NeurIPS, 2021].
Zhuchen Shao, Hao Bian, Yang Chen, Yifeng Wang, Jian Zhang, Xiangyang Ji, Yongbing Zhang.
[PDF] [Github]

Vision Transformer-based recognition of diabetic retinopathy grade. [15 July, 2021] [ ⚡ CVPR, 2021].
Rui Sun, Yihao Li, Tianzhu Zhang, Zhendong Mao, Feng Wu, Yongdong Zhang.
[PDF]

Is it Time to Replace CNNs with Transformers for Medical Images? [20th Aug., 2021] [ 👍 ICCV Workshop of Automated Medical Diagnosis, 2021].
Christos Matsoukas, Johan Fredin Haslum, Magnus Söderberg, Kevin Smith.
[PDF] [Github]

Gene Transformer: Transformers for the Gene Expression-based Classification of Lung Cancer Subtypes [26th Aug., 2021].
Anwar Khan, Boreom Lee.
[PDF]

A transformer-based deep learning approach for classifying brain metastases into primary organ sites using clinical whole brain MRI. [7th Oct., 2021].
Qing Lyu, Sanjeev V. Namjoshi, Emory McTyre, Umit Topaloglu, Richard Barcus, Michael D. Chan, Christina K. Cramer, Waldemar Debinski, Metin N. Gurcan, Glenn J. Lesser, Hui-Kuan Lin, Reginald F. Munden, Boris C. Pasche, Kiran Kumar Solingapuram Sai, Roy E. Strowd, Stephen B. Tatter, Kounosuke Watabe, Wei Zhang, Ge Wang, Christopher T. Whitlow.
[PDF]

CAE-Transformer: Transformer-based Model to Predict Invasiveness of Lung Adenocarcinoma Subsolid Nodules from Non-thin Section 3D CT Scans. [17th Oct., 2021].
Shahin Heidarian, Parnian Afshar, Anastasia Oikonomou, Konstantinos N. Plataniotis, Arash Mohammadi.
[PDF]

Vision Transformer-based recognition of diabetic retinopathy grade. [25th Oct., 2021].
Jianfang Wu, Ruo Hu, Zhenghong Xiao, Jiaxu Chen, Jingwei Liu.
[PDF]

VISION TRANSFORMERS FOR CLASSIFICATION OF BREAST ULTRASOUND IMAGES. [27th Oct., 2021].
Behnaz Gheflati, Hassan Rivaz.
[PDF]

Classification COVID19 (Separate section due to its current significance)

Vision Transformer for COVID-19 CXR Diagnosis using Chest X-ray Feature Corpus. [12th March, 2021].
Sangjoon Park, Gwanghyun Kim, Yujin Oh, Joon Beom Seo, Sang Min Lee, Jin Hwan Kim, Sungjun Moon, Jae-Kwang Lim, Jong Chul Ye.
[PDF]

Vision Transformer using Low-level Chest X-ray Feature Corpus for COVID-19 Diagnosis and Severity Quantification. [15th April, 2021].
Sangjoon Park, Gwanghyun Kim, Yujin Oh, Joon Beom Seo, Sang Min Lee, Jin Hwan Kim, Sungjun Moon, Jae-Kwang Lim, Jong Chul Ye.
[PDF]

POCFormer: A Lightweight Transformer Architecture for Detection of COVID-19 Using Point of Care Ultrasound. [15th May, 2021].
Shehan Perera, Srikar Adhikari, Alper Yilmaz.
[PDF]

Automatic Diagnosis of COVID-19 Using a tailored Transformer-Like Network. [20th May, 2021].
Chengeng Liu1, Qingshan Yin.
[PDF]

COVID-VIT: Classification of COVID-19 from CT chest images based on vision transformer models. [4th July, 2021].
Xiaohong Gao, Yu Qian, Alice Gao.
[PDF] [Github]

xViTCOS: Explainable Vision Transformer Based COVID-19 Screening Using Radiography . [6th July, 2021].
Arnab Kumar MondalArnab Kumar Mondal, Arnab Bhattacharjee, Parag Singla, Prathosh AP.
[PDF]

Visual Transformer with Statistical Test for COVID-19 Classification. [12th July, 2021] [ 👍 ICCV MIA Workshop, 2021].
Chih-Chung Hsu, Guan-Lin Chen, Mei-Hsuan Wu.
[PDF]

MIA-COV19D: A transformer-based framework for COVID19 classification in chest CTs. [15th July, 2021] [ 👍 ICCV MIA Workshop, 2021].
Lei Zhang, Yan Wen.
[PDF]

COViT-GAN: Vision Transformer forCOVID-19 Detection in CT images. [10th August, 2021].
Ara Abigail E. Ambita, Eujene Nikka V. Boquio, Prospero C. Naval Jr.
[PDF]

COVID-Transformer: Interpretable COVID-19 Detection Using Vision Transformer for Healthcare. [23rd Sep., 2021].
Debaditya Shome, T Kar, Sachi Nandan Mohanty, Prayag Tiwari, Khan Muhammad, Abdullah AlTameem, Yazhou Zhang, Abdul Khader Jilani Saudagar.
[PDF]

Vision Transformer based COVID-19 Detection using Chest X-rays. [9th Oct., 2021].
Koushik Sivarama Krishnan, Karthik Sivarama Krishnan.
[PDF]

COVID-19 Detection in Chest X-ray Images Using Swin-Transformer and Transformer in Transformer. [16th Oct., 2021].
Juntao Jiang, Shuyi Lin.
[PDF]

Federated Split Vision Transformer for COVID-19 CXR Diagnosis using Task-Agnostic Training. [2nd Nov., 2021] [ ⚡ NeurIPS, 2021].
Sangjoon Park, Gwanghyun Kim, Jeongsol Kim, Boah Kim, Jong Chul Ye.
[PDF]

Multi-task vision transformer using low-level chest X-ray feature corpus for COVID-19 diagnosis and severity quantification. [4th Nov., 2021] [ ⚡ MIA, 2021].
Sangjoon Parka, Gwanghyun Kima,Yujin Oha, Joon Beom Seo, Sang Min Lee, Jin Hwan Kimc,Sungjun Moond, Jae-Kwang Lime, Jong Chul Ye.
[PDF]

Reconstruction

TransCT: Dual-path Transformer for Low Dose Computed Tomography. [28th Feb., 2021] [ ⚡ MICCAI, 2021].
Zhicheng Zhang, Lequan Yu, Xiaokun Liang, Wei Zhao, Lei Xing.
[PDF] [Github]

Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformers. [15th May, 2021].
Yilmaz Korkmaz, Salman UH Dar, Mahmut Yurt, Muzaffer Özbey, Tolga Çukur.
[PDF] [Github]

TED-net: Convolution-free T2T Vision Transformer-based Encoder-decoder Dilation network for Low-dose CT Denoising. [8th June, 2021].
Dayang Wang, Zhan Wu, Hengyong Yu.
[PDF]

Task Transformer Network for Joint MRI Reconstruction and Super-Resolution. [12th June, 2021] [ ⚡ MICCAI, 2021].
Chun-Mei Feng, Yunlu Yan, Huazhu Fu, Li Chen, Yong Xu.
[PDF] [Github]

Accelerated Multi-Modal MR Imaging with Transformers. [27th June, 2021].
Chun-Mei Feng, Yunlu Yan, Geng Chen, Huazhu Fu, Yong Xu, Ling Shao.
[PDF] [Github]

E-DSSR: Efficient Dynamic Surgical Scene Reconstruction with Transformer-based Stereoscopic Depth Perception. [1st July, 2021] [ ⚡ MICCAI, 2021].
Yonghao Long, Zhaoshuo Li, Chi Hang Yee, Chi Fai Ng, Russell H. Taylor, Mathias Unberath, Qi Dou.
[PDF]

Eformer: Edge Enhancement based Transformer for Medical Image Denoising. [16th Sep., 2021] [ 👍 ICCV Workshop, 2021].
Achleshwar Luthra, Harsh Sulakhe, Tanish Mittal, Abhishek Iyer, Santosh Yadav.
[PDF]

Transformer-Unet: Raw Image Processing with Unet. [17th Sep., 2021].
Youyang Sha, Yonghong Zhang, Xuquan Ji, Lei Hu.
[PDF]

Deep MRI Reconstruction with Generative Vision Transformers . [25th Sep., 2021].
Yilmaz KorkmazMahmut Yurt, Salman Ul Hassan Dar, Muzaffer Özbey, Tolga Cukur.
[PDF] [Github]

3D Transformer-GAN for High-quality PET Reconstruction. [29th Sep., 2021] [ ⚡ MICCAI, 2021].
Yanmei Luo, Yan Wang, Chen Zu, Bo Zhan, Xi Wu, Jiliu Zhou, Dinggang Shen, Luping Zhou.
[PDF]

TranSMS: Transformers for Super-Resolution Calibration in Magnetic Particle Imaging. [3rd Nov., 2021] .
Alper Güngör, Baris Askin, Damla Alptekin Soydan, Emine Ulku Saritas, Can Barış Top, Tolga Çukur.
[PDF]

DuDoTrans: Dual-Domain Transformer Provides More Attention for Sinogram Restoration in Sparse-View CT Reconstruction. [21st Nov., 2021] .
Ce Wang, Kun Shang, Haimiao Zhang, Qian Li, Yuan Hui, S. Kevin Zhou.
[PDF]

Self-supervised CT super-resolution with hybrid model. [23rd Nov., 2021] .
Zhicheng Zhang, Shaode Yu, Wenjian Qin, Xiaokun Liang, Yaoqin Xie, Guohua Cao.
[PDF]

MIST-net: Multi-domain Integrative Swin Transformer network for Sparse-View CT Reconstruction. [29th Nov., 2021] .
Jiayi Pan, Weiwen Wu, Zhifan Gao, Heye Zhang.
[PDF]

Registration

ViT-V-Net: Vision Transformer for Unsupervised Volumetric Medical Image Registration. [13th April, 2021] [ 👍 MIDL Short Paper, 2021].
Junyu Chen, Yufan He, Eric C. Frey, Ye Li, Yong Du.
[PDF] [Github]

Attention for Image Registration (AiR): an unsupervised Transformer approach. [5th May, 2021].
Zihao Wang, Hervé Delingette.
[PDF]

Learning Dual Transformer Network for Diffeomorphic Registration. [21st Sep., 2021] [ ⚡ MICCAI, 2021].
Yungeng Zhang, Yuru Pei, Hongbin Zha.
[PDF]

TransMorph: Transformer for unsupervised medical image registration. [19th Nov., 2021].
Junyu Chen, Yong Du, Yufan He, William P. Segars, Ye Li, Eric C. Frey.
[PDF] [Github]

Synthesis

VTGAN: Semi-supervised Retinal Image Synthesis and Disease Prediction using Vision Transformers. [14th April, 2021] [ 👍 ICCV Workshop on Computer Vision for Automated Medical Diagnosi, 2021].
Sharif Amit Kamran, Khondker Fariha Hossain, Alireza Tavakkoli, Stewart Lee Zuckerbrod, Salah A. Baker.
[PDF] [Github]

PTNet: A High-Resolution Infant MRI Synthesizer Based on Transformer. [28th May, 2021].
Xuzhe Zhang, Xinzi He, Jia Guo, Nabil Ettehadi, Natalie Aw, David Semanek, Jonathan Posner, Andrew Laine, Yun Wang.
[PDF] [Github]

ResViT: Residual vision transformers for multi-modal medical image synthesis. [30th June, 2021].
Onat Dalmaz, Mahmut Yurt, Tolga Çukur.
[PDF] [Github]

CyTran: Cycle-Consistent Transformers for Non-Contrast to Contrast CT Translation. [12th Oct., 2021].
Nicolae-Catalin Ristea, Andreea-Iuliana Miron, Olivian Savencu, Mariana-Iuliana Georgescu, Nicolae Verga, Fahad Shahbaz Khan, Radu Tudor Ionescu.
[PDF] [Github]

Detection

COTR: Convolution in Transformer Network for End to End Polyp Detection. [23rd May, 2021].
Zhiqiang Shen, Chaonan Lin, Shaohua Zheng.
[PDF]

Transformer for Polyp Detection. [14th Oct., 2021].
Shijie Liu, Hongyu Zhou, Xiaozhou Shi, Junwen Pan.
[PDF]

Lymph Node Detection in T2 MRI with Transformers. [9th Nov., 2021].
Tejas Sudharshan Mathai, Sungwon Lee, Daniel C. Elton, Thomas C. Shen, Yifan Peng, Zhiyong Lu, Ronald M. Summers.
[PDF]

Clinical-Report-Generation

Reinforced Transformer for Medical Image Captioning. [10th Oct., 2019].[MLMI, 2019]
Yuxuan Xiong, Bo Du, Pingkun Yan.
[PDF]

Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generation. [20th Oct., 2020].[NAACL, 2020]
Yasuhide Miura, Yuhao Zhang, Emily Bao Tsai, Curtis P. Langlotz, Dan Jurafsky.
[PDF] [Github]

Generating Radiology Reports via Memory-driven Transformer. [30th Oct., 2020].[EMNLP, 2020]
Zhihong Chen, Yan Song, Tsung-Hui Chang, Xiang Wan.
[PDF] [Github]

Hierarchical X-Ray Report Generation via Pathology tags and Multi Head Attention. [30th Nov., 2020].[EMNLP, 2020]
Preethi Srinivasan, Daksh Thapar, Arnav Bhavsar, Aditya Nigam.
[PDF]

Confidence-Guided Radiology Report Generation. [21st June, 2021].[ ⚡ MICCAI, 2021]
Yixin Wang, Zihao Lin, Jiang Tian, Zhongchao Shi, Yang Zhang, Jianping Fan, Zhiqiang He.
[PDF]

Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generation. [13th June, 2021].[ ⚡ CVPR, 2021]
Fenglin Liu, Xian Wu, Shen Ge, Wei Fan, Yuexian Zou.
[PDF]

RATCHET: Medical Transformer for Chest X-ray Diagnosis and Reporting. [5th July, 2021].[ ⚡ MICCAI, 2021]
Benjamin Hou, Georgios Kaissis, Ronald Summers, Bernhard Kainz.
[PDF] [Github]

Surgical Instruction Generation with Transformers. [14th July, 2021].[ ⚡ MICCAI, 2021]
Jinglu Zhang, Yinyu Nie, Jian Chang, Jian Jun Zhang.
[PDF]

Automated Generation of Accurate and Fluent Medical X-ray Reports. [27th Aug., 2021].[EMNLP, 2021]
Hoang T.N. Nguyen, Dong Nie, Taivanbat Badamdorj, Yujie Liu, Yingying Zhu, Jason Truong, Li Cheng.
[PDF] [Github]

AlignTransformer: Hierarchical Alignment of Visual Regions and Disease Tags for Medical Report Generation. [1st Sep., 2021].[ ⚡ MICCAI, 2021]
Di You, Fenglin Liu, Shen Ge, Xiaoxia Xie, Jing Zhang, Xian Wu.
[PDF]

Automatic Generation of Chest X-ray Reports Using a Transformer-based Deep Learning Model. [20th Oct., 2021].[ICDS, 2021]
Ayoub Benali Amjoud; Mustapha Amrouch.
[PDF]

FFA-IR: Towards an Explainable and Reliable Medical Report Generation Benchmark. [31st Oct., 2021].[ ⚡ NeurIPS, 2021]
Mingjie Li, Wenjia Cai, Rui Liu, Yuetian Weng, Xiaoyun Zhao, Cong Wang, Xin Chen, Zhong Liu, Caineng Pan, Mengke Li, yingfeng zheng, Yizhi Liu, Flora D. Salim, Karin Verspoor, Xiaodan Liang, Xiaojun Chang.
[PDF] [Github]

Auto-Encoding Knowledge Graph for Unsupervised Medical Report Generation. [8th Nov., 2021].[ ⚡ NeurIPS, 2021]
Fenglin Liu, Chenyu You, Xian Wu, Shen Ge, Sheng Wang, Xu Sun.
[PDF]

Others

Multimodal Co-Attention Transformer for Survival Prediction in Gigapixel Whole Slide Images. [22nd Sep., 2021]. [ ⚡ ICCV, 2021]
Chen, Richard J and Lu, Ming Y and Weng, Wei-Hung and Chen, Tiffany Y and Williamson, Drew FK and Manz, Trevor and Shady, Maha and Mahmood, Faisal.
[PDF][Github]

Limitations of Transformers on Clinical Text Classification. [25th Sep., 2021].
Shang Gao, Mohammed Alawad, M Todd Young, John Gounley, Noah Schaefferkoetter, Hong Jun Yoon, Xiao-Cheng Wu, Eric B Durbin, Jennifer Doherty, Antoinette Stroup, Linda Coyle, Georgia Tourassi.
[PDF]

Explainable Transformer-Based Neural Network for the Prediction of Survival Outcomes in Non-Small Cell Lung Cancer (NSCLC). [14th Oct., 2021].
Elly Kipkogei, Gustavo Alonso Arango Argoty, Ioannis Kagiampakis, Arijit Patra, Etai Jacob.
[PDF]

3D Medical Point Transformer: Introducing Convolution to Attention Networks for Medical Point Cloud Analysis. [9th Dec., 2021].
Jianhui Yu, Chaoyi Zhang, Heng Wang, Dingxin Zhang, Yang Song, Tiange Xiang, Dongnan Liu, Weidong Cai.
[PDF]

Pre-training and Fine-tuning Transformers for fMRI Prediction Tasks. [10th Dec., 2021].
Itzik Malkiel, Gony Rosenman, Lior Wolf, Talma Hendler.
[PDF]

Does CLIP Benefit Visual Question Answering in the Medical Domain as Much as it Does in the General Domain?. [27th Dec., 2021].
Sedigheh Eslami, Gerard de Melo, Christoph Meinel.
[PDF]

Citation

If you find the listing and survey useful for your work, please cite the paper:

@misc{shamshad2022transformers,
      title={Transformers in Medical Imaging: A Survey}, 
      author={Shamshad, Fahad and  Khan, Salman and Zamir, Syed Waqas and Khan, Muhammad Haris and  Hayat, Munawar and Khan, Fahad Shahbaz and Fu, Huazhu}
      year={2022},
      eprint={2201.09873},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}