FAIMED 3D

use fastai to quickly train fully three-dimensional models on radiological data

Classification

from faimed3d.all import *

Load data in various medical formats (DICOM, NIfTI, NRRD) or even videos as simple as in fastai.

d = pd.read_csv('../data/radiopaedia_cases.csv')
dls = ImageDataLoaders3D.from_df(d,
                                 item_tfms = Resize3D((20, 112, 112)),
                                 batch_tfms = aug_transforms_3d(), 
                                 bs = 2, val_bs = 2)

Faimed3d provides multiple model architectures, pretrained on the UCF101 dataset for action recoginiton, which can be used for transfer learning.

Model	3-fold accuracy	duration/epoch	model size
efficientnet b0	92.5 %	9M:35S	48.8 MB
efficientnet b1	90.1 %	13M:20S	80.5 MB
resnet 18	87.6 %	6M:57S	339.1 MB
resnet 50	94.8 %	12M:16S	561.2 MB
resnet 101	96.0 %	17M:20S	1,030 MB

# slow
learn = cnn_learner_3d(dls, efficientnet_b0)

# slow
learn.lr_find()

SuggestedLRs(lr_min=0.014454397559165954, lr_steep=6.309573450380412e-07)

Click here for a more in-depth classification example.

Segmentation

dls = SegmentationDataLoaders3D.from_df(d,
                                 item_tfms = Resize3D((20, 112, 112)),
                                 batch_tfms = aug_transforms_3d(), 
                                 bs = 2, val_bs = 2)

All models in faimed3d can be used as a backbone for U-Nets, even with pre-trained weights.

# slow
learn = unet_learner_3d(dls, efficientnet_b0, n_out = 2)

# slow 
learn.lr_find()

SuggestedLRs(lr_min=0.33113112449646, lr_steep=0.10000000149011612)

Click here for a more in-depth segmentation example.

Extension to fastai for volumetric medical data

Related tags

Overview

FAIMED 3D

Classification

Segmentation

Owner

Keno

Heart Arrhythmia Classification

Implementation of our NeurIPS 2021 paper "A Bi-Level Framework for Learning to Solve Combinatorial Optimization on Graphs".

[NAACL & ACL 2021] SapBERT: Self-alignment pretraining for BERT.

Code for "Contextual Non-Local Alignment over Full-Scale Representation for Text-Based Person Search"

Evaluation and Benchmarking of Speech Super-resolution Methods

pytorch implementation of ABC : Auxiliary Balanced Classifier for Class-imbalanced Semi-supervised Learning

OptaPlanner wrappers for Python. Currently significantly slower than OptaPlanner in Java or Kotlin.

Sequence modeling benchmarks and temporal convolutional networks

Labelbox is the fastest way to annotate data to build and ship artificial intelligence applications

The 2nd place solution of 2021 google landmark retrieval on kaggle.

[ ICCV 2021 Oral ] Our method can estimate camera poses and neural radiance fields jointly when the cameras are initialized at random poses in complex scenarios (outside-in scenes, even with less texture or intense noise )

Intelligent Video Analytics toolkit based on different inference backends.

Multimodal commodity image retrieval 多模态商品图像检索

Utility tools for the "Divide and Remaster" dataset, introduced as part of the Cocktail Fork problem paper

Pytorch based library to rank predicted bounding boxes using text/image user's prompts.

Microscopy Image Cytometry Toolkit

A synthetic texture-invariant dataset for object detection of UAVs

RL-GAN: Transfer Learning for Related Reinforcement Learning Tasks via Image-to-Image Translation

Hierarchical Memory Matching Network for Video Object Segmentation (ICCV 2021)

MPRNet-Cloud-removal: Progressive cloud removal