Simulated garment dataset for virtual try-on

This repository contains the dataset used in the following papers:

Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-On (CVPR 2021) [Project website] [Video]
Learning-Based Animation of Clothing for Virtual Try-On (Eurographics 2019) [Project website] [Video]

Dataset

The data is generated used a modified version of ARCSim and sequences from the CMU Motion Capture Database converted to SMPL format in SURREAL. Each simulated sequence is stored as a .pkl file that contains the following data:

Key	Description	Dimension
shapes	SMPL shape coefficients	[num_frames, 10]
poses	SMPL pose coefficients	[num_frames, 75]
vertices	Vertices of the simulated garment	[num_frames, num_vertices, 3]
faces	Faces of the garment	[num_faces, 3]
sequence	Sequence identifier
subject	Subject identifier
conf	ARCSim configuration

Extract meshes

Requirements: python3, numpy-1.21.3

To extract the simulated garment meshes as .obj run the following script:

python extract_meshes.py tshirt/simulations/tshirt_shape00_01_01.pkl

Citation

If you find this dataset useful please cite our work:

@article {santesteban2021garmentcollisions,
    journal = {IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
    title = {{Self-Supervised Collision Handling via Generative 3D Garment Models for Virtual Try-On}},
    author = {Santesteban, Igor and Thuerey, Nils and Otaduy, Miguel A and Casas, Dan},
    year = {2021}
}

@article {santesteban2019virtualtryon,
    journal = {Computer Graphics Forum (Proc. Eurographics)},
    title = {{Learning-Based Animation of Clothing for Virtual Try-On}},
    author = {Santesteban, Igor and Otaduy, Miguel A. and Casas, Dan},
    year = {2019},
    ISSN = {1467-8659},
    DOI = {10.1111/cgf.13643}
}

Simulated garment dataset for virtual try-on

Related tags

Overview

Simulated garment dataset for virtual try-on

Dataset

Extract meshes

Citation

Owner

Implementation of hyperparameter optimization/tuning methods for machine learning & deep learning models

PyTorch IPFS Dataset

Randomizes the warps in a stock pokeemerald repo.

Large dataset storage format for Pytorch

A New Open-Source Off-road Environment for Benchmark Generalization of Autonomous Driving

Avalanche RL: an End-to-End Library for Continual Reinforcement Learning

This repository contains the code for Direct Molecular Conformation Generation (DMCG).

Code to train models from "Paraphrastic Representations at Scale".

Data, notebooks, and articles associated with the RSNA AI Deep Learning Lab at RSNA 2021

Gym for multi-agent reinforcement learning

Connecting Java/ImgLib2 + Python/NumPy

Notebook and code to synthesize complex and highly dimensional datasets using Gretel APIs.

PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

Code for Referring Image Segmentation via Cross-Modal Progressive Comprehension, CVPR2020.

Named Entity Recognition with Small Strongly Labeled and Large Weakly Labeled Data

This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”

This repository allows you to anonymize sensitive information in images/videos. The solution is fully compatible with the DL-based training/inference solutions that we already published/will publish for Object Detection and Semantic Segmentation.

This repository contains the code for the binaural-detection model used in the publication arXiv:2111.04637

Machine Learning in Asset Management (by @firmai)

SustainBench: Benchmarks for Monitoring the Sustainable Development Goals with Machine Learning