BalancingGroups

Code to replicate the experimental results from Simple data balancing baselines achieve competitive worst-group-accuracy.

Replicating the main results

Set environment variables

export DATASETS_PATH=/path/to/datasets
export SLURM_PATH=/path/to/slurm/logs

Download and extract datasets

Waterbirds to $DATASETS_PATH/waterbirds
CelebA to $DATASETS_PATH/celeba
CivilComments to $DATASETS_PATH/civilcomments
MultiNLI to $DATASETS_PATH/multinli

Generate dataset metadata

cd metadata/
python generate_metadata_waterbirds.py
python generate_metadata_celeba.py
python generate_metadata_civilcomments.py
python generate_metadata_multinli.py
cd ..

Launch jobs

# Launching 1400 combo seeds = 50 hparams for 4 datasets for 7 algorithms
# Each combo seed is ran 5 times to compute error bars, totalling 7000 jobs
./train.py --output_dir main_sweep --num_hparams_seeds 1400

Parse results

./parse.py main_sweep

License

This source code is released under the CC-BY-NC license, included here.

Simple data balancing baselines for worst-group-accuracy benchmarks.

Related tags

Overview

BalancingGroups

Replicating the main results

Set environment variables

Download and extract datasets

Generate dataset metadata

Launch jobs

Parse results

License

Owner

Facebook Research

A framework for building (and incrementally growing) graph-based data structures used in hierarchical or DAG-structured clustering and nearest neighbor search

A collection of Machine Learning Models To Web Api which are built on open source technologies/frameworks like Django, Flask.

using Machine Learning Algorithm to classification AppleStore application

monolish: MONOlithic Liner equation Solvers for Highly-parallel architecture

Data Version Control or DVC is an open-source tool for data science and machine learning projects

A model to predict steering torque fully end-to-end

A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.

Automatically build ARIMA, SARIMAX, VAR, FB Prophet and XGBoost Models on Time Series data sets with a Single Line of Code. Now updated with Dask to handle millions of rows.

Bonsai: Gradient Boosted Trees + Bayesian Optimization

Karate Club: An API Oriented Open-source Python Framework for Unsupervised Learning on Graphs (CIKM 2020)

Turning images into '9-pan' palettes using KMeans clustering from sklearn.

Forecast dynamically at scale with this unique package. pip install scalecast

Made in collaboration with Chris George for Art + ML Spring 2019.

Module for statistical learning, with a particular emphasis on time-dependent modelling

This is a public repo where code samples are stored for the book Practical MLOps.

Classification based on Fuzzy Logic(C-Means).

UpliftML: A Python Package for Scalable Uplift Modeling

PySpark ML Bank Churn Prediction

A machine learning toolkit dedicated to time-series data

Open MLOps - A Production-focused Open-Source Machine Learning Framework