Direct application of DALLE-2 to video synthesis, using factored space-time Unet and Transformers

Last update: May 15, 2022

Overview

DALLE2 Video (wip)

** only to be built after DALLE2 image is done and replicated, and the importance of the prior network is validated **

Direct application of DALLE-2 to video synthesis, using factored space-time UNet and Transformers

CLIP could have two approaches. (1) design 3D CLIP using TimesFormer for the video encoding (2) use 2D CLIP with attention pooling at the end over all image embeddings with time positional encoding

For all you academics out there emailing me, you are free to publish this idea without citing me at all. I'm just after the world of infinite machine dreams, and I don't really care how we get there.

Owner

Phil Wang

Working with Attention. It's all we need

GitHub Repository

Deep Halftoning with Reversible Binary Pattern

Deep Halftoning with Reversible Binary Pattern ICCV Paper | Project Website | BibTex Overview Existing halftoning algorithms usually drop colors and f

17 Nov 22, 2022

PyTorch-based framework for Deep Hedging

PFHedge: Deep Hedging in PyTorch PFHedge is a PyTorch-based framework for Deep Hedging. PFHedge Documentation Neural Network Architecture for Efficien

139 Dec 30, 2022

RMNA: A Neighbor Aggregation-Based Knowledge Graph Representation Learning Model Using Rule Mining

RMNA: A Neighbor Aggregation-Based Knowledge Graph Representation Learning Model Using Rule Mining Our code is based on Learning Attention-based Embed

4 Aug 07, 2022

PyTorch implementation for Score-Based Generative Modeling through Stochastic Differential Equations (ICLR 2021, Oral)

Score-Based Generative Modeling through Stochastic Differential Equations This repo contains a PyTorch implementation for the paper Score-Based Genera

757 Jan 04, 2023

A Broader Picture of Random-walk Based Graph Embedding

Random-walk Embedding Framework This repository is a reference implementation of the random-walk embedding framework as described in the paper: A Broa

23 Dec 13, 2022

Source code for "FastBERT: a Self-distilling BERT with Adaptive Inference Time".

FastBERT Source code for "FastBERT: a Self-distilling BERT with Adaptive Inference Time". Good News 2021/10/29 - Code: Code of FastPLM is released on

584 Jan 02, 2023

This repository comes with the paper "On the Robustness of Counterfactual Explanations to Adverse Perturbations"

Robust Counterfactual Explanations This repository comes with the paper "On the Robustness of Counterfactual Explanations to Adverse Perturbations". I

5 Dec 20, 2022

Localizing Visual Sounds the Hard Way

Localizing-Visual-Sounds-the-Hard-Way Code and Dataset for "Localizing Visual Sounds the Hard Way". The repo contains code and our pre-trained model.

58 Dec 07, 2022

Election Exit Poll Prediction and U.S.A Presidential Speech Analysis using Machine Learning

Machine_Learning Election Exit Poll Prediction and U.S.A Presidential Speech Analysis using Machine Learning This project is based on 2 case-studies:

1 Jan 27, 2022

Learning kernels to maximize the power of MMD tests

Code for the paper "Generative Models and Model Criticism via Optimized Maximum Mean Discrepancy" (arXiv:1611.04488; published at ICLR 2017), by Douga

201 Dec 17, 2022

Using the provided dataset which includes various book features, in order to predict the price of books, using various proposed methods and models.

1 Jan 13, 2022

Direct application of DALLE-2 to video synthesis, using factored space-time Unet and Transformers

Related tags

Overview

DALLE2 Video (wip)

Owner

Phil Wang

Deep Halftoning with Reversible Binary Pattern

PyTorch-based framework for Deep Hedging

RMNA: A Neighbor Aggregation-Based Knowledge Graph Representation Learning Model Using Rule Mining

PyTorch implementation for Score-Based Generative Modeling through Stochastic Differential Equations (ICLR 2021, Oral)

A Broader Picture of Random-walk Based Graph Embedding

Source code for "FastBERT: a Self-distilling BERT with Adaptive Inference Time".

This repository comes with the paper "On the Robustness of Counterfactual Explanations to Adverse Perturbations"

Localizing Visual Sounds the Hard Way

Election Exit Poll Prediction and U.S.A Presidential Speech Analysis using Machine Learning

Learning kernels to maximize the power of MMD tests

Using the provided dataset which includes various book features, in order to predict the price of books, using various proposed methods and models.

PySlowFast: video understanding codebase from FAIR for reproducing state-of-the-art video models.

Bayesian Optimization Library for Medical Image Segmentation.

Unsupervised Learning of Multi-Frame Optical Flow with Occlusions

KwaiRec: A Fully-observed Dataset for Recommender Systems (Density: Almost 100%)

a reimplementation of Holistically-Nested Edge Detection in PyTorch

Real-time Neural Representation Fusion for Robust Volumetric Mapping

Codebase for BMVC 2021 paper "Text Based Person Search with Limited Data"

Simple keras FCN Encoder/Decoder model for MS-COCO (food subset) segmentation

The lightweight PyTorch wrapper for high-performance AI research. Scale your models, not the boilerplate.