This is a project of data parallel that running on NLP tasks.

Last update: Dec 12, 2021

Related tags

Text Data & NLP torch-ddp

Overview

torch-ddp

This is a project of data parallel that running on NLP tasks.

You can e-mail Jiamao at [email protected] , if you have any questions.

Requirements

Our code works with the following environment.

python>=3.7
pytorch>=1.3
transformers
spacy

Tips

you should contain zh_core_web_sm belonged spacy when you running the project.

Run

0:python pre_myfile.py 1:python generate.py 2:python data__process.py 3:python python -m torch.distributed.launch --nproc_per_node=1 --use_env train.py.py

Owner

GitHub Repository

Code for EMNLP'21 paper "Types of Out-of-Distribution Texts and How to Detect Them"

19 Oct 28, 2022

Twitter-NLP-Analysis - Twitter Natural Language Processing Analysis

Twitter-NLP-Analysis Business Problem I got last @turk_politika 3000 tweets with

7 Mar 12, 2022

NeurIPS'21: Probabilistic Margins for Instance Reweighting in Adversarial Training (Pytorch implementation).

source code for NeurIPS21 paper robabilistic Margins for Instance Reweighting in Adversarial Training

9 Dec 20, 2022

Machine Learning Course Project, IMDB movie review sentiment analysis by lstm, cnn, and transformer

IMDB Sentiment Analysis This is the final project of Machine Learning Courses in Huazhong University of Science and Technology, School of Artificial I

0 Dec 27, 2021

A relatively simple python program to generate one of those reddit text to speech videos dominating youtube.

Reddit text to speech generator A basic reddit tts video generator Current functionality Generate videos for subs based on comments,(askreddit) so rea

17 Dec 19, 2022

Line as a Visual Sentence: Context-aware Line Descriptor for Visual Localization

Line as a Visual Sentence with LineTR This repository contains the inference code, pretrained model, and demo scripts of the following paper. It suppo

158 Dec 27, 2022

:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

(Framework for Adapting Representation Models) What is it? FARM makes Transfer Learning with BERT & Co simple, fast and enterprise-ready. It's built u

1.6k Dec 27, 2022

Test finetuning of XLSR (multilingual wav2vec 2.0) for other speech classification tasks

wav2vec_finetune Test finetuning of XLSR (multilingual wav2vec 2.0) for other speech classification tasks Initial test: gender recognition on this dat

8 Aug 11, 2022

Simple, hackable offline speech to text - using the VOSK-API.

844 Jan 07, 2023

Codes to pre-train Japanese T5 models

t5-japanese Codes to pre-train a T5 (Text-to-Text Transfer Transformer) model pre-trained on Japanese web texts. The model is available at https://hug

37 Dec 25, 2022

Flexible interface for high-performance research using SOTA Transformers leveraging Pytorch Lightning, Transformers, and Hydra.

Flexible interface for high performance research using SOTA Transformers leveraging Pytorch Lightning, Transformers, and Hydra. What is Lightning Tran

581 Dec 21, 2022

Text classification on IMDB dataset using Keras and Bi-LSTM network

Text classification on IMDB dataset using Keras and Bi-LSTM Text classification on IMDB dataset using Keras and Bi-LSTM network. Usage python3 main.py

2 Sep 27, 2022

YACLC - Yet Another Chinese Learner Corpus

汉语学习者文本多维标注数据集YACLC V1.0 中文 | English 汉语学习者文本多维标注数据集（Yet Another Chinese Learner

47 Dec 15, 2022

This repository structures data in title, summary, tags, sentiment given a fragment of a conversation

Understand-conversation-AI This repository structures data in title, summary, tags, sentiment given a fragment of a conversation How to install: pip i

1 Jan 11, 2022

neural network based speaker embedder

Content What is deepaudio-speaker? Installation Get Started Model Architecture How to contribute to deepaudio-speaker? Acknowledge What is deepaudio-s

20 Dec 29, 2022

Code for Findings at EMNLP 2021 paper: "Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot Learning"

Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot Learning This repo is for Findings at EMNLP 2021 paper: Learn Cont

6 Sep 02, 2022

This is a project of data parallel that running on NLP tasks.

Related tags

Overview

torch-ddp

Requirements

Tips

Run

Owner

Code for EMNLP'21 paper "Types of Out-of-Distribution Texts and How to Detect Them"

Twitter-NLP-Analysis - Twitter Natural Language Processing Analysis

NeurIPS'21: Probabilistic Margins for Instance Reweighting in Adversarial Training (Pytorch implementation).

Machine Learning Course Project, IMDB movie review sentiment analysis by lstm, cnn, and transformer

A relatively simple python program to generate one of those reddit text to speech videos dominating youtube.

Line as a Visual Sentence: Context-aware Line Descriptor for Visual Localization

:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

Test finetuning of XLSR (multilingual wav2vec 2.0) for other speech classification tasks

Simple, hackable offline speech to text - using the VOSK-API.

Codes to pre-train Japanese T5 models

Flexible interface for high-performance research using SOTA Transformers leveraging Pytorch Lightning, Transformers, and Hydra.

Text classification on IMDB dataset using Keras and Bi-LSTM network

YACLC - Yet Another Chinese Learner Corpus

This repository structures data in title, summary, tags, sentiment given a fragment of a conversation

neural network based speaker embedder

Code for Findings at EMNLP 2021 paper: "Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot Learning"

Tool which allow you to detect and translate text.

Unsupervised intent recognition

Wind Speed Prediction using LSTMs in PyTorch

Awesome Treasure of Transformers Models Collection