Data and code to support "Applied Natural Language Processing" (INFO 256, Fall 2021, UC Berkeley)

Last update: Dec 06, 2022

Related tags

Overview

anlp21

Course materials for "Applied Natural Language Processing" (INFO 256, Fall 2021, UC Berkeley) Syllabus: http://people.ischool.berkeley.edu/~dbamman/info256.html

Notebook	Description
1.words/EvaluateTokenizationForSentiment	The impact of tokenization choices on sentiment classification.
1.words/ExploreTokenization	Different methods for tokenizing texts (whitespace, NLTK, spacy, regex)
1.words/TokenizePrintedBooks	Design a better tokenizer for printed books
1.words/Text_Complexity	Implement type-token ratio and Flesch-Kincaid Grade Level scores for text
2.compare/ChiSquare, Mann-Whitney Tests	Explore two tests for finding distinctive terms
2.compare/Log-odds ratio with priors	Implement the log-odds ratio with an informative (and uninformative) Dirichlet prior
3.dictionaries/DictionaryTimeSeries	Plot sentiment over time using human-defined dictionaries
3.dictionaries/Empath	Explore using Empath dictionaries to characterize texts
4.embeddings/DistributionalSimilarity	Explore distributional hypothesis to build high-dimensional, sparse representations for words
4.embeddings/WordEmbeddings	Explore word embeddings using Gensim
4.embeddings/Semaxis	Implement SemAxis for scoring terms along a user-defined axis (e.g., positive-negative, concrete-abstract, hot-cold),
4.embeddings/BERT	Explore the basics of token representations in BERT and use it to find token nearest neighbors
4.embedings/SequenceEmbeddings	Use sequence embeddings to find TV episode summaries most similar to a short description
5.eda/WordSenseClustering	Inferring distinct word senses using KMeans clustering over BERT representations
5.eda/Haiku KMeans	Explore text representation in clustering by trying to group haiku and non-haiku poems into two distinct clusters

Data and code to support "Applied Natural Language Processing" (INFO 256, Fall 2021, UC Berkeley)

Related tags

Overview

anlp21

Owner

David Bamman

Code for Findings at EMNLP 2021 paper: "Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot Learning"

本项目是作者们根据个人面试和经验总结出的自然语言处理(NLP)面试准备的学习笔记与资料，该资料目前包含自然语言处理各领域的面试题积累。

LUKE -- Language Understanding with Knowledge-based Embeddings

A very simple framework for state-of-the-art Natural Language Processing (NLP)

Random Directed Acyclic Graph Generator

Shared code for training sentence embeddings with Flax / JAX

Task-based datasets, preprocessing, and evaluation for sequence models.

An easy-to-use framework for BERT models, with trainers, various NLP tasks and detailed annonations

Toward Model Interpretability in Medical NLP

An ultra fast tiny model for lane detection, using onnx_parser, TensorRTAPI, torch2trt to accelerate. our model support for int8, dynamic input and profiling. (Nvidia-Alibaba-TensoRT-hackathon2021)

fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.

Simple telegram bot to convert files into direct download link.you can use telegram as a file server 🪁

AI and Machine Learning workflows on Anthos Bare Metal.

Honor's thesis project analyzing whether the GPT-2 model can more effectively generate free-verse or structured poetry.

📔️ Generate a text-based journal from a template file.

customer care chatbot made with Rasa Open Source.

Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms

Simple bots or Simbots is a library designed to create simple bots using the power of python. This library utilises Intent, Entity, Relation and Context model to create bots .

Natural language computational chemistry command line interface.

Data and code to support "Applied Natural Language Processing" (INFO 256, Fall 2021, UC Berkeley)

Related tags

Overview

anlp21

Owner

David Bamman

Code for Findings at EMNLP 2021 paper: "Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot Learning"

本项目是作者们根据个人面试和经验总结出的自然语言处理(NLP)面试准备的学习笔记与资料，该资料目前包含 自然语言处理各领域的 面试题积累。

LUKE -- Language Understanding with Knowledge-based Embeddings

A very simple framework for state-of-the-art Natural Language Processing (NLP)

Random Directed Acyclic Graph Generator

Shared code for training sentence embeddings with Flax / JAX

Task-based datasets, preprocessing, and evaluation for sequence models.

An easy-to-use framework for BERT models, with trainers, various NLP tasks and detailed annonations

Toward Model Interpretability in Medical NLP

An ultra fast tiny model for lane detection, using onnx_parser, TensorRTAPI, torch2trt to accelerate. our model support for int8, dynamic input and profiling. (Nvidia-Alibaba-TensoRT-hackathon2021)

fastNLP: A Modularized and Extensible NLP Framework. Currently still in incubation.

Simple telegram bot to convert files into direct download link.you can use telegram as a file server 🪁

AI and Machine Learning workflows on Anthos Bare Metal.

Honor's thesis project analyzing whether the GPT-2 model can more effectively generate free-verse or structured poetry.

📔️ Generate a text-based journal from a template file.

customer care chatbot made with Rasa Open Source.

Unofficial implementation of Google's FNet: Mixing Tokens with Fourier Transforms

Simple bots or Simbots is a library designed to create simple bots using the power of python. This library utilises Intent, Entity, Relation and Context model to create bots .

Natural language computational chemistry command line interface.

本项目是作者们根据个人面试和经验总结出的自然语言处理(NLP)面试准备的学习笔记与资料，该资料目前包含自然语言处理各领域的面试题积累。