Code for "Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments".

Last update: Nov 08, 2022

Overview

crfsrl

Yu Zhang, Qingrong Xia, Shilin Zhou, Yong Jiang, Zhenghua Li, Guohong Fu, Min Zhang. Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments. 2021. [arxiv]

Setup

The following packages should be installed:

SuPar: == 1.1.3
PyTorch: >= 1.7
Transformers: >= 4.0

Run the following scripts to obtain the training data. Please make sure PTB and OntoNotes are available:

bash scripts/conll05.sh PTB=<path-to-ptb>             SRL=data
bash scripts/conll12.sh ONTONOTES=<path-to-ontonotes> SRL=data

Run

Try the following commands to train first-order CRF and second-order CRF2o models:

# LSTM
# CRF
python -u crf.py   train -b -c configs/conll05.crf.srl.lstm.char-lemma.ini   -d 0 -f char lemma -p exp/conll05.crf.srl.lstm.char-lemma/model
# CRF2o
python -u crf2o.py train -b -c configs/conll05.crf2o.srl.lstm.char-lemma.ini -d 0 -f char lemma -p exp/conll05.crf2o.srl.lstm.char-lemma/model
# BERT finetuning
# CRF
python -u crf.py   train -b -c configs/conll05.crf.srl.bert.ini   -d 0 -p exp/conll05.crf.srl.bert/model   --batch-size=1000 --encoder bert --bert bert-large-cased 
# CRF2o
python -u crf2o.py train -b -c configs/conll05.crf2o.srl.bert.ini -d 0 -p exp/conll05.crf2o.srl.bert/model --batch-size=1000 --encoder bert --bert bert-large-cased

To do evaluation:

# end-to-end
python -u crf.py   evaluate -c configs/conll05.crf.srl.bert.ini  -d 0 -p exp/conll05.crf.srl.bert/model    --data data/conll05/test.conllu
# w/ gold predicates
python -u crf.py   evaluate -c configs/conll05.crf.srl.bert.ini  -d 0 -p exp/conll05.crf.srl.bert/model    --data data/conll05/test.conllu --prd

To make predictions:

python -u crf.py   predict  -c configs/conll05.crf.srl.bert.ini   -d 0 -p exp/conll05.crf.srl.bert/model   --data data/conll05/test.conllu --pred pred.conllu
bash scripts/eval.sh pred=pred.conllu gold=data/conll05/test.conllu

Contact

If you have any questions, feel free to contact me via emails.

Code for "Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments".

Related tags

Overview

crfsrl

Setup

Run

Contact

Owner

Yu Zhang

Modified GPT using average pooling to reduce the softmax attention memory constraints.

Python library for processing Chinese text

Retraining OpenAI's GPT-2 on Discord Chats

Wikipedia-Utils: Preprocessing Wikipedia Texts for NLP

CCF BDCI 2020 房产行业聊天问答匹配赛道 A榜47/2985

Wrapper to display a script output or a text file content on the desktop in sway or other wlroots-based compositors

The code for the Subformer, from the EMNLP 2021 Findings paper: "Subformer: Exploring Weight Sharing for Parameter Efficiency in Generative Transformers", by Machel Reid, Edison Marrese-Taylor, and Yutaka Matsuo

Signature remover is a NLP based solution which removes email signatures from the rest of the text.

Seq2seq attn - Use the Seq2Seq method to implement machine translation and introduce Attention mechanism to improve the results

Grading tools for Advanced NLP (11-711)Grading tools for Advanced NLP (11-711)

Transformer-based Text Auto-encoder (T-TA) using TensorFlow 2.

This repository describes our reproducible framework for assessing self-supervised representation learning from speech

Source code for the paper "TearingNet: Point Cloud Autoencoder to Learn Topology-Friendly Representations"

The proliferation of disinformation across social media has led the application of deep learning techniques to detect fake news.

Line as a Visual Sentence: Context-aware Line Descriptor for Visual Localization

A very simple framework for state-of-the-art Natural Language Processing (NLP)

This is an incredibly powerful calculator that is capable of many useful day-to-day functions.

CCQA A New Web-Scale Question Answering Dataset for Model Pre-Training

Unofficial Implementation of Zero-Shot Text-to-Speech for Text-Based Insertion in Audio Narration

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.