Code for "Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments".

Last update: Nov 08, 2022

Overview

crfsrl

Yu Zhang, Qingrong Xia, Shilin Zhou, Yong Jiang, Zhenghua Li, Guohong Fu, Min Zhang. Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments. 2021. [arxiv]

Setup

The following packages should be installed:

SuPar: == 1.1.3
PyTorch: >= 1.7
Transformers: >= 4.0

Run the following scripts to obtain the training data. Please make sure PTB and OntoNotes are available:

bash scripts/conll05.sh PTB=<path-to-ptb>             SRL=data
bash scripts/conll12.sh ONTONOTES=<path-to-ontonotes> SRL=data

Run

Try the following commands to train first-order CRF and second-order CRF2o models:

# LSTM
# CRF
python -u crf.py   train -b -c configs/conll05.crf.srl.lstm.char-lemma.ini   -d 0 -f char lemma -p exp/conll05.crf.srl.lstm.char-lemma/model
# CRF2o
python -u crf2o.py train -b -c configs/conll05.crf2o.srl.lstm.char-lemma.ini -d 0 -f char lemma -p exp/conll05.crf2o.srl.lstm.char-lemma/model
# BERT finetuning
# CRF
python -u crf.py   train -b -c configs/conll05.crf.srl.bert.ini   -d 0 -p exp/conll05.crf.srl.bert/model   --batch-size=1000 --encoder bert --bert bert-large-cased 
# CRF2o
python -u crf2o.py train -b -c configs/conll05.crf2o.srl.bert.ini -d 0 -p exp/conll05.crf2o.srl.bert/model --batch-size=1000 --encoder bert --bert bert-large-cased

To do evaluation:

# end-to-end
python -u crf.py   evaluate -c configs/conll05.crf.srl.bert.ini  -d 0 -p exp/conll05.crf.srl.bert/model    --data data/conll05/test.conllu
# w/ gold predicates
python -u crf.py   evaluate -c configs/conll05.crf.srl.bert.ini  -d 0 -p exp/conll05.crf.srl.bert/model    --data data/conll05/test.conllu --prd

To make predictions:

python -u crf.py   predict  -c configs/conll05.crf.srl.bert.ini   -d 0 -p exp/conll05.crf.srl.bert/model   --data data/conll05/test.conllu --pred pred.conllu
bash scripts/eval.sh pred=pred.conllu gold=data/conll05/test.conllu

Contact

If you have any questions, feel free to contact me via emails.

Code for "Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments".

Related tags

Overview

crfsrl

Setup

Run

Contact

Owner

Yu Zhang

Korean Simple Contrastive Learning of Sentence Embeddings using SKT KoBERT and kakaobrain KorNLU dataset

Mysticbbs-rjam - rJAM splitscreen message reader for MysticBBS A46+

Sentello is python script that simulates the anti-evasion and anti-analysis techniques used by malware.

A music comments dataset, containing 39,051 comments for 27,384 songs.

Implementation of the Hybrid Perception Block and Dual-Pruned Self-Attention block from the ITTR paper for Image to Image Translation using Transformers

(ACL-IJCNLP 2021) Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models.

Random Directed Acyclic Graph Generator

An example project using OpenPrompt under pytorch-lightning for prompt-based SST2 sentiment analysis model

DeLighT: Very Deep and Light-Weight Transformers

Header-only C++ HNSW implementation with python bindings

XLNet: Generalized Autoregressive Pretraining for Language Understanding

Creating an LSTM model to generate music

An IVR Chatbot which can exponentially reduce the burden of companies as well as can improve the consumer/end user experience.

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

LightSpeech: Lightweight and Fast Text to Speech with Neural Architecture Search

Pytorch NLP library based on FastAI

The Classical Language Toolkit

Labelling platform for text using distant supervision

ProteinBERT is a universal protein language model pretrained on ~106M proteins from the UniRef90 dataset.

STonKGs is a Sophisticated Transformer that can be jointly trained on biomedical text and knowledge graphs