LPAQA: Language model Prompt And Query Archive

This repository contains data and code for the paper How Can We Know What Language Models Know?

Install

Our repository is based on LAMA. Please download our fork from here and follow the instructions to set up the environment and download pre-trained language models.

# clone LPAQA
git clone https://github.com/jzbjyb/LPAQA.git LPAQA
# clone LAMA
git clone https://github.com/jzbjyb/LAMA.git LAMA
pushd LAMA && git reset --hard b6b1885c64de5981f249a8b65de25cb0802b4bd5 && rm -rf .git && popd
mv LAMA/* LPAQA/ && rm -rf LAMA
# follow the instructions to install
cd LPAQA
./setup.sh

Retrieve factual knowledge from LMs

For example, to query the owner of MSN (Microsoft is the answer), you can either use manually created prompts (x is owned by y):

python lama/eval_generation.py --lm bert --t "MSN is owned by [MASK]."

or use LPAQA that ensembles a diversity of prompts:

# mined prompts
python lama/eval_ensemble.py --lm bert --subject MSN --relation P127 --prompts prompt/mine
# paraphrased prompts
python lama/eval_ensemble.py --lm bert --subject MSN --relation P127 --prompts prompt/paraphrase

Language model Prompt And Query Archive

Related tags

Overview

LPAQA: Language model Prompt And Query Archive

Install

Retrieve factual knowledge from LMs

Owner

An implementation of Equivariant e2 convolutional kernals into a convolutional self attention network, applied to radio astronomy data.

Airbus Ship Detection Challenge

Visual odometry package based on hardware-accelerated NVIDIA Elbrus library with world class quality and performance.

An official source code for paper Deep Graph Clustering via Dual Correlation Reduction, accepted by AAAI 2022

Code for visualizing the loss landscape of neural nets

Implementation for NeurIPS 2021 Submission: SparseFed

License Plate Detection Application

Spam your friends and famly and when you do your famly will disown you and you will have no friends.

Out-of-Distribution Generalization of Chest X-ray Using Risk Extrapolation

GPU Accelerated Non-rigid ICP for surface registration

AquaTimer - Programmable Timer for Aquariums based on ATtiny414/814/1614

YOLO5Face: Why Reinventing a Face Detector (https://arxiv.org/abs/2105.12931)

UIUCTF 2021 Public Challenge Repository

A project which aims to protect your privacy using inexpensive hardware and easily modifiable software

[ICLR 2021, Spotlight] Large Scale Image Completion via Co-Modulated Generative Adversarial Networks

Implementation of "Selection via Proxy: Efficient Data Selection for Deep Learning" from ICLR 2020.

Pytorch Implementation of "Contrastive Representation Learning for Exemplar-Guided Paraphrase Generation"

code for our paper "Source Data-absent Unsupervised Domain Adaptation through Hypothesis Transfer and Labeling Transfer"

Repository for reproducing `Model-Based Robust Deep Learning`

Virtual Dance Reality Stage is a feature that offers you to share a stage with another user virtually.