negation-focused-pretraining

Code and Data for the paper Improving negation detection with negation-focused pre-training

Instruction

Adaptive pre-training code is in pretraining directory
Run negation detection pipeline: sh run.sh

Checkpoints and data

Negation detection dataset is in /data directory
Negation-focused data is in available at https://drive.google.com/file/d/16HTWCM2GUoRlPPs7RcZNEEObpQED_PNM/view?usp=sharing
CueNB is available at https://huggingface.co/joey234/cuenb

Acknowledgement

Negation detection code is based on the NegBERT implementation at https://github.com/adityak6798/Transformers-For-Negation-and-Speculation
Pre-training code is based on https://github.com/gucci-j/light-transformer-emnlp2021