OffensEval2020

KO | EN

gitlite — search

#python #hacktoberfest #typescript #go #machine-learning #deep-learning #linux #macos #cli #awesome-list #vue #security #openai #open-source

(★ 10)

Codes for NLPDove at SemEval 2020 Task 6: OffensEval, COLING 2020

OffensEval2020 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

This is the code for our submission on Semeval 2020 task 12: Offensive Language Identification in Social Media.
The code and description for data augmentation with transferable data selection, will be updated in before paper submission.
Our results: 1st place in greek, 3rd in Danish, 6th in Turkish, 15th in English, and 20th in Arabic.

## Data
OffensEval2019: [Official OLID dataset page](https://sites.google.com/site/offensevalsharedtask/olid).
Data for OffensEval2020: upon request.
```bash
python merge_test.py # OffensEval2019 - merge 3 test data into one file
```

## Quick start
Below is the command to train a model with some potentially important arguments.
For exhaustive list of arguments, read `train.py`.
```bash
NOTE=kor
python train.py \
--train_path ../data/olid/da/offenseval-da-training-v1-train.tsv \
--test_path ../data/olid/da/offenseval-da-training-v1-test.tsv \
--demojize --lower_hashtag --segment_hashtag --textify_emoji --add_cap_sign \
--mention_limit 3 --punc_limit 3 \
--model mbert --time_pooling max_avg --layer 11 \
--attention_probs_dropout_prob 0.1 --hidden_dropout_prob 0.3 \
--lr 0.00002 --weight_decay 0.0 --layer_decrease 1.0 --freeze_upto -1 --warmup_ratio 0.1 \
--batch_size 32 --train_step 700 --patience 20 --cuda 1 --note $NOTE

python inference.py $NOTE
```

## Dependencies

OffensEval2020

OffensEval2020 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

OffensEval2020

OffensEval2020 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README