Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Improving Low Resource Named Entity Recognition using Cross-lingual Knowledge Transfer

Notifications You must be signed in to change notification settings

allForMachine/lrner

Repository files navigation

LR-NER

This repository is the implemented code based on PyTorch of our paper 《Improving Low Resource Named Entity Recognition using Cross-lingual Knowledge Transfer》,our approach achieved improvements on two low resource languages (including Dutch and Spanish) and Chinese OntoNotes 4.0 dataset.

1 Requirement

Python : 2.7
PyTorch : >=0.3.0

2 Installation

PyTorch

This code is based on PyTorch. You can find installation instructions here.

Dependencies

You can install dependencies like this :

pip install -r requirements.txt

3 Usage

The default configuration is in the file demo.train.config and demo.decode.config.You can modify the parameters as you want.

In training status: : CUDA_VISIBLE_DEVICES=0 python main.py --config demo.train.config

In decoding status : python main.py --config demo.decode.config

4 Dataset

Language Dataset Link
Dutch CoNLL-2002 https://github.com/synalp/NER/tree/master/corpus/
Spanish CoNLL-2002 https://github.com/synalp/NER/tree/master/corpus/
Chinese Ontonotes 4.0 https://catalog.ldc.upenn.edu/ldc2011t03
Translation Link
MUSE https://github.com/facebookresearch/MUSE
Word embedding Link
Glove(english) https://nlp.stanford.edu/projects/glove/

5 Reference

NCRF++: An Open-source Neural Sequence Labeling Toolkit

NER-pytorch

About

Improving Low Resource Named Entity Recognition using Cross-lingual Knowledge Transfer

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%

AltStyle によって変換されたページ (->オリジナル) /