Final published version, 417 KB, PDF document
Available under license: CC BY: Creative Commons Attribution 4.0 International License
Final published version
Other version
Licence: CC BY: Creative Commons Attribution 4.0 International License
Research output: Contribution to conference - Without ISBN/ISSN › Conference paper › peer-review
Research output: Contribution to conference - Without ISBN/ISSN › Conference paper › peer-review
}
TY - CONF
T1 - IgboNER 2.0
T2 - AfricaNLP 2023
AU - Chukwuneke, CI
AU - Rayson, Paul
AU - Ezeani, Ignatius
AU - El-Haj, Mahmoud
AU - Asogwa, Doris
AU - Okpalla, Chidimma
AU - Mbonu, Chinedu
PY - 2023/3/3
Y1 - 2023/3/3
N2 - Since the inception of the state-of-the-art neural network models for natural language processing research, the major challenge faced by low-resource languagesis the lack or insufficiency of annotated training data. The named entity recognition (NER) task is no exception. The need for an efficient data creation and annotation process, especially for low-resource languages cannot be over-emphasized.In this work, we leverage an existing NER tool for English in a cross-languageprojection method that automatically creates a mapping dictionary of entities ina source language and their translations in the target language using a parallel English-Igbo corpus. The resultant mapping dictionary, which was manuallychecked and corrected by human annotators, was used to automatically generateand format an NER training dataset from the Igbo monolingual corpus therebysaving a lot of annotation time for the Igbo NER task. The generated dataset wasalso included in the training process and our experiments show improved performance results from previous works.
AB - Since the inception of the state-of-the-art neural network models for natural language processing research, the major challenge faced by low-resource languagesis the lack or insufficiency of annotated training data. The named entity recognition (NER) task is no exception. The need for an efficient data creation and annotation process, especially for low-resource languages cannot be over-emphasized.In this work, we leverage an existing NER tool for English in a cross-languageprojection method that automatically creates a mapping dictionary of entities ina source language and their translations in the target language using a parallel English-Igbo corpus. The resultant mapping dictionary, which was manuallychecked and corrected by human annotators, was used to automatically generateand format an NER training dataset from the Igbo monolingual corpus therebysaving a lot of annotation time for the Igbo NER task. The generated dataset wasalso included in the training process and our experiments show improved performance results from previous works.
M3 - Conference paper
Y2 - 5 May 2023 through 5 May 2023
ER -