Rights statement: © ACM, 2019. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in ACM Transactions on Asian and Low-Resource Language Information Processing, 18, 4, 2019 http://doi.acm.org/10.1145/3314942
Accepted author manuscript, 914 KB, PDF document
Available under license: CC BY-NC: Creative Commons Attribution-NonCommercial 4.0 International License
Final published version
Research output: Contribution to Journal/Magazine › Journal article › peer-review
Research output: Contribution to Journal/Magazine › Journal article › peer-review
}
TY - JOUR
T1 - Toward an effective Igbo part-of-speech tagger
AU - Onyenwe, Ikechukwu E.
AU - Hepple, Mark
AU - Chinedu, Uchechukwu
AU - Ezeani, Ignatius
N1 - © ACM, 2019. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in ACM Transactions on Asian and Low-Resource Language Information Processing, 18, 4, 2019 http://doi.acm.org/10.1145/3314942
PY - 2019/8/31
Y1 - 2019/8/31
N2 - Part-of-speech (POS) tagging is a well-established technology for most Western European languages and a few other world languages, but it has not been evaluated on Igbo, an agglutinative African language. This article presents POS tagging experiments conducted using an Igbo corpus as a test bed for identifying the POS taggers and the Machine Learning (ML) methods that can achieve a good performance with the small dataset available for the language. Experiments have been conducted using different well-known POS taggers developed for English or European languages, and different training data styles and sizes. Igbo has a number of language-specific characteristics that present a challenge for effective POS tagging. One interesting case is the wide use of verbs (and nominalizations thereof) that have an inherent noun complement, which form “linked pairs” in the POS tagging scheme, but which may appear discontinuously. Another issue is Igbo's highly productive agglutinative morphology, which can produce many variant word forms from a given root. This productivity is a key cause of the out-of-vocabulary (OOV) words observed during Igbo tagging. We report results of experiments on a promising direction for improving tagging performance on such morphologically-inflected OOV words.
AB - Part-of-speech (POS) tagging is a well-established technology for most Western European languages and a few other world languages, but it has not been evaluated on Igbo, an agglutinative African language. This article presents POS tagging experiments conducted using an Igbo corpus as a test bed for identifying the POS taggers and the Machine Learning (ML) methods that can achieve a good performance with the small dataset available for the language. Experiments have been conducted using different well-known POS taggers developed for English or European languages, and different training data styles and sizes. Igbo has a number of language-specific characteristics that present a challenge for effective POS tagging. One interesting case is the wide use of verbs (and nominalizations thereof) that have an inherent noun complement, which form “linked pairs” in the POS tagging scheme, but which may appear discontinuously. Another issue is Igbo's highly productive agglutinative morphology, which can produce many variant word forms from a given root. This productivity is a key cause of the out-of-vocabulary (OOV) words observed during Igbo tagging. We report results of experiments on a promising direction for improving tagging performance on such morphologically-inflected OOV words.
KW - African language
KW - Corpora
KW - Corpus annotation
KW - Igbo
KW - Language technology
KW - Machine learning
KW - Morphological analysis
KW - Natural language processing (NLP)
KW - Part-of-speech (POS) tagging
KW - POS tagger
KW - Tagset
KW - Text processing
U2 - 10.1145/3314942
DO - 10.1145/3314942
M3 - Journal article
AN - SCOPUS:85073211790
VL - 18
JO - ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP)
JF - ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP)
SN - 2375-4699
IS - 4
M1 - 42
ER -