Home > Research > Publications & Outputs > A Sense Annotated Corpus for All-Words Urdu Wor...

Links

Text available via DOI:

View graph of relations

A Sense Annotated Corpus for All-Words Urdu Word Sense Disambiguation

Research output: Contribution to Journal/MagazineJournal articlepeer-review

Published
Close
Article number40
<mark>Journal publication date</mark>1/05/2019
<mark>Journal</mark>ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP)
Issue number4
Volume18
Number of pages14
Publication StatusPublished
<mark>Original language</mark>English

Abstract

Word Sense Disambiguation (WSD) aims to automatically predict the correct sense of a word used in a given context. All human languages exhibit word sense ambiguity, and resolving this ambiguity can be difficult. Standard benchmark resources are required to develop, compare, and evaluate WSD techniques. These are available for many languages, but not for Urdu, despite this being a language with more than 300 million speakers and large volumes of text available digitally. To fill this gap, this study proposes a novel benchmark corpus for the Urdu All-Words WSD task. The corpus contains 5,042 words of Urdu running text in which all ambiguous words (856 instances) are manually tagged with senses from the Urdu Lughat dictionary. A range of baseline WSD models based on n-gram are applied to the corpus, and the best performance (accuracy of 57.71%) is achieved using word 4-gram. The corpus is freely available to the research community to encourage further WSD research in Urdu.