Home > Research > Publications & Outputs > Creating language resources for under-resourced...

Electronic data


    Rights statement: The final publication is available at Springer via http://dx.doi.org/10.1007/s10579-014-9274-3

    Accepted author manuscript, 1.48 MB, PDF document

    Available under license: CC BY: Creative Commons Attribution 4.0 International License


Text available via DOI:

View graph of relations

Creating language resources for under-resourced languages: methodologies, and experiments with Arabic

Research output: Contribution to Journal/MagazineJournal articlepeer-review

<mark>Journal publication date</mark>09/2015
<mark>Journal</mark>Language Resources and Evaluation
Issue number3
Number of pages32
Pages (from-to)549-580
Publication StatusPublished
Early online date9/08/14
<mark>Original language</mark>English


Language resources are important for those working on computational methods to analyse and study languages. These resources are needed to help advancing the research in fields such as natural language processing, machine learning,
information retrieval and text analysis in general. We describe the creation of useful resources for languages that currently lack them, taking resources for Arabic summarisation as a case study. We illustrate three different paradigms for creating language resources, namely: (1) using crowdsourcing to produce a small resource rapidly and relatively cheaply; (2) translating an existing gold-standard dataset, which is relatively easy but potentially of lower quality; and (3) using manual effort with appropriately skilled human participants to create a resource that is more expensive but of high quality. The last of these was used as a test collection for TAC-2011. An evaluation of the resources is also presented.

Bibliographic note

The final publication is available at Springer via http://dx.doi.org/10.1007/s10579-014-9274-3