Final published version
Research output: Contribution to Journal/Magazine › Journal article › peer-review
Research output: Contribution to Journal/Magazine › Journal article › peer-review
}
TY - JOUR
T1 - Corpus linguistics and South Asian languages : corpus creation and tool development.
AU - Baker, Paul
AU - Hardie, Andrew
AU - McEnery, Tony
AU - Xiao, Richard Z.
AU - Bontcheva, Kalina
AU - Cunningham, Hamish
AU - Gaizauskas, Robert
AU - Hamza, Oana
AU - Maynard, Diana
AU - Tablan, Valentin
AU - Ursu, Cristian
AU - Jayaram, B. D.
AU - Leisher, Mark
PY - 2004/11/1
Y1 - 2004/11/1
N2 - This paper describes the work carried out on the EMILLE Project (Enabling Minority Language Engineering), which was undertaken by the Universities of Lancaster and Sheffield. The primary resource developed by the project is the EMILLE Corpus, which consists of a series of monolingual corpora for fourteen South Asian languages, totalling more than 96 million words, and a parallel corpus of English and five of these languages. The EMILLE Corpus also includes an annotated component, namely, part-of-speech tagged Urdu data, together with twenty written Hindi corpus files annotated to show the nature of demonstrative use in Hindi. In addition, the project has had to address a number of issues related to establishing a language engineering (LE) environment for South Asian language processing, such as translating 8-bit language data into Unicode and producing a number of basic LE tools. The development of tools for EMILLE has contributed to the ongoing development of the LE architecture GATE, which has been extended to make use of Unicode. GATE thus plugs some of the gaps for language processing R&D necessary for the exploitation of the EMILLE corpora.
AB - This paper describes the work carried out on the EMILLE Project (Enabling Minority Language Engineering), which was undertaken by the Universities of Lancaster and Sheffield. The primary resource developed by the project is the EMILLE Corpus, which consists of a series of monolingual corpora for fourteen South Asian languages, totalling more than 96 million words, and a parallel corpus of English and five of these languages. The EMILLE Corpus also includes an annotated component, namely, part-of-speech tagged Urdu data, together with twenty written Hindi corpus files annotated to show the nature of demonstrative use in Hindi. In addition, the project has had to address a number of issues related to establishing a language engineering (LE) environment for South Asian language processing, such as translating 8-bit language data into Unicode and producing a number of basic LE tools. The development of tools for EMILLE has contributed to the ongoing development of the LE architecture GATE, which has been extended to make use of Unicode. GATE thus plugs some of the gaps for language processing R&D necessary for the exploitation of the EMILLE corpora.
U2 - 10.1093/llc/19.4.509
DO - 10.1093/llc/19.4.509
M3 - Journal article
VL - 19
SP - 509
EP - 524
JO - Literary and Linguistic Computing
JF - Literary and Linguistic Computing
SN - 0268-1145
IS - 4
ER -