Final published version, 352 KB, PDF document
Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSN › Conference contribution/Paper › peer-review
Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSN › Conference contribution/Paper › peer-review
}
TY - GEN
T1 - TAC 2011 MultiLing pilot overview
AU - Giannakopoulos, G.
AU - El-Haj, M.
AU - Favre, B.
AU - Litvak, M.
AU - Steinberger, J.
AU - Varma, V.
PY - 2011
Y1 - 2011
N2 - The Text Analysis Conference MultiLing Pilot of 2011 posed a multi-lingual summarization task to the summarization community, aiming to quantify and measure the performance ofmulti-lingual, multi-document summarization systems. The task was to create a 240–250 word summary from 10 news texts, describing a given topic. The texts of each topic were provided in seven languages (Arabic, Czech, English, French, Greek, Hebrew, Hindi) and each participant generated summaries for at least 2 languages. The evaluation of the summaries was performed using automatic (AutoSummENG, Rouge) and manual processes(Overall Responsiveness score). The participating systems were 8, some of which providing summaries across all languages. Thispaper provides a brief description for the collection of the data, the evaluation methodology, the problems and challenges faced, and an overview of participation and corresponding results.
AB - The Text Analysis Conference MultiLing Pilot of 2011 posed a multi-lingual summarization task to the summarization community, aiming to quantify and measure the performance ofmulti-lingual, multi-document summarization systems. The task was to create a 240–250 word summary from 10 news texts, describing a given topic. The texts of each topic were provided in seven languages (Arabic, Czech, English, French, Greek, Hebrew, Hindi) and each participant generated summaries for at least 2 languages. The evaluation of the summaries was performed using automatic (AutoSummENG, Rouge) and manual processes(Overall Responsiveness score). The participating systems were 8, some of which providing summaries across all languages. Thispaper provides a brief description for the collection of the data, the evaluation methodology, the problems and challenges faced, and an overview of participation and corresponding results.
M3 - Conference contribution/Paper
BT - Text Analysis Conference (TAC) 2011, MultiLing Summarisation Pilot
PB - TAC
CY - Maryland, USA
ER -