Home > Research > Publications & Outputs > TAC 2011 MultiLing pilot overview
View graph of relations

TAC 2011 MultiLing pilot overview

Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

Published
  • G. Giannakopoulos
  • M. El-Haj
  • B. Favre
  • M. Litvak
  • J. Steinberger
  • V. Varma
Close
NullPointerException

Abstract

The Text Analysis Conference MultiLing Pilot of 2011 posed a multi-lingual summarization task to the summarization community, aiming to quantify and measure the performance of
multi-lingual, multi-document summarization systems. The task was to create a 240–250 word summary from 10 news texts, describing a given topic. The texts of each topic were provided in seven languages (Arabic, Czech, English, French, Greek, Hebrew, Hindi) and each participant generated summaries for at least 2 languages. The evaluation of the summaries was performed using automatic (AutoSummENG, Rouge) and manual processes
(Overall Responsiveness score). The participating systems were 8, some of which providing summaries across all languages. This
paper provides a brief description for the collection of the data, the evaluation methodology, the problems and challenges faced, and an overview of participation and corresponding results.