Creation of an Evaluation Corpus and Baseline Evaluation Scores for Welsh Text Summarisation

Computing and Communications

Research output: Contribution to conference - Without ISBN/ISSN › Conference paper › peer-review

Published

Mahmoud El-Haj
Ignatius Ezeani
Jonathan Morris
Dawn Knight

Publication date	15/06/2022
Number of pages	8
Pages	14-21
<mark>Original language</mark>	English
Event	The 4th Celtic Language Technology Workshop (CLTW 2022) - Palais du Pharo, Marseille, France Duration: 20/06/2022 → 20/06/2022 Conference number: 4 http://techiaith.bangor.ac.uk/ticeltaidd/

Workshop

Workshop	The 4th Celtic Language Technology Workshop (CLTW 2022)
Abbreviated title	CLTW 2022
Country/Territory	France
City	Marseille
Period	20/06/22 → 20/06/22
Internet address	http://techiaith.bangor.ac.uk/ticeltaidd/

Abstract

As part of the effort to increase the availability of Welsh digital technology, this paper introduces the first human vs metrics Welsh summarisation evaluation results and dataset, which we provide freely for research purposes to help advance the work on Welsh summarisation. The system summaries were created using an extractive graph-based Welsh summariser. The system summaries were evaluated by both human and a range of ROUGE metric variants (e.g. ROUGE 1, 2, L and SU4). The summaries and evaluation results will serve as benchmarks for the development of summarisers and evaluation metrics in other minority language contexts.

Research

Links