Home > Research > Publications & Outputs > A time-sensitive historical thesaurus-based sem...

Electronic data

  • 1-s2.0-S0885230816302121-main

    Final published version, 2.46 MB, PDF document

    Available under license: CC BY: Creative Commons Attribution 4.0 International License


Text available via DOI:

View graph of relations

A time-sensitive historical thesaurus-based semantic tagger for deep semantic annotation

Research output: Contribution to Journal/MagazineJournal articlepeer-review

<mark>Journal publication date</mark>11/2017
<mark>Journal</mark>Computer Speech and Language
Number of pages23
Pages (from-to)113-135
Publication StatusPublished
Early online date17/05/17
<mark>Original language</mark>English


Automatic extraction and analysis of meaning-related information from natural language data has
been an important issue in a number of research areas, such as natural language processing (NLP),
text mining, corpus linguistics, and data science. An important aspect of such information extraction and analysis is the semantic annotation of language data using a semantic tagger. In practice, various semantic annotation tools have been designed to carry out different levels of semantic annotation, such as topics of documents, semantic role labeling, named entities or events. Currently, the majority of existing semantic annotation tools identify and tag partial core semantic information in language data, but they tend to be applicable only for modern language corpora. While such semantic analyzers have proven useful for various purposes, a semantic annotation tool that is capable of annotating deep semantic senses of all lexical units, or all-words tagging, is still desirable for a deep, comprehensive semantic analysis of language data. With large-scale digitization efforts underway, delivering historical corpora with texts dating from the last 400 years, a particularly challenging aspect is the need to adapt the annotation in the face of significant word meaning change over time. In this paper, we report on the development of a new semantic tagger (the Historical Thesaurus Semantic Tagger), and discuss challenging issues we faced in this work. This new semantic tagger is built on existing NLP tools and incorporates a large-scale historical English thesaurus linked to the Oxford English Dictionary. Employing contextual disambiguation algorithms, this tool is capable of annotating lexical units with a historically-valid highly fine-grained semantic categorization scheme that contains about 225,000 semantic concepts and 4,033 thematic semantic categories. In terms of novelty, it is adapted for processing historical English data, with rich information about historical usage of words and a spelling variant normalizer for historical forms of English. Furthermore, it is able to make use of
knowledge about the publication date of a text to adapt its output. In our evaluation, the system
achieved encouraging accuracies ranging from 77.12% to 91.08% on individual test texts. Applying
time-sensitive methods improved results by as much as 3.54% and by 1.72% on average.