Home > Research > Publications & Outputs > VARD2
View graph of relations

VARD2: a tool for dealing with spelling variation in historical corpora

Research output: Contribution to conference - Without ISBN/ISSN Conference paper

Published
Publication date05/2008
Number of pages15
<mark>Original language</mark>English
EventPostgraduate Conference in Corpus Linguistics - Aston University, Birmingham
Duration: 22/05/2008 → …

Conference

ConferencePostgraduate Conference in Corpus Linguistics
CityAston University, Birmingham
Period22/05/08 → …

Abstract

When applying corpus linguistic techniques to historical corpora, the corpus researcher should be cautious about the results obtained. Corpus annotation techniques such as part of speech tagging, trained for modern languages, are particularly vulnerable to inaccuracy due to vocabulary and grammatical shifts in language over time. Basic corpus retrieval techniques such as frequency profiling and concordancing will also be affected, in addition to the more sophisticated techniques such as keywords, n-grams, clusters and lexical bundles which rely on word frequencies for their calculations. In this paper, we highlight these problems with particular focus on Early Modern English corpora. We also present an overview of the VARD tool, our proposed solution to this problem, which facilitates pre-processing of historical corpus data by inserting modern equivalents alongside historical spelling variants. Recent improvements to the VARD tool include the incorporation of techniques used in modern spell checking software.