Home > Research > Publications & Outputs > Detecting changes and anomalies in nonstationar...

Links

Text available via DOI:

View graph of relations

Detecting changes and anomalies in nonstationary contextual bandits with an application to task categorisation

Research output: Contribution to Journal/MagazineJournal articlepeer-review

E-pub ahead of print
Article number122270
<mark>Journal publication date</mark>30/11/2025
<mark>Journal</mark>Information Sciences
Volume717
Publication StatusE-pub ahead of print
Early online date14/05/25
<mark>Original language</mark>English

Abstract

As society becomes increasingly connected, the demands placed on telecommunications systems will only grow. To meet these demands network providers want to deploy automated tools that make decisions based on available network information. Furthermore, there is a need for these tools to be agile, so that they can react to changes, or identify unexpected outcomes, as they occur in this rapidly evolving digital landscape. To address this challenge the first nonstationary contextual bandit method that simultaneously monitors the observed rewards for both changes and anomalies, SCAPA-UCB, is introduced. In addition to incorporating change and anomaly detection, the proposed approach relaxes common nonstationary bandit assumptions on the reward distribution for an arm, allowing contextual information to be incorporated using a broad range of statistical models. Furthermore, the method provides a faster retraining process once a change is detected. Extensive simulation studies are performed to establish the favourable performance of SCAPA-UCB, and an application categorising maintenance tasks on a telecommunications network is presented.