Home > Research > Publications & Outputs > Leveraging Synthetic Data to Learn Video Stabil...

Electronic data

View graph of relations

Leveraging Synthetic Data to Learn Video Stabilization Under Adverse Conditions

Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

Forthcoming
Publication date24/10/2023
Host publicationIEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
<mark>Original language</mark>English
EventIEEE/CVF Winter Conference on Applications of Computer Vision (WACV) - WAIKOLOA, HAWAII, USA, United States
Duration: 4/01/20248/01/2024
https://wacv2024.thecvf.com/

Conference

ConferenceIEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
Abbreviated titleWACV
Country/TerritoryUnited States
Period4/01/248/01/24
Internet address

Conference

ConferenceIEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
Abbreviated titleWACV
Country/TerritoryUnited States
Period4/01/248/01/24
Internet address

Abstract

Stabilization plays a central role in improving the quality of videos. However, current methods perform poorly under adverse conditions. In this paper, we propose a synthetic-aware adverse weather video stabilization algorithm that dispenses real data for training, relying solely on synthetic data. Our approach leverages specially generated synthetic data to avoid the feature extraction issues faced by current methods. To achieve this, we present a novel data generator to produce the required training data with an automatic ground-truth extraction procedure. We also propose a new dataset, VSAC105Real, and compare our method to five recent video stabilization algorithms using two benchmarks. Our method generalizes well on real-world videos across all weather conditions and does not require large-scale synthetic training data. Implementations for our proposed video stabilization algorithm, generator, and datasets are available at https://github.com/A-Kerim/SyntheticData4VideoStabilization_WACV_2024.