Home > Research > Publications & Outputs > Text-driven Video Acceleration

Electronic data

Links

Text available via DOI:

View graph of relations

Text-driven Video Acceleration

Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

Published
Publication date30/09/2024
Host publication37th Conference on Graphics, Patterns and Images (SIBGRAPI): Workshop of Theses and Dissertations (WTD)
Pages35-41
Number of pages7
<mark>Original language</mark>English
Event2024 37th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI) - Manaus, Brazil
Duration: 30/09/20243/10/2024
https://sibgrapi.sbc.org.br/2024/

Conference

Conference2024 37th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI)
Country/TerritoryBrazil
CityManaus
Period30/09/243/10/24
Internet address

Conference

Conference2024 37th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI)
Country/TerritoryBrazil
CityManaus
Period30/09/243/10/24
Internet address

Abstract

From the dawn of the digital revolution until today, data has grown exponentially, especially in images and videos. Smartphones and wearable devices with high storage and long battery life contribute to continuous recording and massive uploads to social media. This rapid increase in visual data, combined with users' limited time, demands methods to produce shorter videos that convey the same information. Semantic Fast-Forwarding reduces viewing time by adaptively accelerating videos and slowing down for relevant segments. However, current methods require predefined visual concepts or user supervision, which is costly and time-consuming. This work explores using textual data to create text-driven fast-forwarding methods that generate semantically meaningful videos without explicit user input. Our proposed approaches outperform baselines, achieving F1 Score improvements up to 12.8 percentage points over the best competitors. Comprehensive user and ablation studies, along with quantitative and qualitative evaluations, confirm their superiority. Visual results are available at https://youtu.be/cOYqumJQOY and https://youtu.be/u6ODTv7-9C4 .