Augmented Segmentation and Visualization for Presentation Videos
Alexander Haubold, John R. Kender
Abstract
We investigate methods of segmenting, visualizing, and indexing presentation videos by separately considering audio and visual data. The audio track is segmented by speaker, and augmented with key phrases which are extracted using an Automatic Speech Recognizer (ASR). The video track is segmented by visual dissimilarities and augmented by representative key frames. An interactive user interface combines a visual representation of audio, video, text, and key frames, and allows the user to navigate a presentation video. We also explore clustering and labeling of speaker data and present preliminary results.
Create a lesson
Related papers
Trigger Timing, Deadline Readiness, and Event-Aligned Accounting for Dynamic Ad Insertion
Prashant Chaudhary, Kapil Khandelwal
From Models to Systems: A Comprehensive Survey of Efficient Multimodal Learning
Pan Wang, Siwei Song, Hui Ji et al.
MoQSplat: Adaptive Progressive Streaming of 3D Gaussian Splatting via MoQ
Emanuele Artioli, Mohammadreza Ghafari, Md Tariqul Islam et al.
Divide and Conquer: Mixture-of-Bottleneck Experts in Informative Ordinal Space for Video-based Multimodal Sentiment Analysis
Ronghao Lin, Qiaolin He, Zefeng Lu et al.
Multimodal Aspect-Level Sentiment Analysis Based on Gated Noise Filtering and Emotion-Relevance Interaction
Chen Huang, Liangwei Guo, Yamin Li et al.
SemABR: Measuring Video Semantic Fidelity with Multimodal LLMs for Adaptive Bitrate Streaming
Shiqi Xu, Soung Chang Liew, Yuyang Du