Analysis and Interface for Instructional Video
Alexander Haubold, John R. Kender
Abstract
We present a new method for segmenting, and a new user interface for indexing and visualizing, the semantic content of extended instructional videos. Using various visual filters, key frames are first assigned a media type (board, class, computer, illustration, podium, and sheet). Key frames of media type board and sheet are then clustered based on contents via an algorithm with near-linear cost. A novel user interface, the result of two user studies, displays related topics using icons linked topologically, allowing users to quickly locate semantically related portions of the video. We analyze the accuracy of the segmentation tool on 17 instructional videos, each of which is from 75 to 150 minutes in duration (a total of 40 hours); it exceeds 96%.
Create a lesson
Related papers
WISE: An Agentic Framework for Whole-page Multimodal Search Experience Attribution
Wenyi Xu, Renzhe Zhou, Songyang Li et al.
Deliberate Latent Reasoning for Sequential Recommendation
Haobo Zhang, Qiannan Zhu, Yutao Zhu et al.
PMRecBench: A Benchmark for Personalization in Recommendation Agents under Multimodal Queries
Xiaoyu Zhang, Yougang Lyu, Bin Wu et al.
Generative Retrieval under Real-Time Supply Constraints in Local Commerce
Shaopeng Liang, Biao Zhang, Hongzhen Ye et al.
Do Search-Augmented Recommenders Use the Latest Search Episode?
Jiandong Ding
One Basket, Many Experts: Decorrelated Re-ranking for Financial Asset Recommendation
Ryuki Unno, Keigo Sakurai, Koshi Watanabe et al.