Multimodal Concert Video Editing: System Design and Exploratory Evaluation
Editing multi-camera concerts requires coordinated decisions about musical relevance, visual quality and cut timing. We present a modular framework that combines instrument activity from multitrack audio, visible instruments and image sharpness with beat-based timing and probabilistic camera selection. An interpretable scoring model links these components to the choice of views over complete shot intervals. Component tests and an exploratory expert study on a four-camera concert yield mixed assessments across the editing variants. The findings motivate extending local audiovisual relevance with contextual and sequence-level criteria. The architecture provides a basis for testing these extensions and studying how component behaviour affects the quality of complete edits.
Authors
- Adrian Kempf (ORCID: https://orcid.org/0000-0002-0428-3090)
- Tim Mangliers
- Benjamin Himpel (ORCID: https://orcid.org/0000-0002-3737-8379)
- Lennart Schiweck (ORCID: https://orcid.org/0009-0007-9337-7104)
- Moritz Feucht
- Michelle Retig
Publication Details
- Journal
- arXiv (Cornell University)
- Published
- 2026-10-26
- DOI
- https://doi.org/10.48550/arxiv.2610.35816
- Primary Topic
- Video Analysis and Summarization
- Type
- preprint