Summarization solutions for BBC rushes video content emphasizing novel presentation solutions
Rushes are the raw material (extra video, B-rolls footage) used to produce a video. 20 to 40 times as much material may be shot as actually becomes part of the finished product. Rushes usually have only natural sound. Actors are only sometimes present. Within the TRECVid summarisation task, given a video from the rushes test collection, the goal is to automatically create an summary clip less than or equal to 2% of the original video's duration.
In 2007, we produced a keyframe based summary which employed highlight detected frames from the original video. The selection and inclusion was informed by a number of human-centred concepts as was the visual composition and arrangement of the on-screen elements.
In 2008, we produced a summary which employed more sophisticated analysis techniques; namely using principal component analysis and linear discriminant analysis. The resulting low dimensional representation of each shot offers a simple way to compare and select representative shots of the original video. The final summary was constructed as a dynamic storyboard. At launch and completion the storyboard is presented to the viewer, and as the summary progresses it scans and zooms-in to the selected segment within the storyboard and begins accelerated playback where the speed corresponds to the importance of the segment within the summary.