Method for hierarchical summarization and browsing of digital video

Patent 5956026 Issued on September 21, 1999. Estimated Expiration Date:

December 19, 2017. Estimated Expiration Date is calculated based on simple USPTO term provisions. It does not account for terminal disclaimers, term adjustments, failure to pay maintenance fees, or other factors which might affect the term of a patent.

Abstract Claims Description Full Text

Patent References

Scene change detection system and method
Patent #: 5099322
Issued on: 03/24/1992
Inventor: Gove

Motion-dependent image classification for editing purposes
Patent #: 5339166
Issued on: 08/16/1994
Inventor: LeBrat, et al.

Video database indexing and method of presenting video database index to a user
Patent #: 5485611
Issued on: 01/16/1996
Inventor: Astle

Temporal event viewing and editing system
Patent #: 5513306
Issued on: 04/30/1996
Inventor: Mills, et al.

Browsing contents of a given video sequence
Patent #: 5521841
Issued on: 05/28/1996
Inventor: Arman, et al.

System and method for inputting scene information
Patent #: 5537528
Issued on: 07/16/1996
Inventor: Takahashi, et al.

Method and system for operating a data processor to index primary data in real time with iconic table of contents
Patent #: 5550965
Issued on: 08/27/1996
Inventor: Gabbe, et al.

Method and apparatus for annotating full motion video and other indexed data structures
Patent #: 5600775
Issued on: 02/04/1997
Inventor: King, et al.

Method for representing contents of a single video shot using frames
Patent #: 5606655
Issued on: 02/25/1997
Inventor: Arman, et al.

System for automatic video segmentation and key frame extraction for video sequences having both sharp and gradual transitions
Patent #: 5635982
Issued on: 06/03/1997
Inventor: Zhang, et al.

More ...

Inventor

Ratakonda, Krishna

Assignee

Sharp Laboratories of America, Inc.

Application

No. 994558 filed on 12/19/1997

Examiners

Primary: Bayerl, Raymond J.
Assistant: Luu, Sy D.

Attorney, Agent or Firm

Varitz P.C.; Robert D.

Foreign Patent References

0 615 245 A2 EP. 09/18/1994

International Classes

G06F 015/00
G06T 011/00

Abstract

A method of hierarchical digital video summarization and browsing includes inputting a digital video signal for a digital video sequence and generating a hierarchical summary based on keyframes of the video sequence. Additional steps may include computing histograms for the digital video sequence; detecting shot boundaries within the digital video sequence; determining the number of keyframes to be allocated within each shot; locating the actual position of each keyframe within each shot; identifying keyframe locations by the largest consecutive difference criteria; pruning keyframes for an shot without meaningful action; extracting keyframes efficiently in the case of compressed video; and browsing the shots using the hierarchical keyframe summary.

Other References

Yeo et al., "Time-constrained clustering for segmentation of video into story units", IEEE proceedings of ICPR 1996, pp. 375-380, 1996
Chen et al., "A multi-layer video browsing system", IEEE May 1995, pp. 374-375
Mills et al., "A magnifier tool for video data", ACM Proceedings of CHI '92 May 1992, pp. 93-98
Zhang et al., Automatic Video Partitioning and Indexing, Automatic Control World Congress, Sydney, Australia, Jul. 18-23 1993, pp. 697-700
Lagendijk et al., Visual Search in a SMASH System, International Conference on Image Processing, IEEE Signal Processing Society, Sep. 16-19 1996, pp. 671-674
Mann et al., Video Orbits of the Projective Group: A New Perespective on Image Mosaicing, MIT Media Laboratory Perceptual Computing TR No. 338, 1995
Tekalp, A. Murat, Digital Video Processing, Prentice Hall PTR, 1995 (Table of Contents)
Smith et al., Video Skimming and Characterization Through the Combination of Image and Language Understanding Techniques, School of Computer Science, Carnegie Mellon University, Feb. 3, 1997
Puri et al., Digital Video: An introduction to MPEG-2, Chapman & Hall, 1997 (Table of Contents