Method for associating semantic information with multiple images in an image database environment

Patent 6804684 Issued on October 12, 2004. Estimated Expiration Date:

May 7, 2021. Estimated Expiration Date is calculated based on simple USPTO term provisions. It does not account for terminal disclaimers, term adjustments, failure to pay maintenance fees, or other factors which might affect the term of a patent.

Abstract Claims Description Full Text

Patent References

Method and apparatus for utilizing annotations to facilitate computer retrieval of database material
Patent #: 5404295
Issued on: 04/04/1995
Inventor: Katz, et al.

Generation, archiving, and retrieval of digital images with evoked suggestion-set captions and natural language interface
Patent #: 5493677
Issued on: 02/20/1996
Inventor: Balogh, et al.

Method and apparatus for managing browsing, and selecting graphic images
Patent #: 5517605
Issued on: 05/14/1996
Inventor: Wolf

Image query system and method
Patent #: 5579471
Issued on: 11/26/1996
Inventor: Barber, et al.

Image classification and retrieval system using a query-by-example paradigm
Patent #: 5852823
Issued on: 12/22/1998
Inventor: De Bonet

Protection of an electronically stored image in a first color space by the alteration of digital component in a second color space
Patent #: 5893101
Issued on: 04/06/1999
Inventor: Balogh, et al.

Method and system for detection and characterization of open space in digital images
Patent #: 5901245
Issued on: 05/04/1999
Inventor: Warnick, et al.

Semantic and cognition based image retrieval
Patent #: 5930783
Issued on: 07/27/1999
Inventor: Li, et al.

System and method for open space metadata-based storage and retrieval of images in an image database
Patent #: 6115717
Issued on: 09/05/2000
Inventor: Mehrotra, et al.

Video query system and method
Patent #: 6182069
Issued on: 01/30/2001
Inventor: Niblack, et al.

More ...

Inventors

Application

No. 09850475 filed on 05/07/2001

US Classes:

707/104.1, Application of database or data structure (e.g., distributed, multimedia, image)707/102, Generating database or data structure (e.g., via user interface)707/3, Query processing (i.e., searching)382/190, Feature extraction382/162, COLOR IMAGE PROCESSING707/100, DATABASE SCHEMA OR DATA STRUCTURE707/1, DATABASE OR FILE ACCESSING707/6, Pattern matching access382/306, Using identification indicia on document707/205, File allocation382/282Selecting a portion of an image

Examiners

Primary: Robinson, Greta
Assistant: Le, Lana

Attorney, Agent or Firm

Woods; David M.

International Class

G06F 700

Abstract

A method of generating captions or semantic labels for an acquired image is based upon similarity between the acquired image and one or more stored images that are maintained in an image database environment, where the stored images have preexisting captions or labels associated with them. The method includes the steps of: a) acquiring an image for evaluation with respect to the stored images; b) automatically extracting metadata from the acquired image without requiring user interaction in the image database environment; c) automatically selecting one or more stored images having metadata similar to the extracted metadata, thereby providing selected stored images with metadata similar to the acquired image; and d) generating captions or labels for the acquired image from the preexisting captions or labels associated with the selected stored images.

Other References

U.S. patent application Ser. No. 09/223,860, Luo et al., filed Dec. 31, 1998.
U.S. patent application Ser. No. 09/291,857, Zhu et al., filed Apr. 14, 1999.
U.S. patent application Ser. No. 09/450,190, Luo et al., filed Nov. 29, 1999.
U.S. patent application Ser. No. 09/685,112, Lieberman et al., filed Oct. 10, 2000.
“The Image Processing Handbook”, 2nd ed., by John C. Russ. CRC Press, 1995, pp. 259-262.
“Eigenfaces for Recognition” by Matthew Turk and Alex Pentland. Journal of Cognitive Neuroscience, vol. 3, No. 1, 1991, pp. 71-86.
“A Real-Time Face Tracker” by Jibe Yang and Alex Waibel. Third IEEE workshop on Applications of Computer Vision WACV '96. Sponsored by IEEE Computer Society Technical Committee on Pattern Analysis and Machine Intelligence (PAMI), Dec. 2-4, 1996, pp. 142-147.
“Comparing Images Using Color Coherence Vectors” by Greg Pass, Ramin Zabih, and Justin Miller. Proceedings ACM Multimedia 96, Boston, MA, Nov. 18-22, 1996. Sponsored by the ACM Special Interest Groups. SIGCOMM, SIGGRAPH, SUGMULTIMEDIA, and SIGMIS. pp. 65-73.
“Multimedia Information Exploration” by Allan Kuchinsky. CHI98 Workshop on Information Exploration, FX Palo Alto Laboratory, Inc. Palo Alto, CA, 1998.
“Example-Based Learning for View-Based Human Face Detection” by Kah-Kay Sung and Tomaso Poggio. IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, vol. 1, Jan. 1998.
“Algorithms for Clustering Data” by Anil K. Jain and Richard C. Dubes. Prentice Hall, 1988, pp. 55-60, 89-92, 133-135.