U.S. patents available from 1976 to present.
U.S. patent applications available from 2005 to present.

Sound-synchronized video system

Patent 5608839 Issued on March 4, 1997. Estimated Expiration Date: Icon_subject June 21, 2014. Estimated Expiration Date is calculated based on simple USPTO term provisions. It does not account for terminal disclaimers, term adjustments, failure to pay maintenance fees, or other factors which might affect the term of a patent.

Patent References

Apparatus for providing facial image animation
Patent #: 4104625
Issued on: 08/01/1978
Inventor: Bristow ,   et al.

Dialog between TV movies and human viewers
Patent #: 4305131
Issued on: 12/08/1981
Inventor: Best

Audio visual speech recognition
Patent #: 4757541
Issued on: 07/12/1988
Inventor: Beadles

Image encoding and synthesis
Patent #: 4841575
Issued on: 06/20/1989
Inventor: Welsh ,   et al.

Speech transformation system Patent #: 5327521
Issued on: 07/05/1994
Inventor: Savic, et al.

Inventor

Application

No. 263271 filed on 06/21/1994

US Classes:

704/235, Speech to image704/231, Recognition704/270Application

Examiners

Primary: Hafiz, Tariq R.

Foreign Patent References

  • 1162492 JP 06/13/1989
  • 2231246 GB 11/13/1990
  • 2250405 GB 06/13/1992

International Classes

G10L 005/06
G10L 009/00

Abstract

A stream of unsynchronized audio signal, representing speech and video signal of a speaker, is processed by decoding the signal, memorizing a plurality of visemes corresponding to phonemes in the audio signal, fetching from the plurality visemes corresponding to phonemes in the audio signal, and imparting a synchronism to the video signal and audio signal by applying the fetched visemes to the unsynchronized video signal of the stream in synchronism with corresponding phonemes in the audio signal of the stream. According to an embodiment, the fetching step includes fetching visemes of the lip movement. The system is suitable for use in a videophone.

Other References

  • "An Intelligent Facial Image Coding Driven by Speech and Phoneme" by Shigeo Morishima et al., published in Multidimensional Signal Processing, Audio and Electroacoustics, vol. 3, on May 23, 1989, Institute of Electrical and Electronic Engineers, pp. 1795-1798
  • "Face Animation Scenario Making System for Model Based Image Synthesis" by Shigeo Morishima et al., dated 17 Mar. 1993, the 1993 Picture Coding Symposium Proceedings in the Swiss Federal Institute of Technology, Lausanne, Switzerland
  • Wolff et al, "Sensory Fusion: integrating visual and auditory information for recognizing speech;" ICASSP-94, p. 465-8 vol. 1, 19-22 Apr. 199
PatentsPlus Images
Enhanced PDF formats
loading...
PatentsPlus: add to cart
PatentsPlus: add to cartSearch-enhanced full patent PDF image
$9.95more info
PatentsPlus: add to cart
PatentsPlus: add to cartIntelligent turbocharged patent PDFs with marked up images
$16.95more info
 
Sign InRegister
Username  
Password   
forgot password?