Automated speech alignment for image synthesis

Patent 5884267 Issued on March 16, 1999. Estimated Expiration Date:

February 24, 2017. Estimated Expiration Date is calculated based on simple USPTO term provisions. It does not account for terminal disclaimers, term adjustments, failure to pay maintenance fees, or other factors which might affect the term of a patent.

Abstract Claims Description Full Text

Patent References

Apparatus and method for lip-synching animation
Patent #: 4913539
Issued on: 04/03/1990
Inventor: Lewis

Sound-synchronized video system
Patent #: 5608839
Issued on: 03/04/1997
Inventor: Chen

Advanced tools for speech synchronized animation
Patent #: 5613056
Issued on: 03/18/1997
Inventor: Gasper, et al.

Segment-based apparatus and method for speech recognition by analyzing multiple speech unit frames and modeling both temporal and spatial correlation
Patent #: 5625749
Issued on: 04/29/1997
Inventor: Goldenthal, et al.

Advanced tools for speech synchronized animation
Patent #: 5630017
Issued on: 05/13/1997
Inventor: Gasper, et al.

Method and apparatus for producing audio-visual synthetic speech Patent #: 5657426
Issued on: 08/12/1997
Inventor: Waters, et al.

Inventors

Assignee

Digital Equipment Corporation

Application

No. 804761 filed on 02/24/1997

US Classes:

704/270.1, Speech assisted network704/270Application

Examiners

Primary: Hudspeth, David
Assistant: Weiland, Susan

Attorney, Agent or Firm

Graham & James LLP

International Class

G10L 009/00

Abstract

In a computerized method, speech signals are analyzed using statistical trajectory modeling to produce time aligned acoustic-phonetic units. There is one acoustic-phonetic unit for each portion of the speech signal determined to be phonetically distinct. The acoustic-phonetic units are translated to corresponding time aligned image units representative of the acoustic-phonetic units. An image including the time aligned image units is displayed. The display of the time aligned image units is synchronized to a replaying of the digitized natural speech signal.

Other References

"Expression control using synthetic speech," Wyvill et al., ACM Siggraph '89, State of the Art in Facial Animation, 16th Annual Conf. On Computer Graphics & Interactive Techniques, Boston, Mass. 31 Jul.-4 Aug. 1989
"A Media Conversion from Speech to Facial Image for Intelligent Man-Machine Interface," Morishima et al., IEEE Journal on Selected Areas in Communications, vol. 9, No. 4, May 1991
"Automated Lip-Synch and Speech Synthesis for Character Animation," Lewis et al., Computer Graphics Lab New York Institute of Technology, 1987 ACM-0-89791-213-6/87/0004/0143
"Read My Lips . . . and My Jaw|" Le Goff et al., ESCA, Eurospeech '95, 4th European Conf. On Speech Communication and Technology, Madrid, Sep. 1995. ISSN 1018.4074
"Automated Lip-sync: Background and Techniques," Lewis, The Journal of Visualization and Computer Animation, vol. 2: 118-122 (1991)
"A Model for Human Faces that Allows Speech Synchronized Animation," Parke, Conf. On Compuer Graphics and Interactive Techniques, 15-17 Jul. 1974, sponsored by the Univ. Of Colorado Computing Center and ACM/SIGGRAPH
"Talking Heads Mean Business," The Sunday Times, 2 Feb. 1997, http://www.sunday-times.co.uk/news/pages/Sunday-Times/stiinnnws02003.html? 158588