Image synthesis

Patent 6208356 Issued on March 27, 2001. Estimated Expiration Date:

March 13, 2018. Estimated Expiration Date is calculated based on simple USPTO term provisions. It does not account for terminal disclaimers, term adjustments, failure to pay maintenance fees, or other factors which might affect the term of a patent.

Abstract Claims Description Full Text

Patent References

Apparatus and method for lip-synching animation
Patent #: 4913539
Issued on: 04/03/1990
Inventor: Lewis

Apparatus for generating from an audio signal a moving visual lip image from which a speech content of the signal can be comprehended by a lipreader
Patent #: 5313522
Issued on: 05/17/1994
Inventor: Slager

System and method for composing a display frame of multiple layered graphic sprites
Patent #: 5546518
Issued on: 08/13/1996
Inventor: Blossom, et al.

5548693

Method and apparatus for game development using correlation of time sequences and digital video data
Patent #: 5568602
Issued on: 10/22/1996
Inventor: Callahan, et al.

3-dimensional animation generating apparatus and a method for generating a 3-dimensional animation Patent #: 5577175
Issued on: 11/19/1996
Inventor: Naka, et al.

Inventors

Assignee

British Telecommunications public limited company

Application

No. 043148 filed on 03/13/1998

US Classes:

345/473, Animation345/474Motion planning or control

Examiners

Primary: Vo, Cliff N.

Attorney, Agent or Firm

Nixon & Vanderhye P.C.

Foreign Patent References

689 362 EP. 12/13/1995
2 231 246 GB. 11/13/1990

International Class

G06T 15//00

Abstract

Synthesis of a moving picture of a face (e.g. to accompany synthetic speech) is performed by converting an input phoneme string into a sequence of mouth shapes or visemes. Specifically a shape is generated for each vowel and for each transition involving a consonant.

Other References

Gasper Elon, "Getting a Head with Hyperanimation", Dr. Dobb's Journal of Software Tools, Jul. 1998, vol. 13, No. 7, pp. 18-34, ISSN 0888-3076 QH76.D617
Lewis J. P. and Parke F. I., "Automated Lip-Synch and Speech Synthesis for Character Animation", SIGCHI Bulletin, spec. issue, pp. 143-7, ISSN 0736-6906 QH 76.76.H94 H95 1989
Lobanov B., "On the Acoustic Theory of Coarticulation and Reduction", International Conference on Acoustic, Speech and Signal Processing, 1982, vol. 2, pp. 915-8, TK7882.565137a
Pelachud C., Badler N. I., & Steedman M., "Linguistic issues in facial animation" in N. M. Thalmann and D. Thalmann (Eds) Computer Animation '92, Tokyo, Springer-Verlag TR897.5. C657 1991
Welsh, et al., "Model-Based Image Coding", BR TELECOM TECHNOL J., vol. 8, No. 3, Jul. 1990, pp. 94-106
Mahoney, "Facial Animation", COMPUTER GRPAHIC WORLD, Jan. 1995, pp. 60-62
Luo et al., "A Novel Approach For Classifying Continuous Speech Into Visible Mouth-Shape Related Classes", 1994 IEEE, pp. I-465-I-468
Morishima et al., "Facial Animation Synthesis or Human-Machine Communication System", International Conference On Human-Computer Interaction, vol. 2, pp. 1085-90
Cohen, et al., "Modeling Coarticulation in Synthetic Visual Speech", in N.M. Thalmann and D. Thalmann (eds) Models and Techniques in Computer Animation "92, Tokyo, Springer-Verlag, pp. 139-157
Morishima, et al. "A Real-Time Facial Action Image Synthesis System Driven by Speech and Text", SPIE, vol. 1360, Visual Communications and Image Processing "90, pp. 1151-1158
Carraro et al., "A Telephonic Lip Reading Device for The Hearing Impaired", Conference Colloquim "Biomedical Applications of Digital Signal Processing", Digest No. 144, pp. 10/1-8
Bothe et al., "Artificial Visual Speech Synchronized with a Speech Synthesis System", conf., "Computers for Handicapped Persons", 1994, pp. 32-37
Montgomery et al., "The Use of Visible Lip Information In Automatic Speech Recognition", PROCEEDINGS OF EUSIPCO-86: Third European Signal Processing Conference, vol. 1, pp. 577-580
Cohen et al., "Development and Experimentation with Synthetic Visible Speech", May 1994, Behaviour Research Methods, Instruments & Computers, vol. 26, No. 2, pp. 260-5
Page et al., "The Laureate Text-to-Speech System -Architecture and Applications", BT TECHNOL J, vol. 14, No. 1, Jan. 1996, pp. 57-67
SYSTEMS & COMPUTERS IN JAPAN, vol. 22, no. 5, 1 Jan. 1991, pp. 50-59, Morishima et al, "A Facial Motion Synthesis for Intelligent Man-Machine Interface