Speech driven lip synthesis using viseme based hidden markov models
Patent 6366885 Issued on April 2, 2002. Estimated Expiration Date: 
August 27, 2019. Estimated Expiration Date is calculated based on simple USPTO term provisions. It does not account for terminal disclaimers, term adjustments, failure to pay maintenance fees, or other factors which might affect the term of a patent.
August 27, 2019. Estimated Expiration Date is calculated based on simple USPTO term provisions. It does not account for terminal disclaimers, term adjustments, failure to pay maintenance fees, or other factors which might affect the term of a patent.Patent ReferencesMethod and apparatus for producing audio-visual synthetic speech Automated synchronization of video image sequences to new soundtracks Automated speech alignment for image synthesis Technique for providing a computer generated face having coordinated eye and head movement Image synthesis Patent #: 6208356 Inventors
ApplicationNo. 384763 filed on 08/27/1999US Classes:704/270, Application704/235, Speech to image704/258SynthesisExaminersPrimary: Dorvil, RichemondAssistant: Nolan, Daniel Attorney, Agent or FirmInternational ClassesG10L 021/06G10L 015/14 G11B 027/00 AbstractA method of speech driven lip synthesis which applies viseme based training models to units of visual speech. The audio data is grouped into a smaller number of visually distinct visemes rather than the larger number of phonemes. These visemes then form the basis for a Hidden Markov Model (HMM) state sequence or the output nodes of a neural network. During the training phase, audio and visual features are extracted from input speech, which is then aligned according to the apparent viseme sequence with the corresponding audio features being used to calculate the HMM state output probabilities or the output of the neutral network. During the synthesis phase, the acoustic input is aligned with the most likely viseme HMM sequence (in the case of an HMM based model) or with the nodes of the network (in the case of a neural network based system), which is then used for animation.Other References
| |
