System and method for very low frame rate video streaming for face-to-face video conferencing

Patent 7583287 Issued on September 1, 2009. Estimated Expiration Date:

March 22, 2025. Estimated Expiration Date is calculated based on simple USPTO term provisions. It does not account for terminal disclaimers, term adjustments, failure to pay maintenance fees, or other factors which might affect the term of a patent.

Abstract Claims Description Full Text

Patent References

Method for locating a subject's lips in a facial image
Patent #: 5805745
Issued on: 09/08/1998
Inventor: Graf

Information processing system for audio and visual transmission system Patent #: 6307948
Issued on: 10/23/2001
Inventor: Kawasaki, et al.

Inventors

Assignee

Microsoft Corp.

Application

No. 11087221 filed on 03/22/2005

US Classes:

348/14.12Transmission control (e.g., resolution or quality)

Examiners

Primary: Woo, Stella L

Attorney, Agent or Firm

International Class

H04N 7/14

Abstract

A real-time low frame-rate video compression system and method that allows the user to perform face-to-face communication through an extremely low bandwidth network. At the encoder side, the system is able to automatically select only a few good faces from the original sequence with high visual quality and compress and transmit them. At the decoder side, the system use image-morphing based rendering method to generate a normal frame-rate video. Experimental results show that the system is superior to more traditional video codecs for low bit-rate face-to-face communication.

Other References

Wen, Z., Z. Liu, M. Cohen, J. Li, K. Zhang, T. Huang, Low bit-rate video streaming for face-to-face teleconference, IEEE Int'l . Conf. on Multimedia and Expo, ICME '04, Jun. 2004, vol. 3., pp. 1631-1634.
Vieux, W. E., K. Schwerdt, J. L. Crowley, Face-tracking and coding for video compression, Proc. Int. Conf. Computer Vision Systems, Jan. 1999, pp. 151-160.
Polycom, http://www.polycom.com, last accessed Mar. 25, 2005.
Li, S. Z., X Zou, Y. Hu, Z. Zhang, S. Yan, X. Peng, L. Huang, H. Zhang, Real-time multi-view face detection, tracking, pose estimation, alignment, and recognition, IEEE CVPR, Dec. 2001.
Garau, M., M. Slater, S. Bee, M. A. Sasse, The impact for eye gaze on communication using humanoid avatars, Proc. SIGCHI Conf. Human Factors in Computing Systems, Apr. 2001, pp. 309-316.
Crowley, J. L., F. Berard, Multi-modal tracking of faces for video communication, Proc. IEEE Conf Comp. Vision and Pattern Recog., Jun. 1997, pp. 640-645.
Côté, G., B. Erol, M. Gallant and F. Kossentini, 263+: Video coding at low bit rates, IEEE Trans. on Circuits and Systems for Video Tech., Nov. 1998, vol. 8, No. 7, pp. 849-866.
Beier, T., S. Neely, Feature-based image metamorphosis, Computer Graphics, Jul. 1992, vol. 26., No. 2, pp. 35- 42.
Co-pending U.S. Appl. No. 11/087,355, “System and method for very low frame rate teleconferencing employing image cropping and morphing,” filed Mar. 22, 2005.
Co-pending U.S. Appl. No. 11/087,281, “System and method for eye-tracking and blink detection,” filed Mar. 22, 2005.