Abstract

A foveated imaging system, which can be implemented on a general purpose computer and greatly reduces the transmission bandwidth of images has been developed. This system has demonstrated that significant reductions in bandwidth can be achieved while still maintaining access to high detail at any point in an image. The system is implemented with conventional computer, display, and camera hardware. It utilizes novel algorithms for image coding and decoding that are superior both in degree of compression and in perceived image quality and is more flexible and adaptable to different bandwidth requirements and communications applications than previous systems. The system utilizes novel methods of incorporating human perceptual properties into the coding the decoding algorithms providing superior foveation. One version of the system includes a simple, inexpensive, parallel pipeline architecture, which enhances the capability for conventional and foveated data compression. Included are novel applications of foveated imaging in the transmission of pre-recorded video (without eye tracking), and in the use of alternate pointing devices for foveation.

Other References

• Silsbee, et al "Visual Pattern Image Sequence Coding", IEEE, pp. 291-301, 1993.
• Basu, et al "Videoconferencing Using Spatially Varying Sensing With Multiple and Moving Foveae", IEEE, pp. 30-34, 1994.
• Baron, et al "Exploring with a Foveated Robot Eye System", IEEE, pp. 377-380, 1994.
• Yamamoto "An Active Foveated Vision System : Attentional mechanisms and Scan Path Convergence Measures", Academic Press, pp. 50-65, 1996.
• Howard, Display Characteristics of Example Light-Valve Projectors, AFHRL-TP-88-44, Operations Training Division, Air Force Human Resources Laboratory, Williams AFB, AZ, 1989
• Strang, G. and Nguyen, T., Wavelets and Filter Banks, Wellesley-Cambridge Press, 1996. (Text Book)
• E.H. Adelson, E. Simoncelli and Hingorani, Orthogonal Pyramid Transforms for Image Coding. WA: SPIE Optical Engineering Press, 1987
• Benderson, Wallace, Schwarts, "A Miniature Pan-Tilt Actuator: The Spherical Pointing Motor," IEEE Transactions Robotics and Automation, 10:298-308, 1994
• P.J. Burt and E. J. Adelson, The Laplacian Pyramid as a Compact Image Code. IEEE Transactions on Communications. 31:532-540.1983
• Geisler and Banks, "Visual Performance," In: Handbook of Optics vol. 1: Fundamentals, Techniques and Design, 2nd Ed., M. Bass, ed., New York, McGraw-Hill, 1995
• Juday and Fisher, "Geometric Transformations for Video Compression and Human Teleoperator Ddisplay," SPIE Proceedings: Optical Pattern Recognition, 1053:116-123, 1989
• P.T. Kortum and W.S. Geisler, Implementation of a Foveated Image-Coding System for Bandwidth Reduction of Video Images. Human Vision and Electronic Imaging. SPIE:2657, 350-360, 1996
• A. Said and W.A. Pearlman, A New, Fast and Efficient Image Codec Based on Set Partitioning in Hierarchical Trees. IEEE Transactions on Circuits and Systems for Video Technology, 6:243-250, 1996
• J.M. Shapiro, Embedded Image Coding Using Zerotrees of Wavelets Coefficient. IEEE Transactions on Signal Processing. 41:3445-3462, 1993
• Warner, Serfoss, Hubbard, In: Effects of Area-of-Interest Display Characteristics on Visual Search Performance and Head Movements in Simulated Low-Level Flight, Al-TR-1993-0023, Armstrong Laboratory, Human Resources Directorate, Aircrew Training Division, Williams AFB, AZ, 1993
• Wassel, Grunert, Rohrenbeck, Boycott, "Retinal Ganglion Cell Density and Cortical Magnification Factor in the Primate," Vision Research, 30:1897-1911, 1990
• Weiman, "Video Compression Via Log Polar Mapping." SPIE Proceedings: Real Time Image Processing II, 1295-266-277, 1990
• Wilson, Levi, Maffei, Rovamo, Devalois, "The Perception of Form: Retina to Striate Cortex," In: Visual Perception: The Neurophysiological Foundations, L.S. and J.S. Werner, eds., San Diego, Academic Press, 232-272, 199