Gesture-modified diagram for retrieval of image resembling diagram, with parts selectable for further interactive retrieval
Patent 5010500 Issued on April 23, 1991. Estimated Expiration Date: January 26, 2009. Estimated Expiration Date is calculated based on simple USPTO term provisions. It does not account for terminal disclaimers, term adjustments, failure to pay maintenance fees, or other factors which might affect the term of a patent.
Recorded video segments are retrieved and displayed through a user interface that employs gestures. The user provides gestures by moving a mouse, and the resulting signals indicate a diagram. Data identifying the diagram is used to access a data structure to obtain data indicating which of a set of interactive line drawings includes features most closely resembling the diagram. The interactive line drawing with features closest to the diagram can then be displayed. When the user selects a part of the line drawing, a menu is displayed that includes a description of the video segments that relate to that part. To assist the user in providing gestural input, a preliminary diagram is displayed, reducing the amount of information the user must provide. The user can change parts of the diagram to obtain a modified diagram resembling features that appear in a desired line drawing. The diagrams and interactive line drawings can be displayed on a workstation display screen, while the video segments can be displayed on a video monitor screen by a video disk player under control of the workstation CPU.
Other References
APS Text Search and Retrieval Classroom Manual, Planning Research Corp., Chemical Abstract Services, 1986, pp. 1-16, 1-17
Makkuni, R., "Representing the Process of Composing Chinese Temples", Design Computing, vol. 1, No. 3, 1986, pp. 216-235
Makkuni, R., "A Gestural Representation of the Process of Composing Chinese Temples", IEEE Computer Graphics & Applications, vol. 7, No. 12, Dec. 1987, pp. 45-61
Williams, M. D., "What Makes RABBIT Run?", International Journal of Man-Machine Studies, vol. 21 (1984), pp. 333-352
Wilson, K. S., Palenque: An Interactive Multimedia Optical Disc Prototype for Children Bank Street College of Education Center for Children and Technology, Working Paper No. 2, Mar. 1987
Fisher, S. S., McGreevy, M., Humphries, J., and Robinett, W., "Virtual Environment Display System", presented at ACM Workshop on Interactive 3D Graphics, Chapel Hill, North Carolina, Oct. 1986
Sutherland, I. E., "Sketchpad, A Man-Machine Graphical Communication System", AFIPS Spring Joint Computer Conference, vol. 23, 1963, pp. 329-346
Brand, S., The Media Lab, Viking, New York, 1987, pp. 13-14, 35-50, 137-141
Bolt, R. A., The Human Interface, Lifetime Learning Publications, Belmont, California, 1984
Herot, C. F., "Spatial Management of Data", ACM Transactions on Database Systems, vol. 5, No. 4, Dec. 1980, pp. 493-514
Spence, R., and Aperley, M., "Data Base Navigation: An Office Environment for the Professional", Behavior and Information Technology, vol. 1, No. 1, 1982, pp. 43-54
Goldberg, A., Smalltalk-80, The Interactive Programming Environment, Addison-Wesley, Reading, Mass., 1984, pp. 1-49
Wilson, K. S., "Palenque: An Interactive Multimedia Digital Video Interactive Prototype for Children", ACM, CHI '88 Conference Proceedings, 1988, pp. 275-279
"Rumor Central", PC Week, Dec. 19, 1988, p. 132
Lewis, P. H., "The Executive Computer", The New York Times, Nov. 20, 1988, p. 1