U.S. patents available from 1976 to present.
U.S. patent applications available from 2005 to present.

Unsupervised neural network classification with back propagation

Patent 5590218 Issued on December 31, 1996. Estimated Expiration Date: Icon_subject June 7, 2015. Estimated Expiration Date is calculated based on simple USPTO term provisions. It does not account for terminal disclaimers, term adjustments, failure to pay maintenance fees, or other factors which might affect the term of a patent.

Patent References

Method and apparatus for learning in a neural network
Patent #: 5226092
Issued on: 07/06/1993
Inventor: Chen

Method and apparatus for diagnosis of breast tumors
Patent #: 5260871
Issued on: 11/09/1993
Inventor: Goldberg

Method and apparatus for determining and organizing feature vectors for neural network recognition
Patent #: 5274714
Issued on: 12/28/1993
Inventor: Hutcheson, et al.

Neural network apparatus Patent #: 5283838
Issued on: 02/01/1994
Inventor: Togawa, et al.

Inventor

Assignee

Application

No. 481108 filed on 06/07/1995

US Classes:

382/157, Network learning techniques (e.g., back propagation)128/925, Neural network706/20, Classification or recognition706/25Learning method

Examiners

Primary: Mancuso, Joseph
Assistant: Patel, Rajnikant B.

Attorney, Agent or Firm

International Class

G06K 009/62

Abstract

An unsupervised back propagation method for training neural networks. For a set of inputs, target outputs are assigned l's and O's randomly or arbitrarily for a small number of outputs. The learning process is initiated and the convergence of outputs towards targets is monitored. At intervals, the learning is paused, and the values for those targets for the outputs which are converging at a less than average rate, are changed (e.g., 0→1, or 1→0), and the learning is then resumed with the new targets. The process is continuously iterated and the outputs converge on a stable classification, thereby providing unsupervised back propagation. In a further embodiment, samples classified with the trained network may serve as the training sets for additional subdivisions to grow additional layers of a hierarchical classification tree which converges to indivisible branch tips. After training is completed, such a tree may be used to classify new unlabelled samples with high efficiency. In yet another embodiment, the unsupervised back propagation method of the present invention may be adapted to classify fuzzy sets.

Other References

  • International Search Report of PCT/US/9411803
  • Ultrasonics, vol. 30, No. 5, 1992, Guildford GB, pp. 317-324; Damarla, "A self-learning neural net for ultrasonic signal analysis" see p. 317, left column, line 1-p. 320, left col., line 20; figures 1-2
  • IEEE Transactions on Computers, vol. 40, No. 12, Dec. 1991, New York US pp. 1320-1336, LIN "Neural-network-based fuzzy logic control and decision system" see abstract, see p. 1325, left col., line 28-p. 1327-right col., line 37; figures 2-5
  • Proceedings: Applications of Artificial Neural Networks 3, vol. 1709/1, 21 Apr. 1992, Orlando, USA pp. 174-181; Shen "Application of neural networks to hyper-spectral image analysis and interpretation"; see p. 176, line 14-p. 177, line 8; figure 2
  • 1991 IEEE International Joint Conference on Neural Networks, vol. 2, 18 Nov. 1991, Singapore pp. 1554-1559 Mills "Reinforcement learning using bavk-propagation as a building block" see the whole documen
PatentsPlus Images
Enhanced PDF formats
loading...
PatentsPlus: add to cart
PatentsPlus: add to cartSearch-enhanced full patent PDF image
$9.95more info
PatentsPlus: add to cart
PatentsPlus: add to cartIntelligent turbocharged patent PDFs with marked up images
$18.95more info
 
Sign InRegister
Username  
Password   
forgot password?