U.S. patents available from 1976 to present.
U.S. patent applications available from 2005 to present.

Classification method and apparatus based on boosting and pruning of multiple classifiers

Patent 6456991 Issued on September 24, 2002. Estimated Expiration Date: Icon_subject September 1, 2019. Estimated Expiration Date is calculated based on simple USPTO term provisions. It does not account for terminal disclaimers, term adjustments, failure to pay maintenance fees, or other factors which might affect the term of a patent.

Patent References

Neural network model in pattern recognition using probabilistic contextual information
Patent #: 4876731
Issued on: 10/24/1989
Inventor: Loris, et al.

System for self-organization of stable category recognition codes for analog input patterns
Patent #: 4914708
Issued on: 04/03/1990
Inventor: Carpenter, et al.

Neural network apparatus and method for pattern recognition
Patent #: 5058180
Issued on: 10/15/1991
Inventor: Khan

Method for operating an optimal weight pruning apparatus for designing artificial neural networks
Patent #: 5636326
Issued on: 06/03/1997
Inventor: Stork, et al.

Method and system for training a neural network with adaptive weight updating and adaptive pruning in principal component space
Patent #: 5812992
Issued on: 09/22/1998
Inventor: de Vries

Apparatus and methods for machine learning hypotheses
Patent #: 5819247
Issued on: 10/06/1998
Inventor: Freund, et al.

Neural network/conceptual clustering fraud detection architecture
Patent #: 5822741
Issued on: 10/13/1998
Inventor: Fischthal

Classifying system having a single neural network architecture for multiple input representations
Patent #: 5859925
Issued on: 01/12/1999
Inventor: Yaeger, et al.

Computer input stylus method and apparatus
Patent #: 5914708
Issued on: 06/22/1999
Inventor: LaGrange, et al.

Method for improvement accuracy of decision tree based text categorization Patent #: 6253169
Issued on: 06/26/2001
Inventor: Apte, et al.

Inventors

Assignee

Application

No. 388858 filed on 09/01/1999

US Classes:

706/20, Classification or recognition704/9, Natural language706/16, Learning task706/25Learning method

Examiners

Primary: Starks, Wilbert L. Jr.

Attorney, Agent or Firm

International Class

G06N 003/02

Abstract

A boosting and pruning system and method for utilizing a plurality of neural networks, preferably those based on adaptive resonance theory (ART), in order to increase pattern classification accuracy is presented. The method utilizes a plurality of N randomly ordered copies of the input data, which is passed to a plurality of sets of booster networks. Each of the plurality of N randomly ordered copies of the input data is divided into a plurality of portions, preferably with an equal allocation of the data corresponding to each class for which recognition is desired. The plurality of portions is used to train the set of booster networks. The rules generated by the set of booster networks are then pruned in an intra-booster pruning step, which uses a pair-wise Fuzzy AND operation to determine rule overlap and to eliminate rules which are sufficiently similar. This process results in a set of intra-booster pruned booster networks. A similar pruning process is applied in an inter-booster pruning process, which eliminates rules from the intra-booster pruned networks with sufficient overlap. The final, derivative booster network captures the essence of the plurality of sets of booster networks and provides for higher classification accuracy than available using a single network.

Other References

  • Wei Fan, Salvatore J. Stolfo, Junxin Zhang, The application of AdaBoost for distributed, scalable and on-line learning, Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining, Aug. 1999, pp. 362-366.
  • Yoav Freund and Robert E. Schapire, A short introduction to boosting, Journal of Japanese Society for Artificial Intelligence, 14(5):771-780, Sep., 1999. (Appearing in Japanese, translation by Naoki Abe.).
  • F. Hoffmann, Boosting a Genetic Fuzzy Classifier, IFSA/NAFIPS 2001, Vancouver, Canada, Jul. 25-28th, 2001, pp. 1-6.
  • Jonas S. Karlsson, Martin L. Kersten, O-Storage: A Self Organizing Multi-Attribute Storage Technique for Very Large Main Memories, Australasian Database Conference 2000: 57-64.
  • Say Wei Foo; Eng Guan Lim, Speaker recognition using adaptively boosted classifier, Electrical and Electronic Technology, 2001. TENCON. Proceedings of IEEE Region 10 International Conference on, vol.: 1, Aug. 19-22, 2001, pp.: 442-446.
  • Murphey, Y.L.; Zhihang Chen; Hong Guo, Neural learning using AdaBoost, Neural Networks, Jul. 15-19, 2001, Proceedings. IJCNN '01. International Joint Conference on, vol.: 2, 2001 pp.: 1037-1042 vol. 2.
  • Zhao, Q.; Principe, J.C., Support vector machines for SAR automatic target recognition, Aerospace and Electronic Systems, IEEE Transactions on, vol.: 37 Issue: 2, Apr. 2001, pp.: 643-654.
  • Schwenk, H., Using boosting to improve a hybrid HMM/neural network speech recognizer, Acoustics, Speech, and Signal Processing, 1999. Proceedings., 1999 IEEE International Conference on, vol.: 2, Mar. 15-19, 1999, pp.: 1009-1012, vol. 2.
  • T.W. Freeman, K. Tanaka, J. Ohta, and K. Kyuma, "Computer Vision for Computer Games", IEEE2nd Intl. Conf. On Automatic Face and Gesture Recognition, 1996
  • H. Drucker, R. Schapire, and P. Simard, "Boosting Performance in Neural Networks", International Journal of Pattern Recognition and Artificial Intelligence vol. 7, No. 4 (1993) 705-719
  • N. Srinivasa, "Learning and Generalization of Noisy Mapping Using a Modified PROBART Neural Network", IEEE Transactions on Signal Processing vol. 45, No. 10, pp. 2533-2550, Oct. 1997
  • G.A. Carpenter, S. Grossberg, N.Markuzon, J.H. Reynolds, and D.B. Rosen, "Fuzzy Artmap: A Neural Network Architecture for Incremental Supervised Learning of Analog Multidimensional Maps", IEEE Transactions on Neural Networks, vol. 2, pp. 698-712, 1992
  • S. Shafer et al., "The new easylifing project at Microsoft research", Jul. 1998, Smart Spaces Workshop
  • N. Srinivasa and N. Ahuja, "A topological and temporal correlator network for spatiotemporal pattern learning, recognition, and recall", Mar. 1999, IEEE Transaction on Neural Networks, vol. 10, No. 2, pp. 356-371
  • S. Niyogi and W.T. Freeman, "Example-Based Head Tracking", IEEE 2nd Intl. Conf. On Automatic Face and Gesture Recognition, Oct. 1996
  • K. Kyuma et al., "Artificial retinas--fast, versatile image processors", 1994, Nature: Intl. Weekly Journal of Science
  • Y. Aloimonos and A. Rosenfeld, "Computer Vision", Science, Sep. 13, 1991, p. 124
PatentsPlus Images
Enhanced PDF formats
loading...
PatentsPlus: add to cart
PatentsPlus: add to cartSearch-enhanced full patent PDF image
$9.95more info
PatentsPlus: add to cart
PatentsPlus: add to cartIntelligent turbocharged patent PDFs with marked up images
$16.95more info
 
Sign InRegister
Username  
Password   
forgot password?