Global Information Lookup Global Information

Neocognitron information


The neocognitron is a hierarchical, multilayered artificial neural network proposed by Kunihiko Fukushima in 1979.[1] It has been used for Japanese handwritten character recognition and other pattern recognition tasks, and served as the inspiration for convolutional neural networks.[2]

The neocognitron was inspired by the model proposed by Hubel & Wiesel in 1959. They found two types of cells in the visual primary cortex called simple cell and complex cell, and also proposed a cascading model of these two types of cells for use in pattern recognition tasks.[3][4]

The neocognitron is a natural extension of these cascading models. The neocognitron consists of multiple types of cells, the most important of which are called S-cells and C-cells.[5] The local features are extracted by S-cells, and these features' deformation, such as local shifts, are tolerated by C-cells. Local features in the input are integrated gradually and classified in the higher layers.[6] The idea of local feature integration is found in several other models, such as the Convolutional Neural Network model, the SIFT method, and the HoG method.

There are various kinds of neocognitron.[7] For example, some types of neocognitron can detect multiple patterns in the same input by using backward signals to achieve selective attention.[8]

  1. ^ Fukushima, Kunihiko (October 1979). "位置ずれに影響されないパターン認識機構の神経回路のモデル --- ネオコグニトロン ---" [Neural network model for a mechanism of pattern recognition unaffected by shift in position — Neocognitron —]. Trans. IECE (in Japanese). J62-A (10): 658–665.
  2. ^ LeCun, Yann; Bengio, Yoshua; Hinton, Geoffrey (2015). "Deep learning" (PDF). Nature. 521 (7553): 436–444. Bibcode:2015Natur.521..436L. doi:10.1038/nature14539. PMID 26017442. S2CID 3074096.
  3. ^ David H. Hubel and Torsten N. Wiesel (2005). Brain and visual perception: the story of a 25-year collaboration. Oxford University Press US. p. 106. ISBN 978-0-19-517618-6.
  4. ^ Hubel, DH; Wiesel, TN (October 1959). "Receptive fields of single neurones in the cat's striate cortex". J. Physiol. 148 (3): 574–91. doi:10.1113/jphysiol.1959.sp006308. PMC 1363130. PMID 14403679.
  5. ^ Fukushima 1987, p. 83.
  6. ^ Fukushima 1987, p. 84.
  7. ^ Fukushima 2007.
  8. ^ Fukushima 1987, pp. 81, 85.

and 21 Related for: Neocognitron information

Request time (Page generated in 0.5414 seconds.)

Neocognitron

Last Update:

The neocognitron is a hierarchical, multilayered artificial neural network proposed by Kunihiko Fukushima in 1979. It has been used for Japanese handwritten...

Word Count : 547

Kunihiko Fukushima

Last Update:

Systems Institute in Fukuoka, Japan. In 1980, Fukushima published the neocognitron, the original deep convolutional neural network (CNN) architecture. Fukushima...

Word Count : 790

AlexNet

Last Update:

"Neocognitron". Scholarpedia. 2 (1): 1717. Bibcode:2007SchpJ...2.1717F. doi:10.4249/scholarpedia.1717. Fukushima, Kunihiko (1980). "Neocognitron: A...

Word Count : 982

Convolutional neural network

Last Update:

The "neocognitron" was introduced by Kunihiko Fukushima in 1980. It was inspired by the above-mentioned work of Hubel and Wiesel. The neocognitron introduced...

Word Count : 15065

History of artificial neural networks

Last Update:

different parts of the body. The origin of the CNN architecture is the "neocognitron" introduced by Kunihiko Fukushima in 1980. It was inspired by work of...

Word Count : 6436

Timeline of machine learning

Last Update:

shift in position — Neocognitron —]. Trans. IECE (in Japanese). J62-A (10): 658–665. Fukushima, Kunihiko (April 1980). "Neocognitron: A self-organizing...

Word Count : 1501

Types of artificial neural networks

Last Update:

of SNNs are the OSFA spatial neural networks, SVANNs and GWNNs. The neocognitron is a hierarchical, multilayered network that was modeled after the visual...

Word Count : 10294

Hierarchical temporal memory

Last Update:

described in the December 2005 issue of the Artificial Intelligence journal. Neocognitron, a hierarchical multilayered neural network proposed by Professor Kunihiko...

Word Count : 3571

Unsupervised learning

Last Update:

proposed by WA Little [de] for cognition 1980 Fukushima introduces the neocognitron, which is later called a convolutional neural network. It is mostly used...

Word Count : 2467

Handwriting recognition

Last Update:

Intelligent character recognition Live Ink Character Recognition Solution Neocognitron Optical character recognition Pen computing Sketch recognition Stylus...

Word Count : 2285

Cognitive architecture

Last Update:

Conceptual space Deep learning Google Brain Image schema Knowledge level Neocognitron Neural correlates of consciousness Pandemonium architecture Simulated...

Word Count : 1252

Deep learning

Last Update:

(CNNs) with convolutional layers and downsampling layers began with the Neocognitron introduced by Kunihiko Fukushima in 1980. In 1969, he also introduced...

Word Count : 17592

Computer vision

Last Update:

analysis and classification) have their background in neurobiology. The Neocognitron, a neural network developed in the 1970s by Kunihiko Fukushima, is an...

Word Count : 7528

List of computer scientists

Last Update:

computational theoretical physics Ping Fu Xiaoming Fu Kunihiko Fukushima – neocognitron, artificial neural networks, convolutional neural network architecture...

Word Count : 5140

Torsten Wiesel

Last Update:

support collaborative research between scientists in Israel and Palestine. Neocognitron Hubel, David; Wiesel, Torsten (2012). "David Hubel and Torsten Wiesel"...

Word Count : 1894

Pattern recognition

Last Update:

theory List of numerical-analysis software List of numerical libraries Neocognitron Perception Perceptual learning Predictive analytics Prior knowledge for...

Word Count : 4267

Learning rule

Last Update:

tend to belong to multiple categories of learning methods - Hebbian - Neocognitron, Brain-state-in-a-box Gradient Descent - ADALINE, Hopfield Network, Recurrent...

Word Count : 1197

Juyang Weng

Last Update:

3D) is very different from the Neocognitron (for 2D) because the Cresceptron is a fundamental departure from Neocognitron. Cresceptron enables a neural...

Word Count : 2895

Machine learning in bioinformatics

Last Update:

Learning. New York: Springer. ISBN 978-0-387-31073-2. Fukushima K (2007). "Neocognitron". Scholarpedia. 2 (1): 1717. Bibcode:2007SchpJ...2.1717F. doi:10.4249/scholarpedia...

Word Count : 8082

How to Create a Mind

Last Update:

theory behind PRTM is "in the spirit of" a model of vision known as the neocognitron, introduced in 1980. He also says PRTM even more strongly resembles Hierarchical...

Word Count : 2920

1980 in science

Last Update:

London: Springer. ISBN 978-1-85233-532-8. Fukushima, Kunihiko (1980). "Neocognitron: A Self-organizing Neural Network Model for a Mechanism of Pattern Recognition...

Word Count : 1440

PDF Search Engine © AllGlobal.net