Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors
- Published:
- Volume 23, pages 121β134 (1976)
- Cite this article
Abstract
This paper analyses a model for the parallel development and adult coding of neural feature detectors. The model was introduced in Grossberg (1976). We show how experience can retune feature detectors to respond to a prescribed convex set of spatial patterns. In particular, the detectors automatically respond to average features chosen from the set even if the average features have never been experienced. Using this procedure, any set of arbitrary spatial patterns can be recoded, or transformed, into any other spatial patterns (universal recoding), if there are sufficiently many cells in the network's cortex. The network is built from short term memory (STM) and long term memory (LTM) mechanisms, including mechanisms of adaptation, filtering, contrast enhancement, tuning, and nonspecific arousal. These mechanisms capture some experimental properties of plasticity in the kitten visual cortex. The model also suggests a classification of adult feature detector properties in terms of a small number of functional principles. In particular, experiments on retinal dynamics, including amarcrine cell function, are suggested.
This is a preview of subscription content, to check access.
Access this article
Subscribe and save
- Starting from 10 chapters or articles per month
- Access and download chapters and articles from more than 300k books and 2,500 journals
- Cancel anytime
Buy Now
Price excludes VAT (USA)
Tax calculation will be finalised during checkout.
Instant access to the full article PDF.
Similar content being viewed by others
Improving the transferability of adversarial examples with path tuning
Explore related subjects
Discover the latest articles, books and news in related subjects, suggested using machine learning.References
Barlow, H.B., Pettigrew, J.D.: Lack of specificity of neurones in the visual cortex of young kittens. J. Physiol. (Lond.) 218, 98β100 (1971)
Bennett, M.V.L.: Analysis of parallel excitatory and inhibitory synaptic channels. J. Neurophysiol. 34, 69β75 (1971)
Blackenship, J.E., Wachtel, H., Kandel, E.R.: Ionic mechanisms of excitatory, inhibitory, and dual synaptic actions mediated by an identified interneuron in abdominal ganglion of Aplysia. J. Neurophysiol. 34, 76β92 (1971)
Blakemore, C., Cooper, G.F.: Development of the brain depends on the visual environment. Nature (Lond.) 228, 477β478 (1970)
Blakemore, C., Mitchell, D.E.: Environmental modification of the visual cortex and the neural basis of learning and memory. Nature (Lond.) New Biol. 241, 467β468 (1973)
Boycott, B.B., Dowling, J.E.: Organization of the primate retina: light microscopy. Phil. Trans. roy. Soc. B. 255, 109β184 (1969)
Ellias, S.A., Grossberg, S.: Pattern formation, contrast control, and oscillations in the short term memory of shunting on-center off-surround networks. Biol. Cybernetics 20, 69β98 (1975)
Freeman, W. J.: Neural coding through mass action in the olfactory system. Proceeding IEEE Conference on biologically motivated automata theory 1974
Gierer, A., Meinhardt, H.: A theory of biological pattern formation. Kybernetik 12, 30β39 (1972)
Greenspan, H.P., Benney, D.J.: Calculus. New York: McGraw-Hill 1973
Grossberg, S.: Nonlinear difference-differential equations in prediction and learning theory. Proc. nat. Acad. Sci. (Wash.) 58, 1329β1334 (1967)
Grossberg, S.: Some networks that can learn, remember, and reproduce any number of complicated space-time patterns, II. Stud. appl. Math. 49, 135β166 (1970a)
Grossberg, S.: Neural pattern discrimination. J. theor. Biol. 27, 291β337 (1970b)
Grossberg, S.: Pavlovian pattern learning by nonlinear neural networks. Proc. nat. Acad. Sci. (Wash.) 68, 828β831 (1971)
Grossberg, S.: Neural expectation: cerebellar and retinal analogs of cells fired by learnable or unlearned pattern classes. Kybernetik 10, 49β57 (1972)
Grossberg, S.: Contour enhancement, short term memory, and constancies in reverberating neural networks. Stud. appl. Math. 52, 213β257 (1973)
Grossberg, S.: Classical and instrumental learning by neural networks. In: Rosen, R. and Snell, F. (Eds.): Progress in Theoretical Biology, pp. 51β141. New York: Academic Press 1974
Grossberg, S.: A neural model of attention, reinforcement, and discrimination learning. Int. Rev. Neurobiol. 18, 263β327 (1975)
Grossberg, S.: On the development of feature detectors in the visual cortex with applications to learning and reaction-diffusion systems. Biol. Cybernetics 21, 145β159 (1976)
Grossberg, S., Levine, D.S.: Some developmental and attentional biases in the contrast enhancement and short term memory of recurrent neural networks. J. theor. Biol. 53, 341β380 (1975)
Hebb, D.O.: The organization of behavior. New York: Wiley 1949
Hirsch, H.V.B., Spinelli, D.N.: Visual experience modifies distribution of horizontally and vertically oriented receptive fields in cats. Science 168, 869β871 (1970)
Hirsch, H.V.B., Spinelli, D.N.: Modification of the distribution of receptive field orientation in cats by selective visual exposure during development. Exp. Brain Res. 12, 509β527 (1971)
Hubel, D.H., Wiesel, T.N.: The period of susceptibility to the physiological effects of unilateral eye closure in kittens. J. Physiol. (Lond.) 206, 419β436 (1970)
Kimble, G.A.: Foundations of conditioning and learning. New York: Appleton-Century-Crofts 1967
Levine, D.S., Grossberg, S.: Visual illusions in neural networks: line neutralization, tilt aftereffect, and angle expansion. J. theor. Biol., in press (1976)
Meinhardt, H., Gierer, A.: Applications of a theory of biological pattern formation based on lateral inhibition. J. Cell. Sci. 15, 321β346
PΓ©rez, R., Glass, L., Shlaer, R.: Development of specificity in the cat visual cortex. J. math. Biol. (1974)
Von der Malsburg, C.: Self-organization of orientation sensitive cells in the striate cortex. Kybernetik 14, 85β100 (1973)
Wachtel, H., Kandel, E.R.: Conversion of synaptic excitation to inhibition at a dual chemical synapse. J. Neurophysiol. 34, 56 (1971)
Wiesel, T.N., Hubel, D.H.: Single-cell responses in striate cortex of kittens deprived of vision in one eye. J. Neurophysiol. 26, 1003β1017 (1963)
Wiesel, T.N., Hubel, D.H.: Comparison of the effects of unilateral and bilateral eye closure on cortical unit responses in kittens. J. Neurophysiol. 28, 1029β1040 (1965)
Additional information
Supported in part by the Advanced Research Projects Agency under ONR Contract No. N00014-76-C-0185
Rights and permissions
About this article
Cite this article
Grossberg, S. Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors. Biol. Cybernetics 23, 121β134 (1976). https://doi.org/10.1007/BF00344744
Received:
Revised:
Issue date:
DOI: https://doi.org/10.1007/BF00344744
Share this article
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
