Please use this identifier to cite or link to this item:
Appears in Collections:Psychology Journal Articles
Peer Review Status: Refereed
Title: Activation functions, computational goals, and learning rules for local processors with contextual guidance
Author(s): Kay, James W
Phillips, William
Contact Email:
Issue Date: 15-May-1997
Date Deposited: 28-Sep-2016
Citation: Kay JW & Phillips W (1997) Activation functions, computational goals, and learning rules for local processors with contextual guidance. Neural Computation, 9 (4), pp. 895-910.
Abstract: Information about context can enable local processors to discover latent variables that are relevant to the context within which they occur, and it can also guide short-term processing. For example, Becker and Hinton (1992) have shown how context can guide learning, and Hummel and Biederman (1992) have shown how it can guide processing in a large neural net for object recognition. This article studies the basic capabilities of a local processor with two distinct classes of inputs: receptive field inputs that provide the primary drive and contextual inputs that modulate their effects. The contextual predictions are used to guide processing without confusing them with receptive field inputs. The processor's transfer function must therefore distinguish these two roles. Given these two classes of input, the information in the output can be decomposed into four disjoint components to provide a space of possible goals in which the unsupervised learning of Linsker (1988) and the internally supervised learning of Becker and Hinton (1992) are special cases. Learning rules are derived from an information-theoretic objective function, and simulations show that a local processor trained with these rules and using an appropriate activation function has the elementary properties required.
DOI Link: 10.1162/neco.1997.9.4.895
Rights: Publisher policy allows this work to be made available in this repository. Published in Neural Computation (1997) Vol. 9, No. 4, Pages 895-910. Copyright MIT Press:

Files in This Item:
File Description SizeFormat 
KayandPhillips-NeuralComputation-1997.pdfFulltext - Published Version253.24 kBAdobe PDFView/Open

This item is protected by original copyright

Items in the Repository are protected by copyright, with all rights reserved, unless otherwise indicated.

The metadata of the records in the Repository are available under the CC0 public domain dedication: No Rights Reserved

If you believe that any material held in STORRE infringes copyright, please contact providing details and we will remove the Work from public display in STORRE and investigate your claim.