Abstract
The implementation of the Gallistel (1990) model of classical conditioning on a spreadsheet with matrix operations is described. The model estimates the Poisson rate of unconditioned stimulus (US) occurrence in the presence of each conditioned stimulus (CS). The computations embody three implicit principles:additivity (of the rates predicted by each CS),provisional stationarity (the rate predicted by a given CS has been constant over all the intervals when that CS was present), andpredictor minimization (when more than one solution is possible, the model minimizes the number of CSs with a nonzero effect on US rate). The Kolmogorov-Smirnov statistic is used to test for non-stationarity. There are no free parameters in the learning model itself and only two parameters in the formally specified decision process, which translates what has been leamed into conditioned responding. The model predicts a wide range of conditioning phenomena, notably: blocking, overshadowing, overprediction, predictive sufficiency, inhibitory conditioning, latent inhibition, the invariance in the rate of conditioning under scalar transformation of CS-US and US-US intervals, and the effects of partial reinforcement on acquisition and extinction.
Article PDF
Similar content being viewed by others
References
Gallistel, C. R. (1990).The organization of learning. Cambridge, MA: Bradford Books/MIT Press.
Gallistel, C. R. (in press). Classical conditioning as an adaptive specialization: A computational model. In D. L. Medin (Ed.),The psychology of learning and motivation. New York: Academic Press.
Gibbon, J., Baldock, M. D., Locurto, C. M., Gold, L., &Terrace, H. S. (1977). Trial and intertriai durations in autoshaping.Journal of Experimental Psychology: Animal Behavior Processes,3, 264–284.
Gibbon, J., &Balsam, P. (1981). Spreading associations in time. In C. M. Locurto, H. S. Terrace, & J. Gibbon (Ed.),Autoshaping and conditioning theory (pp. 219–253). New York: Academic Press.
Gibbon, J., Farrell, L., Locurto, C. M., Duncan, H. J., &Terrace H. S. (1980). Partial reinforcement in autoshaping with pigeons.Animal Learning & Behavior,8, 45–59.
Goddard, M. J., &Jenkins, H. M. (1987). Effect of signaling extra unconditioned stimuli on autoshaping.Animal Learning & Behavior,15, 40–46.
Kamin, L. J. (1967). “Attention-like” processes in classical conditioning. In M. R. Jones (Ed),Miami Symposium on the Prediction of Behavior: Aversive stimulation (pp. 9–33). Miami, FL: University of Miami Press.
Kamin, L. J. (1969). Predictability, surprise, attention, and conditioning. In B. A. Campbell & R. M. Church (Ed.),Punishment and aversive behavior (pp. 276–296). New York: Appleton-Century-Crofts.
Kremer, E. F. (1978). The Rescorla-Wagner model: Losses in associative strength in compound conditioned stimuli.Journal of Experimental Psychology: Animal Behavior Processes,4, 22–36.
Reiss, S., &Wagner, A. R. (1972). CS habituation produces a “latent inhibition effect” but no active “conditioned inhibition.”Learning & Motivation,3, 237–245.
Rescorla, R. A. (1968). Probability of shock in the presence and absence of CS in fear conditioning.Journal of Comparative & Physiological Psychology,66, 1–5.
Rescorla, R. A. (1984). Signaling intertriai shocks attenuates their negative effect on conditioned suppression.Bulletin of the Psychonomic Society,22, 225–228.
Robbins, S. J., &Rescorla, R. A. (1989). The role of signaled periods of nonreinforcement in responding on a random schedule in autoshaping.Animal Learning & Behavior,17, 304–310.
Wagner, A. R., Logan, F. A., Haberlandt, K., &Price, T. (1968). Stimulus selection in animal discrimination learning.Journal of Experimental Psychology,76, 171–180.
Author information
Authors and Affiliations
Additional information
I am grateful to Tom Wickens for discussions that led to the algorithm for testing stationarity. The costs of creating this spreadsheet and preparing the manuscript were partially covered by NSF Grant BNS89-96246.
Rights and permissions
About this article
Cite this article
Gallistel, C.R. Classical conditioning as a nonstationary, multivariate time series analysis: A spreadsheet model. Behavior Research Methods, Instruments, & Computers 24, 340–351 (1992). https://doi.org/10.3758/BF03203518
Issue Date:
DOI: https://doi.org/10.3758/BF03203518