Abstract
Timing of conditioned keypecking was investigated using a delay autoshaping procedure. In two experiments, the CS-US interval (ISI) was varied and the temporal pattern of responding during unreinforced probe trials extending beyond the reinforced ISI was recorded. Both experiments showed temporal control of keypecking at ISIs of 4, 8, and 16 sec, regardless of whether the probe duration was held constant (Experiment 1) or covaried with the ISI (Experiment 2). Analyses showed that the timing of keypecking was scalar. Increased responding near the end of the probe was due possibly to independent timing of the probe duration. In a third experiment, a group of subjects trained at an ISI of 8 sec were extinguished by presentation of only probe trials. Although the maximal response rate declined progressively, timing of keypecking did not change.
Article PDF
Similar content being viewed by others
References
Amsel, A. (1992).Frustration theory: An analysis of dispositional learning and memory. Cambridge: Cambridge University Press.
Baron, A., &Lienenweber, A. (1994). Molecular and molar analyses of fixed-interval performance.Journal of the Experimental Analysis of Behavior,61, 11–18.
Bartha, G. T., Thompson, R. F., &Gluck, M. A. (1991). Sensorimotor learning and the cerebellum. In M. Arbib & J. Ewert (Eds.),Visual structure and integrated functions (pp. 381–396). New York: Springer-Verlag.
Bitterman, M. E. (1964). Classical conditioning in the goldfish as a function of the CS-US interval.Journal of Comparative & Physiological Psychology,58, 359–366.
Bitterman, M. E. (1965). The CS-US interval in classical and avoidance conditioning. In W. F. Prokasy (Ed.),Classical conditioning (pp. 1–19). New York: Appleton-Century-Crofts.
Boakes, R. A. (1977). Performance on learning to associate a stimulus with positive reinforcement. In H. Davis & H. M. B. Hurwitz (Eds.),Operant-Pavlovian interactions (pp. 67–101). Hillsdale, NJ: Erlbaum.
Brown, B. L., &Hemmes, N. S. (1997). Timing of the CS-US interval by pigeons in trace and delay autoshaping.Quarterly Journal of Experimental Psychology,50B, 43–50.
Brownstein, A. J., &Balsam, P. D. (1975). A search for conditioned reinforcement effects in negative automaintenance of keypecking.Bulletin of the Psychonomic Society,6, 165–168.
Catania, A. C. (1970). Reinforcement schedules and psychophysical judgements: A study of some temporal properties of behavior. In W. N. Shoenfeld (Ed.),The theory of reinforcement schedules (pp. 1–42). New York: Appleton-Century-Crofts.
Church, R. M., Meck, W. H., &Gibbon, J. (1994). Application of scalar timing theory to individual trials.Journal of Experimental Psychology: Animal Behavior Processes,20, 135–155.
Church, R. M., Miller, K. D., Meck, W. H., &Gibbon, J. (1991). Symmetrical and asymmetrical sources of variance in temporal generalization.Animal Learning & Behavior,19, 207–214.
Coleman, S. R., &Gormezano, I. (1971). Classical conditioning of the rabbit’s nictitating membrane response under symmetrical CS-US interval shifts.Journal of Comparative & Physiological Psychology,77, 447–455.
Deich, J. D., &Wasserman, E. A. (1977). Rate and temporal pattern of key pecking under autoshaping and omission schedules of reinforcement.Journal of the Experimental Analysis of Behavior,27, 399–405.
Desmond, J. E., &Moore, J.W. (1988). Adaptive timing in neural networks: The conditioned response.Biological Cybernetics,58, 405–415.
Desmond, J. E., &Moore, J. W. (1991). Altering the synchrony of stimulus trace processes: Tests of a neural-network model.Biological Cybernetics,65, 161–169.
Dews, P. B. (1978). Studies on responding under fixed-interval schedules of reinforcement: II. The scalloped pattern of the cumulative record.Journal of the Experimental Analysis of Behavior,29, 67–75.
Ferster, C. B., &Skinner, B. F. (1957).Schedules of reinforcement. New York: Appleton-Century-Crofts.
Fetterman, J. G., &Killeen, P. R. (1991). Adjusting the pacemaker.Learning & Motivation,22, 226–252.
Fiala, J. C., Grossberg, S., &Bullock, D. (1996). Metabotropic glutamate receptor activation in cerebellar Purkinje cells as substrate for adaptive timing of the classically conditioned eye-blink response.Journal of Neuroscience,16, 3760–3774.
Frey, P. W., &Ross, L. E. (1968). Classical conditioning of the rabbit eyelid response as a function of the interstimulus interval.Journal of Comparative & Physiological Psychology,65, 246–250.
Gallistel, C. R. (1990).The organization of learning. Cambridge, MA: MIT Press, Bradford Books.
Gallistel, C. R. (1992). Classical conditioning as an adaptive specialization: A computational model. In D. L. Medin (Ed.),The psychology of learning and motivation (Vol. 28, pp. 35–67). New York: Academic Press.
Gallistel, C. R., &Gibbon, J. (1998).Time and rate in classical conditioning. Unpublished manuscript.
Gibbon, J. (1972). Timing and discrimination of shock density in avoidance.Psychological Review,79, 68–92.
Gibbon, J. (1977). Scalar expectancy theory and Weber’s law in animal timing.Psychological Review,84, 279–325.
Gibbon, J. (1991). Origins of scalar timing.Learning & Motivation,22, 3–38.
Gibbon, J., &Balsam, P. D. (1981). Spreading association in time. In C. M. Locurto, H. S. Terrace, & J. Gibbon (Eds.),Autoshaping and conditioning theory (pp. 219–251). San Diego: Academic Press.
Gibbon, J., Farrell, L., Locurto, C. M., Duncan, H. J., &Terrace, H. S. (1980). Partial reinforcement in autoshaping with pigeons.Animal Learning & Behavior,8, 45–59.
Gormezano, I. (1972). Investigations of defense and reward conditioning in the rabbit. In A. Black & W. F. Prokasy (Eds.),Classical conditioning II (pp. 151–181). New York: Appleton-Century-Crofts.
Grossberg, S., &Merrill, J.W. L. (1992). A neural network model of adaptively timed reinforcement learning and hippocampal dynamics.Cognitive Brain Research,1, 3–38.
Hearst, E. (1969). Excitation, inhibition and discrimination learning. In N. J. Mackintosh & W. K. Honig (Eds.),Fundamental issues in associative learning (pp. 1–41). Halifax, NS: Dalhousie University Press.
Killeen, P. R., &Fetterman, J. G. (1988). A behavioral theory of timing.Psychological Review,95, 274–295.
Kirkpatrick-Steger, K., Miller, S. S., Betti, C. A., &Wasserman, E. A. (1996). Cyclic responding by pigeons on the peak timing procedure.Journal of Experimental Psychology: Animal Behavior Processes,22, 447–460.
Leak, T. M., &Gibbon, J. (1995). Simultaneous timing of multiple intervals: Implications for the scalar property.Journal of Experimental Psychology: Animal Behavior Processes,21, 3–19.
Longo, N., Klempay, S., &Bitterman, M. E. (1964). Classical appetitive conditioning in the pigeon.Psychonomic Science,1, 19–20.
Meck, W. H. (in press). Neuroanatomical localization of an internal clock: A functional link between mesolimbic-mesocortical and nigrostriatal dopaminergic systems.Behavioural Brain Research.
Moore, J. W., Desmond, J. E., &Berthier, N. E. (1989). Adaptively timed conditioned responses and the cerebellum: A neural network approach.Biological Cybernetics,62, 17–28.
Myerson, J., Myerson, W. A., &Parker, B. K. (1979). Automaintenance without stimulus-change reinforcement: Temporal control of keypecks.Journal of the Experimental Analysis of Behavior,31, 395–403.
Newlin, R. J., &LoLordo, V. M. (1976). A comparison of pecking generated by serial, delay, and trace autoshaping procedures.Journal of the Experimental Analysis of Behavior,25, 227–241.
O’Connell, J. M., &Rashotte, M. E. (1982). Reinforcement magnitude effects in first-order and second-order conditioning of directed action.Learning & Motivation,13, 1–25.
Pavlov, I. P. (1927).Conditioned reflexes (G.V. Anrep, Trans.). London: Oxford University Press.
Roberts, S. (1981). Isolation of an internal clock.Journal of Experimental Psychology: Animal Behavior Processes,7, 242–268.
Roberts, S., &Holder, M. D. (1984). What starts an internal clock?Journal of Experimental Psychology: Animal Behavior Processes,10, 273–296.
Rosas, J. M., &Alonso, G. (1996). Temporal discrimination and forgetting of CS duration in conditioned suppression.Learning & Motivation,27, 43–57.
Schneider, B. A. (1969). A two-state analysis of fixed-interval responding in the pigeon.Journal of the Experimental Analysis of Behavior,12, 677–687.
Schwartz, B. (1972). The role of positive conditioned reinforcement in the maintenance of keypecking which prevents delivery of primary reinforcement.Psychonomic Science,28, 277–278.
Shull, R. L., &Brownstein, A. J. (1970). Interresponse time duration in fixed-interval schedules of reinforcement: Control by ordinal position and time since reinforcement.Journal of the Experimental Analysis of Behavior,14, 49–53.
Siegel, A. (1967). Stimulus generalization of a classically conditioned response along a temporal dimension.Journal of Comparative & Physiological Psychology,64, 461–466.
Silva, F. J., Silva, K. M., &Pear, J. J. (1992). Sign-versus goal-tracking: Effects of conditioned-stimulus-to-unconditioned-stimulus distance.Journal of the Experimental Analysis of Behavior,57, 17–31.
Smith, M. C. (1968). The CS-US interval and US intensity in classical conditioning of the rabbit’s nictitating membrane response.Journal of Comparative & Physiological Psychology,66, 679–687.
Spence, K. W. (1937). The differential response in animals to stimuli varying within a single dimension.Psychological Review,44, 430–444.
Stokes, P. D., &Balsam, P. D. (1991). Effects of reinforcing preselected approximations on the topography of the rat’s bar press response.Journal of the Experimental Analysis of Behavior,55, 213–231.
Swartzentruber, D. (1995). Modulatory mechanisms in Pavlovian conditioning.Animal Learning & Behavior,23, 123–143.
van Hest, A., van Haaren, F., Kop, P., &van der Schoot, F. (1986). Stimulus- and feeder-directed behavior in a long-box: Effect of fixed versus variable time schedules of food presentation.Animal Learning & Behavior,14, 168–172.
Zeiler, M. D., &Powell, D. G. (1994). Temporal control in fixedinterval schedules.Journal of the Experimental Analysis of Behavior,61, 1–9.
Author information
Authors and Affiliations
Corresponding author
Additional information
The present report is based in part on a thesis submitted by the first author to Columbia University in partial fulfillment of the requirements for the Master’s degree. Portions of the data were presented at the annual meeting of the Eastern Psychological Association in Philadelphia, March 1996. We thank Kathy Kao, Elizabeth Pearson, and Heather Walker-Wilson for their assistance in conducting the experiments.
Rights and permissions
About this article
Cite this article
Ohyama, T., Gibbon, J., Deich, J.D. et al. Temporal control during maintenance and extinction of conditioned keypecking in ring doves. Animal Learning & Behavior 27, 89–98 (1999). https://doi.org/10.3758/BF03199434
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03199434