Abstract
A reinforcement schedule states a rule for obtaining reinforcement as a function of behavior actually emitted and perhaps as a function of additional variables. These functions are here called “feedback functions.” Behavior actually emitted is, in turn, a function of obtained reinforcement. This reciprocal interdependency was quantified for an experiment in which pigeons chose among either three or two alternatives. Shifting from three to two alternatives, and vice versa, produced changes in the distribution of responding which were approximately accounted for by equations that combined the feedback functions with the matching law for reinforced responding. These equations predicted, among other things, a violation of the constant-ratio rule of formal choice theory and an absence of simultaneous contrast effects between response alternatives reinforced on variable-interval schedules. Both predictions were approximately confirmed.
Article PDF
Similar content being viewed by others
References
Atkinson, R. C., Bower, G. H., &Crothers, E. J. An introduction to mathematical learning theory. New York: Wiley, 1965.
Baum, W, M. The correlation-based law of effect.Journal of the Experimental Analysis of Behavior, 1973,20, 137–153.
Catania, A. C. Concurrent operants. In W. K. Honig (Ed.),Operant behavior. New York: Appleton-Century-Crofts, 1966.
de Villiers, P. A. Choice in concurrent schedules and a quantitative formulation of the law of effect. In W. K. Honig & J. E. R. Staddon (Eds.),Handbook of operant behavior, Englewood Cliffs, N.J: Prentice-Hall, 1977.
de Villiers, P. A., &Herrnstein, R. J. Toward a law of response strength.Psychological Bulletin, 1976,83, 1131–1153.
Fleshler, M., &Hoffman, H. S. A progression for generating variable interval schedules.Journal of the Experimental Analysis of Behavior, 1962,5, 529–530.
Herrnstein, R. J. On the law of effect.Journal of the Experimental Analysis of Behavior, 1970,13, 243–266.
Herrnstein, R. J. Formal properties of the matching law.Journal of the Experimental Analysis of Behavior, 1974,21, 159–164.
Herrnstein, R. J., &Loveland, D. H. Maximizing and matching on concurrent ratio schedules.Journal of the Experimental Analysis of Behavior, 1975,24, 107–116.
Luce, R. D. Individual choice behavior. New York: Wiley, 1959.
Luce, R. D. The choice axiom after twenty years.Journal of Mathematical Psychology, 1977,15, 215–233.
Author information
Authors and Affiliations
Additional information
This work was supported by Grant MH-15494 from the NIMH to Harvard University.
Rights and permissions
About this article
Cite this article
Prelec, D., Herrnstein, R.J. Feedback functions for reinforcement: A paradigmatic experiment. Animal Learning & Behavior 6, 181–186 (1978). https://doi.org/10.3758/BF03209598
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03209598