Abstract
To assess the effects of discrepancy between two independent variables, investigators sometimes compute difference scores and correlate such scores with a criterion variable. However, the correlation of the difference with the criterion is accounted for by the correlations of the difference constituents with the criterion and the constituents’ variances. It follows that when investigators are testing a prediction that is not captured by the difference constituents’ main effects, using the difference correlation analysis may be misleading. Under these circumstances, the effects of a discrepancy between two independent variables can be assessed by a test of their interaction. The problems inherent in using difference scores and the advantage of testing the interaction are illustrated in relation to research programs on two separate topics in social psychology.
Article PDF
Similar content being viewed by others
References
Abelson, R. P., &Prentice, D. A. (1997). Contrast tests of interaction hypotheses.Psychological Methods,2, 315–328.
Aiken, L. S., &West, S. G. (1991).Multiple regression: Testing and interpreting interactions. Newbury Park, CA: Sage.
Asendorpf, J. B., &Ostendorf, F. (1998). Is self-enhancement healthy? Conceptual, psychometric, and empirical analysis.Journal of Personality & Social Psychology,74, 955–966.
Assor, A., Tzelgov, J., Thein, R., Ilardi, B. C., &Connell, J. P. (1990). Assessing the correlates of over- and underrating of academic competence: A conceptual classification and a methodological proposal.Child Development,61, 2085–2097.
Atkinson, J. W., &Feather, N. T. (Eds.) (1966).A theory of achievement motivation. New York: Wiley.
Atkinson, J. W., &Litwin, G. H. (1960). Achievement motive and test anxiety conceived as motive to approach success and motive to avoid failure.Journal of Abnormal & Social Psychology,60, 52–64.
Bem, D. J., &Allen, A. (1974). On predicting some of the people some of the time: The search for cross-situational consistencies in behavior.Psychological Review,81, 506–520.
Bernieri, F., Zuckerman, M., Koestner, R., &Rosenthal, R. (1994). Measuring person perception accuracy: Another look at self-other agreement.Personality & Social Psychology Bulletin,20, 367–378.
Brigham, J. C. (1993). College students’ racial attitudes.Journal of Applied Social Psychology,23, 1933–1967.
Cohen, F., &Hoberman, H. (1983). Positive events and social support as buffers of life change stress.Journal of Applied Social Psychology,13, 99–125.
Cohen, J., &Cohen, P. (1983).Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Hillsdale, NJ: Erlbaum.
Colvin, C. R., &Block, J. (1994). Do positive illusions foster mental health? An examination of the Taylor and Brown formulation.Psychological Bulletin,116, 3–20.
Colvin, C. R., Block, J., &Funder, D. C. (1995). Overly positive selfevaluation and personality: Negative implications for mental health.Journal of Personality & Social Psychology,68, 1152–1162.
Colvin, C. R., Block, J., &Funder, D. C. (1996). Psychometric truths in the absence of psychological meaning: A reply to Zuckerman and Knee.Journal of Personality & Social Psychology,70, 1252–1255.
Covington, M. W. (1992).Making the grade: A self-worth perspective on motivation and school reform. New York: Cambridge University Press.
Cronbach, L. J. (1955). Processes affecting scores on “underestimating of others” and “assumed similarity.”Psychological Bulletin,52, 177–193.
Deci, E. L., &Ryan, R. M. (1985). The General Causality Orientations Scale: Self-determination in personality.Journal of Research in Personality,19, 109–134.
Deci, E. L., &Ryan, R. M. (1991). A motivational approach to self: Integration in personality. In R. Dienstbier (Ed.),Nebraska symposium on motivation (Vol. 38, pp. 237–288). Lincoln: University of Nebraska Press.
Devine, P. G. (1989). Stereotypes and prejudice: Their automatic and controlled opponents.Journal of Personality & Social Psychology,56, 5–18.
Devine, P. G., Monteith, M. J., Zuwerink, J. R., &Elliot, A. J. (1991). Prejudice with and without compunction.Journal of Personality & Social Psycholog y,60, 817–830.
Dovidio, J. F., Kawakami, K., Johnson, C., Johnson, B., &Howard, A. (1997). On the nature of prejudice: Automatic and controlled processes.Journal of Experimental Social Psychology,33, 510–540.
Edwards, J. R. (1994). The study of congruence in organizational behavior research: Critique and a proposed alternative.Organizational Behavior & Human Decision Processes,58, 51–100.
Elliot, A. J. (1997). Integrating the “classic” and “contemporary” approaches to achievement motivation: A hierarchical model of approach and avoidance achievement motivation. In M. Maehr & P. Pintrich (Eds.),Advances in motivation and achievement (Vol. 10, pp. 143–179). Greenwich, CT: JAI Press.
Fenigstein, A., Scheier, M. F., &Buss, A. H. (1975). Public and private self-consciousness: Assessment and theory.Journal of Consulting & Clinical Psychology,43, 522–527.
Gage, N. L., &Cronbach, L. J. (1955). Conceptual and methodological problems in person-perception.Psychological Review,62, 411–422.
Gilbert, D., &Hixon, J. G. (1991). The trouble with thinking: Activation and application of stereotypic beliefs.Journal of Personality & Social Psycholog y,60, 509–517.
Goldberg, D. P., &Hillier, V. F. (1979). A scaled version of the General Health Questionnaire.Psychological Medicine,9, 139–145.
Griffin, D., Murray, S., &Gonzalez, R. (1999). Difference score correlations in relationship research: A conceptual primer.Personal Relationships,6, 505–518.
Johns, G. (1981). Difference score measures of organizational behavior variables: A critique.Organizational Behavior & Human Performance,27, 443–463.
Koestner, R., Bernieri, F., &Zuckerman, M. (1992). Self-determination and consistency between attitudes, traits, and behaviors.Personality & Social Psycholog y Bulletin,18, 52–59.
Koestner, R., &Zuckerman, M. (1994). Causality orientations, failure, and achievement.Journal of Personality,62, 321–346.
Lazarus, R. S., &Folkman, S. (1984).Stress, appraisal, and coping. New York: Springer-Verlag.
McCrae, R. R., &Costa, P. T., Jr. (1987). Validation of the five-factor model of personality across instruments and observers.Journal of Personality & Social Psychology,52, 81–90.
Monteith, M. J. (1996a). Affective reactions to prejudice-related discrepant responses: The impact of standard salience.Personality & Social Psychology Bulletin,22, 48–59.
Monteith, M. J. (1996b). Contemporary forms of prejudice-related conflict: In search of a nutshell.Personality & Social Psychology Bulletin,22, 461–473.
Monteith, M. J., Devine, P. G., &Zuwerink, J. R. (1993). Self-directed versus other-directed affect as a consequence of prejudice-related discrepancies.Journal of Personality & Social Psychology,64, 198–210.
Monteith, M. J., &Voils, C. I. (1998). Proneness to prejudiced responses: Toward understanding the authenticity of self-reported discrepancies.Journal of Personality & Social Psychology,75, 901–916.
Rosenthal, R., Rosnow, R. L., &Rubin, D. B. (2000).Contrasts and effect sizes in behavioral research. New York: Cambridge University Press.
Taylor, S. E., &Brown, J. D. (1988). Illusion and well-being: A social psychological perspective on mental health.Psychological Bulletin,103, 193–210.
Watson, D., Clark, L. A., &Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: The PANAS Scales.Journal of Personality & Social Psychology,54, 1063–1070.
Zuckerman, M., &Knee, C. R. (1996). The relation between overly positive self-evaluation and adjustment: A comment on Colvin, Block, and Funder (1995).Journal of Personality & Social Psychology,70, 1250–1251.
Author information
Authors and Affiliations
Corresponding author
Additional information
M.G. was supported by a doctoral fellowship from the Social Sciences and Humanities Research Council of Canada.
Rights and permissions
About this article
Cite this article
Zuckerman, M., Gagné, M., Nafshi, I. et al. Testing discrepancy effects: A critique, a suggestion, and an illustration. Behavior Research Methods, Instruments, & Computers 34, 291–303 (2002). https://doi.org/10.3758/BF03195457
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03195457