Skip to main content
Registered Report

The Affect Misattribution Procedure

In Search of Prejudice Effects

Published Online:https://doi.org/10.1027/1618-3169/a000364

Abstract. The Affect Misattribution Procedure (AMP) has been forwarded as one of the most promising alternatives to the Implicit Association Test and the evaluative-priming task for measuring attitudes such as prejudice indirectly. We investigated whether the AMP is indeed able to detect an evaluative out-group bias. In contrast to recent conclusions about the robustness of AMP effects, six out of seven pilot studies indicated that participants did not show any prejudice effects in the AMP. Yet, these pilot studies were not fully conclusive with regard to our research question because they investigated different domains of prejudice, used small sample sizes, and employed a modified AMP version. In a preregistered, high-powered AMP study, we therefore examined whether the standard AMP does reveal prejudice against Turks, the biggest minority in Germany, and found a significant, albeit very small prejudice effect. We discuss possible reasons for the AMP’s weak sensitivity to evaluations in socially sensitive domains.

References

  • Asbrock, F. (2010). Stereotypes of social groups in Germany in terms of warmth and competence. Social Psychology, 41, 76–81. doi: 10.1027/1864-9335/a000011 First citation in articleLinkGoogle Scholar

  • Asendorpf, J. B., Banse, R. & Mücke, D. (2002). Double dissociation between implicit and explicit personality self-concept: The case of shy behavior. Journal of Personality and Social Psychology, 83, 380–393. doi: 10.1037/0022-3514.83.2.380 First citation in articleCrossref MedlineGoogle Scholar

  • Bakker, M., van Dijk, A. & Wicherts, J. M. (2012). The rules of the game called psychological science. Perspectives on Psychological Science, 7, 543–554. doi: 10.1177/1745691612459060 First citation in articleCrossref MedlineGoogle Scholar

  • Bar-Anan, Y. & Nosek, B. A. (2012). Reporting intentional rating of the primes predicts priming effects in the affective misattribution procedure. Personality and Social Psychology Bulletin, 38, 1194–1208. doi: 10.1177/0146167212446835 First citation in articleCrossref MedlineGoogle Scholar

  • Blanton, H. & Jaccard, J. (2006). Arbitrary metrics in psychology. The American Psychologist, 61, 27–41. doi: 10.1037/0003-066X.61.1.27 First citation in articleCrossref MedlineGoogle Scholar

  • Cameron, C. D., Brown-Iannuzzi, J. & Payne, B. K. (2012). Sequential priming measures of implicit social cognition: A meta-analysis of associations with behaviors and explicit attitudes. Personality and Social Psychology Review, 16, 330–350. doi: 10.1177/1088868312440047 First citation in articleCrossref MedlineGoogle Scholar

  • Cooley, E., Payne, B. K. & Phillips, K. J. (2014). Implicit bias and the illusion of conscious ill will. Social Psychological and Personality Science, 5, 500–507. doi: 10.1177/1948550613506123 First citation in articleCrossrefGoogle Scholar

  • Craig, B. M., Lipp, O. V. & Mallan, K. M. (2014). Emotional expression is preferentially processed in implicit evaluations of faces varying in race or age. Emotion, 14, 865–877. doi: 10.1037/a0037270 First citation in articleCrossref MedlineGoogle Scholar

  • Deffenbacher, D. M., Park, B., Judd, C. M. & Correll, J. (2009). Category boundaries can be accentuated without increasing intergroup bias. Group Processes & Intergroup Relationships, 12, 175–193. doi: 10.1177/1368430208101055 First citation in articleCrossrefGoogle Scholar

  • Degner, J. & Wentura, D. (2008). The extrinsic affective Simon task as an instrument for indirect assessment of prejudice. European Journal of Social Psychology, 38, 1033–1043. doi: 10.1002/ejsp.536 First citation in articleCrossrefGoogle Scholar

  • Degner, J. & Wentura, D. (2011). Types of automatically activated prejudice: Assessing possessor-versus other-relevant valence in the evaluative priming task. Social Cognition, 29, 182–209. doi: 10.1521/soco.2011.29.2.182 First citation in articleCrossrefGoogle Scholar

  • Degner, J., Wentura, D., Gniewosz, B. & Noack, P. (2007). Hostility-related prejudice against Turks in adolescents: Masked affective priming allows for a differentiation of automatic prejudice. Basic and Applied Social Psychology, 29, 245–256. doi: 10.1080/01973530701503150 First citation in articleCrossrefGoogle Scholar

  • De Houwer, J., Teige-Mocigemba, S., Spruyt, A. & Moors, A. (2009). Implicit measures: A normative analysis and review. Psychological Bulletin, 135, 347–368. doi: 10.1037/a0014211 First citation in articleCrossref MedlineGoogle Scholar

  • Echabe, A. E. (2013). Relationship between implicit and explicit measures of attitudes: The impact of application conditions. Europe’s Journal of Psychology, 9, 231–245. doi: 10.5964/ejop.v9i2.544 First citation in articleCrossrefGoogle Scholar

  • Eder, A. B. & Deutsch, R. (2015). Watch the target! Effects in the affective misattribution procedure become weaker (but not eliminated) when participants are motivated to provide accurate responses to the target. Frontiers in Psychology, 6, 1442. doi: 10.3389/fpsyg.2015.01442 First citation in articleCrossref MedlineGoogle Scholar

  • Fazio, R. H., Jackson, J. R., Dunton, B. C. & Williams, C. J. (1995). Variability in automatic activation as an unobtrusive measure of racial attitudes: A bona fide pipeline? Journal of Personality and Social Psychology, 69, 1013–1027. doi: 10.1037/0022-3514.69.6.1013 First citation in articleCrossref MedlineGoogle Scholar

  • Florack, A., Scarabis, M. & Bless, H. (2001). Der Einfluss wahrgenommener Bedrohung auf die Nutzung automatischer Assoziationen bei der Personenbeurteilung [The influence of perceived threat on the use of automatic associations in person judgments]. Zeitschrift für Sozialpsychologie, 32, 249–259. doi: 10.1024/0044-3514.32.4.249 First citation in articleLinkGoogle Scholar

  • Gawronski, B. (2002). What does the Implicit Association Test measure? A test of the convergent and discriminant validity of prejudice-related IATs. Experimental Psychology, 49, 171–180. doi: 10.1026/1618-3169.49.3.171 First citation in articleLinkGoogle Scholar

  • Gawronski, B., Cunningham, W. A., LeBel, E. P. & Deutsch, R. (2010). Attentional influences on affective priming: Does categorisation influence spontaneous evaluation of multiply categorisable objects? Cognition and Emotion, 24, 1008–1025. doi: 10.1080/02699930903112712 First citation in articleCrossrefGoogle Scholar

  • Gawronski, B. & De Houwer, J. (2014). Implicit measures in social and personality psychology. In H. T. ReisC. M. JuddEds., Handbook of research methods in social and personality psychology (2nd ed, pp. 283–310). New York, NY: Cambridge University Press. First citation in articleGoogle Scholar

  • Gawronski, B., Geschke, D. & Banse, R. (2003). Implicit bias in impression formation: Associations influence the construal of individuating information. European Journal of Social Psychology, 33, 573–589. doi: 10.1002/ejsp.166 First citation in articleCrossrefGoogle Scholar

  • Gawronski, B. & Payne, B. K. (2010). Handbook of implicit social cognition: Measurement, theory, and applications. New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Gawronski, B., Peters, K. R., Brochu, P. M. & Strack, F. (2008). Understanding the relations between different forms of racial prejudice: A cognitive consistency perspective. Personality and Social Psychology Bulletin, 34, 648–665. doi: 10.1177/0146167207313729 First citation in articleCrossref MedlineGoogle Scholar

  • Gawronski, B. & Strack, F. (2004). On the propositional nature of cognitive consistency. Dissonance changes explicit, but not implicit attitudes. Journal of Experimental Social Psychology, 40, 335–542. doi: 10.1016/j.jesp.2003.10.005 First citation in articleCrossrefGoogle Scholar

  • Gawronski, B. & Ye, Y. (2014). What drives priming effects in the affect misattribution procedure? Personality and Social Psychology Bulletin, 40, 3–15. doi: 10.1177/0146167213502548 First citation in articleCrossref MedlineGoogle Scholar

  • Gawronski, B. & Ye, Y. (2015). Prevention of intention invention in the affect misattribution procedure. Social Psychological and Personality Science, 6, 101–108. doi: 10.1177/1948550614543029 First citation in articleCrossrefGoogle Scholar

  • Greenwald, A. G., Banaji, M. R. & Nosek, B. A. (2015). Statistically small effects of the Implicit Association Test can have societally large effects. Journal of Personality and Social Psychology, 108, 553–561. doi: 10.1037/pspa0000016 First citation in articleCrossref MedlineGoogle Scholar

  • Greenwald, A. G., McGhee, D. E. & Schwartz, J. L. K. (1998). Measuring individual differences in implicit cognition: The Implicit association test. Journal of Personality and Social Psychology, 74, 1464–1480. doi: 10.1037/0022-3514.74.6.1464 First citation in articleCrossref MedlineGoogle Scholar

  • Greenwald, A. G., Poehlman, T. A., Uhlmann, E. & Banaji, M. R. (2009). Understanding and using the Implicit Association Test: III. Meta-analysis of predictive validity. Journal of Personality and Social Psychology, 97, 17–41. doi: 10.1037/a0015575 First citation in articleCrossref MedlineGoogle Scholar

  • Gschwendner, T., Hofmann, W. & Schmitt, M. (2006). Synergistic moderator effects of situation and person factors of awareness and adjustment on the consistency of implicit and explicit attitudes. Journal of Individual Differences, 27, 47–56. doi: 10.1027/1614-0001.27.1.47 First citation in articleLinkGoogle Scholar

  • Guinote, A., Willis, G. B. & Martellota, C. (2009). Social power increases implicit prejudice. Journal of Experimental Social Psychology, 46, 299–307. doi: 10.1016/j.jesp.2009.11.012 First citation in articleCrossrefGoogle Scholar

  • Higgins, E. T., Rholes, W. S. & Jones, C. R. (1977). Category accessibility and impression formation. Journal of Experimental Social Psychology, 13, 141–154. doi: 10.1016/s0022-1031(77)80007-3 First citation in articleCrossrefGoogle Scholar

  • Hofmann, W., Gschwendner, T., Castelli, L. & Schmitt, M. (2008). Implicit and explicit attitudes and interracial interaction: The moderating role of situationally available control resources. Group Processes & Intergroup Relations, 11, 69–87. doi: 10.1177/1368430207084847 First citation in articleCrossrefGoogle Scholar

  • Hofmann, W., Gschwendner, T., Nosek, B. A. & Schmitt, M. (2005). What moderates implicit-explicit consistency? European Review of Social Psychology, 16, 335–390. doi: 10.1080/10463280500443228 First citation in articleCrossrefGoogle Scholar

  • Imhoff, R. & Banse, R. (2009). Ongoing victim suffering increases prejudice. Psychological Science, 20, 1443–1447. doi: 10.1111/j.1467-9280.2009.02457.x First citation in articleCrossref MedlineGoogle Scholar

  • Jones, E. E. & Sigall, H. (1971). The bogus pipeline: A new paradigm for measuring affect and attitude. Psychological Bulletin, 76, 349–364. doi: 10.1037/h0031617 First citation in articleCrossrefGoogle Scholar

  • Kahraman, B. & Knoblich, G. (2000). “Stechen statt sprechen” : Valenz und Aktivierbarkeit von Stereotypen über Türken [Valence and activation of stereotypes about Turks]. Zeitschrift für Sozialpsychologie, 31, 31–34. doi: 10.1024/0044-3514.31.1.31 First citation in articleLinkGoogle Scholar

  • Klauer, K. C., Schmitz, F., Teige-Mocigemba, S. & Voss, A. (2010). Understanding the role of executive control in the Implicit Association Test: Why flexible people have small IAT effects. The Quarterly Journal of Experimental Psychology, 63, 595–619. doi: 10.1080/17470210903076826 First citation in articleCrossrefGoogle Scholar

  • Klink, A. & Wagner, U. (1999). Discrimination against ethnic minorities in Germany: Going back to the field. Journal of Applied Social Psychology, 29, 402–423. doi: 10.1111/j.1559-1816.1999.tb01394.x First citation in articleCrossrefGoogle Scholar

  • Krieglmeyer, R. & Sherman, J. W. (2012). Disentangling stereotype activation and stereotype application in the Stereotype Misperception Task. Journal of Personality and Social Psychology, 103, 205–224. doi: 10.1037/a0028764 First citation in articleCrossref MedlineGoogle Scholar

  • Lakens, D. & Evers, E. R. K. (2014). Sailing from the seas of chaos into the corridors of stability: Practical recommendations to increase the informational value of studies. Perspectives on Psychological Science, 9, 278–292. doi: 10.1177/1745691614528520 First citation in articleCrossref MedlineGoogle Scholar

  • Lundberg, K. B. & Payne, B. K. (2014). Decisions among the undecided: Implicit attitudes predict future voting behavior of undecided voters. PLoS One, 9, e85680. doi: 10.1371/journal.pone.0085680 First citation in articleCrossref MedlineGoogle Scholar

  • Lycke, J. & Setterberg, P. (2011). Effects of allocation of attention on initial facial race discrimination, Unpublished bachelor’s thesis. Stockholm, Sweden: Lund University. First citation in articleGoogle Scholar

  • Neumann, R. & Seibt, B. (2001). The structure of prejudice: Associative strength as a determinant of stereotype endorsement. European Journal of Social Psychology, 31, 609–620. doi: 10.1002/ejsp.69 First citation in articleCrossrefGoogle Scholar

  • Nisbett, R. E. & Wilson, T. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84, 231–259. doi: 10.1037/0033-295X.84.3.231 First citation in articleCrossrefGoogle Scholar

  • Nosek, B. A. & Bar-Anan, Y. (2012). Scientific utopia: I. Opening scientific communication. Psychological Inquiry, 23, 217–243. doi: 10.1080/1047840X.2012.692215 First citation in articleCrossrefGoogle Scholar

  • Nosek, B. A. & Lakens, D. (2014). Registered reports: A method to increase the credibility of published results. Social Psychology, 45, 137–141. doi: 10.1027/1864-9335/a000192 First citation in articleLinkGoogle Scholar

  • Olson, M. A. & Fazio, R. H. (2001). Implicit attitude formation through classical conditioning. Psychological Science, 12, 413–417. doi: 10.1111/1467-9280.00376 First citation in articleCrossref MedlineGoogle Scholar

  • Olson, M. A. & Fazio, R. H. (2003). Relations between implicit measures of racial prejudice: What are we measuring? Psychological Science, 14, 636–639. doi: 10.1046/j.0956-7976.2003.psci_1477.x First citation in articleCrossref MedlineGoogle Scholar

  • Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349, aac4716. doi: 10.1126/science.aac4716 First citation in articleCrossref MedlineGoogle Scholar

  • Oswald, F. L., Mitchell, G., Blanton, H., Jaccard, J. & Tetlock, P. E. (2013). Predicting ethnic and racial discrimination: A meta-analysis of IAT criterion studies. Journal of Personality and Social Psychology, 105, 171–192. doi: 10.1037/a0032734 First citation in articleCrossref MedlineGoogle Scholar

  • Oswald, F. L., Mitchell, G., Blanton, H., Jaccard, J. & Tetlock, P. E. (2015). Using the IAT to predict ethnic and racial discrimination: Small effect sizes of unknown societal significance. Journal of Personality and Social Psychology, 108, 562–571. doi: 10.1037/pspa0000023 First citation in articleCrossref MedlineGoogle Scholar

  • Payne, B. K., Brown-Iannuzzi, J., Burkley, M., Arbuckle, N. L., Cooley, E., Cameron, C. D. & Lundberg, K. B. (2013). Intention invention and the affect misattribution procedure: Reply to Bar-Anan and Nosek (2012). Personality and Social Psychology Bulletin, 39, 375–386. doi: 10.1177/0146167212475225 First citation in articleCrossref MedlineGoogle Scholar

  • Payne, B. K., Burkley, M. A. & Stokes, M. B. (2008). Why do implicit and explicit tests diverge? The role of structural fit. Journal of Personality and Social Psychology, 94, 16–31. doi: 10.1037/0022-3514.94.1.16 First citation in articleCrossref MedlineGoogle Scholar

  • Payne, B. K., Cheng, C. M., Govorun, O. & Stewart, B. (2005). An inkblot for attitudes: Affect misattribution as implicit measurement. Journal of Personality and Social Psychology, 89, 277–293. doi: 10.1037/0022-3514.89.3.277 First citation in articleCrossref MedlineGoogle Scholar

  • Payne, B. K., Govorun, O. & Arbuckle, N. L. (2008). Automatic attitudes and alcohol: Does implicit liking predict drinking? Cognition and Emotion, 22, 238–271. doi: 10.1080/02699930701357394 First citation in articleCrossrefGoogle Scholar

  • Payne, B. K., Hall, D., Cameron, C. D. & Bishara, A. J. (2010). A process model of affect misattribution. Personality and Social Psychological Bulletin, 36, 1397–1408. doi: 10.1177/0146167210383440 First citation in articleCrossref MedlineGoogle Scholar

  • Payne, B. K., Krosnick, J. A., Pasek, J., Lelkes, Y., Akhtar, O. & Tompson, P. (2010). Implicit and explicit prejudice in the 2008 American presidential election. Journal of Experimental Social Psychology, 46, 367–374. doi: 10.1016/j.jesp.2009.11.001 First citation in articleCrossrefGoogle Scholar

  • Payne, B. K. & Lundberg, K. B. (2014). The Affect Misattribution Procedure: Ten years of evidence on reliability, validity, and mechanisms. Social and Personality Psychology Compass, 8, 672–686. doi: 10.1111/spc3.12148 First citation in articleCrossrefGoogle Scholar

  • Pettigrew, T. F. (1998). Reactions towards the new minorities of Western Europe. Annual Review of Sociology, 24, 77–103. doi: 10.1146/annurev.soc.24.1.77 First citation in articleCrossrefGoogle Scholar

  • Pinheiro, M. C. & Wentura, D. (2012). Automatically activated facets of ageism: Masked evaluative priming allows for a differentiation of age-related prejudice. European Journal of Social Psychology, 42, 852–863. doi: 10.1002/ejsp.1912 First citation in articleCrossrefGoogle Scholar

  • Proia, A. G. (2012). The role of affect in the control of attention to monoracial and racially ambiguous faces. Unpublished bachelor’s thesis. Williamsburg, VA. First citation in articleGoogle Scholar

  • Pryor, J. B., Reeder, G. D. & Monroe, A. E. (2012). The infection of bad company: Stigma by association. Journal of Personality and Social Psychology, 102, 224–241. doi: 10.1037/a0026270 First citation in articleCrossref MedlineGoogle Scholar

  • Rosenthal, R. (1979). The “file drawer problem” and tolerance for null results. Psychological Bulletin, 86, 638–641. doi: 10.1037/0033-2909.86.3.638 First citation in articleCrossrefGoogle Scholar

  • Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D. & Iverson, G. (2009). Bayesian t tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin & Review, 16, 225–237. doi: 10.3758/PBR.16.2.225 First citation in articleCrossref MedlineGoogle Scholar

  • Simonsohn, U. (2015). Small telescopes: Detectability and the evaluation of replication results. Psychological Science, 26, 559–569. doi: 10.1177/0956797614567341 First citation in articleCrossref MedlineGoogle Scholar

  • Singmann, H., Kellen, D. & Klauer, K. C. (2013). Investigating the other-race effect of Germans toward Turks and Arabs using multinomial processing tree models. In M. KnauffM. PauenN. SebanzI. WachsmuthEds., Proceedings of the 35th Annual Conference of the Cognitive Science Society (pp. 1330–1335). Austin, TX: Cognitive Science Society. First citation in articleGoogle Scholar

  • Teige-Mocigemba, S. & Klauer, K. C. (2013). On the controllability of evaluative-priming effects: Some limits that are none. Cognition and Emotion, 27, 632–657. doi: 10.1080/02699931.2012.732041 First citation in articleCrossref MedlineGoogle Scholar

  • Teige-Mocigemba, S. & Klauer, K. C. (2015). Implicit association test. In J. D. WrightEd., International encyclopedia of the social and behavioral sciences (2nd ed., Vol. 11 pp. 703–708). Oxford, UK: Elsevier. First citation in articleGoogle Scholar

  • Teige-Mocigemba, S., Klauer, K. C. & Sherman, J. W. (2010). Practical guide to implicit association test and related tasks. In B. GawronskiB. K. PayneEds., Handbook of implicit social cognition: Measurement, theory, and applications (pp. S. 117–139). New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Teige-Mocigemba, S., Penzl, B., Becker, M., Henn, L. & Klauer, K. C. (2016). Controlling the “Uncontrollable”: Faking effects on the affect misattribution procedure. Cognition and Emotion, 30, 1470–1484. doi: 10.1080/02699931.2015.1070793 First citation in articleCrossref MedlineGoogle Scholar

  • Tobin, C. & LeBel, E. P. (2014, June 27). Replication difficulties of Payne, Hall, Cameron, and Bishara’s (2010) multinomial processing tree model of the affect misattribution procedure. Available at SSRN: http://ssrn.com/abstract=2459994 First citation in articleGoogle Scholar

  • Todd, A. R. & Burgmer, P. (2013). Perspective taking and automatic intergroup evaluation change: Testing an associative self-anchoring account. Journal of Personality and Social Psychology, 104, 786–802. doi: 10.1037/a0031999 First citation in articleCrossref MedlineGoogle Scholar

  • Tukey, J. W. (1977). Exploratory data analysis. Reading, MA: Addison-Weasley. First citation in articleGoogle Scholar

  • Wagner, U., van Dick, R. & Zick, A. (2000). Sozialpsychologische Analysen und Erklärungen von Fremdenfeindlichkeit in Deutschland [Social psychological analyses and explanations for hostility towards strangers in Germany]. Zeitschrift für Sozialpsychologie, 32, 59–79. doi: 10.1024//0044-3514.32.2.59 First citation in articleLinkGoogle Scholar

  • Walsh, T. M. (2013). Implicit measures of homophobia and stigmatization of same-sex couples. Unpublished master’s thesis. Tempe, AZ. First citation in articleGoogle Scholar

  • Wentura, D. & Degner, J. (2010). A practical guide to sequential priming and related tasks. In B. GawronskiB. K. PayneEds., Handbook of implicit social cognition: Measurement, theory, and applications (pp. 95–116). New York, NY: Guilford Press. First citation in articleGoogle Scholar

  • Wetzels, R. & Wagenmakers, E.-J. (2012). A default Bayesian hypothesis test for correlations and partial correlations. Psychonomic Bulletin & Review, 19, 1057–1064. doi: 10.3758/s13423-012-0295-x First citation in articleCrossref MedlineGoogle Scholar

  • Wuensch, K. L. (2012). Using SPSS to obtain a confidence interval for Cohen’s d. Retrieved from http://core.ecu.edu/psyc/wuenschk/SPSS/CI-d-SPSS.pdf First citation in articleGoogle Scholar