ReviewStatistical and Methodological Considerations for the Interpretation of Intranasal Oxytocin Studies
Section snippets
The Statistical Power Of Behavioral In-Ot Studies In Humans
Statistical power is the probability that a test will be able to reject the null hypothesis considering a true relation with a given effect size. True effect size values are, however, difficult, if not impossible, to acquire. This problem can to some extent be avoided by using effect size estimates from meta-analyses of relevant prior studies. Even though summary effects from meta-analyses can be inflated due to various sources of bias (8), these analyses provide the best estimates of the true
The Positive Predictive Value of Behavioral In-Ot Studies In Humans
The formula for calculating the PPV using information on power (1 − β), the prestudy odds (R; described below), and the alpha level (α) is PPV = [(1 − β) × R] / [(1 − β) × R + α].
Although rather exact values for both power (calculated above) and alpha level (most commonly set to 5%) can be put into this formula, picking a reasonable value for R is more problematic. Within any research field, both true and false hypotheses can be made. Thus, R represents the ratio of the number of true
Bias In Behavioral In-Ot Studies In Humans
When reading the literature on behavioral IN-OT studies in humans, it is obvious that most articles report positive findings, which is in line with a study by Fanelli (22) showing that more than 80% of scientific publications in various sciences report positive results. Considering the low statistical power within the field of IN-OT, we would expect that approximately 80% of all attempts to detect a true effect would fail. But it seems very unlikely that all hypotheses about how IN-OT affects
Conclusions and Recommendations
Our analyses demonstrate that IN-OT studies are generally considerably underpowered. This leads to a high probability that the reported effects of IN-OT are overestimated. Also, underpowered studies are prone to other types of biases, such as the use of questionable research practices. The combination of low power and low prestudy odds results in low PPV estimates. Taken together, this suggests that most of the reported positive findings regarding how OT affects human behavior are likely to be
Acknowledgments and Disclosures
Preparation of this manuscript was supported by National Institutes of Health Grants R01MH096983 and 1P50MH100023. Additional funding was provided by National Institutes of Health Office of the Director Grant No.P51OD11132 to Yerkes National Primate Research Center.
HW thanks the Swedish Brain Foundation for financial support.
LJY has applied for a patent (US20120108510 – Methods of improving behavioral therapies) for combining melanocortin agonists with behavioral therapies to enhance social
References (48)
- et al.
Social effects of oxytocin in humans: Context and person matter
Trends Cogn Sci
(2011) - et al.
Modulating social behavior with oxytocin: How does it work? What does it mean?
Horm Behav
(2012) - et al.
Intranasal oxytocin effects on social cognition: A critique
Brain Res
(2014) - et al.
Recommendations for the standardisation of oxytocin nasal administration and guidelines for its reporting in human research
Psychoneuroendocrinology
(2013) - et al.
Oxytocin and the neural mechanisms regulating social cognition and affiliative behavior
Front Neuroendocrin
(2009) - et al.
Editorial comment: Oxytocin, vasopressin and social behavior
Horm Behav
(2012) - et al.
Statistically significant meta-analyses of clinical trials have modest credibility and inflated effects
J Clin Epidemiol
(2011) - et al.
A sniff of trust: Meta-analysis of the effects of intranasal oxytocin administration on face recognition, trust to in-group, and trust to out-group
Psychoneuroendocrinology
(2012) - et al.
Intranasal oxytocin: Myths and delusions
Biol Psychiatry
(2016) The file drawer problem and tolerance for null results
Psychol Bull
(1979)