Skip to main content

Abstract

There is a general consensus, based on a number of surveys and analytic efforts, that mixture study designs have historically been lacking. Although there has been considerable progress over the past decades, further improvement is necessary both in the development and application of experimental designs to yield data suitable for quantitative analytic methods and in the implementation of appropriate statistical analyses. This chapter reviews the state of the science with regard to the experimental and statistical quality of mixture studies. The importance of properly powering mixture experiments is emphasized; in particular when the focus is on the low-dose/low-effect region. Issues with powering defined mixture and complex mixture experiments are explored. Some designs that have proven useful in mixture experimentation are reviewed, including full and fractional factorial designs and statistical mixture designs such as the isobologram and the fixed ratio ray. General considerations are provided that will aid in the development of both experimental design and analysis strategies that address the question(s) being asked.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 239.00
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 239.00
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Begley, C.G., and L.M. Ellis. 2012. Drug development: Raise standards for preclinical cancer research. Nature 483: 531–533.

    Article  CAS  PubMed  Google Scholar 

  • Berenbaum, M.C. 1985. The expected effect of a combination of agents – the general-solution. Journal of Theoretical Biology 114: 413–431.

    Article  CAS  PubMed  Google Scholar 

  • ———. 1989. What is synergy? Pharmacological Reviews 41: 93–141.

    CAS  PubMed  Google Scholar 

  • Bernhoft, A., M. Keblys, E. Morrison, H.J. Larsen, and A. Flåøyen. 2004. Combined effects of selected Penicillium Mycotoxins on in vitro proliferation of porcine lymphocytes. Mycopathologia 158: 441–450.

    Article  CAS  PubMed  Google Scholar 

  • Boobis, A., B. Budinsky, S. Collie, K. Crofton, M. Embry, S. Fleter, R. Hertzberg, D. Kopp, G. Mihlan, M. Mumtaz, P. Price, K. Solomon, L. Teuschler, R. Yang, and R. Zaleski. 2011. Critical analysis of literature on low-dose synergy for use in screening chemical mixtures for risk assessment. Critical Reviews in Toxicology 41: 369–338.

    Article  CAS  PubMed  Google Scholar 

  • Borgert, C.J., B. Price, C. Wells, and G.S. Simon. 2001. Evaluating interaction studies for mixture risk assessment. Human and Ecological Risk Assessment 7: 259–306.

    Article  CAS  Google Scholar 

  • Borgert, C.J., S.A. Borgert, and K.C. Findley. 2005. Synergism, antagonism, or additivity of dietary supplements: Application of theory to case studies. Thrombosis Research 117: 123–132.

    Article  CAS  PubMed  Google Scholar 

  • Bostrøm, E., S. Engen, and I. Eide. 1998. Mutagenicity testing of organic extracts of diesel exhaust particles after spiking with PAHs. Archives of Toxicology 72: 645–649.

    Article  PubMed  Google Scholar 

  • Box, G.E.P., W.G. Hunter, and J.S. Hunter. 2005. Statistics for experimenters: Design, innovation, and discovery. 2nd ed. New York: Wiley. 664 p.

    Google Scholar 

  • Carpy, S.A., W. Kobel, and J. Doe. 2000. Health risk of low-dose pesticides mixtures: A review of the 1985–1998 literature on combination toxicology and health risk assessment. Journal of Toxicology and Environmental Health B 3: 1–25.

    Article  CAS  Google Scholar 

  • Casey, M., C. Gennings, W.H. Carter Jr., V.C. Moser, and J.E. Simmons. 2006. Power and sample size calculations for linear hypotheses associated with mixtures of many components using fixed-ratio ray designs. Environmental and Ecological Statistics 13: 11–23.

    Article  Google Scholar 

  • Cedergreen, N. 2014. Quantifying synergy: A systematic review of mixture toxicity studies within environmental toxicology. PLOSOne 9 (5): e96580.

    Article  Google Scholar 

  • Chou, T.C. 2006. Theoretical basis, experimental design, and computerized simulation of synergism and antagonism in drug combination studies. Pharmacological Reviews 58: 621–682. Correction: Pharmacological Reviews, 59: 124.

    Article  CAS  PubMed  Google Scholar 

  • Chou, T.C., and P. Talalay. 1984. Quantitative analysis of dose-effect relationships: The combined effects of multiple drugs or enzyme inhibitors. Advances in Enzyme Regulation 22: 27–55.

    Article  CAS  PubMed  Google Scholar 

  • Cochran, W.G., and G.M. Cox. 1992. Factorial designs. In experimental designs. 2nd ed. New York: Wiley.

    Google Scholar 

  • Coffey, T., C. Gennings, J.E. Simmons, and D.W. Herr. 2005. D-optimal experimental designs to test for departure from additivity in a fixed-ratio mixture ray. Toxicological Sciences 88: 467–476.

    Article  CAS  PubMed  Google Scholar 

  • Cornell, J.A. 2002. Experiments with mixtures: Designs, models, and the analysis of mixture data. 3rd ed. New York: Wiley. 680 p.

    Book  Google Scholar 

  • Crofton, K.M., E.S. Craft, J.M. Hedge, C. Gennings, J.E. Simmons, R.A. Carchman, W.H. Carter Jr., and M.J. DeVito. 2005. Thyroid hormone disrupting chemicals: Evidence for dose-dependent additivity and synergism. Environmental Health Perspectives 113: 1549–1954.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Crosier, R.B. 1984. Mixture experiments: Geometry and pseudocomponents. Technometrics 26: 209–216.

    Article  Google Scholar 

  • Dingus, C.A., L.K. Teuschler, G.E. Rice, J.E. Simmons, and M.G. Narotsky. 2011. Power calculations for a multigenerational reproductive toxicity rodent bioassay of complex mixtures of drinking water disinfection by-products. International Journal of Environmental Research and Public Health 8: 4082–4101.

    Article  PubMed  PubMed Central  Google Scholar 

  • Eide, I. 1996. Strategies for toxicological evaluation of mixtures. Food and Chemical Toxicology 34: 1147–1149.

    Article  CAS  PubMed  Google Scholar 

  • Eide, I., and K. Zahlsen. 1996. Inhalation experiments with mixtures of hydrocarbons: Experimental design, statistics and interpretation of kinetics and possible interactions. Archives of Toxicology 70: 397–404.

    Article  CAS  PubMed  Google Scholar 

  • Eide, I., and H.G. Johnsen. 1998. Mixture design and multivariate analysis in mixture research. Environmental Health Perspectives 106 (Suppl. 6): 1373–1376.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Ermler, S., M. Scholze, and A. Kortenkamp. 2011. The suitability of concentration addition for predicting the effects of multi-component mixtures of up to 17 anti-androgens with varied structural features in an in vitro AR antagonist assay. Toxicology and Applied Pharmacology 257: 189–197.

    Article  CAS  PubMed  Google Scholar 

  • Figueiredo, M.A.O., I. Eide, M. Reynier, A.B. Villas-Bôas, F.T.S. Tâmega, C.G. Ferreira, I. Nilssen, R. Coutinho, and S. Johnsen. 2015. The effect of sediment mimicking drill cuttings on deep water rhodoliths in a flow-through system: Experimental work and modeling. Marine Pollution Bulletin 95: 81–88.

    Article  CAS  PubMed  Google Scholar 

  • George, B.J., J.R. Sobus, L.P. Phelps, B. Rashleigh, J.E. Simmons, R.N. Hines, and the Community of Practice for Statistics Guidance Documents Working Groups. 2015. Raising the Bar for Reproducible Science at the US Environmental Protection Agency Office of Research and Development. Toxicological Sciences 145: 16–22.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Gennings, C., W.H. Carter Jr., E.D. Campbell, J.G. Staniswalis, T.J. Martin, B.R. Martin, and K.L. White Jr. 1990. Isobolographic characterization of drug interactions incorporating biological variability. Journal of Pharmacology and Experimental Therapeutics 252: 208–217.

    CAS  PubMed  Google Scholar 

  • Gennings, C., W.H. Carter Jr., M. Casey, V. Moser, R. Carchman, and J.E. Simmons. 2004. Analysis of functional effects of a mixture of five pesticides using a ray design. Environmental Pharmacology and Toxicology 18: 115–125.

    Article  CAS  Google Scholar 

  • Goldin, A., and N. Mantel. 1957. The employment of combinations of drugs in the chemotherapy of neoplasia: A review. Cancer Research 17: 635–654.

    CAS  PubMed  Google Scholar 

  • Gordon, C.J., D.W. Herr, C. Gennings, J. Graff, M. McMurray, L. Stork, T. Coffey, A. Hamm, and C. Mack. 2006. Thermoregulatory response to an organophosphate and carbamate insecticide mixture: Testing the assumption of dose-additivity. Toxicology 217: 1–13.

    Article  CAS  PubMed  Google Scholar 

  • Greco, W.R., G. Bravo, and J.C. Parson. 1995. The search for synergy: A critical review from a response surface perspective. Pharmacological Reviews 47: 331–385.

    CAS  PubMed  Google Scholar 

  • Groten, J.P., E.J. Sinkeldam, T. Muys, J.B. Luten, and P.J. van Bladeren. 1991. Interaction of dietary Ca, P, Mg, Mn, Cu, Fe, Zn, and Se with the accumulation and oral toxicity of cadmium in rats. Food and Chemical Toxicology 29: 249–258.

    Article  CAS  PubMed  Google Scholar 

  • Hadrup, N., C. Taxvig, M. Pedersen, C. Nellemann, U. Hass, and A.M. Vinggaard. 2013. Concentration addition, independent action and generalized concentration addition models for mixture effect prediction of sex hormone synthesis in vitro. PLoS One 8 (8): e70490. https://doi.org/10.1371/journal.pone.0070490.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Hass, U., S. Christiansen, M. Axelstad, M. Scholze, and J. Boberg. 2017. Combined exposure to low doses of pesticides causes decreased birth weight in rats. Reproductive Toxicology 72: 97–105.

    Article  CAS  PubMed  Google Scholar 

  • Hertzberg, R., Y. Pan, R. Li, L.T. Haber, R. Lyles, D.W. Herr, V. Moser, and J.E. Simmons. 2013. A four step approach to evaluate mixtures for consistency with dose addition. Toxicology 313: 134–144.

    Article  CAS  PubMed  Google Scholar 

  • Howdeshell, K.L., C.V. Rider, V.S. Wilson, J.R. Furr, C.R. Lambright, and L.E. Gray Jr. 2015. Dose addition models based on biologically relevant reductions in fetal testosterone accurately predict postnatal reproductive tract alterations by a phthalate mixture in rats. Toxicological Sciences 148: 488–502.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • IGHRC (The Interdepartmental Group on Health Risks from Chemicals). 2008. Chemical mixtures: A framework for assessing risks to human health. Institute of Environment and Health Cranfield, UK.

    Google Scholar 

  • Ioannidis, J.P., and M.J. Khoury. 2011. Improving validation practices in “Omics” research. Science 334: 1230–1232.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Jawetz, E., and J.B. Gunnison. 1953. Antibiotic synergism and antagonism: An assessment of the problem. Pharmacological Reviews 5: 175–192.

    CAS  PubMed  Google Scholar 

  • Johnsen, S., A.T. Smith, J. Brendehaug, H. Riksheim, and A.L. Gjøse. 1994. Identification of Sources of Acute Toxicity in Produced Water. In: Proceedings SPE International Conference on Health, Safety and Environment. Jakarta, Indonesia. SPE 27138.

    Google Scholar 

  • Könemann, W.H., and M.N. Pieters. 1996. Confusion of concepts in mixture toxicology. Food and Chemical Toxicology 34: 1025–1031.

    Article  PubMed  Google Scholar 

  • Kortenkamp, A., T. Backhaus, and M. Faust. 2009. State of the art Report on Mixture Toxicity. http://ec.europa.eu/environment/chemicals/effects/pdf/report_mixture_toxicity.pdf.

  • Loewe, S., and H. Muischnek. 1926. On combination effects (D. Doty Trans.). Archiv für Experimentalle Pathologie und Pharmakologie 114: 313–326.

    Article  CAS  Google Scholar 

  • Mason, A.M., C.J. Borgert, J.S. Bus, M. Mumtaz, J.E. Simmons, and I.G. Sipes. 2007. Improving the scientific foundation for mixtures joint toxicity and risk assessment: Contributions from the SOT mixtures project. Toxicology and Applied Pharmacology 223: 99–103.

    Article  CAS  PubMed  Google Scholar 

  • McInnes, G.T., and M.J. Brodie. 1988. Drug interactions that matter: A critical reappraisal. Drugs 36: 83–110.

    Article  CAS  PubMed  Google Scholar 

  • Moser, V.C., M. Casey, A. Hamm, W.H. Carter Jr., J.E. Simmons, and C. Gennings. 2005. Neurotoxicological and statistical analyses of a mixture of five organophosphorus pesticides using a ray design. Toxicological Sciences 86: 101–115.

    Article  CAS  PubMed  Google Scholar 

  • Moser, V.C., S. Padilla, J.E. Simmons, L. Haber, and R.C. Hertzberg. 2012. Impact of chemical proportions on the acute neurotoxicity of a mixture of seven carbamates in preweanling and adult rats. Toxicological Sciences 129: 126–134.

    Article  CAS  PubMed  Google Scholar 

  • Narotsky, M.G., D.S. Best, E.H. Rogers, A. McDonald, Y.M. Sey, and J.E. Simmons. 2008. Integrated disinfection by-products mixtures research: Assessment of developmental toxicity in Sprague-Dawley rats exposed to concentrates of water disinfected by chlorination and ozonation/postchlorination. Journal of Toxicology and Environmental Health A 71 (17): 1216–1221.

    Article  CAS  Google Scholar 

  • Narotsky, M.G., G.R. Klinefelter, J.M. Goldman, D.S. Best, A. McDonald, L.F. Strader, J.D. Suarez, A.S. Murr, I. Thillainadarajah, E.S. Hunter, S.D. Richardson, T.F. Speth, R.J. Miltner, J.G. Pressman, L.K. Teuschler, G.E. Rice, V.C. Moser, R.W. Luebke, and J.E. Simmons. 2013. Comprehensive assessment of a chlorinated drinking water concentrate in a rat multigenerational reproductive toxicity study. Environmental Science and Technology 47: 10653–10659.

    CAS  PubMed  Google Scholar 

  • NIST/SEMATECH e-Handbook of Statistical Methods. n.d. http://www.itl.nist.gov/div898/handbook/. Accessed 1-10-18.

  • Orton, F., S. Ermler, S. Kugathas, E. Rosivatz, M. Scholze, and A. Kortenkamp. 2014. Mixture effects at very low doses with combinations of anti-androgenic pesticides, antioxidants, industrial pollutant and chemicals used in personal care products. Toxicology and Applied Pharmacology 278: 201–208.

    Article  CAS  PubMed  Google Scholar 

  • Østby, L., S. Engen, A. Melbye, and I. Eide. 1997. Mutagenicity testing of organic extracts of diesel exhaust particles after fractionation and recombination. Archives of Toxicology 71: 314–319.

    Article  PubMed  Google Scholar 

  • Peace, M.R., L.D. Tarnai, and A. Poklis. 2000. Performance evaluation of four on-site drug testing devices for detection of drugs of abuse in urine. Journal of Analytical Toxicology 24: 589–594.

    Article  CAS  PubMed  Google Scholar 

  • Peng, R.D. 2011. Reproducible research in computational science. Science 334: 1226–1227.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Placket, R.L., and P.S. Hewlett. 1952. Quantal responses to mixture of poisons. Journal of the Royal Statistical Society, series B14: 143–163.

    Google Scholar 

  • Pressman, J.G., S.D. Richardson, T.F. Speth, R.J. Miltner, M.G. Narotsky, E.S. Hunter III, G.E. Rice, L.K. Teuschler, A. McDonald, S. Parvez, S.W. Krasner, H.S. Weinberg, A.B. McKague, C.J. Parrett, N. Bodin, R. Chinn, C.F. Lee, and J.E. Simmons. 2010. Concentration, chlorination, and chemical analysis of drinking water disinfection byproduct mixtures for health effects research: The four lab study. Environmental Science and Technology 44: 7184–7192.

    Article  CAS  PubMed  Google Scholar 

  • Rider, C.V., J. Furr, V.S. Wilson, and L.E. Gray Jr. 2008. A mixture of seven antiandrogens induces reproductive malformations in rats. International Journal of Andrology 31: 249–262.

    Article  CAS  PubMed  Google Scholar 

  • Rider, C.V., J.R. Furr, V.S. Wilson, and L.E. Gray Jr. 2010. Cumulative effects of in utero administration of mixtures of reproductive toxicants that disrupt common target tissues via diverse mechanisms of toxicity. International Journal of Andrology 33: 443–462.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Ryan, M.J. 2011. Replication in field biology: The case of the frog eating bat. Science 334: 1229–1230.

    Article  CAS  PubMed  Google Scholar 

  • Scholze, M., E. Silva, and A. Kortenkamp. 2014. Extending the applicability of the dose addition model to the assessment of chemical mixtures of partial agonists by using a novel toxic unit extrapolation method. PLoS One 9 (2): e88808. https://doi.org/10.1371/journal.pone.0088808.

    Article  PubMed  PubMed Central  Google Scholar 

  • Simmons, J.E. 1995. Chemical mixtures: Challenge for toxicology and risk assessment. Toxicology 105: 111–119.

    Article  CAS  PubMed  Google Scholar 

  • Simmons, J.E., S.D. Richardson, T. Speth, R.J. Miltner, G. Rice, K. Schenck, and L.K. Teuschler. 2002. Development of an research strategy for integrated technology-based toxicology studies on drinking water disinfection byproducts. Environmental Health Perspectives 110 (Supplement 6): 1013–1024.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Simmons, J.E., S.D. Richardson, L.K. Teuschler, R.J. Miltner, T.F. Speth, K.M. Schenck, E.S. Hunter, and G. Rice. 2008. Research issues underlying the four-lab study: Integrated disinfection by-products mixtures research. Journal of Toxicology and Environmental Health A. 71: 1125–1132.

    Article  CAS  Google Scholar 

  • Simmons, J.E., R.S.H. Yang, D.J. Svendsgaard, M.B. Thompson, J.C. Seely, and A. McDonald. 1994. Toxicology studies of a chemical mixture of 25 groundwater contaminants: Hepatic and renal assessment, response to carbon tetrachloride challenge and influence of treatment-induced water restriction. Journal of Toxicology and Environmental Health 43: 305–325.

    Article  CAS  PubMed  Google Scholar 

  • Søfteland, L., I. Eide, and P.A. Olsvik. 2009. Factorial design applied for multiple endpoint toxicity evaluation in Atlantic Salmon (Salmo Salar L.) hepatocytes. Toxicology In Vitro 23: 1455–1464.

    Article  PubMed  Google Scholar 

  • Stork, L.G., C. Gennings, W.H. Carter Jr., R.E. Johnson, P.M. Darcy, J.E. Simmons, E.D. Wagner, and M.J. Plewa. 2007. Testing for additivity in chemical mixtures using a fixed-ratio design and statistical equivalence testing methods. Journal of Agricultural, Biological and Environmental Statistics 12: 514–533.

    Article  Google Scholar 

  • Sun, Y., Z. Sheng, C. Ma, K. Tang, R. Zhu, Z. Wu, R. Shen, J. Feng, D. Wu, D. Huang, D. Huang, J. Fei, Q. Liu, and Z. Cao. 2015. Nature Communications 6: 8481–8490.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Teuschler, L., J. Klaunig, E. Carney, J. Chambers, R. Conolly, C. Gennings, J. Giesy, R.H. Hertzberg, C. Klaassen, R. Kodell, D. Paustenbach, and R. Yang. 2002. Support of science-based decisions concerning the evaluation of the toxicology of mixtures: A new beginning. Regulatory Toxicology and Pharmacology 36: 34–39.

    Article  PubMed  Google Scholar 

  • Thomas, L. 1997. Retrospective power analysis. Conservation. Biology. 11: 276−280.

    Article  Google Scholar 

  • U.S. Environmental Protection Agency (EPA). 1998. Health effects test guidelines OPPTS 870.3800. Reproduction and fertility effects. EPA 712-C-98-208.

    Google Scholar 

  • ———. 1986. Guidelines for the health risk assessment of chemical mixtures. (EPA/630/R-98/002). Federal Register 51 (185): 34014–34025.

    Google Scholar 

  • ———.1990. Technical support document on health risk assessment of chemical mixtures. EPA/600/8–90/064.

    Google Scholar 

  • Veldstra, H. 1956. Synergism and potentiation with special reference to the combination of structural analogues. Pharmacological Reviews 8: 339–387.

    CAS  PubMed  Google Scholar 

Download references

Acknowledgments

The authors thank Drs. Cynthia Rider and Mike Narotsky for thoughtful review of the chapter.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jane Ellen Simmons .

Editor information

Editors and Affiliations

Additional information

DisclaimerThe views expressed in this chapter are those of the authors and do not necessarily represent the views or policies of the U.S. Environmental Protection Agency. Mention of trade names or commercial products does not constitute endorsement or recommendation for use.

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Simmons, J.E., Eide, I., Rice, G., Feder, P. (2018). Mixture Experimental Design. In: Rider, C., Simmons, J. (eds) Chemical Mixtures and Combined Chemical and Nonchemical Stressors. Springer, Cham. https://doi.org/10.1007/978-3-319-56234-6_13

Download citation

Publish with us

Policies and ethics