Skip to main content
SpringerLink
Log in

Does Paying More Mean Getting a Better Product: Comparison of Modes of Survey Administration

  • Chapter
  • First Online:
Handbook of Survey Methodology for the Social Sciences

Abstract

This chapter begins by discussing a review of the literature on the various types of survey designs. The chapter then moves on to discuss the strengths and limitations of each type of survey design, paying special attention to design costs and response rates of each. Finally, the chapter moves on to discuss mixed mode survey designs, paying special attention to prenotice contacts and phasing; if using mixed mode surveys appear to provide significant improvements in response rates and the quality of data gathered; and if the increased costs occurred are commensurate with an improvement in the quantity and quality of data gathered from the mixed mode design model.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Bachmann, D., & Elfrink, J. (1996). Tracking the progress of e-mail versus snail-mail. Marketing Research, 8(2), 31–35.

    Google Scholar 

  • Bachmann, D. P., Elfrink, J., & Vazzana, G. (2000). Email and snail mail face off in rematch. Marketing Research, 11(4), 10–15.

    Google Scholar 

  • Balden, W. (2004). Highlights from the session on Web-based data collection. Federal Committee on Statistical Methodology: Statistical policy seminar session on web based data collection, December, Washington, D.C.

    Google Scholar 

  • Bean, A. G., & Roszkowski, M. J. (1995). The long and short of it. Marketing Research, 7(1), 20–26.

    Google Scholar 

  • Beebe, T. J., Davern, M. E., McAlpine, D. D., Call, K. T., & Rockwood, T. H. (2005). Increasing response rates in a survey of medicaid enrollees: The effect of a prepaid monetary incentive and mixed-modes (mail and telephone). Medical Care, 43, 411–414.

    Article  Google Scholar 

  • Bickart, B., & Schmittlein, D. (1999). The distribution of survey contact and participation in the United States: Constructing a survey-based estimate. Journal of Marketing Research, 36, 286–294.

    Article  Google Scholar 

  • Börkan, B. (2006). Effectiveness of mixed-mode survey designs for teachers using mail and web-based surveys (Doctoral dissertation). Retrieved from http://etd.ohiolink.edu/view.cgi/Borkan%20Bengu.pdf?osu1158597296.

  • Bradburn, N. M. (1992). Presidential address: A response to the non-response problem. Public Opinion Quarterly, 56, 391–398.

    Article  Google Scholar 

  • Bradley, N. (1999). Sampling for Internet surveys: An examination of respondent selection for Internet research. Journal of the Market Research Society, 41(4), 387–395.

    Google Scholar 

  • Carini, R. M., Hayek, J. C., Kuh, G. D., Kennedy, J. M., & Ouimet, J. A. (2001). College student responses to web and paper surveys: Does mode matter? Paper presented at the 41st Annual Forum of the Association for Institutional Research, LongBeach, CA, June 4, 2001.

    Google Scholar 

  • Christian, L. M., Dillman, D. A., & Smyth, J. D. (2008). The effects of mode and format on answers to scalar questions in telephone and web surveys. In J. Lepkowski, C. Tucker, M. Brick, E. De Leeuw, L. Japec, P. Lavrakas, M. Link, & R. Sangster (Eds.), Advances in telephone survey methodology (pp. 250–275). New York: Wiley. (Chapter 12).

    Google Scholar 

  • Cobanoglu, C., Warde, B., & Moreo, P. J. (2001). A comparison of mail, fax and web-based survey methods. International Journal of Market Research, 43, 441–452.

    Google Scholar 

  • Cook, C., Heath, F., & Thompson, R. L. (2000). A meta-analysis of response rates in web- or Internet-based surveys. Educational and Psychological Measurement, 60, 821–826.

    Article  Google Scholar 

  • Couper, M. P. (2000). Web surveys: A review of issues and approaches. Public Opinion Quarterly, 64, 464–494.

    Article  Google Scholar 

  • Curtin, R., Presser, S., & Singer, E. (2005). Changes in telephone survey nonresponse over the past quarter century. Public Opinion Quarterly, 69(1), 87–98.

    Article  Google Scholar 

  • De Leeuw, E. D. (1992). Data quality in mail, telephone, and face-to-face surveys. Amsterdam: TT Publications.

    Google Scholar 

  • De Leeuw, E. D. (2005). To mix or not to mix data collection modes in surveys. Journal of Official Statistics, 21(2), 233–255.

    Google Scholar 

  • De Leeuw, E. D., & Heer, W. (2002). Trends in household survey nonresponse: A longitudinal and international comparison. In R. M. Groves, D. A. Dillman, J. L. Eltinge, & R. J. A. Little (Eds.), Survey nonresponse (pp. 41–54). New York: Wiley.

    Google Scholar 

  • De Leeuw, E.D., & Van Der Zouwen, J. (1988). Data quality in telephone and face-to-face surveys: A comparative analysis. In R.M. Groves, P. Biemer, L. Lyberg, J. Massey, W. Nichols III, & J. Waksberg (Eds.), Telephone survey methodology. New York: Wiley.

    Google Scholar 

  • Dey, E. L. (1997). Working with low survey response rates: The efficacy of weighing adjustments. Research in Higher Education, 38, 215–227.

    Article  Google Scholar 

  • Dillman, D. A. (1978). Mail and telephone surveys: The total design method. New York: Wiley.

    Google Scholar 

  • Dillman, D. A. (1991). The design and administration of mail surveys. Annual Review of Sociology, 17, 225–249.

    Article  Google Scholar 

  • Dillman, D. A. (1999). Mail and Internet surveys: The tailored design method (2nd ed.). New York: Wiley.

    Google Scholar 

  • Dillman, D. (2000). Mail and Internet surveys: The tailored design method (2nd ed.). New York: Wiley.

    Google Scholar 

  • Dillman, D. A., & Christian, L. M. (2003). Survey mode as a source of instability in responses across surveys. Field Methods, 15(2), 1–22.

    Google Scholar 

  • Dillman, D. A., Clark, J. A., & Sinclair, M. A. (1995). How prenotice letters, stamped return envelopes, and reminder postcards affect mailback response rates for census questionnaires? Survey Methodology, 21, 1–7.

    Google Scholar 

  • Dillman, D. A., & Mason, R. G. (1984). The influence of survey method on question response. Paper presented at the Annual Meeting of the American Association for Public Opinion Research. Delavan, WI.

    Google Scholar 

  • Dillman, D. A., Phelps, G., Tortora, R. D., Swift, K., Kohrell, J., & Berck, J. (2009). Response rate and measurement differences in mixed mode surveys using mail, telephone, interactive voice response, and the Internet. Social Science Research, 38, 1–18.

    Article  Google Scholar 

  • Doyle, J. (n.d.). 9 February, 2012, http://www.wpi.edu/Images/CMS/SSPS/Doyle_-_Face-to-Face_Surveys.pdf.

  • Ethier, R. G., Poe, G.L., Schulze, W.D., & Clark, J. (2000). A comparison of hypothetical phone and mail contingent valuation responses for green-pricing electricity programs. Land Economics 76(1), 54–67.

    Article  Google Scholar 

  • Fraenkel, J. R., & Wallen, N. E. (1993). How to design and evaluate research in education (2nd ed.). New York: McGraw Hill.

    Google Scholar 

  • Fowler, F. J, Jr, Gallagher, P. M., Stringfellow, V. L., Zalavsky, A. M., Thompson, J. W., & Cleary, P. D. (2002). Using telephone interviews to reduce nonresponse bias to mail surveys of health plan members. Medical Care, 40, 190–200.

    Article  Google Scholar 

  • Groves, R. (1989). Survey errors and survey costs (1st ed.). New York: Wiley-Interscience.

    Google Scholar 

  • Groves, R. M., Cialdini, R. B., & Courier, M. P. (1992). Understanding the decision to participate in a survey. Public Opinion Quarterly, 56, 475–495.

    Article  Google Scholar 

  • Handwerk, P. G., Carson, C., & Blackwell, K. M. (2000). Online vs. paper-and-pencil surveying of students: A case study. Paper presented at the 40th Annual Forum of the Association for Institutional Research, Cincinnati, OH, May 21–24, 2000.

    Google Scholar 

  • Hare, S., Price, J. H., Flynn, M. G., & King, K. A. (1998). Increasing return rates of a mail survey to exercise professional using a modest monetary incentive. Perceptual and Motor Skills, 86(1), 217–218.

    Article  Google Scholar 

  • Horrigan, J. B., & Smith, A. (2007). Home broadband adoption, 2007. Pew Internet & American Life Project. Accessed July 10, 2011. Available from: http://www.pewinternet.org/pdfs/PIP_Broadband%202007.pdf.

  • Kaplowitz, M. D., Hadlock, T. D., & Levine, R. (2004). A comparison of Web and mail survey response rates. Public Opinion Quarterly, 68, 94–101.

    Article  Google Scholar 

  • Keisler, S., & Sproull, L. S. (1986). Response effects in the electronic survey. Public Opinion Quarterly, 50(3), 402–413.

    Article  Google Scholar 

  • Krysan, M., Schuman, H., Scott, L. J., & Beatty, P. (1994). Response rates and response content in mail versus face-to-face surveys. Public Opinion Quarterly, 58, 381–399.

    Article  Google Scholar 

  • Massey, J. T., O’Connor, D., & Krotki, K. (1997). Response rates in random digit dialing RDD telephone surveys. In: 1997 Proceedings of the section on survey research methods. American Statistical Association. (pp. 707–712). Alexandria, VA.

    Google Scholar 

  • McNamara, C. (2009). General guidelines for conducting interviews. Retrieved June 8, 2011, from http://managementhelp.org/evaluatn/intrview.htm.

  • Paolo, A. M., Bonaminio, G. A., Gibson, C., Patridge, T., & Kallail, K. (2000). Response rate comparisons of e-mail and mail distributed student evaluations. Teaching and Learning in Medicine, 12(2), 81–84.

    Article  Google Scholar 

  • Parker, L. (1992). Collecting data in the e-mail way. Training and Development, 46, 52–54.

    Google Scholar 

  • Sangster, R. L., & Meekins, B. J. (2003). Data concerns for hard to reach and reluctant respondents in telephone panel surveys, Presented for the 14th International Workshop on Household Survey Nonresponse, Leuven, Belgium.

    Google Scholar 

  • Sax, L. J., Gilmartin, S. K., & Bryant, A. N. (2003). Assessing response rates and nonresponse bias in web and paper surveys. Research in Higher Education, 44, 409–432.

    Article  Google Scholar 

  • Schaefer, D. R., & Dillman, D. A. (1998). Development of a standard e-mail methodology. Public Opinion Quarterly, 62, 378–397.

    Article  Google Scholar 

  • Schmidt, W. C. (1997). World-Wide Web survey research: Benefits, potential problems, and solutions. Behavior Research Methods, Instruments and Computers, 29, 274–279.

    Article  Google Scholar 

  • Schuman, H. (2002). Sense and nonsense about surveys. Contexts, 1, 40–47.

    Article  Google Scholar 

  • Shank, M. D., Darr, B. D., & Werner, T. C. (1990). Increasing mail survey response rates: Investigating the perceived value of cash versus non-cash incentives. Applied Marketing Research, 30(3), 28–32.

    Google Scholar 

  • Sheehan, K. B., & Hoy, M. G. (1999). Using e-mail to survey Internet users in the United States: Methodology and assessment. Journal of Computer Mediated Communication, 4(3). [Online]. Available: http://www.ascusc.org/jcmc/vol4/issue3/sheehan.html.

  • Sheehan, B. K., & McMillan, J. S. (1999). Response variation in e-mail surveys: An exploration. Journal of Advertising, 39(4), 45–54.

    Google Scholar 

  • Sills, S. J., & Song, C. (2002). Innovations in survey research: An application of web surveys. Social Science Computer Review, 20, 22–30.

    Article  Google Scholar 

  • Singer, E. (2006). Introduction: Nonresponse bias in household surveys. Public Opinion Quarterly, 70(5), 637–645.

    Article  Google Scholar 

  • Smith, T. (1995). Trends in nonresponse rates. International Journal of Public Opinion Research, 7, 157–171.

    Article  Google Scholar 

  • Smith, C. B. (1997). Casting the net: Surveying an Internet population. Journal of Communication Mediated by Computers, 4(3). http://www.ascusc.org/jcmc/vol3/issue1/smith.html.

  • Solomon, D. J. (2001). Conducting Web-based surveys. Practical Assessment, Research, and Evaluation, 7(19), 1–5.

    Google Scholar 

  • Steeh, C. (1981). Trends in nonresponse rates. Public Opinion Quarterly, 45, 40–57.

    Article  Google Scholar 

  • Swoboda, S. J., Muehlberger, N., Weitkunat, R., & Schneeweiss, S. (1997). Internet surveys by direct mailing: An innovative way of collecting data. Social Science Computer Review, 15(3), 242–255.

    Article  Google Scholar 

  • Tarnai, J., & Dillman, D. A. (1992). Questionnaire context as a source of response differences in mail versus telephone surveys. In N. Schwarz & S. Sudman (Eds.), Context effects in social and psychological research. New York: Springer.

    Google Scholar 

  • Tse, A. (1998). Comparing the response rate, response speed and response quality of two methods of sending questionnaires: E-mail vs. mail. Journal of the Market Research Society, 40(4), 353–361.

    Google Scholar 

  • Weible, R., & Wallace, J. (1998). The impact of the Internet on data collection. Marketing Research, 10(3), 19–23.

    Google Scholar 

  • Wyatt, J. C. (2000). When to use web-based surveys. Journal of the American Medical Informatics Association, 7(4), 426–429.

    Article  Google Scholar 

  • Yun, G. W., & Trumbo C. W., (2000). Comparative response to a survey executed by post, e-mail, and web form. Available at http://jcmc.indiana.edu/vol6/issue1/yun.html.

  • Zatz, D. (2000). Create effective e-mail surveys. HR Magazine, 45(1), 97–103.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Criminal Justice, University of Cincinnati, 665 Dyer Hall, Clifton Avenue, P.O. Box 210389, Cincinnati, OH, 45221-0389, USA

    Beau Shine & Brandon Dulisse

Authors
  1. Beau Shine
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Brandon Dulisse
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Beau Shine .

Editor information

Editors and Affiliations

  1. John Jay College of Criminal Justice, City University of New York, Tenth Ave. 899, New York, 10019, New York, USA

    Lior Gideon

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer Science+Business Media New York

About this chapter

Cite this chapter

Shine, B., Dulisse, B. (2012). Does Paying More Mean Getting a Better Product: Comparison of Modes of Survey Administration. In: Gideon, L. (eds) Handbook of Survey Methodology for the Social Sciences. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-3876-2_21

Download citation

Publish with us

Policies and ethics

Search

Navigation