Skip to main content
Log in

In search of a happy medium in instructional technology research: Issues concerning external validity, media replications, and learner control

  • Published:
Educational Technology Research and Development Aims and scope Submit manuscript

Abstract

Due in part to the diverse characteristics and training of its researchers, the field of instructional technology is currently plagued by much uncertainty regarding meaningful research questions and accepted paradigms for investigating them. Major areas in which these uncertainties are manifested concern the degree of emphasis to be placed on basic versus developmental research and considerations involving the separation of media from methods in research designs. To help researchers achieve a “happier medium” in balancing instructional technology goals with the performance of well-designed and scientifically sound studies, greater attention to three concerns is advocated: the external validity of studies to increase the relevance of findings to applied technologies; usage of media replications to test the generalizability of findings obtained with individual media and to demonstrate delivery applications; and learner control as a potentially effective and practical means of adapting validated instructional strategies to individuals. Each of these issues is discussed in relation to research conducted by the authors and to suggested designs for future studies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Allessi, S. M., & Trollip, S. R. (1985).Computerbased instruction: Methods and development. Englewood Cliffs, NJ: Prentice-Hall, Inc.

    Google Scholar 

  • Askwall, S. (1985). Computer supported reading vs. reading text on paper: A comparison of two reading situations.Journal of Man-Machine Studies, 22, 425–439.

    Google Scholar 

  • Bangert, R., Kulik, J., & Kulik, C. (1983). Individualized systems of instruction in secondary schools.Review of Educational Research, 53, 143–158.

    Google Scholar 

  • Beckworth, D. (1988). The future of educational technology.Canadian Journal of Educational Communication, 17(1), 3–20.

    Google Scholar 

  • Benton, C. L. (1979).The connotative dimensions of selected display typefaces. Paper presented at the annual meeting of the Association for Education in Journalism, Houston, TX.

  • Bonner, J. (1986). Implications of cognitive theory for instructional design: Revisited.Educational Communication and Technology Journal, 36, 3–14.

    Google Scholar 

  • Bork, A. (1987).Learning with personal computers. New York: Harper & Row.

    Google Scholar 

  • Burke, R. L. (1981).CAI sourcebook. Englewood Cliffs, NJ: Prentice-Hall, Inc.

    Google Scholar 

  • Campbell, D. T., & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research on teaching. In N. L. Gage (Ed.),Handbook of research on teaching. Chicago: Rand McNally, 1963.

    Google Scholar 

  • Campeau, P. L. (1974). Selective review of the results of research on the use of audiovisual media to teach adults.AV Communications Review, 22(1), 5–40.

    Google Scholar 

  • Carrier, C., Davidson, G., & Williams, M. (1985). The selection of instructional options in a computer-based coordinate concept lesson.Educational Communication and Technology Journal, 33, 199–212.

    Google Scholar 

  • Carrier, C. A., & Sales, G. C. (1987). Pair versus individual work on the acquisition of concepts in a computer-based instructional lesson.Journal of Computer-Based Instruction, 14, 11–17.

    Google Scholar 

  • Clark, R. E. (1978). Doctoral research in educational technology.Educational Communication and Technology Journal, 26, 165–173.

    Google Scholar 

  • Clark, R. E. (1983). Reconsidering research on learning from media.Review of Educational Research, 53, 445–459.

    Google Scholar 

  • Clark, R. E. (1984a). Research on student thought processes during computer-based instruction.Journal of Instructional Development, 7, 2–5.

    Google Scholar 

  • Clark, R. E. (1984b). “Where's the beef?”: A reply to Heinich.Educational Communication and Technology Journal, 32, 229–232.

    Google Scholar 

  • Clark, R. E. (1985). Evidence for confounding in computer-based instruction studies: Analyzing the meta-analyses.Educational Communication and Technology Journal, 33, 249–262.

    Google Scholar 

  • Clark, R. E., & Snow, R. E. (1975). Alternative designs for instructional technology research.AV Communication Review, 23(4), 373–394.

    Google Scholar 

  • Cunningham, D. J. (1986). Good guys and bad guys.Educational Communication and Technology Journal, 34, 3–7.

    Google Scholar 

  • Davis, R. Y., & Smith, H. J. (1933). Determinants of feeling tone in typefaces.Journal of Applied Psychology, 17, 741–746.

    Google Scholar 

  • DiVesta, F. I., & Rieber, L. P. (1987). Characteristics of cognitive engineering: The next generation of instructional systems.Educational Communication and Technology Journal, 35, 213–230.

    Google Scholar 

  • Driscoll, M. P. (1984). Alternative paradigms for research in instructional systems.Journal of Instructional Development, 7(4), 2–10.

    Google Scholar 

  • Feibel, W. (1984). Natural phrasing in the delivery of text on computer screens: Discussion of results and research approaches. In D. T. Bonnett (Ed.),Proceedings of the Sixth Annual National Educational Computing Conference (pp. 160–163), Dayton, Ohio.

  • Fish, M. C., & Feldman, S. C. (1987). A comparison of reading comprehension using print and microcomputer presentation.Journal of Computer-Based Instruction, 14, 57–61.

    Google Scholar 

  • Gagné, R. M. (1987). Introduction. In R. M. Gagné (Ed.).Instructional technology: Foundations (pp. 1–9). Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Gay, G. (1986). Interaction of learner control and prior understanding in computer-assisted video instruction.Journal of Educational Psychology, 78, 225–227.

    Article  Google Scholar 

  • Gordon, G. N. (1969).The languages of communication. New York: Hastings House.

    Google Scholar 

  • Grabinger, R. S. (1983).CRT text design: Psychological attributes underlying the evaluation of models of CRT text displays. Unpublished doctoral dissertation, Indiana University.

  • Grabinger, R. S., & Amedeo, D. (in press). CRT text layout: Perceptions of viewers. Unpublished manuscript.

  • Gropper, G. L. (1983). A behavioral approach to instructional prescription. In C. M. Reigeluth (Ed.),Instructional design theories and models: An overview of their current status (pp. 101–161). Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Hagler, P., & Knowlton, J. (1987). Invalid implicit assumption in CBI comparison research.Journal of Computer-Based Instruction, 14, 84–88.

    Google Scholar 

  • Hannafin, M. J. (1984). Guidelines for using locus of instructional control in the design of computer-assisted instruction.Journal of Instructional Development, 7(3), 6–10.

    Google Scholar 

  • Hansen, D. N., Ross, S. M., & Rakow, E. (1977). Adaptive models for computer-based training systems.Annual report to Naval Personnel Research and Development Center. Memphis, TN: Memphis State University.

    Google Scholar 

  • Hartley, J. (1987). Designing electronic text: The role of print-based research.Educational Communication and Technology Journal, 35, 3–17.

    Google Scholar 

  • Heines, J. M. (1984).Screen design strategies for computer-assisted instruction. Bedford, MA: Digital Equipment Corp.

    Google Scholar 

  • Heinich, R. (1970).Technology and the management of instruction. Washington, DC: Association for Educational Communications and Technology.

    Google Scholar 

  • Heinich, R. (1984). The proper study of instructional technology.Educational Communication and Technology Journal, 32, 67–88.

    Google Scholar 

  • Heinich, R. (1985). Instructional technology and the structure of education.Educational Communication and Technology Journal, 33, 9–15.

    Google Scholar 

  • Heinich, R., Molenda, A., & Russell, J. (1985).Instructional media and the new technologies of instruction. New York: John Wiley & Sons.

    Google Scholar 

  • Hepner, F. H., Anderson, J. G., Farstrup, A. E., & Weiderman, N. H. (1985). Reading performance in a standardized test is better from print than from computer display.Journal of Reading, 28, 321–325.

    Google Scholar 

  • Judd, W. A., Bunderson, C. V., & Bessent, E. W. (1970).An investigation of the effects of learner control in computer-assisted instruction prerequisite mathematics. (MATHS Tech. Rep. 5). Austin, TX: University of Texas (ERIC Document Reproduction Service No. ED 053 532).

    Google Scholar 

  • Kastl, A. J., & Child, I. L. (1968). Emotional meaning of four typographical variables.Journal of Applied Psychology, 52, 440–446.

    Google Scholar 

  • Knowlton, J. Q. (1964). A conceptual scheme for the audiovisual field.Bulletin of the School of Education: Indiana University, 40(3), 1–44.

    Google Scholar 

  • McCann, P. (1981). Learning strategies and computer-based instruction.Computers and Education, 5, 133–140.

    Article  Google Scholar 

  • Mielke, K. W. (1968). Asking the right ETV questions.Educational Broadcasting Review, 2(6), 54–61.

    Google Scholar 

  • Mielke, K. W. (1972). Reviewing the link between communications and educational technology.AV Communications Review, 20(4), 357–399.

    Google Scholar 

  • Morrison, G. R. (1986). Communicability of the emotional connotation of type.Educational Communication and Technology Journal, 34, 235–244.

    Google Scholar 

  • Morrison, G. R., Ross, S. M., & O'Dell, J. K. (1988). Text density level as a design variable in instructional displays.Educational Communication and Technology Journal, 36, 103–115.

    Google Scholar 

  • Morrison, G. R., Ross, S. M., O'Dell, J. K., & Schultz, C. W. (1988a). Adapting presentations to media attributes: Getting more out of less in CBI.Computers and Human Behavior, 4, 65–75.

    Google Scholar 

  • Morrison, G. R., Ross, S. M., O'Dell, J. K., & Schultz, C. W. (1988b). [Screen density preferences from single frames]. Unpublished raw data.

  • Newkirk, R. L. (1973). A comparison of learner control and machine control strategies for computer-assisted instruction.Programmed Learning and Educational Technology, 10, 82–91.

    Google Scholar 

  • Nitsch, K. E. (1977). Structuring decontextualized forms of knowledge. Unpublished Ph.D. dissertation, Vanderbilt University.

  • Papert, S. (1987). Computer criticism and technocentric thinking.Educational Researcher, 16, 22–30.

    Google Scholar 

  • Park, O., Perez, R. S., Seidel, R. J. (1987). Intelligent CAI: Old wine in new bottles, or a new vintage? In G. P. Kearsley (Ed.),Artificial intelligence and instruction: Applications and methods (pp. 11–45). Reading, MA: Addison-Wesley.

    Google Scholar 

  • Petkovich, M. D., & Tennyson, R. D. (1984). Clark's “Learning from media”: A critique.Educational Communication and Technology Journal, 32, 233–241.

    Google Scholar 

  • Poffenberger, A. T., & Franken, R. B. (1923). A study of the appropriateness of typefaces.Journal of Applied Psychology, 7, 312–329.

    Google Scholar 

  • Reiser, R. A. (1984). Reducing student procrastination in a personalized system of instruction course.Educational Communication and Technology Journal, 32, 41–49.

    Google Scholar 

  • Rosenberg, R. (1987). A critical analysis of research on intelligent tutoring systems.Educational Technology, 27, 7–13.

    Google Scholar 

  • Ross, S. M., & Anand, P. (1987). A computer-based strategy for personalizing verbal problems in teaching mathematics.Educational Communication and Technology Journal, 35, 151–162.

    Google Scholar 

  • Ross, S. M., Anand, P., & Morrison, G. R. (1988). Personalizing math problems: A modern technology approach to a new idea.Educational Technology, 28, 20–24.

    Google Scholar 

  • Ross, S. M., McCormick, D., & Krisak, N. (1986). Adapting the thematic context of mathematical problems to student interests: Individual versus group-based strategies.Journal of Educational Research, 79, 245–252.

    Google Scholar 

  • Ross, S. M., Morrison, G. R., & O'Dell, J. (1988). Obtaining more out of less text in CBI: Effects of varied text density levels as a function of learner characteristics and control strategy.Educational Communication and Technology Journal, 36, 131–142.

    Google Scholar 

  • Ross, S. M., & Rakow, E. A. (1981). Learner control versus program control as adaptive strategies for selection of instructional support on math rules.Journal of Educational Psychology, 73, 745–753.

    Google Scholar 

  • Ross, S. M., & Rakow, E. A. (1982). Adaptive instructional strategies for teaching rules in mathematics.Educational Communication and Technology Journal, 30, 67–74.

    Google Scholar 

  • Ross, S. M., Rakow, E. A., & Bush, A. J. (1980). Instructional adaptation for self-managed learning systems.Journal of Educational Psychology, 72, 312–320.

    Google Scholar 

  • Salomon, G. (1983). The differential investment in mental effort in learning from different sources.Educational Psychologist, 18, 42–51.

    Google Scholar 

  • Salomon, G., & Clark, R. W. (1977). Reexamining the methodology of research on media and technology in education.Review of Educational Research, 47(1), 99–120.

    Google Scholar 

  • Salomon, G., & Snow, R. E. (1968). The specification of film attributes for psychological and educational research purposes.AV Communication Review, 16, 225–244.

    Google Scholar 

  • Seidel, R. J. (1975).Learner control of instructional sequencing within an adaptive tutorial CAI environment. Alexandria, VA: Human Resources Research Organization Technical Report, 75–77.

  • Seidel, R., & Wagner, T. (1978). Learner control of instructional sequencing within an adaptive tutorial CAI environment.Instructional Science, 7, 37–80.

    Article  Google Scholar 

  • Silber, K. H. (1978). Problems and needed directions in the profession of educational technology.Educational Communication and Technology Journal, 26, 174–185.

    Google Scholar 

  • Slavin, R. E. (1987). Mastery learning reconsidered.Review of Educational Research, 57, 175–214.

    Google Scholar 

  • Steinberg, E. R. (1977). Review of student control in computer-assisted instruction.Journal of Computer-Based Instruction, 3, 84–90.

    Google Scholar 

  • Streibel, M. J. (1986). A critical analysis of the use of computers in education.Educational Communication and Technology Journal, 34, 137–162.

    Google Scholar 

  • Tannenbaum, P. H., Jacobson, H. K., & Norris, L. N. (1964). An experimental investigation of typeface connotation.Journalism Quarterly, 41, 65–73.

    Google Scholar 

  • Taylor, W. D., & Johnson, J. B. (1988).On reducing teachers and students to technological components. Paper presented at the annual meeting of the Association of Educational Communications and Technology, New Orleans.

  • Tennyson, R. D. (1980). Instructional control strategies and content structure as design variables in concept acquisition using computer-based instruction.Journal of Educational Psychology, 72, 525–532.

    Google Scholar 

  • Tennyson, R. D. (1984). Artificial intelligence methods in computer-based instructional design: The Minnesota Adaptive Instructional System.Journal of Instructional Development, 7(3), 17–22.

    Google Scholar 

  • Tennyson, R. D., & Buttrey, T. (1980). Advisement and management strategies as design variables in computer-assisted instruction.Educational Communication and Technology Journal, 28, 169–176.

    Google Scholar 

  • Tennyson, R. D., & Rasch, M. (1988).The learning environment: A cognitive science approach to instructional planning and design. Paper presented at the annual meeting of the American Educational Research Association, New Orleans.

  • Twyman, M. (1981). Typography without words.Visible Language, 25(1), 5–12.

    Google Scholar 

  • Tullis, T. S. (1981). An evaluation of alphanumeric, graphic, and color information displays.Human Factors, 23(5), 541–550.

    Google Scholar 

  • Tullis, T. S. (1983). The formatting of alphanumeric displays: A review and analysis.Human Factors, 25(6), 657–682.

    Google Scholar 

  • Weaver, W. (1949). Recent contributions to the mathematical theory of communication. In C. E. Shannon & W. Weaver (Eds.),The mathematical theory of communication (pp. 1–28). Urbana: The University of Illinois Press.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

The authors would like to thank Robert D. Tennyson for his helpful suggestions regarding an earlier draft.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ross, S.M., Morrison, G.R. In search of a happy medium in instructional technology research: Issues concerning external validity, media replications, and learner control. ETR&D 37, 19–33 (1989). https://doi.org/10.1007/BF02299043

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02299043

Keywords

Navigation