Abstract
JAVA applets are not accurate enough to measure reaction time unless precautions are taken. A response-filtering technique is introduced that identifies inaccurate measurements by testing whether the client-side JAVA implementation produces false measurements of a time interval of known length during the measured reaction time. Reaction times that indicate such inaccuracy are discarded to increase the reliability of the remaining data. Three studies provide illustrative data on the effectiveness of the new technique, using 11 different computer systems. Study 1 showed differences in the accuracy of different clients and higher variability of the obtained means with applets than with native programs. Study 2 showed sharply increased variability when additional loads were imposed on the clients during reaction time measurement. The response-filtering technique diminishes this variability. Study 3 indicated more accurate measurement, with the new technique being able to reveal even smaller differences in difficult technical conditions.
Article PDF
Similar content being viewed by others
References
Allport, A., Styles, R. A., &Hsieh, S. (1994). Shifting intentional set: Exploring the dynamic control of tasks. In C. Umiltà & M. Moscovitch (Eds.),Attention and performance XV: Conscious and nonconscious information processing (pp. 421–452). Cambridge, MA: MIT Press.
Apple Computer (1992a).Inside Macintosh: Macintosh toolbox essentials. Reading, MA: Addison-Wesley.
Apple Computer (1992b).Inside Macintosh: Processes. Reading, MA: Addison-Wesley.
Apple Computer (2000).Technical Q & A Java20: Using System,. currentTimeMillis() [On-line]. Available: http://developer.apple.com/qa/java/java20.html.
Gosling, J., Joy, B., Steele, G., &Bracha, G. (2000).The Java language specification (2nd ed.). Reading, MA: Addison-Wesley.
Harold, R. R. (1997).Java network programming. Sebastopol, CA: O’Reilly.
Hecht, H., Oesker, M., Kaiser, A., Civelek, H., &Stecker, T. (1999). A perception experiment with time-critical graphics animation on the World-Wide Web.Behavior Research Methods, Instruments, & Computers,31, 439–445.
Hildebrandt, M., Meyer, H., & Janetzko, D. (1998, October).JAVA-basierte Versuchsdurchführung: Potentiale und Probleme am, Beispiel von Reaktionszeitexp erimenten [JAVA-based conducting of experiments: Potentials and problems shown by theexample of reaction time experiments]. Paper presented at German Online Research (28.-29.10.), Mannheim.
Janetzko, D., Hildebrandt, M., &Meyer, H. (1999, March). JAVA-basierte Versuchsdurchführung im WWW: Potentiale und Probleme am Beispiel von Reaktionszeiten [JAVA-based experimenting in the WWW: Potentials and problems shown by the example of reaction times]. Abstract in E. Schröger, A. Mecklinger, & A. Widmann (Eds.),Experimentelle Psychologie: 41. Tagung experimentell arbeitender Psychologen (p. 15). Lengerich: Pabst.
Kieley, J. M. (1996). CGI scripts: Gateways to World-Wide Web power.Behavior Research Methods, Instruments, & Computers,28, 165–169.
Klauer, K. C., Musch, J., &Naumer, B. (2000). On belief bias in syllogistic reasoning.Psychological Review,107, 852–884.
Krantz, J. H., Ballard, J., &Scher, J. (1997). Comparing the results of laboratory and World-Wide Web samples on the determinants of female attractiveness.Behavior Research Methods, Instruments, & Computers,29, 264–269.
Lawson, R., & Todd, J. (2000, November).The role of similarities and differences in learning novel visual categories. Poster presented at the 41 st Annual Meeting of the Psychonomic Society, New Orleans.
Malloy, T. R., & Jensen, G. G. (2000, November).Utah virtual lab: JAVA interactivity for teaching science and statistics online. Paper presented at the 2000 Society for Computers in Psychology conference, New Orleans.
Michalak, R. R. (1998). The use of the Internet as a research tool: The nature and characteristics of seasonal affective disorders (SAD) amongst a population of users.Interacting With Computers,9, 349–365.
Myors, B. (1999). Timing accuracy of PC programs running under Dos and Windows.Behavior Research Methods, Instruments, & Computers,31, 322–328.
Peterson, M. (1998).Psychological toolbox: C/C++functions for psychology experiments [Manuscript and software]. Available: http://or.psychology.dal.ca/~jc/PAPI.hqx.
Reips, U.-D. (1996, October).Experimenting in the World-Wide Web. Paper presented at the 1996 Society for Computers in Psychology Conference, Chicago.
Reips, U.-D. (2000). The Web experiment method: Advantages, disadvantages, and solutions. In M. H. Birnbaum (Ed.),Psychological experiments on the Internet (pp. 89–114). San Diego, CA: Academic Press.
Rogers, R. D., &Monsell, S. (1995). Costs of a predictable switch between simple cognitive tasks.Journal of Experimental Psychology: General,125, 207–231.
Schmidt, W. C. (1997). World Wide Web survey research: Benefits, potential problems, and solutions.Behavior Research Methods, Instruments, & Computers,29, 274–279.
Schwartz, A. (1998). Tutorial: Perl, a psychologically efficient reformatting language.Behavior Research Methods, Instruments, & Computers,30, 605–609.
Stevenson, A. K., Francis, G., &Kim, H. (1999). Java experiments for introductory cognitive psychology courses.Behavior Research Methods, Instruments, & Computers,31, 99–106.
Sun Microsystems (1997).JAVA development kit version 1.1 [On-line], Available: http://java.sun.eom/products/jdk/l.l/index.html.
Welch, N., &Krantz, J. H. (1996). The World-Wide Web as a medium for psychoacoustical demonstrations and experiments: Experience and results.Behavior Research Methods, Instruments, & Computers,28, 192–196.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Eichstaedt, J. An inaccurate-timing filter for reaction time measurement by JAVA applets implementing Internet-based experiments. Behavior Research Methods, Instruments, & Computers 33, 179–186 (2001). https://doi.org/10.3758/BF03195364
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03195364