Skip to main content
Log in

Why is monitoring accuracy so poor in number line estimation? The importance of valid cues and systematic variability for U.S. college students

  • Published:
Metacognition and Learning Aims and scope Submit manuscript

Abstract

Metacognitive monitoring, recognizing when one is accurate or not, is important because judgments of one’s performance or knowledge often relate to control decisions, such as help seeking. Unfortunately, children and adults struggle to accurately monitor their performance during number-magnitude estimation. People’s accuracy in estimating number magnitudes is related to math achievement and health risk comprehension. Thus, poor monitoring of number-magnitude estimation performance could pose problems when completing math tasks or making health decisions. Here, we evaluated why monitoring accuracy was so poor during number-line estimation, whether it was greater in the presence of a cue that was predictive of performance or when accounting for spatial skills, and the relation between monitoring judgments and control. Monitoring accuracy was greater in a condition in which familiarity, a cue adults commonly rely on to monitor their performance in this task, was predictive of estimation accuracy, compared to a condition in which familiarity was misleading. Although indices of monitoring accuracy did not improve when accounting for spatial skills, reducing variability by dichotomizing estimation performance into accurate or not improved monitoring accuracy metrics. Accurate monitoring was important because adults were more likely to ask for help when they were less confident in their estimate. Taken together, our data on monitoring accuracy suggested that (a) using cues predictive of accuracy is important for monitoring in number-line estimation, (b) adults are poor at detecting small differences in their performance, and (c) prior estimates of monitoring accuracy in number-line estimation may underestimate people's true monitoring ability.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. Note that screen resolution and CSS pixels often differ because screen resolution, which reflects screen size multiplied by pixel density, has increased in recent years. CSS pixel width and height is a more accurate reflection of screen size than resolution, or total number of pixels.

  2. If participants exceeded the time constraint, the window flashed and prompted them to: “Please respond within the time limit” but still permitted them to answer the item. Thus, there were no missing data on the number-line estimation task.

  3. Recall that continuous predictors were rescaled by dividing the within-person mean centered variables by 100. We rescaled here for interpretation.

  4. We rescaled confidence here to be on the same 100-point scale as PAE. Recall that in the primary analyses, we rescaled within-person mean centered confidence by dividing by 100.

  5. We predicted confidence judgments from condition and help seeking (yes or no) in a mixed effects model. Confidence was lower in the diagnostic than non-diagnostic cue conditions, b = -10.53, p < .001, and when participants asked for help compared to when they did not, b = -12.09, p < .001. An interaction (b = -15.41, p < .001) revealed that confidence was similar for small-component items between conditions but lower when participants asked for help in the diagnostic (M = 42.0, SE = 3.72) than non-diagnostic cue (M = 60.20, SE = 3.79) conditions. And, in the non-diagnostic cue condition, confidence was similar when they asked for or did not (M = 64.6, SE = 3.59) ask for help p = .096.

  6. Note that we multiplied gamma values by -1 because our measure of estimation accuracy was a degree of error. Thus, gamma values closer to 1 reflect more accurate monitoring with this coding.

References

  • Alibali, M. W., & Sidney, P. G. (2015). Variability in the natural number bias: Who, when, how, and why. Learning and Instruction, 37, 56–61. https://doi.org/10.1016/j.learninstruc.2015.01.003

    Article  Google Scholar 

  • Baars, M., Wijnia, L., de Bruin, A., & Paas, F. (2020). The relation between students’ effort and monitoring judgments during learning: A meta-analysis. Educational Psychology Review, 32, 979–1002.

    Article  Google Scholar 

  • Bates, D., Maechler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48. https://doi.org/10.18637/jss.v067.i01

    Article  Google Scholar 

  • Booth, J. L., & Siegler, R. S. (2006). Developmental and individual differences in pure numerical estimation. Developmental Psychology, 42(1), 189. https://doi.org/10.1037/0012-1649.41.6.189

    Article  Google Scholar 

  • Booth, J. L., & Siegler, R. S. (2008). Numerical magnitude representations influence arithmetic learning. Child Development, 79(4), 1016–1031. https://doi.org/10.1111/j.1467-8624.2008.01173.x

    Article  Google Scholar 

  • Braithwaite, D. W., & Siegler, R. S. (2018a). Children learn spurious associations in their math textbooks: Examples from fraction arithmetic. Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(11), 1765.

    Google Scholar 

  • Braithwaite, D. W., & Siegler, R. S. (2018b). Developmental changes in the whole number bias. Developmental Science, 21(2), e12541.

    Article  Google Scholar 

  • Bröder, A., & Undorf, M. (2019). Metamemory viewed through the judgment lens. Acta Psychologica, 197, 153–165.

    Article  Google Scholar 

  • Brunswik, E. (1955). Representative design and probabilistic theory in a functional psychology. Psychological Review, 62(3), 193–217.

    Article  Google Scholar 

  • Chesney, D. L., & Matthews, P. G. (2013). Knowledge on the line: Manipulating beliefs about the magnitudes of symbolic numbers affects the linearity of line estimation tasks. Psychonomic Bulletin & Review, 20(6), 1146–1153.

    Article  Google Scholar 

  • Clarke, S., & Beck, J. (2021). The number sense represents (rational) numbers. Behavioral and Brain Sciences, 44, 1–62. https://doi.org/10.1017/S0140525X21000571

    Article  Google Scholar 

  • Dehaene, S. (1992). Varieties of numerical abilities. Cognition, 44(1–2), 1–42. https://doi.org/10.1016/0010-0277(92)90049-n

    Article  Google Scholar 

  • Dehaene, S. (2011). The number sense: How the mind creates mathematics (Rev. and updated ed.). Oxford University Press.

  • Dunlosky, J., & Lipko, A. R. (2007). Metacomprehension: A brief history and how to improve its accuracy. Current Directions in Psychological Science, 16(4), 228–232.

    Article  Google Scholar 

  • Dunlosky, J., & Matvey, G. (2001). Empirical analysis of the intrinsic–extrinsic distinction of judgments of learning (JOLs): Effects of relatedness and serial position on JOLs. Journal of Experimental Psychology: Learning, Memory, and Cognition, 27(5), 1180.

    Google Scholar 

  • Dunlosky, J., Mueller, M. L., Morehead, K., Tauber, S. K., Thiede, K. W., & Metcalfe, J. (2021). Why does excellent monitoring accuracy not always produce gains in memory performance? Zeitshcrift Fur Psychologie, 229(2), 104–119. https://doi.org/10.1027/2151-2604/a000441

    Article  Google Scholar 

  • Dunlosky, J., & Hertzog, C. (1998). Training programs to improve learning in later adulthood: Helping older adults educate themselves (pp. 263–290). Routledge.

  • Dunlosky, J., & Metcalfe, J. (2009). Metacognition. Sage Publications.

  • Ebersbach, M., Luwel, K., & Verschaffel, L. (2015). The relationship between children’s familiarity with numbers and their performance in bounded and unbounded number line estimations. Mathematical Thinking and Learning, 17(2–3), 136–154.

    Article  Google Scholar 

  • Efklides, A. (2011). Interactions of metacognition with motivation and affect in self-regulated learning: The MASRL model. Educational Psychologist, 46(1), 6–25.

    Article  Google Scholar 

  • Fazio, L. K., Bailey, D. H., Thompson, C. A., & Siegler, R. S. (2014). Relations of different types of numerical magnitude representations to each other and to mathematics achievement. Journal of Experimental Child Psychology, 123, 53–72. https://doi.org/10.1016/j.jecp.2014.01.013

    Article  Google Scholar 

  • Fazio, L. K., DeWolf, M., & Siegler, R. S. (2016). Strategy use and strategy choice in fraction magnitude comparison. Journal of Experimental Psychology: Learning, Memory, and Cognition, 42(1), 1. https://doi.org/10.1037/xlm0000153

    Article  Google Scholar 

  • Fitzsimmons, C. J., & Thompson, C. A. (2022). Developmental differences in monitoring accuracy and cue use when estimating whole-number and fraction magnitudes. Cognitive Development, 61, 101148. https://doi.org/10.1016/j.cogdev.2021.101148

    Article  Google Scholar 

  • Fitzsimmons, C. J., Thompson, C. A., & Sidney, P. G. (2020a). Confident or familiar? The role of familiarity ratings in adults’ confidence judgments when estimating fraction magnitudes. Metacognition and Learning, 15(2), 215–231. https://doi.org/10.1007/s11409-020-09225-9

    Article  Google Scholar 

  • Fitzsimmons, C. J., Thompson, C. A., & Sidney, P. G. (2020b). Do adults treat equivalent fractions equally? Adults’ strategies and errors during fraction reasoning. Journal of Experimental Psychology: Learning, Memory, and Cognition. https://doi.org/10.1037/xlm0000839

    Article  Google Scholar 

  • Fitzsimmons, C., Morehead, K., Thompson, C. A., Buerke, M., & Dunlosky, J. (2021). Does studying worked examples improve numerical magnitude estimation? The Journal of Experimental Education. 1–26. https://doi.org/10.1080/00220973.2021.1891009

  • Frick, A., & Newcombe, N. S. (2012). Getting the big picture: Development of spatial scaling abilities. Cognitive Development, 27(3), 270–282.

    Article  Google Scholar 

  • Fyfe, E. R., Byers, C., & Nelson, L. J. (2022). The benefits of a metacognitive lesson on children’s understanding of mathematical equivalence, arithmetic, and place value. Journal of Educational Psychology, 114(6), 1292.

    Article  Google Scholar 

  • Gilligan, K. A., Hodgkiss, A., Thomas, M. S., & Farran, E. K. (2019). The developmental relations between spatial cognition and mathematics in primary school children. Developmental Science, 22(4), e12786.

    Article  Google Scholar 

  • Green, P., & MacLeod, C. J. (2016). simr: An R package for power analysis of generalized linear mixed models by simulation. Methods in Ecology and Evolution, 7(4), 493–498. https://doi.org/10.1111/2041-210X.12504

    Article  Google Scholar 

  • Hammer, J. (n.d.). Best laptop sizes: For which lifestyle does each one fit? Retrieved from: https://gizbuyerguide.com/average-laptop-screen-size-with-6-examples/. Accessed July 2021

  • Hammond, K. R., & Stewart, T. R. (Eds.). (2001). The essential Brunswik: Beginnings, explications, applications. Oxford University Press.

    Google Scholar 

  • Jirout, J. J., & Newcombe, N. S. (2014). Mazes and maps: Can young children find their way? Mind, Brain, and Education, 8(2), 89–96.

    Article  Google Scholar 

  • Jirout, J. J., Holmes, C. A., Ramsook, K. A., & Newcombe, N. S. (2018). Scaling up spatial development: A closer look at children’s scaling ability and its relation to number knowledge. Mind, Brain, and Education, 12(3), 110–119.

    Article  Google Scholar 

  • Jirout, J., & Newcombe, N. S. (2018). How Much as Compared to What: Relative Magnitude as a Key Idea in Mathematics Cognition. In Visualizing Mathematics (pp. 3–24). Springer, Cham.

  • Koriat, A. (1997). Monitoring one’s own knowledge during study: A cue-utilization approach to judgments of learning. Journal of Experimental Psychology: General, 126(4), 349. https://doi.org/10.1037/0096-3445.126.4.349

    Article  Google Scholar 

  • Koriat, A. (2008). Easy comes, easy goes? The link between learning and remembering and its exploitation in metacognition. Memory & Cognition, 36, 416–428.

    Article  Google Scholar 

  • Koriat, A., & Ackerman, R. (2010). Choice latency as a cue for children’s subjective confidence in the correctness of their answers. Developmental Science, 13(3), 441–453. https://doi.org/10.1111/j.1467-7687.2009.00907.x

    Article  Google Scholar 

  • Koriat, A., Ackerman, R., Lockl, K., & Schneider, W. (2009). The easily learned, easily remembered heuristic in children. Cognitive Development, 24(2), 169–182.

    Article  Google Scholar 

  • Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017). lmerTest Package: Tests in Linear Mixed EffectsModels. Journal of Statistical Software, 82(13), 1–26. https://doi.org/10.18637/jss.v082.i13

    Article  Google Scholar 

  • Leibovich, T., Katzin, N., Harel, M., & Henik, A. (2017). From “sense of number” to “sense of magnitude”: The role of continuous magnitudes in numerical cognition. Behavioral and Brain Sciences, 40, 1–62. https://doi.org/10.1017/S0140525X16000960

    Article  Google Scholar 

  • Metcalfe, J. (2002). Is study time allocated selectively to a region of proximal learning? Journal of Experimental Psychology: General, 131(3), 349.

    Article  Google Scholar 

  • Metcalfe, J. (2009). Metacognitive Judgments and Control of Study. Current Directions in Psychological Science, 18(3), 159–163. https://doi.org/10.1111/j.1467-8721.2009.01628.x

    Article  Google Scholar 

  • Möhring, W., Newcombe, N. S., Levine, S. C., & Frick, A. (2016). Spatial proportional reasoning is associated with formal knowledge about fractions. Journal of Cognition and Development, 17(1), 67–84.

    Article  Google Scholar 

  • Möhring, W., Frick, A., & Newcombe, N. S. (2018). Spatial scaling, proportional thinking, and numerical understanding in 5- to 7-year-old children. Cognitive Development, 45, 57–67. https://doi.org/10.1016/j.cogdev.2017.12.001

    Article  Google Scholar 

  • Mood, C. (2010). Logistic regression: Why we cannot do what we think we can do, and what we can do about it. European Sociological Review, 26(1), 67–82.

    Article  Google Scholar 

  • Mueller, M. L., & Dunlosky, J. (2017). How beliefs can impact judgments of learning: Evaluating analytic processing theory with beliefs about fluency. JOurnal of Memory and Language, 93, 245–258.

    Article  Google Scholar 

  • Mueller, M. L., Dunlosky, J., Tauber, S. K., & Rhodes, M. G. (2014). The font-size effect on judgments of learning: Does it exemplify fluency effects or reflect people’s beliefs about memory? Journal of Memory and Language., 70, 1–12. https://doi.org/10.1016/j.jml.2013.09.007

    Article  Google Scholar 

  • Murayama, K., Sakaki, M., Yan, V. X., & Smith, G. M. (2014). Type I error inflation in the traditional by-participant analysis to metamemory accuracy: A generalized mixed-effects model perspective. Journal of Experimental Psychology: Learning, Memory, and Cognition, 40(5), 1287. https://doi.org/10.1037/a0036914

    Article  Google Scholar 

  • Nelson, T. O., & Narens, L. (1990). Metamemory: A Theoretical Framework and New Findings. In Psychology of Learning and Motivation (Vol. 26, pp. 125–173). Elsevier. https://doi.org/10.1016/S0079-7421(08)60053-5

  • Nelson, L. J., & Fyfe, E. R. (2019). Metacognitive monitoring and help-seeking decisions on mathematical equivalence problems. Metacognition and Learning, 14(2), 167–187. https://doi.org/10.1007/s11409-019-09203-w

    Article  Google Scholar 

  • Newcombe, N. S., Levine, S. C., & Mix, K. S. (2015). Thinking about quantity: The intertwined development of spatial and numerical cognition. Wiley Interdisciplinary Reviews: Cognitive Science, 6(6), 491–505.

    Google Scholar 

  • Nussinson, R., & Koriat, A. (2008). Correcting experience-based judgments: The perseverance of subjective experience in the face of the correction of judgment. Metacognition and Learning, 3, 159–174.

    Article  Google Scholar 

  • O’Leary, A. P., & Sloutsky, V. M. (2017). Carving Metacognition at Its Joints: Protracted Development of Component Processes. Child Development, 88(3), 1015–1032. https://doi.org/10.1111/cdev.12644

    Article  Google Scholar 

  • O’Leary, A. P., & Sloutsky, V. M. (2018). Components of metacognition can function independently across development. Developmental Psychology, 55(2), 315–328. https://doi.org/10.1037/dev0000645

    Article  Google Scholar 

  • Opfer, J. E., & DeVries, J. M. (2008). Representational change and magnitude estimation: Why young children can make more accurate salary comparisons than adults. Cognition, 108(3), 843–849.

    Article  Google Scholar 

  • Opfer, J. E., Siegler, R. S., & Young, C. J. (2011). The powers of noise-fitting: Reply to Barth and Paladino. Developmental Science, 14(5), 1194–1204. https://doi.org/10.1111/j.1467-7687.2011.01070.x

    Article  Google Scholar 

  • Opfer, J. E., Thompson, C. A., & Kim, D. (2016). Free versus anchored numerical estimation: A unified approach. Cognition, 149, 11–17. https://doi.org/10.1016/j.cognition.2015.11.015

    Article  Google Scholar 

  • Peeters, D., Verschaffel, L., & Luwel, K. (2017). Benchmark-based strategies in whole number line estimation. British Journal of Psychology, 108(4), 668–686.

    Article  Google Scholar 

  • Peters, E. (2012). Beyond comprehension: The role of numeracy in judgments and decisions. Current Directions in Psychological Science, 21(1), 31–35.

    Article  Google Scholar 

  • R Core Team (2021). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. https://www.R-project.org/.

  • Reder, L. M., & Ritter, F. E. (1992). What Determines Initial Feeling of Knowing? Familiarity With Question Terms, Not With the Answer. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18(3), 435–451. https://doi.org/10.1037/0278-7393.18.3.435

    Article  Google Scholar 

  • Resnick, I., Davatzes, A., Newcombe, N. S., & Shipley, T. F. (2017). Using analogy to learn about phenomena at scales outside human perception. Cognitive Research: Principles and Implications, 2(1), 21. https://doi.org/10.1186/s41235-017-0054-7

    Article  Google Scholar 

  • Rivers, M. L., Fitzsimmons, C. J., Fisk, S. R., Dunlosky, J., & Thompson, C. A. (2021). Gender differences in confidence during number-line estimation. Metacognition and Learning, 16(1), 157–178. https://doi.org/10.1007/s11409-020-09243-7

    Article  Google Scholar 

  • Roebers, C. M., & Spiess, M. (2017). The development of metacognitive monitoring and control in second graders: A short-term longitudinal study. Journal of Cognition and Development, 18(1), 110–128.

    Article  Google Scholar 

  • Roebers, C. M., Mayer, B., Steiner, M., Bayard, N. S., & van Loon, M. H. (2019). The role of children’s metacognitive experiences for cue utilization and monitoring accuracy: A longitudinal study. Developmental Psychology, 55(10), 2077. https://doi.org/10.1037/dev0000776

    Article  Google Scholar 

  • Scheibe, D., Fitzsimmons, C. J., Mielicki, M. K., Taber, J. M., Sidney, P. G., Coifman, K., & Thompson, C. A. (in press). Confidence in COVID problem solving: What factors predict adults’ item-level metacognitive judgments on health-related math problems before and after an educational intervention? Metacognition and Learning.

  • Sidney, P. G., Thalluri, R., Buerke, M. L., & Thompson, C. A. (2019). Who uses more strategies? Linking mathematics anxiety to adults’ strategy variability and performance on fraction magnitude tasks. Thinking & Reasoning, 25(1), 94–131.

    Article  Google Scholar 

  • Siegler, R. S., & Thompson, C. A. (2014). Numerical landmarks are useful—except when they’re not. Journal of Experimental Child Psychology, 120, 39–58. https://doi.org/10.1016/j.jecp.2013.11.014

    Article  Google Scholar 

  • Siegler, R. S., Thompson, C. A., & Schneider, M. (2011). An integrated theory of whole number and fractions development. Cognitive Psychology, 62(4), 273–296. https://doi.org/10.1016/j.cogpsych.2011.03.001

    Article  Google Scholar 

  • Siegler, R. S., Duncan, G. J., Davis-Kean, P. E., Duckworth, K., Claessens, A., Engel, M., et al. (2012). Early predictors of high school mathematics achievement. Psychological Science, 23(7), 691–697. https://doi.org/10.1177/0956797612440101

    Article  Google Scholar 

  • Sullivan, J. L., Juhasz, B. J., Slattery, T. J., & Barth, H. C. (2011). Adults’ number-line estimation strategies: Evidence from eye movements. Psychonomic Bulletin & Review, 18(3), 557–563.

    Article  Google Scholar 

  • Thompson, C. A., Sidney, P. G., Fitzsimmons, C. J., Mielicki, M., Schiller, L. K., Scheibe, D. A., Opfer, J. E., & Siegler, R. S. (2022). Comments regarding Numerical estimation strategies are correlated with math ability in school-age children. Cognitive Development.

  • Thompson, C. A., & Opfer, J. E. (2008). Costs and benefits of representational change: Effects of context on age and sex differences in symbolic magnitude estimation. Journal of Experimental Child Psychology, 101(1), 20–51.

    Article  Google Scholar 

  • Undorf, M., & Erdfelder, E. (2013). Separation of encoding fluency and item difficulty effects on judgements of learning. Quarterly Journal of Experimental Psychology, 66(10), 2060–2072. https://doi.org/10.1080/17470218.2013.777751

    Article  Google Scholar 

  • Vuorre, M., & Metcalfe, J. (2021). Measures of relative metacognitive accuracy are confounded with task performance in tasks that permit guessing. Metacognition and Learning, 17, 269–291. https://doi.org/10.1007/s11409-020-09257-1

    Article  Google Scholar 

  • Wall, J. L., Thompson, C. A., Dunlosky, J., & Merriman, W. E. (2016). Children can accurately monitor and control their number-line estimation performance. Developmental Psychology, 52(10), 1493. https://doi.org/10.1037/dev0000180

    Article  Google Scholar 

  • Weaver, C. A., & Bryant, D. S. (1995). Monitoring of comprehension: The role of text difficulty in metamemory for narrative and expositorytext. Memory and Cognition, 23, 12–22.

    Article  Google Scholar 

  • Yang, C., Zhao, W., Yuan, B., Luo, L., & Shanks, D. R. (2023). Mind the Gap Between Comprehension and Metacomprehension: Meta-Analysis of Metacomprehension Accuracy and Intervention Effectiveness. Review of Educational Research, 93(2), 143–194. https://doi.org/10.3102/00346543221094083

    Article  Google Scholar 

Download references

Acknowledgements

Support for this research was provided in part by the U.S. Department of Education, Institute of Education Sciences Grant R305A160295 and R305U200004 to Clarissa A. Thompson. We would like to thank members of the first authors’ dissertation, John Dunlosky, Nora Newcombe, Brad Morris, Chris Was, and Jeff Ciesla for their valued input on this work.

Funding

This research was funded by Institute of Education Sciences (IES) grants R305A160295 and R305U200004.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Charles J. Fitzsimmons.

Ethics declarations

Conflicts of interest

The authors declare no conflicts of interest.

Ethical approval

This study was approved by the Kent State University (protocol #: 21–289).

Informed consent

Adults provided informed consent via the online survey platform in line with the IRB protocol.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Part of the data and writing in this study were included as the first authors’ dissertation. We report all measures included in the study and all data and analytic scripts are available on the OSF project page (https://osf.io/g7rxn/). All analyses were run in R. This study was pre-registered on OSF (https://osf.io/myqjp/).

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fitzsimmons, C.J., Thompson, C.A. Why is monitoring accuracy so poor in number line estimation? The importance of valid cues and systematic variability for U.S. college students. Metacognition Learning 19, 21–52 (2024). https://doi.org/10.1007/s11409-023-09345-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11409-023-09345-y

Keywords

Navigation