Skip to main content

The Role of Data Simulation in Quantitative Ethnography

  • Conference paper
  • First Online:
Advances in Quantitative Ethnography (ICQE 2022)

Abstract

Data simulations are powerful analytic tools that give researchers a great degree of control over data collection and experimental design. Despite these advantages, data simulations have not yet received the same amount of use as other techniques within the context of quantitative ethnography. In this paper, we explore the reasons for this and use examples of recent work to argue that data simulations can—and already do—play an important role in quantitative ethnography.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    In textual data, lines of text are composed of tokens: the individual, or unique combinations of, pieces of information that each line of data contains [22].

References

  1. Almuallim, H., Dietterich, T.G.: Learning with many irrelevant features. In: Proceedings of the Ninth National Conference on Artificial Intelligence AAAI, vol. 91, pp. 547–552 (July 1991)

    Google Scholar 

  2. Csanadi, A., Eagan, B., Kollar, I., Shaffer, D.W., Fischer, F.: When coding-and counting is not enough: using epistemic network analysis (ENA) to analyze verbal data in CSCL research. Int. J. Comput.-Support. Collab. Learn. 13(4), 419–438 (2018)

    Article  Google Scholar 

  3. DeChurch, L.A., Mesmer-Magnus, J.R.: The cognitive underpinnings of effective teamwork: a meta-analysis. J. Appl. Psychol. 95(1), 32–53 (2010). http://doi.org/10.1037/a0017328, http://doi.apa.org/getdoi.cfm?doi=10.1037/a0017328

  4. Eagan, B., Brohinsky, J., Wang, J., Shaffer, D.W.: Testing the reliability of inter-rater reliability. In: Proceedings of the 10th International Conference on Learning Analytics & Knowledge, pp. 454–461. Association for Computing Machinery (2020). http://www.epistemicanalytics.org/wpcontent/uploads/2020/06/LAK20_Eagan_IRR_Camera_Ready.pdf,https://doi.org/10.1145/3375462.3375508

  5. Eagan, B., Rogers, B., Serlin, R., Ruis, A., Arastoopour, G., Shaffer, D.W.: Can we rely on reliability? Testing the assumptions of inter-rater reliability. In: Smith, B., Borge, M., Mercier, E., Yon Lim, K. (eds.) Making a Difference: Prioritizing Equity and Access in CSCL: 12th International Conference on Computer Supported Collaborative Learning (CSCL) 2017, vol. 2, pp. 529–532 (2017)

    Google Scholar 

  6. Eagan, B.R.: Measuring the Impact of Transcription Error. Doctoral Dissertation, University of Wisconsin - Madison (2020)

    Google Scholar 

  7. Frank, K., Min, K.S.: 10. Indices of robustness for sample representation. Sociol. Methodol. 37(1), 349–392 (2007)

    Article  Google Scholar 

  8. Gilad-Bachrach, R., Navot, A., Tishby, N.: Margin based feature selection-theory and algorithms. In: Proceedings of the Twenty-First International Conference on Machine learning, p. 43 (July 2004)

    Google Scholar 

  9. Gilber, N., Troitzsch, K.: Simulation for the Social Scientist. McGraw-Hill Education, UK (2005)

    Google Scholar 

  10. Jager, W., Popping, R., Van de Sande, H., Jager, W., Popping, R., Van de Sande, H.: Clustering and fighting in two-party crowds: simulating the approach avoidance conflict. J. Artif. Soc. Soc. Simul. 4(3), 1–18 (2001)

    Google Scholar 

  11. Kaliisa, R., Misiejuk, K., Arastoopour, G., Misfeldt, M.: Scoping the emerging field of quantitative ethnography: opportunities, challenges and future directions. In: Ruis, A., Lee, S. (eds.) Advances in Quantitative Ethnography: Second International Conference, ICQE 2020, Malibu, CA, USA, February 1–3, 2021, Proceedings, pp. 3–17. Springer, Heidelberg (2021). https://doi.org/10.1007/9783-030-67788-6_1, https://link.springer.com/chapter/10.1007/978-3-030-67788-6_1

  12. Liu, H., Setiono, R.: A probabilistic approach to feature selection-a filter solution. In: ICML, vol. 96, pp. 319–327 (July 1996)

    Google Scholar 

  13. Ruis, A.R., Siebert-Evenstone, A.L., Pozen, R., Eagan, B.R., Shaffer, D.W.: Finding common ground: a method for measuring recent temporal context in analyses of complex, collaborative thinking. In: A Wide Lens: Combining Embodied, Enactive, Extended, and Embedded Learning in Collaborative Settings: 13th International Conference on Computer Supported Collaborative Learning (CSCL), vol. 1, pp. 136–143 (2019)

    Google Scholar 

  14. Shaffer, D.W.: Quantitative Ethnography. Cathcart Press (2017). http://www.quantitativeethnography.org/

  15. Shaffer, D.W., Collier, W., Ruis, A.R.: A tutorial on epistemic network analysis: analyzing the structure of connections in cognitive, social, and interaction data. J. Learn. Anal. 3(3), 9–45 (2016). http://learninganalytics.info/journals/index.php/JLA/article/view/4329

  16. Shaffer, D.W., Ruis, A.R.: How we code. In: Ruis, A.R., Lee, S.B. (eds.) ICQE 2021. CCIS, vol. 1312, pp. 62–77. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-67788-6_5

    Chapter  Google Scholar 

  17. Shaffer, D.W., Serlin, R.: What good are statistics that don’t generalize? Educ. Res. 33(9), 14–25 (2004)

    Article  Google Scholar 

  18. Slavin, R.E.: Cooperative Learning. Learning and Cognition in Education, pp. 160–166. Elsevier Academic Press, Boston (2011)

    Google Scholar 

  19. Swiecki, Z.: The expected value test: a new statistical warrant for theoretical saturation. In: Wasson, B., Zörgő, S. (eds.) Advances in Quantitative Ethnography: Third International Conference, ICQE 2021 Virtual Event, November 6–11, 2021, Proceedings. Springer, Heidelberg (2022). https://doi.org/10.1007/978-3-030-93859-8_4

  20. Swiecki, Z., Marquart, C., Eagan, B.: Simulating collaborative discourse. In: Paper Accepted to the ISLS Annual Meeting 2022 (2022)

    Google Scholar 

  21. Swiecki, Z., Ruis, A.R., Farrell, C., Shaffer, D.W.: Assessing individual contributions to collaborative problem solving: a network analysis approach. Comput. Hum. Behav. 104, 105876 (2020). https://doi.org/10.1016/j.chb.2019.01.009

    Article  Google Scholar 

  22. Webster, J., Chunuy, K.: Tokenizaion as the initial phase in NLP. In: COLING 1992 Volume 4; the 14th International Conference on Computational Linguistics (1992)

    Google Scholar 

  23. Witten, I.H., Frank, E., Hall, M.A.: Data Mining: Practical Machine Learning Tools and Techniques. Morgan Kaufmann, USA (2011)

    Google Scholar 

  24. Zörgő, S., Peters, G.J.Y., Porter, C., Moraes, M., Donegan, S., Eagan, B.: Methodology in the mirror: a living, systematic review of works in quantitative ethnography. In: Wasson, B., Zörgő, S. (eds.) Advances in Quantitative Ethnography: Third International Conference, ICQE 2021 Virtual Event, November 6–11, 2021, Proceedings. Springer, Heidelberg (November 2021). https://doi.org/10.1007/978-3-030-93859-8_10

Download references

Acknowledgements

This work was funded in part by Monash University, the National Science Foundation (DRL-1661036, DRL-1713110, DRL-2100320), the Wisconsin Alumni Research Foundation, and the Office of the Vice Chancellor for Research and Graduate Education at the University of Wisconsin-Madison. The opinions, findings, and conclusions do not reflect the views of the funding agencies, cooperating institutions, or other individuals.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zachari Swiecki .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Swiecki, Z., Eagan, B. (2023). The Role of Data Simulation in Quantitative Ethnography. In: Damşa, C., Barany, A. (eds) Advances in Quantitative Ethnography. ICQE 2022. Communications in Computer and Information Science, vol 1785. Springer, Cham. https://doi.org/10.1007/978-3-031-31726-2_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-31726-2_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-31725-5

  • Online ISBN: 978-3-031-31726-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics