Michael Muller
Dakuo Wang
David Piorkowski
Thomas Erickson
ABSTRACT
With the rise of big data, there has been an increasing need for practitioners in this space and an increasing opportunity for researchers to understand their workflows and design new tools to improve it. Data science is often described as data-driven, comprising unambiguous data and proceeding through regularized steps of analysis. However, this view focuses more on abstract processes, pipelines, and workflows, and less on how data science workers engage with the data. In this paper, we build on the work of other CSCW and HCI researchers in describing the ways that scientists, scholars, engineers, and others work with their data, through analyses of interviews with 21 data science professionals. We set five approaches to data along a dimension of interventions: Data as given; as captured; as curated; as designed; and as created. Data science workers develop an intuitive sense of their data and processes, and actively shape their data. We propose new ways to apply these interventions analytically, to make sense of the complex activities around data practices.
- Sebastian Abt and Harold Baier (2014). A plea for utilizing synthetic data when performing machine learning based cyber-security experiments. Proc. AISec 2014. Google Scholar
Digital Library
- Ritu Agarwal and Vasant Dhar (2014). Editorial -- Big data, data science, and analytics: The opportunity and challenge for IS research. Info. Sys. Res. 25(3), 443--448. Google ScholarDigital Library
- Ashton Anderson, Jon Kleinberg, and Sendhil Mullainathan (2017). Assessing human error against a benchmark of perfection. TKDD 11(4), Art. 45. Google ScholarDigital Library
- Jesse Anderson (2018). Data engineers vs. data scientists. O'Reilly. https://www.oreilly.com/ideas/data-engineers-vs-data-scientists .Google Scholar
- Lora Aroyo and Chris Welty (2013). Crowd truth: Harnessing disagreement in crowdsourcing a relation extraction gold standard. Proc. Web Science 2013.Google Scholar
- Karen S. Baker and Geoffrey C. Bowker (2007). Information ecology: Open system environments for data, memories, and knowing. J. Intell. Inf. Syst. 29, 127--144. Google ScholarDigital Library
- Karen S. Baker and Helena Karasti (2018). Data care and its politics: Designing for local collective data management as a neglected thing. Proc. PDC 2018, Art. 10. Google ScholarDigital Library
- Jo Bates, Yu-Wei Lin, and Paula Goodale (2016). Data journeys: Capturing the socio-material constitution of data objects and flows. Big Data & Soc. 3(2), 112.Google ScholarCross Ref
- Steve Benford, Gabriella Giannachi, Boriana Koleva, and Tom Rodden (2009). From interaction to trajectories: Designing coherent journeys through user experiences. Proc. CHI 2009, 709--718, Google ScholarDigital Library
- Hélène Bilis (2018). Mapping fiction: Social networks and the novel. Presentation at Shifting (the) boundaries conference, Wellesley College.Google Scholar
- Herbert Blumer (1954). What is wrong with social theory? American Sociological Review 18, 3--1.Google ScholarCross Ref
- Glenn A. Bowen (2006). Grounded theory and sensitizing concepts. Int. J. Qual. Meth. 5(3), 12--23.Google ScholarCross Ref
- danah boyd and Kate Crawford (2012). Critical questions for big data: Provocations for a cultural, technological, and scholarly phenonomenon. Info. Comm. Soc. 15(5), 662--679.Google ScholarCross Ref
- Ciara Byrne (2013). The rise of the DIY data scientist. Fast Company. https://www.fastcompany.com/3014018/the-rise-of-the-diy-data-scientist .Google Scholar
- Jennie Carroll. 2004. Completing design in use: closing the appropriation cycle. In Proceedings of the 12th European Conference on Information Systems (ECIS 2004). 337--347.Google Scholar
- Kathy Charmaz (2015). Constructing grounded theory. Sage.Google Scholar
- Akemi T. Chatfield, Vivian N. Shlemoon, Wilbur Redublado, and Faizur Rahman (2014). Data scientists as game changers in big data environments. Proc. ACIS 2014, 1--11.Google Scholar
- Amy Cheatle and Steven J. Jackson (2015) "Digital entanglements: Craft, computation and collaboration in fine art furniture production. Proc. CSCW 2015, 958--968. Google ScholarDigital Library
- Madeline T.H. Chi, Robert Glaser, and Marshall Farr (1988/2014) (eds.). The nature of expertise. Psychology Press.Google Scholar
- Søren Christensen, Jens Bæk Jørgensen, and Kim Halskov Madsen (1997). Design as interaction with computer based materials. Proc. DIS 1997, 65--71. Google ScholarDigital Library
- Juliet Corbin and Anselm L. Strauss (2007). Basics of qualitative research: Techniques and procedures for developing grounded theory. 3rd edition. Newbury Park, CA, USA: Sage.Google Scholar
- Andrew Dearden (2006). Design as a conversation with digital materials. Des. Stud. 27(3), 399--421.Google ScholarCross Ref
- Alan Dix (2007). Designing for appropriation. Proc. BCS-HCI 2007, 27--30. Google ScholarDigital Library
- C. Dobre and F. Xhafa (2014), Intelligent services for big data science. Fut. Gen. Comp. Sys. 37, 267--291.Google ScholarCross Ref
- Anca Dumitrache, Lora Aroyo, and Chris Welty (2018). Crowdsourcing ground truth for medical relation extraction. TIIS 8(2), art. 11. Google ScholarDigital Library
- Ciarán Dunne (2011). The place of literature review in grounded theory research. Int.J. Soc. Res. Meth. 14(2), 111--124.Google ScholarCross Ref
- Hugh Durrante-Whyte (2015), Data, knowledge and discovery: Machine learning meets natural science. Proc. KDD 2015, 7. Google ScholarDigital Library
- Melanie Feinberg (2017a). A design perspective on data. Proc. CHI 2017, 29522963. Google ScholarDigital Library
- Melanie Feinberg, Daniel Carter, and Julia Bullard (2014b). A story without end: Writing the residual into descriptive infrastructure. Proc. DIS 2014, 385394. Google ScholarDigital Library
- Melanie Feinberg, Daniel Carter, Julia Bullard, and Ayse Gursoy (2017b). Translating texture: Design as integration. Proc. DIS 2017, 297--307. Google ScholarDigital Library
- Batya Friedman, Peter H. Kahn, and Alan Borning (2006). Value sensitive design and information systems. In P. Zhang and D. Galletta (eds.), HumanComputer Interaction and Management Information Systems: Foundations. M.E. Sharpe.Google Scholar
- Lisa Gitelman (2013) (ed.), "Raw data" is an oxymoron. MIT Press.Google ScholarCross Ref
- Barney G. Glaser (1998). Doing grounded theory: Issues and discussions. Mill Valley, CA: Sociology Press.Google Scholar
- Barney G. Glaser (2005). The grounded theory perspective III: Theoretical coding. Mill Valley, CA, USA: Sociology Press.Google Scholar
- Robert Glaser and Micheline T.H. Chi (1988/2014). Overview. In Michelene T.H. Chi, Robert Glaser, and Marshall J. Farr (eds). (1988/2014). The nature of expertise. Taylor and Francis.Google Scholar
- Michele Goetz (2015). 3 ways data preparation tools help you get ahead of big data. Forrester. https://go.forrester.com/blogs/15-02--17--3_ways_data _preparation_ tools_help_you_get_ahead_of_big_data/ .Google Scholar
- Jonathan Gray, Carolyn Gerlitz, and Liliana Bounegru (2018). Data infrastructure literacy. Big Data & Soc. 5(2), 1--13.Google ScholarCross Ref
- Shad Gross, Jeoffrey Bardzell and Shaowen Bardzell (2014). Structures, forms, and stuff: The materiality and medium of interaction. Pers. Ubiquit. Comput. 18(3), 637--649. Google ScholarDigital Library
- Philip J. Guo, Sean Kandel, Joseph M. Hellerstein, and Jeffrey Heer (2011). Proactive wrangling: Mixed-initiative end-user programming of data transformation scripts. Proc. UIST 2011, 65--74. Google ScholarDigital Library
- Bob Hayes (2018a). A majority of data scientists lack competency in advanced machine learning areas and techniques. BusinessOverBroadway, http://businessoverbroadway.com/a-majority-of-data-scientists-lackcompetency-in-advanced-machine-learning-areas-and-techniques .Google Scholar
- Bob Hayes (2018c). Most used data science tools and technologies in 2017 and what to expect for 2018. BusinessOverBroadway. http://businessoverbroadway.com/most-used-data-science-tools-andtechnologies-in-2017-and-what-to-expect-for-2018 .Google Scholar
- Bob Hayes (2018b). Top 10 challenges to practicing data science at work. BusinessOverBroadway. http://businessoverbroadway .com/top-10challenges-to-practicing-data-science-at-work .Google Scholar
- Jeffrey Heer, Joseph M. Hellerstein, and Sean Kandel (2015). Predictive interaction for data transformation. Proc. CIDR 2015.Google Scholar
- Tony Hey, Stewart Tansley, and Kristin Tolle (2009). The fourth paradigm: Data-intensive scientific discovery. Microsoft Research.Google Scholar
- Ming-Tung Hong and Claudia Müller-Birn (2017). Conceptualization of computer-supported collaborative sensemaking. CSCW 2017 Companion, 199--202. Google ScholarDigital Library
- Marjin Janssen and George Kuk (2016). The challenges and limits of big data algorithms in technocratic governance. Gov. Info. Quart., 33(3), 371--377.Google ScholarCross Ref
- Kaggle (2017). Kaggle ML and data science survey, 2017: A big picture view of the state of data science and machine learning. Kaggle. https://www.kaggle.com/kaggle/kaggle-survey-2017 .Google Scholar
- KDNuggets. (2018). Doing data science: A Kaggle walkthrough -- Cleaning data. https://www.kdnuggets.com/2016/03/doing-data-science-kaggleawalkthrough-cleaning-data.html .Google Scholar
- Sean Kandel, Andreas Paepcke, Joseph Hellerstein, and Jeffrey Heer (2011). Wrangler: Interactive visual specification of data transformation scripts. Proc. CHI 2011, 3363--3372. Google ScholarDigital Library
- James Max Kanter and Kalyan Veeramachaneri (2015). Deep feature synthesis: Towards automating data science endeavors. Proc. DSAA 2015, 1--10.Google ScholarCross Ref
- Jakko Kemper and Daan Kolkman (2018). Transparent to whom? No algorithmic accountability without a critical audience. Info. Comm. & Soc.Google Scholar
- Allison Kidd (1994). The marks are on the knowledge worker. Proc. CHI 1994, 186--191. Google ScholarDigital Library
- Miryung Kim, Thomas Zimmermann, Robert DeLine, and Andrew Begel (2016). The emerging role of data scientists on software development teams. Proc. IEEE CSE 2016, 96--107. Google ScholarDigital Library
- John King and Roger Magoulas (2015). 2015 data science salary survey: Tools, trends, what pays (and what doesn't) data professionals. O,Reilly. http://www.eli.sdsu.edu/courses/fall16/cs696/2015-data-science-salarysurvey.pdf .Google Scholar
- Ákos Kiss and Tamás Szirányi (2013). Evaluation of manually created ground truth for multi-view people localization. Proc. VIGTA 2013. Google ScholarDigital Library
- Peter Gall Krogh, Marianne Graves Petersen, Kenton O'Hara, and Jens Emil Grønbæk (2017). Sensitizing concepts for socio-spatial literacy in HCI. Proc. CHI 2017, 6449--6460. Google ScholarDigital Library
- Cheng Han Lee (2014). Data career paths: Data analyst vs. data scientist vs. data engineer: 3 data careers decoded and what it means for you. Udacity. https://blog.udacity.com/2014/12/data-analyst-vs-data-scientist-vs-dataengineer.htmlGoogle Scholar
- Alan Lesgold, Harriet Rubinson, Paul Feltovich, Robert Glaser, Dale Klopfer, and Yen Wang (1988/2014). Expertise in a complex skill: Diagnosing X-ray pictures. In Michelene T.H. Chi, Robert Glaser, and Marshall J. Farr (eds). (1988/2014). The nature of expertise. Taylor and Francis.Google Scholar
- Jessica Lingel (2016). The poetics of socio-technical space: Evaluating the Internet of things through craft. Proc. CHI 2016, 815--826. Google ScholarDigital Library
- Jessica Lingel and Tim Regan (2014). "it's in your spinal cord, it's in your fingertips: practices of tools and craft in building software." Proc. CSCW 2014, 295--304. Google ScholarDigital Library
- Paul Luo Li, Andrew J. Ko, and Jiamin Zhu (2015). What makes a great software engineer? Proc. ICSE 2015, 700--710. Google ScholarDigital Library
- Karen Grace Martin (2018). Preparing data for analysis is (more than) half the battle. Analysis Factor. https://www.theanalysisfactor.com/preparing-dataanalysis/ .Google Scholar
- Gerry McGhee, Glenn R. Marland, and Jacqueline Atkinson (2007). Grounded theory research: Literature reviewing and reflexivity. J. Adv. Nurs. 60(3), 334342.Google ScholarCross Ref
- Helena M. Mentis, Ahmed Rahim, and Pierre Theodore (2016). Crafting the image in surgical telemedicine. Proc. CSCW 2016, 744--755. Google ScholarDigital Library
- Renée J. Miller (2017). The future of data integration. Proc. KDD 2017, 3. Google ScholarDigital Library
- Steven Miller (2014). Collaborative approaches needed to close the big data knowledge and skills gap. J. Org. Des. 3(1), 26--30.Google Scholar
- Julia Moehrmann and Gunther Heidemann (2012). Efficient annotation of image data sets for computer vision applications. Proc. VIGTA 12. Google ScholarDigital Library
- Michael Muller (2014). Curiosity, creativity, and surprise as analytic tools: Grounded theory method. In Judith Olson and Wendy A. Kellogg (eds.), Ways of knowing in HCI. Springer.Google ScholarCross Ref
- Syed Sadat Nazrul (2018). DevOps for data scientists: Taming the unicorn. Medium: Towards Data Science, https://towardsdatascience.com/devopsfor-data-scientists-taming-the-unicorn-6410843990de .Google Scholar
- Gina Neff, Ahissa Tanweer, Brittany Fiore-Gartland, and Laura Osburn (2017). Critique and contribute: A practice-based framework for improving critical data studies and data science. Big Data 5(2), 85--97.Google ScholarCross Ref
- Samir Passi and Steven J. Jackson (2017). Data vision: Learning to see through algorithmic abstraction. Proc. CSCW 2017, 2436--2447. Google ScholarDigital Library
- Kayur Patel, James Fogarty, James A. Landay, and Beverly Harrison (2008). Investigating statistical machine learning as a tool for software development. Proc. CHI 2008, 667--676. Google ScholarDigital Library
- Kathleen H. Pine and Max Liboiron (2015). The politics of measurement and action. Proc. CHI 2015, 3147--3156. Google ScholarDigital Library
- Sarah Pink, Minna Ruckenstein, Robert Willim, and Melisa Duque (2018). Broken data: Conceptualizing data in an emerging world. Big Data & Soc. 5(1), 1--13.Google ScholarCross Ref
- Michael I. Posner (1988/2014). Introduction. In Michelene T.H. Chi, Robert Glaser, and Marshall J. Farr (eds). (1988/2014). The nature of expertise. Taylor and Francis.Google ScholarCross Ref
- Krishna Rajan (2013). Informatics for materials science and engineering: Datadriven discovery for materials science and engineering. Elsevier.Google Scholar
- Vijayshankar Raman and Joseph M. Hellerstein (2001). Potter's wheel: An interactive data cleaning system. Proc. VLDB 2001. Google ScholarDigital Library
- Tye Rattenbury, Joseph M. Hellerstein, Jeffrey Heer, Sean Kandel, and Connor Carreras (2017). Principles of data wrangling: Practical techniques for data preparation. O'Reilly. Google ScholarDigital Library
- David Ribes (2017). Notes on the concept of data interoperability: Cases from an ecology of AIDS research infrastructures. Proc. CSCW 2017, 1514--1526. Google ScholarDigital Library
- Daniela K. Rosner, Miwa Ikemiya, and Tim Regan (2015). Resisting alignment: Code and clay. Proc. TEI 2015, 181--188. Google ScholarDigital Library
- Evelyn Ruppert (2013). Rethinking empirical social sciences. Dial. Hum. Geo. 3(3), 268--273.Google ScholarCross Ref
- Evelyn Ruppert, Penny Harvey, Celia Lury, Adrian Mackenzie, Ruth McNally, Stephanie Alice Baker, Yannis Kallianos, and Camilla Lewis (2015). Socializing big data: From concept to practice. CRESC, U. Manchester, Open U.Google Scholar
- Daniel M. Russell, George Furnas, Mark Stefik, Stuart Card, and Peter Pirolli (2008). Sensemaking workshop 2008. CHI EA 2008, 4751--4754.Google Scholar
- Donald Schön (1983). The reflective practitioner. How professionals think in action. Basic Books.Google Scholar
- Scikit-Learn (2017). scikit-learn Tutorials. http://scikit-learn.org/stable/ tutorial/index.html .Google Scholar
- Shventank Shah, Andrew Horne, and Jaime Capella (2012). Good data won't guarantee good decisions. Harv Bus Rev, Apr 2012.Google Scholar
- Susan Elliott Sim, Marisa Levitt Cohn, and Kavita Philip. (2009). The work of software development as an assemblage of computing practices. Proc. CHASE 2009, 92--95. Google ScholarDigital Library
- Charles Sutton, Timothy Hobson, James Geddes, and Rich Caruana (2018). Data diff: Interpretable, executable summaries of changes in distributions for datq wrangling. Proc. KDD 2018. Google ScholarDigital Library
- Alex S. Taylor, Siân Lindley, Tim Regan, David Sweeney, Vasilis Vlachokyriakos, Lillie Grainger, and Jessa Lingel (2015). Data-in-place: Thinking through relations between data and community. Proc. CHI 2015, 2863--2872. Google ScholarDigital Library
- Jakob Tholander, Maria Normack, and Chiara Rossitto (2012). Understanding agency in interaction design materials. Proc. CHI 2012, 2499--2508. Google ScholarDigital Library
- Paul F. Uhlir and Peter Schoder (2007). Open data for global science. Data Sci. J. 6, 36--53.Google Scholar
- Wil M.P. van der Aalst (2014). Data scientist: The engineer of the future. Proc. I-ESA 7, 13--26.Google Scholar
- Ruben Verborgh and Max De Wilde (2013). Using OpenRefine. Packt. Google ScholarDigital Library
- Leonard J. Waks (2001). Donald Schon's {sic} philosophy of design and design education. Int. J. Tech. Des. Educ. 11, 37--51.Google ScholarCross Ref
- Samuel F. Way, Daniel B. Larremore, and Aaron Clauset (2016). Gender, productivity, and prestige in computer science faculty hiring networks. Proc. WWW 2016, 1169--1179. Google ScholarDigital Library
- Mikael Wiberg (2014). Methodology for materiality: Interaction design through a material lens. Pers. Ubiquit. Comput. 18(3), 625--636. Google ScholarDigital Library
- Fo Wilson (2010). The new materiality: Digital dialogues at the boundaries of contemporary craft. Cultura Visual 1(14), 83--88.Google Scholar
- Qian Yang, Alex Scuito, John Zimmerman, Jodi Forlizzi, and Aaron Steinfeld (2018a). Investigating how experienced UX designers effectively work with machine learning. Proc. DIS 2018, Google ScholarDigital Library
- Qian Yang, Jina Suh, Nan-Chen Chen, and Gonzalo Ramos (2018b). Grounding interactive machine learning tool design in how non-experts actually build models. Proc. DIS 2018, 573--584. Google ScholarDigital Library
Index Terms
- How Data Science Workers Work with Data: Discovery, Capture, Curation, Design, Creation
Recommendations
Data Science: A Comprehensive Overview
The 21st century has ushered in the age of big data and data economy, in which data DNA, which carries important knowledge, insights, and potential, has become an intrinsic constituent of all data-based organisms. An appropriate understanding of data ...
Trust in Data Science: Collaboration, Translation, and Accountability in Corporate Data Science Projects
The trustworthiness of data science systems in applied and real-world settings emerges from the resolution of specific tensions through situated, pragmatic, and ongoing forms of work. Drawing on research in CSCW, critical data studies, and history and ...
A data warehouse architecture for clinical data warehousing
ACSW '07: Proceedings of the fifth Australasian symposium on ACSW frontiers - Volume 68Data warehousing methodologies share a common set of tasks, including business requirements analysis, data design, architectural design, implementation and deployment. Clinical data warehouses are complex and time consuming to review a series of patient ...
Comments