Netta Ofer
Fiona Bell
ABSTRACT
Living matter is an emerging topic of interest in HCI as researchers are recognizing the unique affordances of biological materials. We explore direct interactions with Dinoflagellates, bioluminescent algae that produce light when exposed to oxygen through physical stimulation. Leveraging Dinoflagellates’ natural feedback mechanism, we propose directly engaging the human user with the organism through physical kinetic interactions. We take an organism-centered design approach, considering the well-being of the organism by focusing first on designing appropriate environments for the organism, then proceeding to exploring the available interactions within these environments. Our framework consists of four components (form, reception, feedback, and control) and can be used to guide designers in their design process with living matter. We demonstrate the framework with environments for Dinoflagellates and three real-life examples: a checkers game, a ball game. and hopscotch. Last, we discuss the constraints and limitations of integrating Dinoflagellates and living matter in interactive systems.
Supplemental Material
- Mirela Alistar and Margherita Pevere. 2020. Semina Aeternitatis: Using Bacteria for Tangible Interaction with Data. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.Google Scholar
- Gilles Bailly, Sidharth Sahdev, Sylvain Malacria, and Thomas Pietrzak. 2016. LivingDesktop: Augmenting desktop workstation with actuated devices. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 5298–5310.Google ScholarDigital Library
- Bahareh Barati, Elvin Karana, Kaspar MB Jansen, and Stan Claus. 2018. Making’a drop of light’: an illustrative case of designing for electroluminescent material experiences. International Journal of Design Engineering 8, 2 (2018), 170–196.Google ScholarCross Ref
- Fiona Bell, Alice Hong, Andreea Danielescu, Aditi Maheshwari, Ben Greenspan, Hiroshi Ishii, Laura Devendorf, and Mirela Alistar. 2021. Self-deStaining Textiles: Designing Interactive Systems with Fabric, Stains and Light. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems.Google ScholarDigital Library
- [5] Erika Blumenfeld.2016. Retrieved February 2, 2021 from https://erikablumenfeld.com/works/bioluminescence/Google Scholar
- [6] BTMETER.2020. Retrieved August 12, 2020 from https://www.amazon.com/stores/BTMETER/page/0BCF3C8A-52A3-4F3D-9322-154B2676C255?ref_=ast_blnGoogle Scholar
- Richard Buchanan. 1998. Branzi’s dilemma: design in contemporary culture. Design Issues 14, 1 (1998), 3–20.Google ScholarCross Ref
- Serena Camere and Elvin Karana. 2018. Fabricating materials from living organisms: An emerging design practice. Journal of Cleaner Production 186 (2018), 570–584.Google ScholarCross Ref
- Yves Candau, Jules Françoise, Sarah Fdili Alaoui, and Thecla Schiphorst. 2017. Cultivating kinaesthetic awareness through interaction: Perspectives from somatic practices and embodied cognition. In Proceedings of the 4th International Conference on Movement Computing. 1–8.Google ScholarDigital Library
- SS Chang, BB Prezelin, and RK Trench. 1983. Mechanisms of photoadaptation in three strains of the symbiotic dinoflagellate Symbiodinium microadriaticum. Marine Biology 76, 3 (1983), 219–229.Google ScholarCross Ref
- Adrian David Cheok, Roger Thomas Kok, Chuen Tan, Owen Noel Newton Fernando, Tim Merritt, and Janyn Yen Ping Sen. 2008. Empathetic living media. In Proceedings of the 7th ACM conference on Designing interactive systems. 465–473.Google ScholarDigital Library
- Alan Cooper. 1999. ”The inmates are running the asylum. Indianapolis, IA: SAMS”. Macmillan (1999).Google ScholarCross Ref
- Paul Coulton and Joseph Galen Lindley. 2019. More-than human centred design: Considering other things. The Design Journal 22, 4 (2019), 463–481.Google ScholarCross Ref
- Ingrid De Pauw, Prabhu Kandachar, Elvin Karana, David Peck, and Renee Wever. 2010. Nature inspired design: Strategies towards sustainability. (2010).Google Scholar
- Dennis E Desjardin, Anderson G Oliveira, and Cassius V Stevani. 2008. Fungi bioluminescence revisited. Photochemical & Photobiological Sciences 7, 2 (2008), 170–182.Google ScholarCross Ref
- Hugh Dubberly, Paul Pangaro, and Usman Haque. 2009. ON MODELING What is interaction? are there different types?interactions 16, 1 (2009), 69–75.Google Scholar
- Karen El Asmar. 2019. Social Microbial Prosthesis: Towards Super-Organism Centered Design. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 1–7.Google ScholarDigital Library
- Joanne Engebrecht, Kenneth Nealson, and Michael Silverman. 1983. Bacterial bioluminescence: isolation and genetic analysis of functions from Vibrio fischeri. Cell 32, 3 (1983), 773–781.Google ScholarCross Ref
- Sidney Fels. 2000. Intimacy and embodiment: implications for art and technology. In Proceedings of the 2000 ACM workshops on Multimedia. 13–16.Google ScholarDigital Library
- [20] DIY Bio An Institution for the Do-It-Yourself Biologist.2020. Retrieved September 16, 2020 from https://diybio.orgGoogle Scholar
- Karmen Franinović and Luke Franzke. 2015. Luminous matter. Electroluminescent paper as an active material. In Proceedings of the International Conference on Design and Semantics of Form and Movement. 37–47.Google Scholar
- Gilad Gome, Julian Waksberg, Andrey Grishko, Iddo Yehoshua Wald, and Oren Zuckerman. 2019. OpenLH: open liquid-handling system for creative experimentation with biology. In Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction. 55–64.Google ScholarDigital Library
- David S Goodsell. 2009. The machinery of life. Springer Science & Business Media.Google Scholar
- Phillip Gough, Larissa Pschetz, Naseem Ahmadpour, Leigh-Anne Hepburn, Clare Cooper, Carolina Ramirez-Figueroa, and Oron Catts. 2020. The Nature of biodesigned systems: Directions for HCI. In Companion Publication of the 2020 ACM Designing Interactive Systems Conference. 389–392.Google ScholarDigital Library
- Andreas Greiner and Sunlay Almeida Rodriguez. 2014. Toccata for Pyrocystis Fusiformis. (2014). Retrieved February 2, 2021 from http://www.andreasgreiner.com/works/toccata-for-pyrocystis-fusiformis/Google Scholar
- Foad Hamidi and Melanie Baljko. 2017. Engaging children using a digital living media system. In Proceedings of the 2017 Conference on Designing Interactive Systems. 711–723.Google ScholarDigital Library
- Tom Hitron, Idan David, Netta Ofer, Andrey Grishko, Iddo Yehoshua Wald, Hadas Erel, and Oren Zuckerman. 2018. Digital Outdoor play: Benefits and risks from an interaction design perspective. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.Google ScholarDigital Library
- David Holstius, John Kembel, Amy Hurst, Peng-Hui Wan, and Jodi Forlizzi. 2004. Infotropism: living and robotic plants as interactive displays. In Proceedings of the 5th conference on Designing interactive systems: processes, practices, methods, and techniques. 215–221.Google ScholarDigital Library
- Kristina Höök, Anna Ståhl, Martin Jonsson, Johanna Mercurio, Anna Karlsson, and Eva-Carin Banka Johnson. 2015. Cover story somaesthetic design. interactions 22, 4 (2015), 26–33.Google Scholar
- Caroline Hummels, Kees CJ Overbeeke, and Sietske Klooster. 2007. Move to get moved: a search for methods, tools and knowledge to design for expressive and rich movement-based interaction. Personal and Ubiquitous Computing 11, 8 (2007), 677–690.Google ScholarDigital Library
- Hiroshi Ishii. 2008. Tangible bits: beyond pixels. In Proceedings of the 2nd international conference on Tangible and embedded interaction. xv–xxv.Google ScholarDigital Library
- Hiroshi Ishii, Dávid Lakatos, Leonardo Bonanni, and Jean-Baptiste Labrune. 2012. Radical atoms: beyond tangible bits, toward transformable materials. interactions 19, 1 (2012), 38–51.Google ScholarDigital Library
- Yuhua Jin, Isabel Qamar, Michael Wessely, and Stefanie Mueller. 2020. Photo-Chromeleon: Re-Programmable Multi-Color Textures Using Photochromic Dyes. In Special Interest Group on Computer Graphics and Interactive Techniques Conference Emerging Technologies. 1–2.Google Scholar
- Eduard Kac. 1999. GENESIS. (1999). Retrieved February 2, 2021 from http://www.ekac.org/geninfo.htmlGoogle Scholar
- Elvin Karana, Bahareh Barati, and Elisa Giaccardi. 2020. Living artefacts: Conceptualizing livingness as a material quality in everyday artefacts. International Journal of Design 14, 3 (2020), 37–53.Google Scholar
- Jansen Kaspar, Bahareh Barati, and Stan Claus. 2016. A drop of light. (2016). Retrieved February 2, 2021 from https://www.tudelft.nl/en/ide/research/research-labs/emerging-materials-lab/electroluminescence/a-drop-of-lightGoogle Scholar
- Jansen Kaspar, Frans Taminiau, and Linda Plaude. 2016. Awearable. (2016). Retrieved February 2, 2021 from https://www.tudelft.nl/en/ide/research/research-labs/emerging-materials-lab/electroluminescence/awearableGoogle Scholar
- Jansen research group Kaspar. 2016. Electroluminescence Strip Lamp. (2016). Retrieved February 2, 2021 from https://www.tudelft.nl/en/ide/research/research-labs/emerging-materials-lab/electroluminescence/electroluminiscence-strip-lampGoogle Scholar
- Honesty Kim, Lukas Cyrill Gerber, Daniel Chiu, Seung Ah Lee, Nate J Cira, Sherwin Yuyang Xia, and Ingmar H Riedel-Kruse. 2016. LudusScope: accessible interactive smartphone microscopy for life-science education. PloS one 11, 10 (2016), e0162602.Google ScholarCross Ref
- Rebecca Klee and Siouxsie Wiles. 2013. Living Light. Retrieved February 2, 2021 from https://www.youtube.com/watch?v=XupGVZB0Y5Y&feature=emb_titleGoogle Scholar
- Satoshi Kuribayashi, Yusuke Sakamoto, and Hiroya Tanaka. 2007. I/O plant: a tool kit for designing augmented human-plant interactions. In CHI’07 extended abstracts on Human factors in computing systems. 2537–2542.Google Scholar
- Stacey Kuznetsov, Carrie Doonan, Nathan Wilson, Swarna Mohan, Scott E Hudson, and Eric Paulos. 2015. DIYbio things: open source biology tools as platforms for hybrid knowledge production and scientific participation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 4065–4068.Google ScholarDigital Library
- Michael I Latz. 2019. The Making of Infinity Cube, a Bioluminescence Art Exhibit. Limnology and Oceanography Bulletin 28, 4 (2019), 130–134.Google ScholarCross Ref
- Andrew Lau. 2004. Life Centered Design–A Paradigm For Engineering In The 21 St Century. In 2004 Annual Conference. 9–866.Google ScholarCross Ref
- Seung Ah Lee, Engin Bumbacher, Alice M Chung, Nate Cira, Byron Walker, Ji Young Park, Barry Starr, Paulo Blikstein, and Ingmar H Riedel-Kruse. 2015. Trap it! A playful human-biology interaction for a museum installation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2593–2602.Google Scholar
- Jen Liu, Daragh Byrne, and Laura Devendorf. 2018. Design for collaborative survival: An inquiry into human-fungi relationships. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.Google ScholarDigital Library
- Clara Mancini. 2011. Animal-computer interaction: a manifesto. interactions 18, 4 (2011), 69–73.Google ScholarDigital Library
- Clara Mancini. 2017. Towards an animal-centred ethics for Animal–Computer Interaction. International Journal of Human-Computer Studies 98 (2017), 221–233.Google ScholarDigital Library
- Samuel Mann and LG Smith. 2008. Biomimicry as a super systems metaphor for software engineering. In 21st Annual Conference of the National Advisory Committee on Computing Qualifications, Supplementary Proceedings, Auckland. Citeseer.Google Scholar
- Marta de Menezes. 2003. The artificial natural: manipulating butterfly wing patterns for artistic purposes. Leonardo 36, 1 (2003), 29–32.Google ScholarCross Ref
- Timothy Merritt, Foad Hamidi, Mirela Alistar, and Marta DeMenezes. 2020. Living media interfaces: a multi-perspective analysis of biological materials for interaction. Digital Creativity 31, 1 (2020), 1–21.Google ScholarCross Ref
- Timothy Merritt, Christine Linding Nielsen, Frederik Lund Jakobsen, and Jens Emil Grønbæk. 2017. GlowPhones: Designing for Proxemics Play with Low-Resolution Displays in Location-based Games.. In CHI PLAY. 69–81.Google Scholar
- Hideshi Nakamura, Yoshito Kishi, Osamu Shimomura, David Morse, and J Woodland Hastings. 1989. Structure of dinoflagellate luciferin and its enzymic and nonenzymic air-oxidation products. Journal of the American Chemical Society 111, 19 (1989), 7607–7611.Google ScholarCross Ref
- Iohanna Nicenboim, Elisa Giaccardi, Marie Louise Juul Søndergaard, Anuradha Venugopal Reddy, Yolande Strengers, James Pierce, and Johan Redström. 2020. More-Than-Human Design and AI: In Conversation with Agents. In Companion Publication of the 2020 ACM Designing Interactive Systems Conference. 397–400.Google ScholarDigital Library
- Donald A Norman. 1988. The Psychology of Everyday Things, New York, Basic Book. paperback as the Design of Everyday Things(1988), 1990.Google Scholar
- Kalle Olli and Donald M Anderson. 2002. High encystment success of the dinoflagellate Scrippsiella cf. lachrymosa in culture experiments 1. Journal of Phycology 38, 1 (2002), 145–156.Google ScholarCross Ref
- Amanda Parkes and Connor Dickie. 2013. A biological imperative for interaction design. In CHI’13 Extended Abstracts on Human Factors in Computing Systems. 2209–2218.Google Scholar
- Amanda Parkes, Ivan Poupyrev, and Hiroshi Ishii. 2008. Designing kinetic interactions for organic user interfaces. Commun. ACM 51, 6 (2008), 58–65.Google ScholarDigital Library
- Pat Pataranutaporn, Todd Ingalls, and Ed Finn. 2018. Biological HCI: towards integrative interfaces between people, computer, and biological materials. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. 1–6.Google ScholarDigital Library
- Pat Pataranutaporn, Angela Vujic, David S Kong, Pattie Maes, and Misha Sra. 2020. Living bits: Opportunities and challenges for integrating living microorganisms in human-computer interaction. In Proceedings of the Augmented Humans International Conference. 1–12.Google ScholarDigital Library
- [61] PetSmart.2021. Retrieved February 2, 2021 from https://www.petsmart.comGoogle Scholar
- [62] PyroFarms.2021. Retrieved February 2, 2021 from https://fritzaquatics.comGoogle Scholar
- [63] PyroFarms.2021. Retrieved February 2, 2021 from https://pyrofarms.comGoogle Scholar
- Majken K Rasmussen, Esben W Pedersen, Marianne G Petersen, and Kasper Hornbæk. 2012. Shape-changing interfaces: a review of the design space and open research questions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 735–744.Google ScholarDigital Library
- K Richardson, J Beardall, and JA Raven. 1983. Adaptation of unicellular algae to irradiance: an analysis of strategies. New Phytologist 93, 2 (1983), 157–191.Google ScholarCross Ref
- RB Rivkin, HH Seliger, E Swift, and WH Biggley. 1982. Light-shade adaptation by the oceanic dinoflagellates Pyrocystis noctiluca and P. fusiformis. Marine Biology 68, 2 (1982), 181–191.Google ScholarCross Ref
- [67] Mark Rober.2013. Retrieved February 2, 2021 from https://www.youtube.com/watch?v=mDmFSz8-r7gGoogle Scholar
- Ben Salem, Adrian Cheok, and Adria Bassaganyes. 2008. BioMedia for Entertainment. In International Conference on Entertainment Computing. Springer, 232–242.Google ScholarDigital Library
- Elena Márquez Segura, Laia Turmo Vidal, and Asreen Rostami. 2016. BODYSTORMING FOR MOVEMENT-BASED INTERACTION DESIGN.Human Technology 12, 2 (2016).Google Scholar
- Richard Shusterman. 1999. Somaesthetics: A disciplinary proposal. The journal of aesthetics and art criticism 57, 3 (1999), 299–313.Google Scholar
- Nancy Smith, Shaowen Bardzell, and Jeffrey Bardzell. 2017. Designing for cohabitation: Naturecultures, hybrids, and decentering the human in design. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 1714–1725.Google ScholarDigital Library
- Frances Stracey. 2009. Bio-art: the ethics behind the aesthetics. Nature Reviews Molecular Cell Biology 10, 7 (2009), 496–500.Google ScholarCross Ref
- Katsunori Teranishi. 2007. Luminescence of imidazo [1, 2-a] pyrazin-3 (7H)-one compounds. Bioorganic chemistry 35, 1 (2007), 82–111.Google Scholar
- Bill Verplank. 2003. Interaction design sketchbook. Unpublished paper for CCRMA course Music 250a (2003), 6–10.Google Scholar
- Linden Vongsathorn, Kenton O’Hara, and Helena M Mentis. 2013. Bodily interaction in the dark. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1275–1278.Google ScholarDigital Library
- Michelle Westerlaken and Stefano Gualeni. 2016. Becoming with: towards the inclusion of animals as participants in design processes. In Proceedings of the Third International Conference on Animal-Computer Interaction. 1–10.Google ScholarDigital Library
- Emil H White, Mark G Steinmetz, Jeffrey D Miano, Peter D Wildes, and Robert Morland. 1980. Chemi-and bioluminescence of firefly luciferin. Journal of the American Chemical Society 102, 9 (1980), 3199–3208.Google ScholarCross Ref
- Siouxsie Wiles. 2016. Artists create living paintings from glow-in-the-dark bacteria. Microbiology International(2016). Retrieved February 2, 2021 from https://800ezmicro.com/blog-articles/114-artists-create-living-paintings-from-glow-in-the-dark-bacteria.htmlGoogle Scholar
- Siouxsie Wiles. 2016. Painting bacteria: art meets glow-in-the-dark microbes. Special Broadcasting Service (SBS) Australia (2016). Retrieved February 2, 2021 from https://www.sbs.com.au/topics/science/nature/article/2016/03/17/painting-bacteria-art-meets-glow-dark-microbesGoogle Scholar
- Thérèse Wilson and J Woodland Hastings. 1998. Bioluminescence. Annual review of cell and developmental biology 14, 1 (1998), 197–230.Google Scholar
- Lining Yao, Jifei Ou, Chin-Yi Cheng, Helene Steiner, Wen Wang, Guanyun Wang, and Hiroshi Ishii. 2015. bioLogic: Natto cells as nanoactuators for shape changing interfaces. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 1–10.Google ScholarDigital Library
- Bin Yu, Jun Hu, Mathias Funk, and Loe Feijs. 2018. DeLight: biofeedback through ambient light for stress intervention and relaxation assistance. Personal and Ubiquitous Computing 22, 4 (2018), 787–805.Google ScholarCross Ref
- Chi Zhang, Josh Tabor, Jialiang Zhang, and Xinyu Zhang. 2015. Extending mobile interaction through near-field visible light sensing. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. 345–357.Google ScholarDigital Library
Recommendations
Exploring Perceptual and Motor Gestalt in Touchless Interactions with Distant Displays
TEI '15: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied InteractionMarkerless motion-sensing promises to position touchless interactions successfully in various domains (e.g., entertainment or surgery) because they are deemed natural. This naturalness, however, depends upon the mechanics of touchless interaction that ...
MagicPAPER: An Integrated Shadow-Art Hardware Device Enabling Touch Interaction on Paper
DIS '18 Companion: Proceedings of the 2018 ACM Conference Companion Publication on Designing Interactive SystemsTouch interaction is usually implemented on a computer screen or a projected surface. However, tactile quality of paper is attractive and intuitive for people to manipulate in traditional paintings and storytelling. In order to enable touch interaction ...
Smart Objects and Replicas: A Survey of Tangible and Embodied Interactions in Museums and Cultural Heritage Sites
Tangible and embodied interactions are areas of research within HCI and interaction design. They refer to a way in which interacting with computer systems is closer to the way we interact with the real world. Instead of using devices such as a computer or ...
Comments