Tim Campbell
Cesar Torres
Eric Paulos
ABSTRACT
Fluid User Interfaces (Fl.UIs) are liquid-based touch surfaces that use computer vision to detect and interpret a range of tactile user inputs. While Fl.UIs have less input resolution than digital touch screens, they provide an excellent low-cost solution for rapidly prototyping non-rectilinear screen designs as well as exploring novel surface interaction techniques. Fabricated on a laser cutter using low-cost materials, Fl.UIs use unique shape outlines to displace an internal colored liquid to regions-of-interest for a camera. This paper presents a set of software tools that help users rapidly design, fabricate and author interactions with Fl.UIs. The robust construction and an unpowered surface makes Fl.UIs well-suited for outdoor and public installations. Our Fl.UIs prototyping tool encourages these uncommon "screens" to emerge in complex environments (i.e. urban spaces, benches, tables, fountains, sidewalks).
Supplemental Material
- Bränzel, A., Holz, C., Hoffmann, D., Schmidt, D., Knaust, M., Läuhne, P., Meusel, R., Richter, S., and Baudisch, P. Gravityspace: Tracking users and their poses in a smart room using a pressure-sensing floor. In CHI '13, ACM Press (2013), 725--734. Google Scholar
Digital Library
- Follmer, S., Johnson, M., Adelson, E., and Ishii, H. deForm: An interactive malleable surface for capturing 2.5D arbitrary objects, tools and touch. In UIST '11, ACM Press (2011), 527--536. Google ScholarDigital Library
- Han, J. Y. Low-cost multi-touch sensing through frustrated total internal reflection. In UIST '05, ACM Press (2005), 115--118. Google ScholarDigital Library
- Harrison, C., and Hudson, S. E. Providing dynamically changeable physical buttons on a visual display. In CHI '09, ACM Press (2009), 299--308. Google ScholarDigital Library
- Hartmann, B., and Wright, P. K. Designing bespoke interactive devices. Computer 46, 8 (2013), 85--89. Google ScholarDigital Library
- Hennecke, F., Berwein, F., and Butz, A. Optical pressure sensing for tangible user interfaces. In Proc. ITS '11, ACM Press (2011), 45--48. Google ScholarDigital Library
- Hilliges, O., Kim, D., and Izadi, S. Creating malleable interactive surfaces using liquid displacement sensing. In Proc. Tabletop 2008, IEEE Press (2008), 157160.Google ScholarCross Ref
- Jansen, Y. Mudpad: fluid haptics for multitouch surfaces. In Extended Abstracts of CHI '10, ACM (2010), 43514356. Google ScholarDigital Library
- Lehni, J., and Puckey, J. Paper.js, 2011.Google Scholar
- Matsushita, N., and Rekimoto, J. HoloWall: designing a finger, hand, body, and object sensitive wall. In UIST '97, ACM Press (1997), 209--210. Google ScholarDigital Library
- Maynes-Aminzade, D., Winograd, T., and Igarashi, T. Eyepatch: prototyping camera-based interaction through examples. In UIST '07, ACM Press (2007), 33--42. Google ScholarDigital Library
- Moeller, J., and Kerne, A. Zerotouch: An optical multi-touch and free-air interaction architecture. In CHI '12, ACM Press (2012), 2165--2174. Google ScholarDigital Library
- Murugappan, S., Vinayak, Elmqvist, N., and Ramani, K. Extended multitouch: Recovering touch posture and differentiating users using a depth camera. In UIST '12, ACM Press (2012), 487--496. Google ScholarDigital Library
- Swain, M. J., and Ballard, D. H. Color indexing. Int'l J. Computer Vision '91, 1 (1991), 1132. Google ScholarDigital Library
- Sylvester, A., Dring, T., and Schmidt, A. Liquids, smoke, and soap bubbles: reflections on materials for ephemeral user interfaces. In TEI '10, ACM (2010), 269--270. Google ScholarDigital Library
Index Terms
- Fl.UIs: Liquid-Mediated Vision Based Touch Surfaces
Recommendations
PERCs: Persistently Trackable Tangibles on Capacitive Multi-Touch Displays
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & TechnologyTangible objects on capacitive multi-touch surfaces are usually only detected while the user is touching them. When the user lets go of such a tangible, the system cannot distinguish whether the user just released the tangible, or picked it up and ...
PERCs Demo: Persistently Trackable Tangibles on Capacitive Multi-Touch Displays
ITS '15: Proceedings of the 2015 International Conference on Interactive Tabletops & SurfacesTangible objects on capacitive multi-touch surfaces are usually only detected while the user is touching them. When the user lets go of such a tangible, the system cannot distinguish whether the user just released the tangible, or picked it up and ...
reacTIVision and TUIO: a tangible tabletop toolkit
ITS '09: Proceedings of the ACM International Conference on Interactive Tabletops and SurfacesThis article presents the recent updates and an evaluation of reacTIVision, a computer vision toolkit for fiducial marker tracking and multi-touch interaction. It also discusses the current and future development of the TUIO protocol and framework, ...
Comments