Abstract
Smart homes are technologically augmented spaces where several interconnected devices; artifacts and other services are available to support people. In such spaces, natural interaction with devices and things may free people from working in a desktop-like setting and provides intuitiveness in accessing various services of interest. For example, when reading a newspaper, a person might want to turn on the light or activate the media player while sitting on a couch. The proposed system provides avenues to create geometric annotation map of smart home things. The annotation map is then compared with the user’s realtime location data in order to realize programmable context-aware interaction rules with smart home services. Further, we demonstrate how the programmable framework can facilitate interaction using commonly used paradigm of TouchMe, PointMe and ScanMe to interact with Internet of Things and show the suitability of the proposed work.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ailisto, H., Pohjanheimo, L., Valkkynen, P., Strmmer, E., Tuomisto, T., Korhonen, I.: Bridging the physical and virtual worlds by local connectivity-based physical selection. Pers. Ubiquitous Comput. 10(6), 333–344
Ballagas, R., Borchers, J., Rohs, M., Sheridan, J.: The smart phone: a ubiquitous input device. IEEE Pervasive Comput. 5(1), 70–77
Ballagas, R., Rohs, M., Sheridan, J.G.: Sweep and point and shoot: phonecam-based interactions for large public displays. In: CHI ’05 Extended Abstracts on Human Factors in Computing Systems. ACM, Portland, USA (2005)
Broll, G., Rukzio, E., Paolucci, M., Wagner, M., Schmidt, A., HuBmann, H.: Perci: Pervasive service interaction with the internet of things. IEEE Internet Comput. 13(6), 74–81 (2009)
Broll, G., Siorpaes, S., Rukzio, E., Paolucci, M., Hamard, J., Wagner, M., Schmidt, A.: Supporting mobile service usage through physical mobile interaction. In: Fifth Annual IEEE International Conference on Pervasive Computing and Communications. White Plains, NY (2007)
Chen, Q., Cordea, M.D., Petriu, E.M., Varkonyi Koczy, A.R., Whalen, T.E.: Human computer interaction for smart environment applications using hand gestures and facial expressions. Int. J. Adv. Media Commun. 3(1/2), 95–109 (2009)
Egenhofer, M.: Spatial information appliances: a next generation of geographic information systems. In: First Brazilian Workshop on Geoinformatics. Campinas, Brazil (1999)
Froehlich, P., Baillie, L., Simon, R.: Realizing the vision of mobile spatial interaction. Interactions 15(1) (2008)
Gellersen, H., Fischer, C., Guinard, D., Gostner, R., Kortuem, G., Kray, C., Rukzio, E., Streng, S.: Supporting device discovery and spontaneous interaction with spatial references. Pers. Ubiquitous Comput. 13(4) (2008)
Hinske, S.: Pulling Digital Data from a Smart Object: Implementing the PullMe-Paradigm with a Mobile Phone. Human-Computer Interaction. Interaction Platforms and Techniques, Chap. Lecture Notes in Computer Science, pp. 306–310. Springer, Berlin/Heidelberg (2007)
Jaimes, A., Sebe, N.: Multimodal human-computer interaction: a survey. Comput. Vis. Image Underst. 108(1–2), 116–134 (2007)
Madhavapeddy, A., Scott, D., Sharp, R., Upton, E.: Using camera phones to enhance human-computer interaction. In: Adjunct Proc. 6th Int’l Conf. Ubiquitous Computing (UbiComp 2004) (2004)
Mantyjarvi, J., Paterno, F., Salvador, Z., Santoro, C.: Scan and tilt: towards natural interaction for mobile museum guides (2006)
Nakazato, Y., Kanbara, M., Yokoya, N.: Localization system for large indoor environments using invisible markers. In: Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology. ACM, Bordeaux, France (2008)
Pering, T., Ballagas, R., Want, R.: Spontaneous marriages of mobile devices and interactive spaces. Commun. ACM 48(9), 53–59
Rahman, A.S.M.M., Hossain, M.A., Parra, J., El Saddik, A.: Motion-path based gesture interaction with smart home services. In: Proceedings of the Seventeen ACM International Conference on Multimedia. ACM, Beijing, China (2009)
Rahman, A.S.M.M., Cha, J., El Saddik, A.: Authoring edutainment content through video annotations and 3d model augmentation. In: IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems (VECIMS), pp. 370–374. China, Hong Kong (2009)
Riekki, J., Salminen, T., Alakarppa, I.: Requesting pervasive services by touching RFID tags. IEEE Pervasive Comput. 5(2), 40–46 (2006)
Rohs, M.: Visual code widgets for marker-based interaction. In: 25th IEEE International Conference on Distributed Computing Systems Workshops, pp. 506–513 (2005)
Rohs, M.: Real-world interaction with camera-phones. In: 2nd International Symposium on Ubiquitous Computing Systems. Springer (2004)
Rukzio, E., Leichtenstern, K., Callaghan, V., Holleis, P., Schmidt, A., Chin, J.: An Experimental Comparison of Physical Mobile Interaction Techniques: Touching, Pointing and Scanning, vol. 4206. Springer, Berlin/Heidelberg (2006)
Ruzkio, E., Broll, G., Leichtenstern, K., Schmidt, A.: Mobile interaction with the real world: an evaluation and comparison of physical mobile interaction techniques. In: AmI-07: European Conference on Ambient Intelligence. Springer, Darmstadt, Germany (2007)
Sanchez, I., Riekki, J., Pyykknen, M.: Touch and control: interacting with services by touching RFID tags. In: Proc of IWRT 08 (2008)
Schoo, P., Paolucci, M.: Do you talk to each poster? security and privacy for interactions with web service by means of contact free tag readings. In: First International Workshop on Near Field Communication, pp. 81–86. IEEE Computer Society (2009)
Schramm, W.: Television in the lives of our children. Stanford University Press (1961)
Siltanen, S., Woodward, C., Valli, S., Honkamaa, P., Rauber, A.: User Interaction for Mobile Devices, vol. 33. Springer, US (2008)
Strachan, S., Murray-Smith, R.: Bearing-based selection in mobile spatial interaction. In: Personal and Ubiquitous Computing, pp. 265–280 (2009)
Tomitsch, M., Schl, R., Grechenig, T., Wimmer, C., Thomas, K.: Accessible real-world tagging through audio-tactile location markers. In: 5th Nordic Conference on Human-Computer Interaction: Building Bridges. ACM, Lund, Sweden (2008)
Valkkynen, P., Tuomisto, T.: Physical browsing research. In: Pervasive Mobile Interaction Devices. Springer (2005)
Want, R., Fishkin, K.P., Gujar, A., Harrison, B.L.: Bridging physical and virtual worlds with electronic tags. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: the CHI is the Limit, pp. 370–377. ACM, Pittsburgh, Pennsylvania, United States (1999)
Zhang, B., Rau, P.L.P., Salvendy, G.: Design and evaluation of smart home user interface: effects of age, tasks and intelligence level. Behav. Inf. Technol. 28(3), 239–249 (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Rahman, A.S.M.M., Momeni, M., Braton, C. (2024). Towards Programmable Context Aware Interaction with Smart Home Internet of Things. In: Arai, K. (eds) Intelligent Systems and Applications. IntelliSys 2023. Lecture Notes in Networks and Systems, vol 824. Springer, Cham. https://doi.org/10.1007/978-3-031-47715-7_45
Download citation
DOI: https://doi.org/10.1007/978-3-031-47715-7_45
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-47714-0
Online ISBN: 978-3-031-47715-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)