skip to main content
10.1145/3580585.3606461acmconferencesArticle/Chapter ViewAbstractPublication PagesautomotiveuiConference Proceedingsconference-collections
research-article

ARcoustic: A Mobile Augmented Reality System for Seeing Out-of-View Traffic

Published:18 September 2023Publication History

ABSTRACT

Locating out-of-view vehicles can help pedestrians to avoid critical traffic encounters. Some previous approaches focused solely on visualising out-of-view objects, neglecting their localisation and limitations. Other methods rely on continuous camera-based localisation, raising privacy concerns. Hence, we propose the ARcoustic system, which utilises a microphone array for nearby moving vehicle localisation and visualises nearby out-of-view vehicles to support pedestrians. First, we present the implementation of our sonic-based localisation and discuss the current technical limitations. Next, we present a user study (n = 18) in which we compared two state-of-the-art visualisation techniques (Radar3D, CompassbAR) to a baseline without any visualisation. Results show that both techniques present too much information, resulting in below-average user experience and longer response times. Therefore, we introduce a novel visualisation technique that aligns with the technical localisation limitations and meets pedestrians’ preferences for effective visualisation, as demonstrated in the second user study (n = 16). Lastly, we conduct a small field study (n = 8) testing our ARcoustic system under realistic conditions. Our work shows that out-of-view object visualisations must align with the underlying localisation technology and fit the concrete application scenario.

References

  1. Abduladhem Abdulkareem Ali and Hussein Alaa Hussein. 2016. Distance estimation and vehicle position detection based on monocular camera. In 2016 Al-Sadeq International Conference on Multidisciplinary in IT and Communication Science and Applications (AIC-MITCSA). 1–4. https://doi.org/10.1109/AIC-MITCSA.2016.7759904Google ScholarGoogle ScholarCross RefCross Ref
  2. Tatsuya Amano, Shugo Kajita, Hirozumi Yamaguchi, Teruo Higashino, and Mineo Takai. 2018. Smartphone Applications Testbed Using Virtual Reality. In Proceedings of the 15th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (New York, NY, USA) (MobiQuitous ’18). Association for Computing Machinery, New York, NY, USA, 422–431. https://doi.org/10.1145/3286978.3287028Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Mingsian R. Bai, Shih-Syuan Lan, Jong-Yi Huang, Yi-Cheng Hsu, and Hing-Cheung So. 2020. Audio Enhancement and Intelligent Classification of Household Sound Events Using a Sparsely Deployed Array. The Journal of the Acoustical Society of America 147, 1 (2020), 11–24. https://doi.org/10.1121/10.0000492Google ScholarGoogle ScholarCross RefCross Ref
  4. Aaron Bangor, Philip Kortum, and James Miller. 2009. Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of usability studies 4, 3 (2009), 114–123.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Patrick Baudisch and Ruth Rosenholtz. 2003. Halo: A Technique for Visualizing off-Screen Objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Ft. Lauderdale, Florida, USA) (CHI ’03). Association for Computing Machinery, New York, NY, USA, 481–488. https://doi.org/10.1145/642611.642695Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. D. Benyon. 2019. Designing User Experience. Pearson Educación.Google ScholarGoogle Scholar
  7. Felix Bork, Christian Schnelzer, Ulrich Eck, and Nassir Navab. 2018. Towards Efficient Visual Guidance in Limited Field-of-View Head-Mounted Displays. IEEE Transactions on Visualization and Computer Graphics 24, 11 (2018), 2983–2992. https://doi.org/10.1109/TVCG.2018.2868584Google ScholarGoogle ScholarCross RefCross Ref
  8. John Brooke. 1996. SUS: A ’quick and dirty’ usability scale. In Usability Evaluation in Industry, Patrick W. Jordan, Bruce Thomas, Bernhard A. Weerdmeester, and Ian L. McClelland (Eds.). CRC Press, London, UK, Chapter 21, 189–194.Google ScholarGoogle Scholar
  9. Chia-Ming Chang, Koki Toda, Xinyue Gui, Stela H. Seo, and Takeo Igarashi. 2022. Can Eyes on a Car Reduce Traffic Accidents?. In Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Seoul, Republic of Korea) (AutomotiveUI ’22). Association for Computing Machinery, New York, NY, USA, 349–359. https://doi.org/10.1145/3543174.3546841Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Paolo Chiariotti, Milena Martarelli, and Paolo Castellini. 2019. Acoustic beamforming for noise source localization–Reviews, methodology and applications. Mechanical Systems and Signal Processing 120 (2019), 422–448.Google ScholarGoogle ScholarCross RefCross Ref
  11. Shuchisnigdha Deb, Daniel W. Carruth, Richard Sween, Lesley Strawderman, and Teena M. Garrison. 2017. Efficacy of virtual reality in pedestrian safety research. Applied Ergonomics 65 (2017), 449 – 460. https://doi.org/10.1016/j.apergo.2017.03.007Google ScholarGoogle ScholarCross RefCross Ref
  12. Najim Dehak, Patrick J. Kenny, Réda Dehak, Pierre Dumouchel, and Pierre Ouellet. 2011. Front-End Factor Analysis for Speaker Verification. IEEE Transactions on Audio, Speech, and Language Processing 19, 4 (2011), 788–798. https://doi.org/10.1109/TASL.2010.2064307Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Tamara Denning, Zakariya Dehlawi, and Tadayoshi Kohno. 2014. In Situ with Bystanders of Augmented Reality Glasses: Perspectives on Recording and Privacy-Mediating Technologies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 2377–2386. https://doi.org/10.1145/2556288.2557352Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Henrik Detjen, Sarah Faltaous, Jonas Keppel, Marvin Prochazka, Uwe Gruenefeld, Shadan Sadeghian, and Stefan Schneegass. 2022. Investigating the Influence of Gaze- and Context-Adaptive Head-up Displays on Take-Over Requests. In Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Seoul, Republic of Korea) (AutomotiveUI ’22). Association for Computing Machinery, New York, NY, USA, 108–118. https://doi.org/10.1145/3543174.3546089Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Debargha Dey, Azra Habibovic, Melanie Berger, Devanshi Bansal, Raymond H. Cuijpers, and Marieke Martens. 2022. Investigating the Need for Explicit Communication of Non-Yielding Intent through a Slow-Pulsing Light Band (SPLB) EHMI in AV-Pedestrian Interaction. In Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Seoul, Republic of Korea) (AutomotiveUI ’22). Association for Computing Machinery, New York, NY, USA, 307–318. https://doi.org/10.1145/3543174.3546086Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Debargha Dey, Kai Holländer, Melanie Berger, Berry Eggen, Marieke Martens, Bastian Pfleging, and Jacques Terken. 2020. Distance-Dependent EHMIs for the Interaction Between Automated Vehicles and Pedestrians. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Virtual Event, DC, USA) (AutomotiveUI ’20). Association for Computing Machinery, New York, NY, USA, 192–204. https://doi.org/10.1145/3409120.3410642Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. K Anders Ericsson and Herbert A Simon. 1984. Protocol analysis: Verbal reports as data.the MIT Press.Google ScholarGoogle Scholar
  18. Alessandro Evangelista, Vito Modesto Manghisi, Francesco Laera, Michele Gattullo, Antonio Emmanuele Uva, and Michele Fiorentino. 2022. CompassbAR: A Technique for Visualizing Out-of-View Objects in a Mixed Reality Environment. In Design Tools and Methods in Industrial Engineering II, Caterina Rizzi, Francesca Campana, Michele Bici, Francesco Gherardini, Tommaso Ingrassia, and Paolo Cicconi (Eds.). Springer International Publishing, Cham, 141–148.Google ScholarGoogle Scholar
  19. Ting Fu, Luis Miranda-Moreno, and Nicolas Saunier. 2018. A novel framework to evaluate pedestrian safety at non-signalized locations. Accident Analysis & Prevention 111 (2018), 23–33.Google ScholarGoogle ScholarCross RefCross Ref
  20. Joseph L Gabbard, J Edward Swan, and Adam Zarger. 2013. Color blending in outdoor optical see-through AR: The effect of real-world backgrounds on user interface color. In 2013 IEEE Virtual Reality (VR). IEEE, 157–158.Google ScholarGoogle Scholar
  21. Chuang Gan, Hang Zhao, Peihao Chen, David Cox, and Antonio Torralba. 2019. Self-Supervised Moving Vehicle Tracking with Stereo Sound. arXiv:arXiv:1910.11760Google ScholarGoogle Scholar
  22. Jeff Gothelf. 2013. Lean UX: Applying lean principles to improve user experience. " O’Reilly Media, Inc.".Google ScholarGoogle Scholar
  23. Uwe Gruenefeld, Abdallah El Ali, Susanne Boll, and Wilko Heuten. 2018. Beyond Halo and Wedge: Visualizing out-of-View Objects on Head-Mounted Virtual and Augmented Reality Devices. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (Barcelona, Spain) (MobileHCI ’18). Association for Computing Machinery, New York, NY, USA, Article 40, 11 pages. https://doi.org/10.1145/3229434.3229438Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Uwe Gruenefeld, Dag Ennenga, Abdallah El Ali, Wilko Heuten, and Susanne Boll. 2017. EyeSee360: Designing a Visualization Technique for out-of-View Objects in Head-Mounted Augmented Reality. In Proceedings of the 5th Symposium on Spatial User Interaction (Brighton, United Kingdom) (SUI ’17). Association for Computing Machinery, New York, NY, USA, 109–118. https://doi.org/10.1145/3131277.3132175Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Uwe Gruenefeld, Ilja Koethe, Daniel Lange, Sebastian Weiß, and Wilko Heuten. 2019. Comparing Techniques for Visualizing Moving Out-of-View Objects in Head-mounted Virtual Reality. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 742–746. https://doi.org/10.1109/VR.2019.8797725Google ScholarGoogle ScholarCross RefCross Ref
  26. Uwe Gruenefeld, Daniel Lange, Lasse Hammer, Susanne Boll, and Wilko Heuten. 2018. FlyingARrow: Pointing Towards Out-of-View Objects on Augmented Reality Devices. In Proceedings of the 7th ACM International Symposium on Pervasive Displays (Munich, Germany) (PerDis ’18). Association for Computing Machinery, New York, NY, USA, Article 20, 6 pages. https://doi.org/10.1145/3205873.3205881Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Uwe Gruenefeld, Andreas Löcken, Yvonne Brueck, Susanne Boll, and Wilko Heuten. 2018. Where to Look: Exploring Peripheral Cues for Shifting Attention to Spatially Distributed Out-of-View Objects. In Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (Toronto, ON, Canada) (AutomotiveUI ’18). Association for Computing Machinery, New York, NY, USA, 221–228. https://doi.org/10.1145/3239060.3239080Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Uwe Gruenefeld, Tim Claudius Stratmann, Abdallah El Ali, Susanne Boll, and Wilko Heuten. 2018. RadialLight: Exploring Radial Peripheral LEDs for Directional Cues in Head-Mounted Displays. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (Barcelona, Spain) (MobileHCI ’18). Association for Computing Machinery, New York, NY, USA, Article 39, 6 pages. https://doi.org/10.1145/3229434.3229437Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Uwe Gruenefeld, Tim Claudius Stratmann, Jinki Jung, Hyeopwoo Lee, Jeehye Choi, Abhilasha Nanda, and Wilko Heuten. 2018. Guiding Smombies: Augmenting Peripheral Vision with Low-Cost Glasses to Shift the Attention of Smartphone Users. In 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 127–131. https://doi.org/10.1109/ISMAR-Adjunct.2018.00050Google ScholarGoogle ScholarCross RefCross Ref
  30. Yuki Harada and Junji Ohyama. 2022. Quantitative evaluation of visual guidance effects for 360-degree directions. Virtual Reality 26, 2 (2022), 759–770.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Sandra G. Hart. 2006. Nasa-Task Load Index (NASA-TLX); 20 Years Later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50, 9 (2006), 904–908. https://doi.org/10.1177/154193120605000909 arXiv:https://doi.org/10.1177/154193120605000909Google ScholarGoogle ScholarCross RefCross Ref
  32. Nargess Hassani and Michael J Murdoch. 2016. Color appearance modeling in augmented reality. In Proceedings of the ACM Symposium on Applied Perception. 132–132.Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Alberto Izquierdo, Lara del Val, and Juan J. Villacorta. 2021. Feasibility of Using a MEMS Microphone Array for Pedestrian Detection in an Autonomous Emergency Braking System. Sensors 21, 12 (2021), 4162. https://doi.org/10.3390/s21124162Google ScholarGoogle ScholarCross RefCross Ref
  34. Jinki Jung, Hyeopwoo Lee, Jeehye Choi, Abhilasha Nanda, Uwe Gruenefeld, Tim Stratmann, and Wilko Heuten. 2018. Ensuring Safety in Augmented Reality from Trade-off Between Immersion and Situation Awareness. In 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 70–79. https://doi.org/10.1109/ISMAR.2018.00032Google ScholarGoogle ScholarCross RefCross Ref
  35. Moritz Kampelmühler, Michael G Müller, and Christoph Feichtenhofer. 2018. Camera-based vehicle velocity estimation from monocular video. arXiv preprint arXiv:1802.07094 (2018).Google ScholarGoogle Scholar
  36. HyeongYeop Kang, Geonsun Lee, and JungHyun Han. 2019. Obstacle Detection and Alert System for Smartphone AR Users. In Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology (Parramatta, NSW, Australia) (VRST ’19). Association for Computing Machinery, New York, NY, USA, Article 2, 11 pages. https://doi.org/10.1145/3359996.3364256Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Nazli Eser Kaya, Suzan Ayas, Canmanie Teresa Ponnambalam, and Birsen Donmez. 2018. Visual attention failures during turns at intersections: An on-road study. Victoria 1 (2018).Google ScholarGoogle Scholar
  38. Serkan Kiranyaz, Onur Avci, Osama Abdeljaber, Turker Ince, Moncef Gabbouj, and Daniel J Inman. 2021. 1D convolutional neural networks and applications: A survey. Mechanical systems and signal processing 151 (2021), 107398.Google ScholarGoogle ScholarCross RefCross Ref
  39. Marion Koelle, Matthias Kranz, and Andreas Möller. 2015. Don’t Look at Me That Way! Understanding User Attitudes Towards Data Glasses Usage. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (Copenhagen, Denmark) (MobileHCI ’15). Association for Computing Machinery, New York, NY, USA, 362–372. https://doi.org/10.1145/2785830.2785842Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Bettina Laugwitz, Theo Held, and Martin Schrepp. 2008. Construction and evaluation of a user experience questionnaire. In Symposium of the Austrian HCI and usability engineering group. Springer, Springer, Berlin, Germany, 63–76.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Feng Liang, Stevanus Kevin, Holger Baldauf, Kai Kunze, and Yun Suen Pai. 2020. OmniView: An Exploratory Study of 360 Degree Vision Using Dynamic Distortion Based on Direction of Interest. In Proceedings of the Augmented Humans International Conference (Kaiserslautern, Germany) (AHs ’20). Association for Computing Machinery, New York, NY, USA, Article 5, 10 pages. https://doi.org/10.1145/3384657.3384796Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Alexander Marquardt, Christina Trepkowski, Tom David Eibich, Jens Maiero, Ernst Kruijff, and Johannes Schöning. 2020. Comparing Non-Visual and Visual Guidance Methods for Narrow Field of View Augmented Reality Displays. IEEE Transactions on Visualization and Computer Graphics 26, 12 (2020), 3389–3401. https://doi.org/10.1109/TVCG.2020.3023605Google ScholarGoogle ScholarCross RefCross Ref
  43. Riccardo Mazza. 2009. Introduction to Information Visualization. Springer, London. https://doi.org/10.1007/978-1-84800-219-7Google ScholarGoogle ScholarCross RefCross Ref
  44. Roberto Merino-Martínez, Pieter Sijtsma, Mirjam Snellen, Thomas Ahlefeldt, Jérôme Antoni, Christopher J. Bahr, Daniel Blacodon, Daniel Ernst, Arthur Finez, Stefan Funke, Thomas F. Geyer, Stefan Haxter, Gert Herold, X. Huang, William M. Humphreys, Quentin Leclère, A.M.N. Malgoezar, Ulf Michel, Thomas Padois, A. Pereira, Christophe Picard, Ennes Sarradj, Henri A. Siller, Dick G. Simons, and Carsten Spehr. 2019. A review of acoustic imaging methods using phased microphone arrays. CEAS Aeronautical Journal 10 (2019), 197–230.Google ScholarGoogle ScholarCross RefCross Ref
  45. Prashanth Mohan, Venkata N. Padmanabhan, and Ramachandran Ramjee. 2008. Nericell: Rich Monitoring of Road and Traffic Conditions Using Mobile Smartphones. In Proceedings of the 6th ACM Conference on Embedded Network Sensor Systems (Raleigh, NC, USA) (SenSys ’08). Association for Computing Machinery, New York, NY, USA, 323–336. https://doi.org/10.1145/1460412.1460444Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Vivian Genaro Motti and Kelly Caine. 2015. Users’ Privacy Concerns About Wearables. In Financial Cryptography and Data Security, Michael Brenner, Nicolas Christin, Benjamin Johnson, and Kurt Rohloff (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 231–244.Google ScholarGoogle Scholar
  47. Takuro Nakao, Masashi Nakatani, Liwei Chan, and Kai Kunze. 2016. Smart Glasses with a Peripheral Vision Display. In Proceedings of the 2016 Virtual Reality International Conference (Laval, France) (VRIC ’16). Association for Computing Machinery, New York, NY, USA, Article 16, 3 pages. https://doi.org/10.1145/2927929.2927938Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Annie W.Y. Ng and Alan H.S. Chan. 2018. Color associations among designers and non-designers for common warning and operation concepts. Applied Ergonomics 70 (2018), 18–25. https://doi.org/10.1016/j.apergo.2018.02.004Google ScholarGoogle ScholarCross RefCross Ref
  49. Antti OI Nurminen and Konsta Mikael Sirvio. 2021. Bus Stop Spotting: A Field Experiment Comparing 2D Maps, Augmented Reality and 3D Maps. In Proceedings of the 23rd International Conference on Mobile Human-Computer Interaction (Toulouse and Virtual, France) (MobileHCI ’21). Association for Computing Machinery, New York, NY, USA, Article 37, 14 pages. https://doi.org/10.1145/3447526.3472051Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. James F Parker Jr and Vita R West. 1973. Bioastronautics Data Book: NASA SP-3006.NASA Special Publication 3006 (1973).Google ScholarGoogle Scholar
  51. Margie Peden, Richard Scurfield, David Sleet, C Mathers, Eva Jarawan, AA Hyder, D Mohan, AA Hyder, and E Jarawan. 2004. World report on road traffic injury prevention. World Health Organization.Google ScholarGoogle Scholar
  52. Dalibor Pešić, Boris Antić, Draženko Glavić, and Marina Milenković. 2016. The effects of mobile phone use on pedestrian crossing behaviour at unsignalized intersections–Models for predicting unsafe pedestrians behaviour. Safety science 82 (2016), 1–8.Google ScholarGoogle Scholar
  53. Max Pfeiffer, Tim Dünte, Stefan Schneegass, Florian Alt, and Michael Rohs. 2015. Cruise Control for Pedestrians: Controlling Walking Direction Using Electrical Muscle Stimulation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 2505–2514. https://doi.org/10.1145/2702123.2702190Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Jiamin Ping, Yue Liu, and Dongdong Weng. 2019. Comparison in depth perception between virtual reality and augmented reality systems. In 2019 IEEE conference on virtual reality and 3d user interfaces (VR). IEEE, 1124–1125.Google ScholarGoogle ScholarCross RefCross Ref
  55. Benjamin Poppinga, Niels Henze, Jutta Fortmann, Wilko Heuten, and Susanne Boll. 2012. AmbiGlasses-Information in the Periphery of the Visual Field.. In Mensch & Computer, Vol. 12. 153–162.Google ScholarGoogle Scholar
  56. Karyn Pravossoudovitch, Francois Cury, Steve G Young, and Andrew J Elliot. 2014. Is red the colour of danger? Testing an implicit red–danger association. Ergonomics 57, 4 (2014), 503–510.Google ScholarGoogle ScholarCross RefCross Ref
  57. Amir Rasouli, Iuliia Kotseruba, and John K Tsotsos. 2017. Understanding pedestrian behavior in complex traffic scenes. IEEE Transactions on Intelligent Vehicles 3, 1 (2017), 61–70.Google ScholarGoogle ScholarCross RefCross Ref
  58. Francisco Rebelo, Paulo Noriega, Emília Duarte, and Marcelo Soares. 2012. Using Virtual Reality to Assess User Experience. Human Factors 54, 6 (2012), 964–982. https://doi.org/10.1177/0018720812465006Google ScholarGoogle ScholarCross RefCross Ref
  59. Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. 2016. You Only Look Once: Unified, Real-Time Object Detection. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 779–788. https://doi.org/10.1109/CVPR.2016.91Google ScholarGoogle ScholarCross RefCross Ref
  60. ReSpeaker. 2023. ReSpeaker 6-Mic Circular Array Kit for Raspberry Pi | Seeed Studio Wiki. https://wiki.seeedstudio.com/ReSpeaker_6-Mic_Circular_Array_kit_for_Raspberry_Pi/ (Accessed on 04/19/2023).Google ScholarGoogle Scholar
  61. Simone Scardapane, Michele Scarpiniti, Marta Bucciarelli, Fabiola Colone, Marcello Vincenzo Mansueto, and Raffaele Parisi. 2015. Microphone Array Based Classification for Security Monitoring in Unstructured Environments. AEU - International Journal of Electronics and Communications 69, 11 (2015), 1715–1723. https://doi.org/10.1016/j.aeue.2015.08.007Google ScholarGoogle ScholarCross RefCross Ref
  62. Torben Schinke, Niels Henze, and Susanne Boll. 2010. Visualization of Off-Screen Objects in Mobile Augmented Reality. In Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services (Lisbon, Portugal) (MobileHCI ’10). Association for Computing Machinery, New York, NY, USA, 313–316. https://doi.org/10.1145/1851600.1851655Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Yannick Schulz, Avinash Kini Mattar, Thomas M. Hehn, and Julian F. P. Kooij. 2021. Hearing What You Cannot See: Acoustic Vehicle Detection Around Corners. IEEE Robotics and Automation Letters 6, 2 (2021), 2587–2594. https://doi.org/10.1109/LRA.2021.3062254 arXiv:2007.15739Google ScholarGoogle ScholarCross RefCross Ref
  64. Valentin Schwind, Pascal Knierim, Lewis Chuang, and Niels Henze. 2017. "Where’s Pinky?": The Effects of a Reduced Number of Fingers in Virtual Reality. In Proceedings Annual Symposium on Computer-Human Interaction in Play (Amsterdam, The Netherlands) (CHIPlay ’17). ACM, New York, NY, USA, 507–515. https://doi.org/10.1145/3116595.3116596Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Adalberto L. Simeone, Robbe Cools, Stan Depuydt, João Maria Gomes, Piet Goris, Joseph Grocott, Augusto Esteves, and Kathrin Gerling. 2022. Immersive Speculative Enactments: Bringing Future Scenarios and Technology to Life Using Virtual Reality. In Proceedings of the SIGCHI Conference on Human Factors(CHI). ACM, 1–20. https://doi.org/10.1145/3491102.3517492Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. Despina Stavrinos, Katherine W. Byington, and David C. Schwebel. 2011. Distracted walking: Cell phones increase injury risk for college pedestrians. Journal of Safety Research 42, 2 (2011), 101–107. https://doi.org/10.1016/j.jsr.2011.01.004Google ScholarGoogle ScholarCross RefCross Ref
  67. Leah L Thompson, Frederick P Rivara, Rajiv C Ayyagari, and Beth E Ebel. 2013. Impact of social and technological distraction on pedestrian crossing behaviour: an observational study. Injury prevention 19, 4 (2013), 232–237.Google ScholarGoogle Scholar
  68. J.-M. Valin, F. Michaud, J. Rouat, and D. Letourneau. 2003. Robust Sound Source Localization Using a Microphone Array on a Mobile Robot. In Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453), Vol. 2. IEEE, Las Vegas, NV, USA, 1228–1233. https://doi.org/10.1109/IROS.2003.1248813Google ScholarGoogle ScholarCross RefCross Ref
  69. Francisco Rivera Valverde, Juana Valeria Hurtado, and Abhinav Valada. 2021. There Is More than Meets the Eye: Self-Supervised Multi-Object Detection and Tracking with Sound by Distilling Multimodal Knowledge. arXiv:arXiv:2103.01353Google ScholarGoogle Scholar
  70. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017).Google ScholarGoogle Scholar
  71. Tianyu Wang, Giuseppe Cardone, Antonio Corradi, Lorenzo Torresani, and Andrew T. Campbell. 2012. WalkSafe: A Pedestrian Safety App for Mobile Phone Users Who Walk and Talk While Crossing Roads. In Proceedings of the Twelfth Workshop on Mobile Computing Systems & Applications (San Diego, California) (HotMobile ’12). Association for Computing Machinery, New York, NY, USA, Article 5, 6 pages. https://doi.org/10.1145/2162081.2162089Google ScholarGoogle ScholarDigital LibraryDigital Library
  72. Peter Welch. 1967. The use of fast Fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. IEEE Transactions on audio and electroacoustics 15, 2 (1967), 70–73.Google ScholarGoogle ScholarCross RefCross Ref
  73. B. Widrow. 2001. A Microphone Array for Hearing Aids. IEEE Circuits and Systems Magazine 1, 2 (2001), 26–32. https://doi.org/10.1109/7384.938976Google ScholarGoogle ScholarCross RefCross Ref
  74. Oliver J. Woodman. 2007. An introduction to inertial navigation. Technical Report UCAM-CL-TR-696. University of Cambridge, Computer Laboratory. https://doi.org/10.48456/tr-696Google ScholarGoogle Scholar
  75. Robert Xiao and Hrvoje Benko. 2016. Augmenting the Field-of-View of Head-Mounted Displays with Sparse Peripheral Displays. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 1221–1232. https://doi.org/10.1145/2858036.2858212Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. Jianghao Xiong, En-Lin Hsiang, Ziqian He, Tao Zhan, and Shin-Tson Wu. 2021. Augmented reality and virtual reality displays: emerging technologies and future perspectives. Light: Science & Applications 10, 1 (2021), 216.Google ScholarGoogle ScholarCross RefCross Ref
  77. Peter Zeller 2009. Handbuch Fahrzeugakustik. Vol. 2. Springer.Google ScholarGoogle Scholar
  78. Xuesong Zhang and Adalberto L Simeone. 2022. Using the Think Aloud Protocol in an Immersive Virtual Reality Evaluation of a Virtual Twin. In Proceedings of the 2022 ACM Symposium on Spatial User Interaction. 1–8.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. ARcoustic: A Mobile Augmented Reality System for Seeing Out-of-View Traffic

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in
          • Published in

            cover image ACM Conferences
            AutomotiveUI '23: Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
            September 2023
            352 pages
            ISBN:9798400701054
            DOI:10.1145/3580585

            Copyright © 2023 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 18 September 2023

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
            • Research
            • Refereed limited

            Acceptance Rates

            Overall Acceptance Rate248of566submissions,44%

            Upcoming Conference

          • Article Metrics

            • Downloads (Last 12 months)212
            • Downloads (Last 6 weeks)29

            Other Metrics

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          HTML Format

          View this article in HTML Format .

          View HTML Format