Skip to main content

iDriveAR: In-Vehicle Driver Awareness and Drowsiness Framework Based on Facial Tracking and Augmented Reality

  • Chapter
  • First Online:
Internet of Vehicles and its Applications in Autonomous Driving

Part of the book series: Unmanned System Technologies ((UST))

Abstract

The accident rate in Saudi Arabia is quite high due to several factors such as speeding, lousy weather, pedestrian unawareness, etc. For the past year, Kingdom of Saudi Arabia suffered from a significant loss of human life and economical due to a traffic accident. Ministry of Interior Riyadh Traffic department reporting that traffic accident has made financial loss about 21 billion riyals a year. The traffic accident has increased rapidly, six injuries per eight incidents are caused by a traffic accident, whereas the global ratio is one injury for every eight accidents. This paper proposed unique solution by using two primary cameras for tracking the driver and pedestrian. The recognition rate of facial tracking have been evaluated through several machine learning algorithm and Tree has achieved the highest recognition rate with 87% followed by KNN with 77%. The result is quite promising with this double tracking: facial tracking to track the drowsiness and awareness while pedestrian tracking brake analysis for the object in front of or behind the vehicle. The future work with advanced sensor such as sonar and high speed camera might improve the accuracy and efficiency of the system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ministry of Interior,General Directorate of Traffic. (2017). Traffic accident statistic. Retrieved January 2020, from https://data.gov.sa/Data/en/dataset/traffic-accident-statistics-as-of-1438-h

  2. Ansari, S., Akhdar, F., Mandoorah, M., & Moutaery, K. (2000). Causes and effects of road traffic accidents in Saudi Arabia. Public Health, 114(1), 37–39.

    Article  Google Scholar 

  3. Nabbout, M. (2019). Over 160,000 car accidents in Saudi Arabia are caused by phone usage.Retrieved January 2020, from https://stepfeed.com/over-160-000-car-accidents-in-saudi-arabia-are-caused-by-phone-usage-9800

  4. Hachisuka, S., Ishida, K., Enya, T., & Kamijo, M. (2011). Facial expression measurement for detecting driver drowsiness. In D. Harris (Ed.), Engineering psychology and cognitive ergonomics (pp. 135–144). Heidelberg: Springer.

    Chapter  Google Scholar 

  5. Aidman, E., Chadunow, C., Johnson, K., & Reece, J. (2015). Real-time driver drowsiness feedback improves driver alertness and self-reported driving performance. Accident Analysis and Prevention, 81, 8–13.

    Article  Google Scholar 

  6. de Naurois, C. J., Bourdin, C., Bougard, C., & Vercher, J.-L. (2018). Adapting artificial neural networks to a specific driver enhances detection and prediction of drowsiness. Accident Analysis and Prevention, 121, 118–128.

    Article  Google Scholar 

  7. Watson, A.,&Zhou, G.(2016). Microsleep prediction using an EKG capable heart rate monitor. 2016 IEEE First International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE). 328–329. https://doi.org/10.1109/CHASE.2016.30

  8. Galarza, E. E., Egas, F. D., Silva, F. M., Velasco, P. M., & Galarza, E. D. (2018). Real time driver drowsiness detection based on driver’s face image behavior using a system of human computer interaction implemented in a smartphone. Advances in Intelligent Systems and Computing, 721, 563–572. https://doi.org/10.1007/978-3-319-73450-7_53.

    Article  Google Scholar 

  9. Phan, M. T., Thouvenin, I., &Frémont, V. (2016). Enhancing the driver awareness of pedestrian using augmented reality cues.The 19th IEEE International Conference on Intelligent Transportation Systems (ITSC), Windsor Oceanico Hotel, Rio de Janeiro, Brazil, November 1–4, 2016.

    Google Scholar 

  10. Pawar, N. M., Khanuja, R. K., Choudhary, P., & Velaga, N. R. (2020). Modelling braking behaviour and accident probability of drivers under increasing time pressure conditions. Accident Analysis and Prevention, 136, 1–17.

    Article  Google Scholar 

  11. Rendon-Velez, E., van Leeuwen, P. M., Happee, R., Horváth, I., van der Vegte, W. F., & de Winter, J. C. F. (2016). The effects of time pressure on driver performance and physiological activity: A driving simulator study. Transportation Research Part F: Traffic Psychology and Behaviour, 41, 150–169. https://doi.org/10.1016/j.trf.2016.06.013.

    Article  Google Scholar 

  12. Paschalidis, E., Choudhury, C. F., & Hess, S. (2019). Combining driving simulator and physiological sensor data in a latent variable model to incorporate the effect of stress in car-following behaviour. Analytic Methods in Accident Research, 22, 100089. https://doi.org/10.1016/j.amar.2019.02.001.

    Article  Google Scholar 

  13. Techer, F., Ojeda, L., Barat, D., Marteau, J., Rampillon, F., Feron, S., & Dogan, E. (2019). Anger and highly automated driving in urban areas :The role of time pressure. Transportation Research Part F: Traffic Psychology and Behaviour, 64, 353–360. https://doi.org/10.1016/j.trf.2019.05.016.

    Article  Google Scholar 

  14. Naveteur, J., Cœugnet, S., Charron, C., & Dorn, L. (2013). Impatience and time pressure:Subjective reactions of drivers in situations forcing them to stop their car in the road. Transportation Research Part F: Traffic Psychology and Behaviour, 18, 58–71. https://doi.org/10.1016/j.trf.2012.

    Article  Google Scholar 

  15. Palat, B., & Delhomme, P. (2016). A simulator study of factors influencing drivers’ behavior at traffic lights. Transportation Research Part F: Traffic Psychology and Behaviour, 37, 107–118. https://doi.org/10.1016/j.trf.2015.11.009.

    Article  Google Scholar 

  16. Kasheevnik, A., Lashkov, I., & Gurtov, A. (2019). Methodology and mobile application for driver behavior analysis and accident prevention. IEEE Transactions on Intelligent Transportation Systems, 1, 1–10. https://doi.org/10.1109/TITS.2019.2918328.

    Article  Google Scholar 

  17. de Carrera, P. F. (2010). Face recognition algorithm. Lejona: Universidaddel Pais Vasco.

    Google Scholar 

Download references

Acknowledgement

This work was supported by the Deanship of Scientific Research (DSR), King Abdulaziz University, Jeddah Saudi Arabia. The authors, therefore, gratefully acknowledge the DSR technical and financial support.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ahmad Hoirul Basori .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Basori, A.H., Malebary, S.J. (2021). iDriveAR: In-Vehicle Driver Awareness and Drowsiness Framework Based on Facial Tracking and Augmented Reality. In: Gupta, N., Prakash, A., Tripathi, R. (eds) Internet of Vehicles and its Applications in Autonomous Driving. Unmanned System Technologies. Springer, Cham. https://doi.org/10.1007/978-3-030-46335-9_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-46335-9_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-46334-2

  • Online ISBN: 978-3-030-46335-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics