Abstract
Methods for automated eye blinking analysis can be applied to support people with certain disabilities in interaction with technical systems, to analyse human deceptive behaviour, in driver fatigue assessment, etc. In this paper we introduce a robust shape-based algorithm for automatic eye blinking detection in video sequences. First, all video frames are classified separately into those showing an open and those corresponding to a closed eye. Second, these classification results are cleverly combined for blinking detection so that the influence of single misclassified frames gets compensated almost completely. In addition to that, we present our investigations on the user behaviour in terms of eye blinking frequency in two different everyday life situations. The most relevant scientific contributions of this paper are (1) the introduction of a new and robust feature extraction technique for the representation of images displaying eyes, (2) a smart fusion scheme improving the results for single-frame classification and (3) the compensation of wrong classification results for single frames providing an almost perfect eye blinking detection rate.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Atherton, T., Kerbyson, D.: Size invariant circle detection. Image Vis. Comput. 17(1), 795–803 (1999). http://www.sciencedirect.com/science/article/pii/S0262885698001607
Choi, I., Han, S., Kim, D.: Eye detection and eye blink detection using adaboost learning and grouping. In: 2011 Proceedings of the 20th International Conference on Computer Communications and Networks (ICCCN), pp. 1–4, July 2011
Danisman, T., Bilasco, I., Djeraba, C., Ihaddadene, N.: Drowsy driver detection system using eye blink patterns. In: 2010 International Conference on Machine and Web Intelligence (ICMWI), pp. 230–233 (2010)
Fukuda, K.: Analysis of eyeblink activity during discriminative tasks. Percept. Mot. Skills 79, 1599–1608 (1994)
Krolak, A., Strumillo, P.: Vision-based eye blink monitoring system for human-computer interfacing. In: 2008 Conference on Human System Interactions, pp. 994–998, May 2008
Lalonde, M., Byrns, D., Gagnon, L., Teasdale, N., Laurendeau, D.: Real-time eye blink detection with gpu-based sift tracking. In: Fourth Canadian Conference on Computer and Robot Vision, 2007, CRV ’07, pp. 481–487 (2007)
Leal, S., Vrij, A.: Blinking during and after lying. J. Nonverbal Behav. 32(4), 187–194 (2008)
Li, J.W.: Eye blink detection based on multiple gabor response waves. In: International Conference on Machine Learning and Cybernetics, vol. 5, pp. 2852–2856, July 2008
Lindeman, R.H., Merenda, P.F., Gold, R.: Robust real-time face detection (1980)
Minkov, K., Zafeiriou, S., Pantic, M.: A comparison of different features for automatic eye blinking detection with an application to analysis of deceptive behavior. In: 2012 5th International Symposium on Communications Control and Signal Processing (ISCCSP), pp. 1–4, May 2012
Nixon, M., Aguado, A.S.: Robust real-time face detection, vol. 2 (2007)
Panning, A., Al-Hamadi, A., Michaelis, B.: A color based approach for eye blink detection in image sequences. In: 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA), pp. 40–45 (2011)
Park, I., Ahn, J.H., Byun, H.: Efficient measurement of eye blinking under various illumination conditions for drowsiness detection systems. In: 18th International Conference on Pattern Recognition, ICPR 2006, vol. 1, pp. 383–386 (2006)
Radlak, K., Smolka, B.: A novel approach to the eye movement analysis using a high speed camera. In: 2012 2nd International Conference on Advances in Computational Tools for Engineering Applications (ACTEA), pp. 145–150, December 2012
Ryu, J.B., Yang, H.S., Seo, Y.H.: Real time eye blinking detection using local ternary pattern and SVM. In: 2013 Eighth International Conference on Broadband and Wireless Computing, Communication and Applications (BWCCA), pp. 598–601 (2013)
Shirahama, K., Grzegorzek, M.: Towards large-scale multimedia retrieval enriched by knowledge about human interpretation -retrospective survey. Multimedia Tools and Applications (2014)
Tadeusiewicz, R., Ogiela, M.R.: Why automatic understanding? In: Bartlomiej, B., Dzielinski, A., Iwanowski, M., Bernerdete, R. (eds.) Adaptive and Natural Computing. Lecture Notes on Computer Science, pp. 477–491. Springer, Heidelberg (2007). http://www.springer.com
Viola, P., Jones, M.: Robust real-time face detection. In: Proceedings of the Eighth IEEE International Conference on Computer Vision, ICCV 2001, vol. 2, pp. 747–747 (2001)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Boukhers, Z., Jarzyński, T., Schmidt, F., Tiebe, O., Grzegorzek, M. (2016). Shape-Based Eye Blinking Detection and Analysis. In: Burduk, R., Jackowski, K., Kurzyński, M., Woźniak, M., Żołnierek, A. (eds) Proceedings of the 9th International Conference on Computer Recognition Systems CORES 2015. Advances in Intelligent Systems and Computing, vol 403. Springer, Cham. https://doi.org/10.1007/978-3-319-26227-7_31
Download citation
DOI: https://doi.org/10.1007/978-3-319-26227-7_31
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-26225-3
Online ISBN: 978-3-319-26227-7
eBook Packages: EngineeringEngineering (R0)