ISCA Archive Eurospeech 2003
ISCA Archive Eurospeech 2003

Low resource lip finding and tracking algorithm for embedded devices

Jesus F. Guitarte Perez, Klaus Lukas, Alejandro F. Frangi

One of the best challenges in Lip Reading is to apply this technology to an embedded device. In the current solutions the high use of resources, especially in reference to visual processing, makes the implementation in a small device very difficult. In this article a new, efficient and straightforward algorithm for detection and tracking of lips is presented. Lip Finding and Tracking is the first step in visual processing for Lip Reading. In our approach the Lip Finding is performed between a small amount of blobs, which should fulfill a geometric restriction. In terms of computational power and memory the proposed algorithm meets the requirements of an embedded device; on average less than 4 MHz^1 of CPU is required. This algorithm shows promising results in a realistic environment accomplishing successful lip finding and tracking in 94.2% of more than 4900 image frames.


doi: 10.21437/Eurospeech.2003-630

Cite as: Perez, J.F.G., Lukas, K., Frangi, A.F. (2003) Low resource lip finding and tracking algorithm for embedded devices. Proc. 8th European Conference on Speech Communication and Technology (Eurospeech 2003), 2253-2256, doi: 10.21437/Eurospeech.2003-630

@inproceedings{perez03_eurospeech,
  author={Jesus F. Guitarte Perez and Klaus Lukas and Alejandro F. Frangi},
  title={{Low resource lip finding and tracking algorithm for embedded devices}},
  year=2003,
  booktitle={Proc. 8th European Conference on Speech Communication and Technology (Eurospeech 2003)},
  pages={2253--2256},
  doi={10.21437/Eurospeech.2003-630}
}