Skip to main content
SpringerLink
Log in

Visual spatial-context based wildfire smoke sensor

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

Sensors for early fire detection based on visual analysis have been under constant development and improvement, especially during the last decade. However, there is still a lot of room for advancement to increase the accuracy and reliability of such sensors. In this paper, a novel method for wildfire smoke detection based on spatial context analysis as well as motion detection, chromatic, texture and shape analysis is introduced. Several measures for evaluating quality of smoke detection are used, both on image and pixel scale. Smoke is a semi-transparent and amorphous phenomenon whose boundaries are hard to determine precisely; therefore, fuzzy measures are introduced for assessing the detection error. The proposed method is evaluated using the proposed measures and compared with two existing methods. The results show that the wildfire sensor based on proposed method is capable of detecting fire-smoke accurately and reliably, and in most detection aspects it outperforms the existing methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Kührt, E., Knollenberg, J., Mertens, V.: An automatic early warning system for forest fires. Ann. Burns Fire Disasters 14(3), 151–154 (2001)

    Google Scholar 

  2. Borges, P.V.K., Izquierdo, E.: A probabilistic approach for vision-based fire detection in videos. IEEE Trans. Circ. Syst. Video 20(5), 721–731 (2010)

    Article  Google Scholar 

  3. Jun, C., Yang, D., Dong, W.: An early fire image detection and identification algorithm based on DFBIR model. In: Processdings of WRI World Congress on Computer Science and Information Engineering, Los Angeles, CA, USA, pp. 229–232 (2009)

  4. Çelik, T., Kai-Kuang, M.: Computer vision based fire detection in color images. In: Proccedings of IEEE Conference on Soft Computing in Industrial Applications Muroran, Japan, pp. 258–263 (2008)

  5. De Dios, J.R.M., Arrue, B.C., Ollero, A., Merino, L., Gómez-Rodríguez, F.: Computer vision techniques for forest fire perception. Image Vis. Comput. 26(4), 550–562 (2008)

    Article  Google Scholar 

  6. Cho, B.-H., Bae, J.-W., Jung, S.-H.: Image processing-based fire detection system using statistic color model. In: Proceedings of International Conference on Advanced Language Processing and Web Information Technology, Dalian Liaoning, China, pp. 245–250 (2008)

  7. Dedeoǧlu, Y., Töreyin, B.U., Güdükbay, U., Çetin, A.E.: Real-time fire and flame detection in video. In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, Philadelphia, Pennsylvania, USA, pp. 669–672 (2005)

  8. Che-Bin, L., Ahuja, N.: Vision based fire detection. In: Proceedings of the 17th International Conference on Pattern Recognition, Cambridge, UK, pp. 134–137 (2004)

  9. Abuelgasim, A., Fraser, R.: Day and night-time active fire detection over North America using NOAA-16 AVHRR data. In: Proceedings of Geoscience and Remote Sensing Symposium, Toronto, Ontorio, Canada, pp. 1489–1491 (2002)

  10. Cui, Y., Dong, H., Zhou, E.: An early fire detection method based on smoke texture analysis and discrimination. In: Proceedings of Congress on Image and Signal Processing, Sanya, China, pp. 95–99 (2008)

  11. Hidenori, M., Yasuharu, K., Akihiro, N., Fujio, K.: Smoke detection in open areas using its texture features and time series properties. In: Proceedings of IEEE International Symposium on Industrial Electronics, Seoul, South Korea, pp. 1904–1908 (2009)

  12. Chunyu, Y., Yongming, Z., Jun, F., Jinjun, W.: Texture analysis of smoke for real-time fire detection. In: Proceedings of Second International Workshop on Computer Science and Engineering, Qingdao, China, pp. 511–515. IEEE Computer Society, New York (2009)

  13. Çelik, T., Özkaramanli, H., Demirel, H.: Fire and smoke detection without sensors: image processing based approach. In: Proceedings of 15th European Signal Processing Conference, Barcelona, Spain, pp. 1794-1798 (2007)

  14. Krstinić, D., Stipaničev, D., Jakovčević, T.: Histogram-based smoke segmentation in forest fire detection system. Inf. Technol. Control 38, 237–244 (2009)

    Google Scholar 

  15. Ho, C.-C.: Machine vision-based real-time early flame and smoke detection. Meas. Sci. Technol. 20(4), 1–13 (2009)

    Article  Google Scholar 

  16. Xu, Z., Xu, J.: Automatic fire smoke detection based on image visual features. In: Proceedings of the International Conference on Computational Intelligence and Security Workshops 2007, Harbin, Heilongjiang, China, pp. 316–319 (2007)

  17. Rubaiyat, Y.: Detection of smoke propagation direction using color video sequences. Int. J. Soft. Comput. 4, 45–48 (2009)

    Google Scholar 

  18. Gómez-Rodríguez, F., Arrue, B.C., Ollero, A.: Smoke monitoring and measurement using image processing: application to forest fires. In: Proceedings of Automatic Target Recognition XIII, SPIE, Orlando, FL, USA, pp. 404–411 (2003)

  19. Chunyu, Y., Jun, F., Jinjun, W., Yongming, Z.: Video fire smoke detection using motion and color features. Fire Technol. 46(3), 651–663 (2009)

    Article  Google Scholar 

  20. Yu, C., Zhang, Y., Fang, J., Wang, J.: Video smoke recognition based on optical flow. In: Proceedings of the 2nd International Conference on Advanced Computer Control, Shenyang, China, pp. 16–21 (2010)

  21. Xiong, Z., Caballero, R., Wang, H., Finn, A.M., Lelic, M.A., Peng, P.-Y.: Video-based smoke detection: possibilities, techniques, and challenges. In: Proceedings of Suppression and Detection Research and Applications: A Technical Working Conference, Orlando, Florida, USA, pp. 112–118 (2007)

  22. Yang, J., Chen, F., Zhang, W.: Visual-based smoke detection using support vector machine. In: Proceedings of Fourth International Conference on Natural Computation, Jinan, Shandong, China, pp. 301–305 (2008)

  23. Maruta, H., Nakamura, A., Kurokawa, F.: A new approach for smoke detection with texture analysis and support vector machine. In: Proceedings of 2010 IEEE International Symposium on Industrial Electronics, Bari, Italy, pp. 1550–1555 (2010)

  24. Vicente, J., Guillemant, P.: An image processing technique for automatically detecting forest fire. Int. J. Therm. Sci. 41(12), 1113–1120 (2002)

    Article  Google Scholar 

  25. Maruta, H., Yamamichi, T., Nakamura, A., Kurokawa, F.: Image based smoke detection with two-dimensional local hurst exponent. In: Proceedings of IEEE International Symposium on Industrial Electronics, Bari, Italy, pp. 1651–1656 (2010)

  26. Ham, S., Ko, B.-C., Nam, J.-Y.: Vision based forest smoke detection using analyzing of temporal patterns of smoke and their probability models. In: Image Processing: Machine Vision Applications IV, SPIE, San Francisco, California, USA

  27. Gonzalez-Gonzalez, R., Alarcon-Aquino, V., Rosas-Romero, R., Starostenko, O., Rodriguez-Asomoza, J., Ramirez-Cortes, J.M.: Wavelet-based smoke detection in outdoor video sequences. In: Proceedings of 53rd IEEE International Midwest Symposium on Circuits and Systems, Seattle, WA, USA, pp. 383–387 (2010)

  28. Piccinini, P., Calderara, S., Cucchiara, R.: Reliable smoke detection in the domains of image energy and color. In: Proceedings of 15th IEEE International Conference on Image Processing, San Diego, CA, USA, pp. 1376–1379 (2008)

  29. Calderara, S., Piccinini, P., Cucchiara, R.: Smoke detection in video surveillance: a MoG model in the wavelet domain. In: Proceedings of the 6th international conference on Computer vision systems, Santorini, Greece, ICVS’08, pp. 119–128 (2008)

  30. Calderara, S., Piccinini, P., Cucchiara, R.: Vision based smoke detection system using image energy and color information. Mach. Vis. Appl. 21, 1–15 (2010)

    Google Scholar 

  31. Töreyin, B.U., Dedeoǧlu, Y., Çetin, A.E.: Contour based smoke detection in video using wavelets. In: Proceedings of European Signal Processing Conference, Florence, Italy (2006)

  32. Töreyin, B.U., Dedeoǧlu, Y., Çetin, A.E.: Wavelet based real-time smoke detection in video. In: 13th European Signal Processing Conference, Antalya, Turkey (2005)

  33. Den Breejen, E., Breuers, M., Cremer, F., Kemp, R., Roos, M., Schutte, K., De Vries, J.S.: Autonomous forest fire detection. In: Proceedings of AUSWEB 2000, the sixth Australian world wide web conference, Carins, Australia, pp. 167–181 (2000)

  34. Ho, C., Kuo, T.: Real-time video-based fire smoke detection system. In: Proceedings of International Conference on Advanced Intelligent Mechatronics, Singapore, Singapore, pp. 1845–1850 (2009)

  35. Guillemant, P., Vicente, J.: Real-time identification of smoke images by clustering motions on a fractal curve with a temporal embedding method. Opt. Eng. 40(4), 554–563 (2001)

    Article  Google Scholar 

  36. Collins, R.T., Lipton, A.J., Kanade, T.: A system for video surveilllance and monitoring. In: Proceedings of American Nuclear Society (ANS) Eight International Topical Meeting on Robotics and Remote Systems, Pittsburgh, Pennsylvania (1999)

  37. Pantofaru, C., Hebert, M.: A comparison of image segmentation algorithms. In. Technical report CMU-RI-TR-05-40, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, (2005)

  38. Nock, R., Nielsen, F.: Semi-supervised statistical region refinement for color image segmentation. Pattern Recognit. 38(6), 835–846 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  39. Nock, R., Nielsen, F.: Statistical region merging. Pattern Anal. Mach. Intell. 26(11), 1452–1458 (2004)

    Article  Google Scholar 

  40. John, H.G., Langley, P.: Estimating continuous distributions in Bayesian classifiers. In: Eleventh Conference on Uncertainty in Artificial Intelligence, Montreal, Quebec, Canada, pp. 338–345 (1995)

  41. Saathoff, C., Staab, S.: Exploiting spatial context in image region labelling using fuzzy constraint reasoning. In: Proceedings of Ninth International Workshop on Image Analysis for Multimedia Interactive Services, Klagenfurt, Austria, pp. 16–19 (2008)

  42. Jakovčević, T., Bodrožić, L., Stipaničev, D., Krstinić, D.: Wildfire smoke-detection algorithms evaluation. In: Proceedings of VI International Conference on Forest Fire Research, Coimbra, Portugal (2010)

  43. Egan, J.P.: Signal Detection Theory and Roc Analysis. Academic Press, New York, NY, USA (1975)

    Google Scholar 

  44. Martin, A., Doddington, G., Kamm, T., Ordowski, M., Przybocki, M.: The DET curve in assessment of detection task performance. In: Proceedings of the 5th European Conference on Speech Communication and Technology, Rhodes, Greece, pp. 1895–1898 (1997)

  45. Matthews, B.W.: Comparison of the predicted and observed secondary structure of T4 phage lysozyme. Biochim. Biophys. Acta. 405(2), 442–451 (1975)

    Google Scholar 

  46. Fernández-Berni, J., Carmona-Galán, R., Carranza-González, L.: A vision-based monitoring system for very early automatic detection of forest fires. In: Modelling, Monitoring and Management of Forest Fires. pp. 161–170. WIT Press, Southampton (2008)

  47. Günay, O., Çetin, A.E., Töreyin, B.U.: Online Adaptive Decision Fusion Framework Based on Projections onto Convex Sets with Application to Wildfire Detection in Video. Opt. Eng. 50(7) (2011)

  48. Günay, O., Töreyin, B.U., Köse, K., Çetin, A.E.: Entropy functional based online adaptive decision fusion framework with application to wildfire detection in video. IEEE Trans. Image Process. 21(5), 2853–2865 (2012)

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgments

Ministry of Science, Education and Sport of the Republic of Croatia has supported this research under Grant 023-0232005-2003 “AgISEco Agent-based intelligent environmental monitoring and protection systems”. Testing images and video sequences could be found on our Wildfire Observers and Smoke Recognition Homepage http://wildfire.fesb.hr. These video sequences are partly collected by iForestFire monitoring units (http://iforestfire.fesb.hr).

Author information

Authors and Affiliations

  1. Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture, University of Split, R. Boskovica B.B., 21000 , Split, Croatia

    Toni Jakovčević, Darko Stipaničev & Damir Krstinić

Authors
  1. Toni Jakovčević
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Darko Stipaničev
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Damir Krstinić
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Toni Jakovčević.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Jakovčević, T., Stipaničev, D. & Krstinić, D. Visual spatial-context based wildfire smoke sensor. Machine Vision and Applications 24, 707–719 (2013). https://doi.org/10.1007/s00138-012-0481-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-012-0481-x

Keywords

Search

Navigation