Skip to main content

YOLO-Based Object Detection in Industry 4.0 Fischertechnik Model Environment

  • Conference paper
  • First Online:
Intelligent Systems and Applications (IntelliSys 2023)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 823))

Included in the following conference series:

  • 23 Accesses

Abstract

In this paper we extensively explore the suitability of YOLO architectures to monitor the process flow across a Fischertechnik Industry 4.0 application. Specifically, different YOLO architectures in terms of size and complexity design along with different prior-shapes assignment strategies are adopted. To simulate the real world factory environment, we prepared a rich dataset augmented with different distortions that highly enhance and in some cases degrade our image qualities. The degradation is performed to account for environmental variations and enhancements opt to compensate the color correlations that we face while preparing our dataset. The analysis of our conducted experiments shows the effectiveness of the presented approach evaluated using different measures along with the training and validation strategies that we tailored to tackle the unavoidable color correlations that the problem at hand inherits by nature.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ultralytics github. https://github.com/ultralytics. Accessed 27 Oct 2022

  2. Abele, E., Chryssolouris, G., Sihn, W., Metternich, J., ElMaraghy, H.A., Seliger, G., Sivard, G., Elmaraghy, W., Hummel, V., Tisch, M., Seifermann, S.: Learning factories for future oriented research and education in manufacturing. Cirp Ann.-Manuf. Technol. 66, 803–826 (2017)

    Google Scholar 

  3. Benjdira, B., Khursheed, T., Koubaa, A., Ammar, A., Ouni, K.: Car Detection Using Unmanned Aerial Vehicles: Comparison Between Faster r-cnn and yolov3 (2018)

    Google Scholar 

  4. Bochkovskiy, A., Wang, C.-Y., Mark Liao, H.-Y.: Yolov4: Optimal speed and accuracy of object detection. CoRR. ArXiv:abs/2004.10934, 2020

  5. Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)

    Article  Google Scholar 

  6. Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)

    Google Scholar 

  7. Everingham, M., Eslami, S.M., Gool, L., Williams, C.K., Winn, J., Zisserman, A.: The pascal visual object classes challenge: a retrospective. Int. J. Comput. Vision 111(1), 98–136 (2015)

    Google Scholar 

  8. Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation (2013)

    Google Scholar 

  9. Grüger, J., Malburg, L., Mangler, J., Bertrand, Y., Rinderle-Ma, S., Bergmann, R.: Sensorstream: An xes extension for enriching event logs with iot-sensor data (2022)

    Google Scholar 

  10. Gu, C., Lim, J.J., Arbelaez, P., Malik, J.: Recognition using regions. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1030–1037 (2009)

    Google Scholar 

  11. He, K., Gkioxari, G., Dollár, P., Girshick. R.: Mask r-cnn (2017)

    Google Scholar 

  12. Hester, C.F., Casasent, D.: Multivariant technique for multiclass pattern recognition. Appl. Opt. 19(11), 1758–1761 (1980)

    Article  Google Scholar 

  13. Jingwei Huang. Digital engineering transformation with trustworthy ai towards industry 4.0: Emerging paradigm shifts. 2023

    Google Scholar 

  14. Jocher, G., Chaurasia, A., Stoken, A., Borovec, J., NanoCode012, Kwon, Y., TaoXie, Michael, K., Fang, J., Imyhxy, L., Wong, C., Yifu, Z., Abhiram, V., Montes, D., Wang, Z., Fati, C., Nadar, J., Laughing, U., tkianai, y., Skalski, P., Hogan, A., Strobel, M., Jain, M., Mammana, L., xylieong.: ultralytics/yolov5: v6.2 - YOLOv5 Classification Models, Apple M1, Reproducibility, ClearML and Deci.ai integrations (2022)

    Google Scholar 

  15. Jung, A.B., Wada, K., Crall, J., Tanaka, S., Graving, J., Reinders, C., Yadav, S., Banerjee, J., Vecsei, G., Kraft, A., Rui, Z., Borovec, J., Vallentin, C., Zhydenko, S., Pfeiffer, K., Cook, B., Fernández, I., De Rainville, F.-M., Weng, C.-H., Ayala-Acevedo, A., Meudec, R., Laporte, M., et al.: Imgaug. https://github.com/aleju/imgaug (2020). Online; accessed 01 Feb 2020

  16. Jung, H.-K., Choi, G.-S.: Improved yolov5: Efficient object detection using drone images under various conditions. Appl. Sci. 12(14) (2022)

    Google Scholar 

  17. Kim, J.-A., Sung, J.-Y., Park, S.-H.: Comparison of faster-rcnn, yolo, and ssd for real-time vehicle type recognition. In: 2020 IEEE International Conference on Consumer Electronics—Asia (ICCE-Asia), pp. 1–4 (2020)

    Google Scholar 

  18. Klein, P., Bergmann, R.: Generation of complex data for ai-based predictive maintenance research with a physical factory model. In: ICINCO (2019)

    Google Scholar 

  19. Law, H., Deng, J.: Cornernet: Detecting objects as paired keypoints (2018)

    Google Scholar 

  20. Li, M., Zhang, Z., Lei, L., Wang, X., Guo, X.: Agricultural greenhouses detection in high-resolution satellite images based on convolutional neural networks: Comparison of faster r-cnn, yolo v3 and ssd. Sensors 20(17) (2020)

    Google Scholar 

  21. Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., Belongie, S.: Feature pyramid networks for object detection (2016)

    Google Scholar 

  22. Lin, T.-Y., Maire, M., Belongie, S.J., Bourdev, L.D., Girshick, R.B., Hays, J., Perona, P., Ramanan, D., Doll’a r, P., Lawrence Zitnick, C.: Microsoft COCO: common objects in context. CoRR (2014). ArXiv:abs/1405.0312

  23. Liu, S., Qi, L., Qin, H., Shi, J., Jia, J.: Path aggregation network for instance segmentation (2018)

    Google Scholar 

  24. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., Berg, A.C.: SSD: Single shot MultiBox detector. In: Computer Vision–ECCV 2016, pp. 21–37. Springer International Publishing (2016)

    Google Scholar 

  25. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S.E., Fu, C.-Y., Berg, A.C.: SSD: single shot multibox detector. CoRR (2015). ArXiv:abs/1512.02325

  26. Lloyd, S.: Least squares quantization in pcm. IEEE Trans. Inf. Theory 28(2), 129–137 (1982)

    Article  MathSciNet  Google Scholar 

  27. Luan, S., Li, Y., Wang, X., Zhang, B.: Object detection and tracking benchmark in industry based on improved correlation filter (2018)

    Google Scholar 

  28. Malburg, L., Rieder, M.-P., Seiger, R., Klein, P., Bergmann, R.: Object detection for smart factory processes by machine learning. Procedia Comput. Sci. 184, 581–588 (2021); The 12th International Conference on Ambient Systems, Networks and Technologies (ANT)/The 4th International Conference on Emerging Data and Industry 4.0 (EDI40)/Affiliated Workshops

    Google Scholar 

  29. Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K., Galstyan, A.: A survey on bias and fairness in machine learning (2019)

    Google Scholar 

  30. Peng, C., Zhu, M., Ren, H., Emam, M.: Small object detection method based on weighted feature fusion and csma attention module. Electronics 11, 2546 (2022)

    Google Scholar 

  31. Redmon, J., Divvala, S.K., Girshick, R.B., Farhadi, A.: You only look once: Unified, real-time object detection. CoRR (2015). ArXiv:abs/1506.02640

  32. Redmon, J., Farhadi, A.: YOLO9000: better, faster, stronger. CoRR (2016). ArXiv:abs/1612.08242

  33. Redmon, J., Farhadi, A.: Yolov3: An incremental improvement. CoRR (2018). ArXiv:abs/1804.02767

  34. Ren, S., He, K., Girshick, R., Sun, J.: Towards real-time object detection with region proposal networks, Faster r-cnn (2015)

    Google Scholar 

  35. Rezatofighi, H., Tsoi, N., Gwak, J.Y., Sadeghian, A., Reid, I., Savarese, S.: A metric and a loss for bounding box regression, Generalized intersection over union (2019)

    Google Scholar 

  36. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Vanhoucke, V., Rabinovich, A.: Going deeper with convolutions, Dumitru Erhan (2014)

    Google Scholar 

  37. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, vol. 1, pp. I–I (2001)

    Google Scholar 

  38. Wang, C.-Y., Liao, H.-Y.M., Wu, Y.H., Chen, P.Y., Hsieh, J.W., Yeh, I.-H.: A new backbone that can enhance learning capability of cnn, Cspnet (2019)

    Google Scholar 

  39. Wang, W., Wang, Y.: Underwater target detection system based on yolo v4. In: 2021 2nd International Conference on Artificial Intelligence and Information Systems, ICAIIS 2021. Association for Computing Machinery, New York, NY, USA (2021)

    Google Scholar 

  40. Abbas Zaidi, S.S., Ansari, M.S., Aslam, A., Kanwal, N., Asghar, M., Lee, B.: A survey of modern deep learning based object detection models (2021)

    Google Scholar 

  41. Zhao, K., Ren, X.: Small aircraft detection in remote sensing images based on yolov3. IOP Conf. Ser. Mater. Sci. Eng. 533(1), 012056 (2019)

    Google Scholar 

  42. Zou, Z., Chen, K., Shi, Z., Guo, Y., Ye, J.: Object detection in 20 years: A survey (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ashkan Mansouri Yarahmadi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Schneidereit, S., Yarahmadi, A.M., Schneidereit, T., Breuß, M., Gebauer, M. (2024). YOLO-Based Object Detection in Industry 4.0 Fischertechnik Model Environment. In: Arai, K. (eds) Intelligent Systems and Applications. IntelliSys 2023. Lecture Notes in Networks and Systems, vol 823. Springer, Cham. https://doi.org/10.1007/978-3-031-47724-9_1

Download citation

Publish with us

Policies and ethics