Skip to main content
SpringerLink
Log in

A novel automatic reading method of pointer meters based on deep learning

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

The automatic reading of pointer meters is significantly important to data monitoring and efficient measurement in the industrial field. However, the existing automatic reading method can not obtain accurate performance in natural scenarios and present no satisfactory application effects in industrial fields (such as power stations and gas stations). In this paper, a novel automatic reading method for pointer meters based on deep learning is proposed, which contains five stages. Stage-1: the object detection algorithm Yolov4 and the feature optimization module IFF are used to locate the target meter. Stage-2: Semantic segmentation model is applied to extract the pointer area based on Anam-Net. Stage-3: the character detection algorithm CRAFT and the text recognition algorithm E2E-MLT are combined and used to recognize the scale text and unit on the meter. Stage-4: the scale area of the meter is converted to the polar coordinate system, and a lightweight convolutional neural network is designed to locate the main scale line. And finally in Stage-5: the reading data are calculated according to the outputs of the above-mentioned deep learning models. The experiment results show that the reading method proposed in this paper has higher accuracy and robustness than those of the existing approaches and obtains satisfactory application effects in the industrial field.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Data availability statement

The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.

References

  1. Jian Y, Xin W, Xue Z, ZhenYou D (2015) In: IEEE 28th canadian conference on electrical and computer engineering (CCECE), pp. 337–342. https://doi.org/10.1109/CCECE.2015.7129299

  2. Lai H, Kang Q, Pan L, Cui C (2019) In: 2019 IEEE 15th International conference on automation science and engineering (CASE), pp. 374–379. https://doi.org/10.1109/COASE.2019.8843107

  3. Park JY, Lee JK, Cho BH, Oh KY (2012) An inspection robot for live-line suspension insulator strings in 345-kV power lines. IEEE Trans Power Deliv 27(2):632. https://doi.org/10.1109/TPWRD.2011.2182620

    Article  Google Scholar 

  4. Gao JW, Xie HT, Zuo L, Zhang CH (2017) In: 2017 International conference on robotics and automation sciences (ICRAS) (IEEE, 2017), pp. 43–47

  5. Alegria FC, Serra AC (2000) Computer vision applied to the automatic calibration of measuring instruments. Measurement 28(3):185

    Article  Google Scholar 

  6. Ye W, da Hu, bin Zou W (2009) in In: 2009 international conference on networking and digital society, vol. 2 (IEEE), pp. 83–86

  7. Hao ZL, Chen XH, Hu JQ, Wen X, Wang XD (2014) In: Applied mechanics and materials, vol. 615. Trans Tech Publ, pp. 149–152

  8. Wen K, Li D, Zhao X, Fan A, Mao Y, Zheng S (2018) In: 2018 IEEE 3rd advanced information technology, electronic and automation control conference (IAEAC). (IEEE), pp. 759–764

  9. Li Q, Fang Y, He Y, Yang F (2014) In: IECON 2014-40th annual conference of the IEEE industrial electronics society (IEEE), pp. 3414–3418

  10. Chi J, Liu L, Liu J, Jiang Z, Zhang G (2015) Machine vision based automatic detection method of indicating values of a pointer gauge. Math Problems Eng, 2015

  11. Hu D, Li J, Liu Y, Li Y (2020) Flow adversarial networks: flowrate prediction for gas to liquid multiphase flows across different domains. IEEE Trans Neural Netw Learn Syst 31(2):475. https://doi.org/10.1109/TNNLS.2019.2905082

    Article  Google Scholar 

  12. Prosvirin AE, Piltan F, Kim JM (2020) Hybrid rubbing fault identification using a deep learning-based observation technique. IEEE Trans Neural Netw Learn Syst 32(11):5144–5155. https://doi.org/10.1109/TNNLS.2020.3027160

    Article  MathSciNet  Google Scholar 

  13. He P, Zuo L, Zhang C, Zhang Z (2019) In: 2019 9th international conference on information science and technology (ICIST) (IEEE, 2019), pp. 108–113

  14. Cai WD, Ma B, Zhang L, Han YM (2020) Measurement 163. https://doi.org/10.1016/j.measurement.2020.107962.

  15. Li Z, Zhou YS, Sheng QH, Chen KJ, Huang J (2020) Sensors 20(20):17 https://doi.org/10.3390/s20205946

  16. Liu Y, Liu J, Ke YC (2020) Measurement 152:10 https://doi.org/10.1016/j.measurement.2019.107333.

  17. Wang L, Wang P, Wu L, Xu L, Huang P, Kang Z (2021) Computer vision based automatic recognition of pointer instruments: data set optimization and reading. Entropy 23(3):272

    Article  Google Scholar 

  18. Baek Y, Lee B, Han D, Yun S, Lee H (2019) In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 9365–9374

  19. Bušta M, Patel Y, Matas J (2018) In: Asian conference on computer vision Springer, pp. 127–143

  20. Zhao ZQ, Zheng P, Xu ST, Wu X (2019) Object detection with deep learning: a review. IEEE Trans Neural Netw Learn Syst 30(11):3212. https://doi.org/10.1109/TNNLS.2018.2876865

    Article  Google Scholar 

  21. Bochkovskiy A, Wang CY, Liao HYM (2020) arXiv preprint arXiv:2004.10934

  22. Wang CY, Mark Liao HY, Wu YH, Chen PY, Hsieh JW, Yeh IH (2020) In: 2020 IEEE/CVF conference on computer vision and pattern recognition workshops, CVPRW 2020, June 14, 2020 –June 19, 2020, IEEE computer society conference on computer vision and pattern recognition workshops, vol. 2020-June (IEEE Computer Society, 2020), IEEE computer society conference on computer vision and pattern recognition workshops, vol. 2020-June, pp. 1571–1580. https://doi.org/10.1109/CVPRW50498.2020.00203

  23. He K, Zhang X, Ren S, Sun J (2015) Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans Pattern Anal Mach Intell 37(9):1904. https://doi.org/10.1109/TPAMI.2015.2389824

    Article  Google Scholar 

  24. Liu S, Qi L, Qin H, Shi J, Jia J (2018) In: 31st meeting of the IEEE/CVF conference on computer vision and pattern recognition, CVPR 2018, June 18, 2018–June 22, 2018 (IEEE Computer Society, 2018), Proceedings of the IEEE computer society conference on computer vision and pattern recognition, pp. 8759–8768. https://doi.org/10.1109/CVPR.2018.00913

  25. Redmon A, Joseph Farhadi (2018) Yolov3: An incremental improvement. https://ui.adsabs.harvard.edu/abs/2018arXiv180402767R

  26. Mao M, Tian Y, Zhang B, Ye Q, Liu W, Doermann D (2021) IffDetector: inference-aware feature filtering for object detection. IEEE Trans Neural Netw Learn Syst, 1–10. https://doi.org/10.1109/TNNLS.2021.3081864

  27. Paluru N, Dayal A, Jenssen HB, Sakinis T, Cenkeramaddi LR, Prakash J, Yalavarthy PK (2021) Anam-Net: Anamorphic depth embedding-based lightweight CNN for segmentation of anomalies in COVID-19 chest CT images. IEEE Trans Neural Netw Learn Syst 32(3):932. https://doi.org/10.1109/TNNLS.2021.3054746

    Article  Google Scholar 

  28. Ronneberger O, Fischer P, Brox T (2015) In: International Conference on Medical image computing and computer-assisted intervention. Springer, pp. 234–241

Download references

Author information

Authors and Affiliations

  1. Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, China

    Junjiao Sun & Zhiqing Huang

  2. School of Electronic and Information Engineering, Beijing Jiaotong University, Beijing, 100044, China

    Yanxin Zhang

Authors
  1. Junjiao Sun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhiqing Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yanxin Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhiqing Huang.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sun, J., Huang, Z. & Zhang, Y. A novel automatic reading method of pointer meters based on deep learning. Neural Comput & Applic 35, 8357–8370 (2023). https://doi.org/10.1007/s00521-022-08110-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-08110-7

Keywords

Search

Navigation