Abstract
Tool condition monitoring (TCM) has developed several mature methods to improve processing efficiency. However, existing methods either require the removal of the tool from the machining system for individual monitoring or extensive data processing, manual labeling, and empirical judgment on whether to replace the tool. A TCM method combining machine vision and acoustic emission (AE) is proposed in this paper. Based on the structural similarity index (SSIM) algorithm, the relationship between tool speed and camera frame number is established. Through machine learning (ML) and neural network (NN) methods, the mapping between the wear mount extracted by the machine vision method and the AE feature vector is constructed, and the tool monitoring model is established. Verified by the data set obtained by the milling test, the TCM model established by the proposed can achieve a recognition accuracy of 96.11%, and the root mean square error (RMSE) predicted by the model is 0.0106. This method has proved to be practical and versatile in TCM.
Similar content being viewed by others
Data availability
Some or all data generated or used during the study are available from the corresponding author by request.
Code availability
Some or all code used during the study are available from the corresponding author by request.
References
He Z, Shi T, Xuan J (2022) Milling tool wear prediction using multi-sensor feature fusion based on stacked sparse autoencoders. Measurement 190:110719. https://doi.org/10.1016/j.measurement.2022.110719
Mohanraj T, Shankar S, Rajasekar R, Sakthivel NR, Pramanik A (2020) Tool condition monitoring techniques in milling process — a review. J Mater Res Technol 9(1):1032–1042. https://doi.org/10.1016/j.jmrt.2019.10.031
Zhou Y, Zhi G, Chen W, Qian Q, He D, Sun B, Sun W (2022) A new tool wear condition monitoring method based on deep learning under small samples. Measurement 189:110622. https://doi.org/10.1016/j.measurement.2021.110622
Vagnorius Z, Rausand M, Sørby K (2010) Determining optimal replacement time for metal cutting tools. Eur J Oper Res 206(2):407–416. https://doi.org/10.1016/j.ejor.2010.03.023
Liu C, Wang GF, Li ZM (2015) Incremental learning for online tool condition monitoring using Ellipsoid ARTMAP network model. Appl Soft Comput 35:186–198. https://doi.org/10.1016/j.asoc.2015.06.023
Lins RG, Guerreiro B, Marques de Araujo PR, Schmitt R (2020) In-process tool wear measurement system based on image analysis for CNC drilling machines. IEEE Trans Instrum Meas 69(8):5579–5588. https://doi.org/10.1109/TIM.2019.2961572
Shen Y, Yang F, Habibullah MS, Ahmed J, Das AK, Zhou Y, Ho CL (2021) Predicting tool wear size across multi-cutting conditions using advanced machine learning techniques. J Intell Manuf 32(6):1753–1766. https://doi.org/10.1007/s10845-020-01625-7
Li Y, Wang X, He Y, Wang Y, Wang Y, Wang S (2022) Deep spatial-temporal feature extraction and lightweight feature fusion for tool condition monitoring. IEEE Trans Ind Electron 69(7):7349–7359. https://doi.org/10.1109/TIE.2021.3102443
Zamudio-Ramirez I, Antonino-Daviu JA, Trejo-Hernandez M, Osornio-Rios RA (2022) Cutting tool wear monitoring in CNC machines based in spindle-motor stray flux signals. IEEE Trans Ind Informatics 18(5):3267–3275. https://doi.org/10.1109/TII.2020.3022677
Fernández-Robles L, Sánchez-González L, Díez-González J, Castejón-Limas M, Pérez H (2021) Use of image processing to monitor tool wear in micro milling. Neurocomputing 452:333–340. https://doi.org/10.1016/j.neucom.2019.12.146
Zhang T, Zhang C, Wang Y, Zou X, Hu T (2021) A vision-based fusion method for defect detection of milling cutter spiral cutting edge. Measurement 177:109248. https://doi.org/10.1016/j.measurement.2021.109248
Fong KM, Wang X, Kamaruddin S, Ismadi MZ (2021) Investigation on universal tool wear measurement technique using image-based cross-correlation analysis. Measurement 169:108489. https://doi.org/10.1016/j.measurement.2020.108489
You Z, Gao H, Guo L, Liu Y, Li J, Li C (2022) Machine vision based adaptive online condition monitoring for milling cutter under spindle rotation. Mech Syst Signal Process 171:108904. https://doi.org/10.1016/j.ymssp.2022.108904
Miao H, Zhao Z, Sun C, Li B, Yan R (2021) A U-Net-based approach for tool wear area detection and identification. IEEE Trans Instrum Meas 70:1–10. https://doi.org/10.1109/TIM.2020.3033457
Dou J, Xu C, Jiao S, Li B, Zhang J, Xu X (2020) An unsupervised online monitoring method for tool wear using a sparse auto-encoder. Int J Adv Manuf Technol 106(5–6):2493–2507. https://doi.org/10.1007/s00170-019-04788-7
Móricz L, Viharos ZJ, Németh A, Szépligeti A, Büki M (2020) Off-line geometrical and microscopic & on-line vibration based cutting tool wear analysis for micro-milling of ceramics. Measurement 163:108025. https://doi.org/10.1016/j.measurement.2020.108025
Kong D, Chen Y, Li N, Tan S (2017) Tool wear monitoring based on kernel principal component analysis and v-support vector regression. Int J Adv Manuf Technol 89(1–4):175–190. https://doi.org/10.1007/s00170-016-9070-x
Laddada S, Si-Chaib MO, Benkedjouh T, Drai R (2020) Tool wear condition monitoring based on wavelet transform and improved extreme learning machine. Proc Inst Mech Eng Part C J Mech Eng Sci 234(5):1057–1068. https://doi.org/10.1177/0954406219888544
Gao K, Xu X, Jiao S (2022) Measurement and prediction of wear volume of the tool in nonlinear degradation process based on multi-sensor information fusion. Eng Fail Anal 136:106164. https://doi.org/10.1016/j.engfailanal.2022.106164
Huang Z, Zhu J, Lei J, Li X, Tian F (2020) Tool wear predicting based on multi-domain feature fusion by deep convolutional neural network in milling operations. J Intell Manuf 31(4):953–966. https://doi.org/10.1007/s10845-019-01488-7
Peng R, Liu J, Fu X, Liu C, Zhao L (2021) Application of machine vision method in tool wear monitoring. Int J Adv Manuf Technol 116(3–4):1357–1372. https://doi.org/10.1007/s00170-021-07522-4
Rosten E, Porter R, Drummond T (2010) Faster and better: a machine learning approach to corner detection. IEEE Trans Pattern Anal Mach Intell 32(1):105–119. https://doi.org/10.1109/TPAMI.2008.275
Xiao L, Ouyang H, Fan C (2020) Otsu’s thresholding method based on plane intercept histogram and geometric analysis. Int Arab J Inf Technol 17(5):692–701. https://doi.org/10.34028/iajit/17/5/2
Li P (2022) Quantum implementation of the classical Canny edge detector. Multimed Tools Appl 81(8):11665–11694. https://doi.org/10.1007/s11042-022-12337-w
Ershov EI, Terekhin AP, Nikolaev DP (2018) Generalization of the fast Hough transform for three-dimensional images. J Commun Technol Electron 63(6):626–636. https://doi.org/10.1134/S1064226918060074
Barile C, Casavola C, Pappalettera G, Paramsamy KV (2022) Acoustic emission waveforms for damage monitoring in composite materials: shifting in spectral density, entropy and wavelet packet transform. Struct Heal Monit 21(4):1768–1789. https://doi.org/10.1177/14759217211044692
Qu JL, Wang XF, Gao F, Zhou YP, Zhang XY (2014) Noise assisted signal decomposition method based on complex empirical mode decomposition. Acta Phys Sin 63(11):110201. https://doi.org/10.7498/aps.63.110201
Meng Q, Li K, Zhao C (2019) An improved particle filtering algorithm using different correlation coefficients for nonlinear system state estimation. Big Data 7(2):114–120. https://doi.org/10.1089/big.2018.0130
Benjamini Y, Yekutieli D (2001) The control of the false discovery rate in multiple testing under dependency. Ann Stat 29(4):1165–1188. https://doi.org/10.1214/aos/1013699998
Kong D, Zhu J, Duan C, Lu L, Chen D (2021) Surface roughness prediction using kernel locality preserving projection and Bayesian linear regression. Mech Syst Signal Process 152:107474. https://doi.org/10.1016/j.ymssp.2020.107474
Ding S, Su C, Yu J (2011) An optimizing BP neural network algorithm based on genetic algorithm. Artif Intell Rev 36(2):153–162. https://doi.org/10.1007/s10462-011-9208-z
Guo C, Yan J, Tian Z (2019) Analysis and design of an attitude calculation algorithm based on elman neural network for SINS. Cluster Comput 22(6):15267–15272. https://doi.org/10.1007/s10586-018-2562-8
Chauhan VK, Dahiya K, Sharma A (2019) Problem formulations and solvers in linear SVM: a review. Artif Intell Rev 52(2):803–855. https://doi.org/10.1007/s10462-018-9614-6
Guan S, Wang X, Hua L, Li L (2021) Quantitative ultrasonic testing for near-surface defects of large ring forgings using feature extraction and GA-SVM. Appl Acoust 173:107714. https://doi.org/10.1016/j.apacoust.2020.107714
Pu Q, Xu C, Wang H, Zhao L (2022) A novel artificial bee colony clustering algorithm with comprehensive improvement. Vis Comput 38(4):1395–1410. https://doi.org/10.1007/s00371-021-02367-0
Acknowledgements
This research has been financially supported by the National Natural Science Foundation of China (No. 51975504, 51475404), the Natural Science Foundation of Hunan Province (No. 2021JJ30676), Provincial Natural Science Foundation of Hunan for Distinguished Young Scholars (2022JJ10045), and Postgraduate Scientific Research Innovation Project of Hunan Province (No. CX20210519, XDCX2022Y103).
Funding
This work was supported by the National Natural Science Foundation of China (No. 51975504, 51475404), the Natural Science Foundation of Hunan Province (No. 2021JJ30676), Provincial Natural Science Foundation of Hunan for Distinguished Young Scholars (2022JJ10045), and Postgraduate Scientific Research Innovation Project of Hunan Province (No. CX20210519, XDCX2022Y103).
Author information
Authors and Affiliations
Contributions
Meiliang Chen performed the experiment and contributed to analysis and manuscript; Mengdan Li contributed to the conception of the study and was a major contributor in writing the manuscript; Linfeng Zhao contributed significantly to analysis and manuscript preparation; Jiachen Liu performed the experiment and wrote the manuscript.
Corresponding author
Ethics declarations
Ethical approval
Not applicable
Consent to participate
Not applicable
Consent to publish
Not applicable
Competing interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Chen, M., Li, M., Zhao, L. et al. Tool wear monitoring based on the combination of machine vision and acoustic emission. Int J Adv Manuf Technol 125, 3881–3897 (2023). https://doi.org/10.1007/s00170-023-11017-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00170-023-11017-9