Next Article in Journal
Comparing Methods of Feature Extraction of Brain Activities for Octave Illusion Classification Using Machine Learning
Next Article in Special Issue
Simu2VITA: A General Purpose Underwater Vehicle Simulator
Previous Article in Journal
Measurement of Axial Strain of Geogrid by Optical Sensors
Previous Article in Special Issue
2D Optimal Trajectory Planning Problem in Threat Environment for UUV with Non-Uniform Radiation Pattern
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Communication

Adaptive Navigation Algorithm with Deep Learning for Autonomous Underwater Vehicle

1
Shanghai Marine Electronic Equipment Research Institute, Shanghai 201108, China
2
College of Shipbuilding Engineering, Harbin Engineering University, Harbin 150001, China
3
Qingdao Innovation and Development Center, Harbin Engineering University, Qingdao 266000, China
4
College of Information Science and Engineering, Ocean University of China, Qingdao 266000, China
*
Author to whom correspondence should be addressed.
Sensors 2021, 21(19), 6406; https://doi.org/10.3390/s21196406
Submission received: 21 July 2021 / Revised: 22 September 2021 / Accepted: 23 September 2021 / Published: 25 September 2021
(This article belongs to the Special Issue Autonomous Underwater Vehicle Navigation Ⅱ)

Abstract

:
Precise navigation is essential for autonomous underwater vehicles (AUVs). The measurement deviation of the navigation sensors, especially the microelectromechanical systems (MEMS) sensors, is a crucial factor that affects the localization accuracy. Deep learning is a novel method to solve this problem. However, the calculation cycle and robustness of the deep learning method may be insufficient in practical application. This paper proposes an adaptive navigation algorithm with deep learning to address these questions and realize accurate navigation. Firstly, this algorithm uses deep learning to generate low-frequency position information to correct the error accumulation of the navigation system. Secondly, the χ2 rule is selected to judge if the Doppler velocity log (DVL) measurement fails, which could avoid interference from DVL outliers. Thirdly, the adaptive filter, based on the variational Bayesian (VB) method, is employed to estimate the navigation information simultaneous with the measurement covariance, improving navigation accuracy even more. The experimental results, based on AUV field data, show that the proposed algorithm could realize robust navigation performance and significantly improve position accuracy.

1. Introduction

The autonomous underwater vehicle (AUV) is an essential equipment for ocean exploration and has been widely applied in recent years. By collecting information from various relevant sensors, the navigation system could estimate the position, velocity, and other navigation information of the AUV [1,2]. Therefore, AUV navigation technology is an essential prerequisite for ocean exploration. Because the global positioning system (GPS) is invalid when the AUV operates underwater, it is necessary to develop underwater autonomous navigation technology. The main navigation methods at present include inertial navigation [3,4], acoustic navigation [5,6], simultaneous localization and mapping (SLAM) [7,8], geophysical map-based navigation [9], and integrated navigation [10]. Among the above methods, integrated navigation is the most widely used navigation method for AUVs.
Considering the cost and convenience, the integrated navigation system for the small-scale AUV, which works in shallow seas and lakes, mainly relays on the Doppler velocity log (DVL) and the attitude and heading reference system (AHRS). Based on the kinematics equation, the dead-reckoning method can be used to calculate the location of AUVs [11,12]. However, the measurement error, which could be considered Gaussian white noise, would cause the position error accumulation. The navigation system needs to use the filter to reduce the interference of measurement error. The regularly used filters include extended the Kalman filter (EKF) [13,14], and the unscented Kalman filter (UKF) [15,16]. EKF is the most commonly used nonlinear filtering method for AUV navigation. By intercepting the first-order Taylor series, it could approximate the nonlinear transformation process, but the EKF neglects the higher-order terms, which leads to the system model error. The Gauss-Newton is an optimized method that could reduce the nonlinear model error to a certain extent [17]. Optimized methods, such as genetic algorithm [18] and particle filter [19], could also be used to improve the performance of EKF. UKF uses an unscented transformation to sample and estimate the state by calculating the covariance of the system state and the observed state, which could achieve a higher estimation accuracy than EKF. However, in practical application, the computational complexity of UKF is high, and it is easy to introduce the problem of nonpositive covariance, which also affects the robustness of the navigation system.
To achieve the state estimation, accurate error covariance is necessary. Because of the influence of environmental factors and sensor characteristics, the measurement noise covariance is uncertain, even time-varying, and it is difficult to obtain precise noise errors in engineering applications. The existing solution assumes the noise satisfies the white Gaussian noise distribution and realizes the state estimation through an adaptive filter. Sage Husa [20,21], H∞ filter [22], the maximum likelihood estimation method [23,24], and variational Bayesian (VB) [25,26] are the primary adaptive algorithms at present. The adaptive filter could obtain the state estimation with approximate error covariance.
The adaptive filter could effectively estimate the error distribution in the case of white noise. However, due to the magnetic sensitivity of the external ferromagnetic material and the electromagnetic wave of AUVs, the data of AHRS may have a deviation from the true value, which could be treated as a color noise. The color noise could not be addressed by the conventional method and it is still a challenging issue in practical applications. Deep learning [27] has developed rapidly in recent years and has been applied in image processing [28], language translation [29], pattern recognition [30], and other engineering fields [31]. Since the neural network method could approach the optimal solution, this method could effectively improve the navigation accuracy when the sensor has a large deviation. However, according to our research, the positioning accuracy of the neural network method is unsatisfactory compared to that of the traditional navigation method when the sensor accuracy is high [32]. Additionally, the navigation information frequency of the deep learning method is low since the calculation cycle of the deep learning method needs data from a duration time, which would cause this method to be insufficient in some missions.
This paper proposes an adaptive navigation algorithm with deep learning, which could be employed to the integration of AHRS and DVL. Firstly, the method employs the VB method to adapt the covariance of the measurement of noise covariance. Subsequently, when the calculation cycle of deep learning is finished, the neural network would obtain a relatively precise position, and the measurement model of the filter uses this position, and the data from AHRS and DVL, to correct the system state. Otherwise, the measurement value includes the data of AHRS and DVL. During the impact from the environment and AUV motion, the DVL measurement may fail [33,34]. To avoid the impact of DVL outliers on the filter estimate, the χ2 rule is employed to evaluate the DVL measurement [35,36]. When the DVL measurement fails, the observation will remove the data from the DVL. The proposed method is evaluated by the AUV field data, and experimental results show that the algorithm proposed in this paper could significantly improve the accuracy and the robustness of the navigation system.
The remainder of this paper is organized as follows: Section 2 introduces the navigation system of the platform and the conventional EKF navigation method. The details of the proposed method are presented in Section 3. Section 4 presents the performance of different navigation methods and the experimental results analysis. Finally, the conclusion of this work is in Section 5.

2. Navigation System

2.1. Equipment and Sensors

Figure 1 is the structure of the Sailfish AUV. The Sailfish AUV includes the propulsion system, communication system, environmental perception system, and navigation system. The propulsion system includes the propeller, rudder, and their related control units, which provide the power of AUV motion. The communication system aims to provide stable information interaction between the AUV and the offshore control unit. The environmental perception system uses sensors to obtain environmental information that can be used for mission performance and obstacle avoidance. Among them, the navigation system could provide navigation information for other systems, so it is the fundamental function of AUVs. To realize the navigation state estimation, the AUV is equipped with various sensors and equipment. The navigation system is integrated in the middle cable of the whole AUV. The related sensors and equipment include a GPS, DVL, AHRS, and a depth meter (DM). Each sensor and equipment will be introduced in the following parts. The specification of part sensors and equipment could refer to our previous work [37].
As a piece of passive positioning equipment, the GPS could obtain an accurate position when the AUV floats on the surface. The GPS calculates its localization by receiving the signal of the satellite, and the position information has no error accumulation. However, because of the interference from the wind and waves, the GPS navigation information may have outliers. A filter is needed before the GPS information can used in the navigation system. Table 1 presents the specifications of the GPS.
The DVL is aimed at measuring the linear velocity of the AUV. When the DVL works, a short sound pulse with a fixed frequency will be transmitted and reflected by the bottom of the seafloor. The transducer of the DVL calculates the linear velocity based on the frequency change of the echo. The sound echo would be interference with environment and the AUV motion state, which caused the DVL measurement to fail in practical application. When the DVL operates normally, the measurement error is considered to be the white noise. Table 2 presents the specifications of the DVL.
The AHRS, which includes a three-axial gyroscope, accelerometer, and magnetic compass, could directly measure the linear acceleration, angular velocity, and magnetic intensity. The above data would be a fusion with a Kalman filter to get a stable heading and attitude. However, due to the magnetic sensitivity of the external ferromagnetic material and the electromagnetic wave of AUV, the information of AHRS, especially the yaw data, may have a deviation from the true value, which could not be treated as white noise. Table 3 presents the specifications of AHRS.
The DM is an essential sensor that can provide AUV depth during vehicle operation in the water. The core component of the DM is a pressure sensor that can obtain the intensity of pressure. The micro process unit of the DM uses the pressure, fluid density, and constant of gravitation to calculate the depth of the AUV. The data from DMs are relatively accurate and can be employed directly in AUV navigation. Therefore, the main challenge in our AUV navigation is to achieve a position estimation in the horizontal coordinate. Table 4 presents the specifications of the DM.

2.2. Conventional EKF Navigation Algorithm

The conventional navigation algorithm of the AUV platform is EKF. EKF can be divided into two parts: time update and measurement update. In the time update stage, the system employs the kinematics equation to predict the system state, and the Jacobin matrix of the system update function is used to forecast the covariance of system noise. Equations (1) and (2) represent the system propagate process:
X k | k 1 = f ( X k 1 )
P k | k 1 = F k P k 1 F k T + Q
where X is the system state, f is the system update function based on the kinematics equation, P is the system error covariance, Q is the covariance of the system noise, and F is the system noise transition matrix.
In the measurement update stage, the system state and covariance would be corrected by the measurement value. The Kalman gain, which is determined by the covariance of system noise and measurement noise, represents the degree of correction. The measurement update process is shown in the following equations:
K k = P k | k 1 H k T ( H k P k | k 1 H k T + R k ) 1
X k = X k | k 1 + K k ( Z k h ( X k | k 1 ) )
P k = ( I K k H k ) P k | k 1
where K is the Kalman gain, Z is the measurement vector, h is the measurement function, H is the Jacobin matrix of measurement function, and R is the measurement noise covariance matrix.
In the AUV navigation modeling process, the kinematics equation of AUV navigation is represented as Equation (6):
[ x y ψ u v a u a v ω ] k = [ x + ( u t + 0.5 a u t 2 ) cos ( ψ ) ( v t + 0.5 a v t 2 ) sin ( ψ ) + n x y + ( u t + 0.5 a u t 2 ) sin ( ψ ) + ( v t + 0.5 a v t 2 ) cos ( ψ ) + n y ψ + ω t + n ψ u + a u t + n u v + a v t + n v a u + n a u a v + n a v ω + n ω ] k 1
where x and y are the positions along the north and east axis, Ψ is the heading of AUV, u and v are the longitudinal and transverse velocities in horizontal coordinates, au and av are the related acceleration, ω is the angular velocity of heading, and t is the time interval. Since the error propagation is a complex coupled process, to simplify the calculations, the system noise is assumed as the white Gaussian noise. The system noise is shown as Equation (7).
n = [ n x n y n ψ n u n v n a u n a v n w ] T
As the system update function is nonlinear, the system noise transition function, which is shown in Equation (8), is the Jacobin matrix of the system update function.
F = [ 1 0 ( u t + 0.5 a u t 2 ) sin ( ψ ) ( v t + 0.5 a v t 2 ) cos ( ψ ) t cos ( ψ ) t sin ( ψ ) 0.5 t 2 cos ( ψ ) 0.5 t 2 sin ( ψ ) 0 0 1 ( u t + 0.5 a u t 2 ) cos ( ψ ) ( v t + 0.5 a v t 2 ) sin ( ψ ) t sin ( ψ ) t cos ( ψ ) 0.5 t 2 sin ( ψ ) 0.5 t 2 cos ( ψ ) 0 0 0 1 0 0 0 0 t 0 0 0 1 0 t 0 0 0 0 0 0 1 0 t 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 1 ]
The measurement state includes the velocity, acceleration, heading, and angular velocity and is shown in Equation (9):
Z = [ ψ u v a u a v w ] T
As the measurement state has a linear relationship to the system state, the measurement transition matrix is easy to express:
H = [ 0 6 × 2 I 6 × 6 ]
According to the above navigation system modeling, the navigation information of the AUV can be calculated in real-time by using the EKF algorithm. However, the data of the AHRS is vulnerable to the external ferromagnetic material and the electromagnetic waves of the AUV. In the actual AUV application, the noise of the heading is colored noise and difficult to estimate, which is the main reason that affects the positioning accuracy of the navigation system. The velocity measurement error of the DVL is another factor that affects navigation accuracy.

3. Adaptive Navigation Algorithm with Deep Learning

This paper proposed an adaptive navigation algorithm with deep learning to address sensor noise in the navigation system. Figure 2 is the flowchart of the developed method. The algorithm is based on the EKF method, and regular observation contains the data of the DVL and AHRS. When the deep learning calculation cycle is finished, the position calculated by deep learning would be added to the observation ZD. To avoid interference from DVL outliers, the observation ZA would remove the data of DVL when it fails. The VB method is employed in the EKF to adjust the covariance of noise.

3.1. Deep Learning Navigation Method

The yaw data of AHRS includes colored noise, which is hard to estimate by the conventional method. Therefore, we employed a hybrid recurrent neural networks (RNNs) framework to realize AUV position estimation. Since the training process uses the GPS movement as the label, and the raw data of the sensors as the input, the trained framework could include the interference from yaw error [32]. Figure 3 presents the structure of hybrid RNNs. This framework uses unidirectional and bidirectional long short-term memory (LSTM) to handle different sensor data. The calculation process of LSTM is as follows [38]. Figure 4 is the structure of LSTM.
f g t = σ f ( W f [ h l t 1 , X s t ] + b f )
i g t = σ i ( W i [ h l t 1 , X s t ] + b i )
C t = f g t C t 1 + i g t tanh ( W c [ h l t 1 , X s t ] + b c )
o g t = σ o ( W o [ h l t 1 , X s t ] + b o )
h l t = o g t tanh ( C t )
where Xs is the sequence input of data, the W and b are the weight and bias, the fg is the forgetting gate, ig is the input gate, C is the cell state, Og is the output gate, and hl is the hidden layer. The activation function σ uses the sigmoid. The ∘ represents the point-wise product operation.
The RNN structure is used to preprocess the raw data of the DVL and AHRS. Then the output of different RNNs and the time interval are used as the input to transform the displacement by a fully connected layer [39]. The GPS trajectory is smoothed by an adaptive fault-tolerance filter and separated into segments to generate labels for training. In this network, root mean square error (RMSE) is selected to calculate the loss between the label and prediction. The RMSE calculation process is shown in Equation (16).
ξ = 1 m i = 1 m ( χ i X d i ) 2
where m is the number of train datasets, χ is the label, and Xd is the predicted value of deep learning.
To improve the training efficiency of the network, the activation function in the fully connected layers employs the rectified linear unit (ReLu) to overcome the vanishing gradient problem. According to our experiments, the learning rate should be reduced during the training process, so the adaptive gradient (AdaGrad) is selected to adjust the learning rate, and AdaGard could effectively decrease training cycles. The trained network could achieve AUV position estimation.
Deep learning is an end-to-end navigation method and does not need to handle various complex matrix operations. Therefore, it is easy to implement. Since the neural network method could approximate the optimal solution, it could obtain relatively precise localization when the raw data has a large deviation. However, the performance is relatively weak when the raw data is accurate. The calculation cycle of the deep learning method needs data from a duration time, which causes the deep learning method to only obtain navigation information with a low frequency. In this work, the position information of deep learning is used as the element in the observation to correct the navigation information. Here the measurement vector Zd includes the deep learning output and the data from the DVL and AHRS. The RMSE of deep learning describes the deviation degree from truth value, and the square of RMSE is mean square error (MSE), which is the same as the meaning of measurement variance. Hence, we use the MSE as an approximate measurement variance of the neural network position estimation. The measurement noise covariance matrix Rd concludes the MSE of deep learning and the measurement noise. Because the variance obtained by the MSE is still not accurate, it needs to be corrected by the VB method.

3.2. DVL Fault Diagnosis

When AUVs cruise in the water, the motion state is interfered with by the waves and surge, which may have an adverse impact on the DVL measurement. The moving objects near the DVL, or a rapid change in the terrain, is another factor for DVL accuracy.
To restrain the above impact, the χ2 rule is selected to judge if the DVL measurement fails [35,36]. The innovation of DVL measurement is satisfied with white noise when the data of DVL is available.
r D V L ~ ( 0 , N D V L )
In our navigation system, the covariance matrix NDVL is expressed as follows:
N D V L = [ H P k | k 1 H T + R ] 2 : 3 , 2 : 3
The fault detection criterion is defined as Equation (19).
C D V L = r D V L T ( N D V L ) 1 r D V L
If C D V L is above the threshold, we consider the DVL measurement to have failed, and the DVL measurement is removed from the observation matrix Za. The measurement noise covariance matrix Ra only contains the measurement noise of AHRS. The χ2 rule is suitable for mutant fault detection, which could effectively avoid the impact of DVL measurement failure in navigation.

3.3. Variational Bayesian Method

The accuracy of the covariance estimation is significant to the performance of the Kalman filter. Since the system covariance is the inherent characteristics, and approximate estimation could maintain the stability of the filter, the measurement covariance is the main factor that affects the accuracy of the state estimation. In our navigation algorithm, the measurement includes position, yaw angle, and velocity. Among them, the covariance of position is obtained by deep learning, which is an approximate value, and the covariance of the DVL would be affected by the environment. The VB method is introduced to the state estimation to simultaneously estimate the measurement covariance to address this question.
The VB method aims to obtain the conditional probability density of joint distribution p(Xk, Rk|Zk). To simplify the calculation process, the joint distribution is approximate to the product of two independent probability densities, as shown in Equation (20).
p ( X k , R k | Z k ) q ( X k ) q ( R k )
According to the VB theory, the approximate probability density can be obtained by minimizing the Kullback-Leibler divergence from the actual probability density. Since the measurement follows the law of normal distribution, the covariance of covariance is assumed to satisfy the inverse Wishart distribution [37]. The VB method can be concluded as follows.
In the time update process, the VB method is similar to the standard Kalman filter. In addition, the parameter initialization is as Equation (21).
{ α k | k 1 = ρ ( α k 1 m 1 ) + m + 1 β k | k 1 = ρ β k 1
where α and β are the elements in the probabilistic distribution of measurement covariance, m is the degree of the observation matrix, and ρ is the factor that approximates the posterior of the measurement covariance.
The measurement update is an iterative process. The calculation is expressed in Equation (22).
{ α k ( i + 1 ) = α k ( i ) + 1 β k ( i + 1 ) = β k ( i ) + ( Z k H X k ( i ) ) T ( Z k H X k ( i ) ) + H P k | k 1 H T R k ( i + 1 ) = [ ( α ( i + 1 ) m 1 ) / β ( i + 1 ) ] 1 K ( i + 1 ) = P k | k 1 H T ( H P k | k 1 H T + R k ( i + 1 ) ) 1 X k ( i + 1 ) = X k | k 1 + K ( i + 1 ) ( Z k H X k | k 1 ) P k ( i + 1 ) = P k | k 1 K ( i + 1 ) H P k | k 1
where i represents the number of iterations. After the iteration is finished, the last system state and measurement covariance are the estimations of the VB method.
In the proposed navigation algorithm, the covariance of measurement is uncertain, which could seriously impact navigation accuracy. The VB method could simultaneously estimate the measurement noise covariance and system state, which could reduce the interference from imprecise covariance.
For simplicity, the notation of the AUV model and the developed algorithm is regrouped for clarity in Table 5.

4. Experiments and Analysis

In this section, a series of experiments based on the AUV field data is carried out. To evaluate the performance of different navigation methods, a truth value, such as GPS position, is necessary for the experiment platform. As the AUV could not obtain a GPS position while immersed underwater, the field data were collected when the AUV was cruising on the surface. Moreover, the GPS-smoothed trajectories could be generated as the labels to train the deep learning network. Figure 5 is the Sailfish AUV during the Tuandao Bay experiments. The scene is the Sailfish cruising on the surface.
The field data of our experiments were acquired from different places, such as the Menlou Reservoir, Jiaozhou Bay, and Tuandao Bay. Table 6 depicts the details of the experimental data. The field data of four groups covers straight lines, turns, and cycles, which represent almost all of the motion modes of AUVs. Additionally, the experimental environment in different places is varied. The winds and waves in bay and coastal waters are more intense than those in the reservoir.
In our experiments, the conventional EKF, pure deep learning, and the proposed algorithm were employed to generate the AUV trajectory. Figure 6 shows the paths produced by various algorithms. Since the GPS data frequency in our platform is 1 Hz, the GPS trajectory is divided into movements per second. Therefore, the navigation data frequency of deep learning is 1 Hz, while the conventional method and the proposed method are 10 Hz.
In Figure 6, black lines represent the smoothed GPS trajectories that are considered as the ground truth, red lines represent the conventional EKF trajectories, blue lines represent pure deep learning trajectories, and violet lines represent the proposed method. According to our previous research, the performance of the deep learning method would be better than the conventional EKF algorithm in most cases. However, the EKF trajectory would be closer to the ground truth when the accuracy of navigation sensors is high, which caused the pure deep learning in Test1 to be worse than the EKF. The proposed method could adaptively fuse the data from sensors and the deep learning method by the VB method. Therefore, the navigation accuracy in Test1 can be improved more than other methods. In Test2, DVL raw data has a jump that causes the EKF to deviate from the expected trajectory. The deep learning method is robust to the outliers and could effectively avoid interference. In the proposed method, the DVL fault diagnosis method detects the measurement fails and removes the velocity data from the observation, so the proposed method could maintain the robustness towards the measurement outliers. Test3 and Test4 show that the proposed method could effectively improve navigation accuracy more than the conventional EKF method.
Figure 7 shows the position errors between the ground truth and different algorithms. The position errors are the distance between the GPS and the estimation results of different methods. In Figure 7a, because of the slight sensor deviation and the data fusion strategy, the performance of the proposed method is better than other methods. Figure 7b shows the error of Test2. Since the DVL measurement has outliers, the deep learning method could significantly improve the navigation accuracy. The proposed method, with a fault diagnosis function leading to the algorithm, has positive fault tolerance ability to the DVL measurement fails. Figure 7c,d show that the proposed method could improve the position accuracy compared to the conventional EKF method, and the accuracy is close to the deep learning method. Table 7 summarizes the RMSE of all the above algorithms during the four experiments. The RMSE results evidence that, although the proposed algorithm is insufficient compared to deep learning in most cases, it could achieve norm frequency and robust navigation, and improve accuracy to a larger extent than the conventional method. A number of experimental tests verify that the RMSE could improve by at least 14.4%.

5. Conclusions

In this work, we developed an adaptive navigation algorithm based on deep learning. Firstly, this algorithm uses deep learning to generate low-frequency position information to correct the navigation error. Secondly, the χ2 rule is selected to judge if the DVL measurement fails, which could avoid the interference from DVL outliers. Thirdly, the adaptive filter based on the VB method is employed to estimate navigation information simultaneous to the measurement covariance, improving navigation accuracy even more.
Different from the pure deep learning navigation method, this work could achieve robustness and high accuracy navigation with a normal frequency, which could be satisfied by the requirements of various missions. The experimental results based on AUV field data verified that even the performance of the proposed algorithm is slightly worse than pure deep learning. However, it has good robustness and could effectively improve navigation accuracy compared to the conventional navigation algorithms. In the future, we will carry on more complex integrated navigation system design, such as the integration of different acoustic equipment, and investigate the performance of the proposed algorithm.

Author Contributions

Methodology, software, and writing—original draft preparation, H.M.; investigation, writing—review and editing, X.M.; project administration, B.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Key Research and Development Program of China, grant number 2019YFC1408304.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Paull, L.; Saeedi, S.; Seto, M.; Li, H. Auv navigation and localization: A review. IEEE J. Ocean. Eng. 2014, 39, 131–149. [Google Scholar] [CrossRef]
  2. Miller, P.A.; Farrell, J.A.; Zhao, Y.Y.; Djapic, V. Autonomous Underwater Vehicle Navigation. IEEE J. Ocean. Eng. 2010, 35, 663–678. [Google Scholar] [CrossRef]
  3. Wang, L.; Pang, S. AUV Navigation Based on Inertial Navigation and Acoustic Positioning Systems. In Proceedings of the OCEANS 2018, Charleston, SC, USA, 22–25 October 2018. [Google Scholar]
  4. Bo, Y.; Xiaogang, Y.; Geping, Q.; Yongjun, W. Accurate Integrated Navigation Method Based on Medium Precision Strapdown Inertial Navigation System. Math. Probl. Eng. 2020, 2020. [Google Scholar] [CrossRef]
  5. Neasham, J.A.; Goodfellow, G.; Sharphouse, R. Development of the “Seatrac” miniature acoustic modem and USBL positioning units for subsea robotics and diver applications. In Proceedings of the OCEANS 2019, Genova, Italy, 18–21 May 2015. [Google Scholar]
  6. Fan, S.S.; Liu, C.Z.; Li, B.; Xu, Y.X.; Xu, W. AUV docking based on USBL navigation and vision guidance. J. Mar. Sci. Technol.-Jpn. 2019, 24, 673–685. [Google Scholar] [CrossRef]
  7. He, B.; Zhang, H.J.; Li, C.; Zhang, S.J.; Liang, Y.; Yan, T.H. Autonomous Navigation for Autonomous Underwater Vehicles Based on Information Filters and Active Sensing. Sensors 2011, 11, 10958–10980. [Google Scholar] [CrossRef]
  8. Palomer, A.; Ridao, P.; Ribas, D. Inspection of an underwater structure using point-cloud SLAM with an AUV and a laser scanner. J. Field Robot 2019, 36, 1333–1344. [Google Scholar] [CrossRef]
  9. Liu, M.Y.; Wang, P.X.; Guo, J.J.; Niu, Y.; Shi, T.C.; Wang, C. Research on Geomagnetic Navigation and Positioning Algorithm Based on Full-connected Constraints for AUV. In Proceedings of the OCEANS 2019, Seattle, WA, USA, 27–31 October 2019. [Google Scholar]
  10. Lyu, W.W.; Cheng, X.H.; Wang, J.L. Adaptive Federated IMM Filter for AUV Integrated Navigation Systems. Sensors 2020, 20, 6806. [Google Scholar] [CrossRef]
  11. Sabet, M.T.; Daniali, H.M.; Fathi, A.; Alizadeh, E. A Low-Cost Dead Reckoning Navigation System for an AUV Using a Robust AHRS: Design and Experimental Analysis. IEEE J. Ocean. Eng. 2018, 43, 927–939. [Google Scholar] [CrossRef]
  12. Klein, I.; Diamant, R. Dead Reckoning for Trajectory Estimation of Underwater Drifters under Water Currents. J. Mar. Sci. Eng. 2020, 8, 205. [Google Scholar] [CrossRef] [Green Version]
  13. Wolbrecht, E.; Pick, D.; Canning, J.; Edwards, D. Improving AUV Localization Accuracy by Combining Ultra-Short-Baseline and Long-Baseline Measurements Systems in a Post-Processing Extended Kalman Filter. In Proceedings of the OCEANS 2019, Seattle, WA, USA, 27–31 October 2019. [Google Scholar]
  14. Xu, H.L.; Chen, G.; Jia, Q.Y.; Cao, S.; Jiang, M. The research on sea-bottom terrain tracking by AUV based on Least Squares Method and Extended Kalman Filter. In Proceedings of the OCEANS 2016, Shanghai, China, 10–13 April 2016. [Google Scholar]
  15. Li, H.X.; Guo, H.; Qi, Y.H.; Deng, L.K.; Yu, M. Research on multi-sensor pedestrian dead reckoning method with UKF algorithm. Measurement 2021, 169. [Google Scholar] [CrossRef]
  16. Allotta, B.; Caiti, A.; Costanzi, R.; Fanelli, F.; Fenucci, D.; Meli, E.; Ridolfi, A. A new AUV navigation system exploiting unscented Kalman filter. Ocean. Eng. 2016, 113, 121–132. [Google Scholar] [CrossRef]
  17. Hiroyuki, M.; Nobuo, Y.; Masao, F. The Incremental Gauss-Newton Algorithm with Adaptive Stepsize Rule. Comput. Optim. Appl. 2003, 26, 107–141. [Google Scholar]
  18. Hu, F.; Wu, G. Distributed Error Correction of EKF Algorithm in Multi-Sensor Fusion Localization Model. IEEE Access 2020, 8, 93211–93218. [Google Scholar] [CrossRef]
  19. He, H.; Wang, K.; Sun, L. A SLAM algorithm of fused EKF and Particle filter. In Proceedings of the WRC SARA 2018, Beijing, China, 16 August 2018; pp. 172–177. [Google Scholar]
  20. Xu, S.Q.; Zhou, H.Y.; Wang, J.Q.; He, Z.M.; Wang, D.Y. SINS/CNS/GNSS Integrated Navigation Based on an Improved Federated Sage-Husa Adaptive Filter. Sensors 2019, 19, 3812. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  21. Liu, K.N.; Zhao, W.Y.; Sun, B.G.; Wu, P.T.; Zhu, D.L.; Zhang, P. Application of Updated Sage-Husa Adaptive Kalman Filter in the Navigation of a Translational Sprinkler Irrigation Machine. Water 2019, 11, 1269. [Google Scholar] [CrossRef] [Green Version]
  22. Jiang, C.; Zhang, S.B.; Zhang, Q.Z. A New Adaptive H-Infinity Filtering Algorithm for the GPS/INS Integrated Navigation. Sensors 2016, 16, 2127. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Gibbs, B.P. Improved GOES-R ABI image navigation and registration using maximum likelihood parameter estimation. J. Appl. Remote Sens 2020, 14. [Google Scholar] [CrossRef]
  24. Shankar, S.; Ezal, K.; Hespanha, J.P. Finite Horizon Maximum Likelihood Estimation for Integrated Navigation with RF Beacon Measurements. Asian J. Control 2019, 21, 1470–1482. [Google Scholar] [CrossRef]
  25. Qin, H.D.; Yu, X.; Zhu, Z.B.; Deng, Z.C. A variational Bayesian approximation based adaptive single beacon navigation method with unknown ESV. Ocean. Eng. 2020, 209. [Google Scholar] [CrossRef]
  26. Su, B.Z.; Mu, R.J.; Long, T.; Li, Y.T.; Cui, N.G. Variational Bayesian adaptive high-degree cubature Huber-based filter for vision-aided inertial navigation on asteroid missions. IET Radar Sonar. Nav. 2020, 14, 1391–1401. [Google Scholar] [CrossRef]
  27. LeCun, Y.; Bengio, Y.; Hinton, G. Deep learning. Nature 2015, 521, 436–444. [Google Scholar] [CrossRef]
  28. Yang, W.L.; Fan, S.S.; Xu, S.X.; King, P.; Kang, B.; Kim, E. Autonomous Underwater Vehicle Navigation Using Sonar Image Matching based on Convolutional Neural Network. IFAC Pap. 2019, 52, 156–162. [Google Scholar] [CrossRef]
  29. Park, C.I.; Sohn, C.B. Data Augmentation for Human Keypoint Estimation Deep Learning based Sign Language Translation. Electronics 2020, 9, 1257. [Google Scholar] [CrossRef]
  30. Castellano, G.; Vessio, G. Deep learning approaches to pattern extraction and recognition in paintings and drawings: An overview. Neural Comput. Appl. 2021. [Google Scholar] [CrossRef]
  31. Han, S.P.; Meng, Z.; Zhang, X.C.; Yan, Y.P. Hybrid Deep Recurrent Neural Networks for Noise Reduction of MEMS-IMU with Static and Dynamic Conditions. Micromachines 2021, 12, 214. [Google Scholar] [CrossRef] [PubMed]
  32. Mu, X.K.; He, B.; Zhang, X.; Song, Y.; Shen, Y.; Feng, C. End-to-end navigation for Autonomous Underwater Vehicle with Hybrid Recurrent Neural Networks. Ocean. Eng. 2019, 194. [Google Scholar] [CrossRef]
  33. Kang, Y.; Zhao, L.; Cheng, J.; Wu, M.; Fan, X. A Novel Grid SINS/DVL Integrated Navigation Algorithm for Marine Application. Sensors 2018, 18, 364. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Li, W.; Chen, M.; Zhang, C.; Zhang, L.; Chen, R. A Novel Neural Network-Based SINS/DVL Integrated Navigation Approach to Deal with DVL Malfunction for Underwater Vehicles. Math. Probl. Eng. 2020, 2020, 2891572. [Google Scholar]
  35. Liu, J.; Wei, Y.; Hao, S. A fault diagnosis method for INS/DVL/USBL integrated navigation system based on support vector regression. In Proceedings of the OCEANS 2019, Marseille, France, 17–20 June 2019. [Google Scholar]
  36. Zhao, L.Y.; Liu, X.J.; Wang, L.; Zhu, Y.H.; Liu, X.X. A Pretreatment Method for the Velocity of DVL Based on the Motion Constraint for the Integrated SINS/DVL. Appl. Sci. 2016, 6, 79. [Google Scholar] [CrossRef] [Green Version]
  37. Mu, X.K.; He, B.; Wu, S.Y.; Zhang, X.; Song, Y.; Yan, T.H. A practical INS/GPS/DVL/PS integrated navigation algorithm and its application on Autonomous Underwater Vehicle. Appl. Ocean. Res. 2021, 106. [Google Scholar] [CrossRef]
  38. Yu, Y.; Si, X.S.; Hu, C.H.; Zhang, J.X. A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures. Neural Comput. 2019, 31, 1235–1270. [Google Scholar] [CrossRef] [PubMed]
  39. Matsumura, N.; Ito, Y.; Nakano, K.; Kasagi, A.; Tabaru, T. A novel structured sparse fully connected layer in convolutional neural networks. Concurr. Comp.-Pract. E 2021. [Google Scholar] [CrossRef]
Figure 1. Structure of the Sailfish autonomous underwater vehicle (AUV).
Figure 1. Structure of the Sailfish autonomous underwater vehicle (AUV).
Sensors 21 06406 g001
Figure 2. Flowchart of the developed algorithm.
Figure 2. Flowchart of the developed algorithm.
Sensors 21 06406 g002
Figure 3. Structure of hybrid recurrent neural networks (RNNs).
Figure 3. Structure of hybrid recurrent neural networks (RNNs).
Sensors 21 06406 g003
Figure 4. Structure of long short-term memory (LSTM).
Figure 4. Structure of long short-term memory (LSTM).
Sensors 21 06406 g004
Figure 5. Experiment scene of AUV platform.
Figure 5. Experiment scene of AUV platform.
Sensors 21 06406 g005
Figure 6. Four experimental results of the ground truth trajectory and the trajectories obtained using different methods based on field data.
Figure 6. Four experimental results of the ground truth trajectory and the trajectories obtained using different methods based on field data.
Sensors 21 06406 g006
Figure 7. Position error between the ground truth and the estimation of different navigation methods.
Figure 7. Position error between the ground truth and the estimation of different navigation methods.
Sensors 21 06406 g007aSensors 21 06406 g007b
Table 1. Specification of GPS used on the AUV platform.
Table 1. Specification of GPS used on the AUV platform.
Equipment TypeGPS
Position Accuracy3 m (CEP50)
Velocity Accuracy0.05 m/s
Update Rate5 Hz (Max)
Table 2. Specification of DVL used on the AUV platform.
Table 2. Specification of DVL used on the AUV platform.
Scheme 600DVL
Sound frequency600 KHz
Velocity accuracy1%
Operational height0.3–110 m
Table 3. Specification of AHRS used on the AUV platform.
Table 3. Specification of AHRS used on the AUV platform.
Sensor TypeAHRS
Yaw accuracy
Pitch/Roll accuracy0.3°
Output frequencyUp to 2 kHz
Bias stability (Gyroscopes)10°/h
Bias stability (Accelerometor)15 μg
Table 4. Specification of DM used on the AUV platform.
Table 4. Specification of DM used on the AUV platform.
Sensor TypeDM
Resolution0.001% range
Accuracy0.01% range
Update Rate5 Hz
Response Time1 millisecond
Table 5. AUV model and developed algorithm notation.
Table 5. AUV model and developed algorithm notation.
VariableDescription
XState vector
fState predict function
FState predict transition matrix (Jacohian matrix of f)
ZMeasurement vector (data of DVL and AHRS)
hMeasurement function
HMeasurement transition matrix (Jacohian matrix of h)
nWhite Gaussian noise.
RMeasurement noise covariance matrix
KKalman gain
XsSequence data input of RNN
W, bWeight and bias of neural cell
fgForgetting gate
igInput gate
OgOutput gate
hlHidden layer
σActivation function (sigmoid function usually)
ZdMeasurement vector includes deep learning data
RdMeasurement noise covariance matrix includes deep learning
ZaMeasurement vector of AHRS
RaMeasurement noise covariance matrix of AHRS
Table 6. Details of AUV field data used in experiments.
Table 6. Details of AUV field data used in experiments.
No.Start PointEnd PointDistance
Test1120.34096° E, 36.16952° N120.34219° E, 36.16920° N751 m
Test2121.20101° E, 37.40701° N121.20509° E, 36.40629° N316 m
Test3120.29453° E, 36.05187° N120.29454° E, 36.05187° N260 m
Test4120.29362° E, 36.05155° N120.29351° E, 36.05159° N224 m
Table 7. Root mean square error (RMSE) of position in different navigation methods.
Table 7. Root mean square error (RMSE) of position in different navigation methods.
No.EKFDeep LearningProposed Method
Test110.689913.08049.3048
Test233.672910.847613.1595
Test37.25254.03695.3061
Test47.63012.92524.0130
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Ma, H.; Mu, X.; He, B. Adaptive Navigation Algorithm with Deep Learning for Autonomous Underwater Vehicle. Sensors 2021, 21, 6406. https://doi.org/10.3390/s21196406

AMA Style

Ma H, Mu X, He B. Adaptive Navigation Algorithm with Deep Learning for Autonomous Underwater Vehicle. Sensors. 2021; 21(19):6406. https://doi.org/10.3390/s21196406

Chicago/Turabian Style

Ma, Hui, Xiaokai Mu, and Bo He. 2021. "Adaptive Navigation Algorithm with Deep Learning for Autonomous Underwater Vehicle" Sensors 21, no. 19: 6406. https://doi.org/10.3390/s21196406

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop