Next Article in Journal
Tool Health Monitoring of a Milling Process Using Acoustic Emissions and a ResNet Deep Learning Model
Previous Article in Journal
An Effective Method for Improving Low-Frequency Response of Geophone
Previous Article in Special Issue
3D Off-Grid Localization for Adjacent Cavitation Noise Sources Using Bayesian Inference
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A High–Efficiency Side–Scan Sonar Simulator for High–Speed Seabed Mapping

1
Institute of Deep–Sea Science and Engineering, Chinese Academy of Sciences, Sanya 572000, China
2
University of Chinese Academy of Sciences, Beijing 100049, China
3
Ocean College, Zhejiang University, Zhoushan 316021, China
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(6), 3083; https://doi.org/10.3390/s23063083
Submission received: 2 February 2023 / Revised: 5 March 2023 / Accepted: 10 March 2023 / Published: 13 March 2023
(This article belongs to the Special Issue Underwater Acoustic Remote Sensing for Ocean and Lake Monitoring)

Abstract

:
Side scan sonar (SSS) is a multi–purpose ocean sensing technology, but due to the complex engineering and variable underwater environment, its research process often faces many uncertain obstacles. A sonar simulator can provide reasonable research conditions for guiding development and fault diagnosis, by simulating the underwater acoustic propagation and sonar principle to restore the actual experimental scenarios. However, the current open–source sonar simulators gradually lag behind mainstream sonar technology; therefore, they cannot be of sufficient assistance, especially due to their low computational efficiency and unsuitable high–speed mapping simulation. This paper presents a sonar simulator based on a two–level network architecture, which has a flexible task scheduling system and extensible data interaction organization. The echo signal fitting algorithm proposes a polyline path model to accurately capture the propagation delay of the backscattered signal under high–speed motion deviation. The large–scale virtual seabed is the operational nemesis of the conventional sonar simulators; therefore, a modeling simplification algorithm based on a new energy function is developed to optimize the simulator efficiency. This paper arranges several seabed models to test the above simulation algorithms, and finally compares the actual experiment results to prove the application value of this sonar simulator.

1. Introduction

Side–scan sonar (SSS) is an underwater acoustic instrument widely used in several applications [1], such as ocean engineering assistance, shipwreck rescue, and military target detection. The acoustic sensor (also called a transducer) is the main component of the sonar system used to perform sound transmission and receival. In the design of such sensors, due to the complexity of the application environment, theoretical calculations cannot guarantee satisfactory performance, while field experiments are also difficult to carry out in the early stage of development [2]. For the purpose of design verification, in addition to the accumulation of practical experiences, researchers usually have to resort to certain analysis tools, e.g., a sonar simulator.
A sonar simulator is a numerical simulation technology that can provide a virtual experimental environment to support design, performance prediction, and fault diagnosis, which is especially useful for a new–principle sonar [3,4,5]. For instance, Bouxsein modeled the acoustic scattering characteristics of complex geometric surfaces, and then established an underwater simulation environment to explore the underwater automatic obstacle avoidance technology [6]. This low–cost approach with sufficient simulation results enabled him to summarize the sensor optimization theory of obstacle avoidance. Similarly, Sung proposed an underwater target search method using an acoustic imaging simulator and a convolutional neural network (CNN), which overcomes the difficulties of acquiring multi–view sonar images in unstable ocean environments [7].
The Synthetic Image Generator for Modeling Active Sonar (SIGMAS) developed by the NATO (North Atlantic Treaty Organization) Underwater Research Center (NURC) is the most advanced SSS simulator at present, which adopts both a finite element model (FEM) and a boundary element model (BEM) to accelerate the simulation performance [8]. The improved version of SIGMAS+, optimized by a graphics processing unit (GPU), constructs different render stages required for the final image and more refined effects, such as the sensor’s point spread function (PSF) and fast image correlation [9]. However, SIGMAS/SIGMAS+ is limited in accessibility. While some other sonar simulators are available for individual conventional systems, they typically lack a flexible data structure.
Research on sonar simulators often has to solve the mutual constraint between simulation fidelity and computational efficiency [10,11]. Essentially, echo signal fitting serves to calculate the acoustic characteristics of the scattering points in the scanning area, so the total point number is the main factor affecting the simulation performance. Such points, set only with spatial coordinates, are usually combined into a mesh structure using specific topologies, such as triangular meshes (TMs). Riordan adopted a geometric element deletion method to perform multi–resolution TMs, in which mesh elements not contributing to the final imaging are deleted before reaching the rendering pipeline, thus greatly saving computing resources while retaining valuable acoustic information [12].
A related modeling simplification algorithm has been developed following graphics rendering technology, where a TM not only records the spatial coordinates of the point cloud, but also topological information that is not meaningful for acoustic simulation [13,14,15,16]. Liu proposed a dual–mode scheme combining TMs and the point cloud, in which TMs are used as a base model for performing simplification processing, and the extracted point cloud later participates in echo estimation [17]. However, the methods only focus on geometric structure features, ignoring the influences arising from the underlying acoustic principle.
This paper presents a sonar simulator that can support the research requirements of advanced SSS. In order to provide convenience for the research community, it is open–source. The main contributions are summarized as follows:
  • A two–level network architecture is developed, which can reasonably modularize the cumbersome simulation process to form a flexible operational network. It can support mainstream SSS engineering as well as module expansion for future research directions, thus being more advanced than the current open–source solutions.
  • Different from the conventional sonar simulator using a stop&hop path model, an echo signal fitting algorithm based on the polyline path model is proposed, which can restore accurate propagation parameters of the backscattered signal to adapt the high–speed mapping simulation. Moreover, the Doppler effect is also accounted to achieve high–fidelity echo calculations.
  • Avoiding the disadvantages of graphics rendering technology, more efficient point cloud is fully applied instead of redundant TMs. A modeling simplification algorithm based on a new energy function is proposed, which fully considers the acoustic principle and identifies the model structure sensitive to underwater acoustic signals, and then eliminates the low–value scattering points to accelerate the simulation performance on a large–scale virtual seabed.
The rest of this paper is organized as follows: Section 2 introduces the sonar simulator framework in terms of a two–level network architecture; Section 3 presents the echo signal fitting algorithm; Section 4 presents the modeling simplification algorithm based on a new energy function; Section 5 applies the lake experiment results to justify the performance of the developed sonar simulator; and Section 6 concludes this paper.

2. Sonar Simulator Framework Based on a Two–Level Network Architecture

This section starts by analyzing the operation principle of conventional SSS systems, and then clarifies the functional requirements to introduce the simulator framework.

2.1. Sonar Principle

The acoustic sensors are installed on both sides of the sonar platform, which radiates the acoustic beam to the seabed at a fixed frame rate and collects the echo signal to generate continuous strip–shaped images. These images reflect the topographic features and acoustic information in the scanning area. Then, the upper computer combines the navigation information to form a complete seabed mapping image [18,19].
In Figure 1, a signal–beam side–scan sonar forms a narrow receiving beam of θ - 3 dB (in degrees) along the azimuth, which is determined by the length L and operation frequency f c of the sensor as
θ 3 dB = 0.88 × c L × f c × 180 ° π
where c is the sound speed in the water. θ - 3 dB is the angular beamwidth in elevation, which is often rather large to ensure strip coverage [20]. The receiving beam footprint has a width of S θ - 3 dB at the maximum operation range R s s s along the navigation direction.
Hence, in order to ensure the continuity of adjacent frames in strip maps, the navigation speed is constrained by
v max S θ - 3 dB × c 2 × R s s s
which can only reach 2~6 knots [21].
With the increasing demand for oceanographic surveys, advanced SSS technologies have been developed to improve efficiency and/or accuracy. For example, multi–beam side–scan sonar based on dynamic aperture can maintain an ideal resolution for wide–swath imaging at high speed [22]; multi–pulse side–scan sonar can also achieve high–speed mapping by using continuous pulse modulation [23]; and multi–array synthetic aperture side–scan sonar can significantly improve the azimuth resolution [24]. All the above schemes need to be pre–validated by the sonar simulator with flexible engineering customization, such as sensor structure, mapping principle, and data scalability. However, most existing open–source sonar simulators can only adapt to single–beam side–scan sonar for low–speed mapping [25].

2.2. Two–Level Network Architecture

The simulator framework is shown in Figure 2. As a two–level network architecture, it allocates the whole operation process into a modular program at different stages, thus enabling flexible task scheduling.
The primary network is established according to the simulation function, and inside each module is a secondary network composed of different components that perform special processing segments and maintain dynamic operation relations.
Among them, the sonar engineering module is the entrance of the simulator, which is used to load the engineering parameters of the tested sonar system. Its secondary network includes a sensor structure, signal waveform, navigation tracking, and virtual seabed model. The mapping simulation module is the core part, which is used to calculate the dynamic physical interaction between the acoustic signal and the virtual seabed along the planned navigation track. Therefore, its secondary network, taking the ray–tracing theory [26,27,28] as the reference, establishes countless acoustic rays between the sensors and the scanning surface, as shown in Figure 3. Taking scattering point S m as an example, the total ray path can be used to estimate the phase property of its echo signal. The angle γ between the transmitting ray and S m can be used to estimate the target strength parameter. Similarly, the angle θ between the receiving ray and the receiving sensor can affect the response sensitivity, which is the basis for calculating the amplitude property.
Then, the acoustic imaging module collects these simulated echo signals to combine the strip–shaped images into a complete mapping image. Moreover, the simulated echo signal may provide a large number of controllable seabed imaging samples for underwater target recognition and image segmentation algorithm research [29].

3. Echo Signal Fitting Algorithm for High–Speed Mapping

Most sonar simulators adopt simplified simulation methods; e.g., the stop&hop path model, which prevents them from restoring echo accuracy [30]. This section proposes an echo signal fitting algorithm for high–speed mapping simulation in particular, including a polyline path model, echo signal computation, and Doppler effect correction.

3.1. Polyline Path Model

Figure 4 is the self–coordinate system established with the centroid of the sonar platform as the origin, in which the displacements along the x , y , z axis are sway, surge, and heave, respectively, while the rotation angles around the x , y , z axis are pitch β , roll η , and yaw α , respectively. Let us denote [ ] T as the transpose operation. The spatial position [ x , y , z ] T of the sensor can be calculated as
[ x y z ] = M T [ Δ x Δ y Δ z ] + [ x A y A z A ]
where [ Δ x , Δ y , Δ z ] T is the relative position of the sensor in the self–coordinate system, and [ x A , y A , z A ] T is the absolute position of the sonar platform in the geographic coordinate system. M T is the attitude–distance conversion matrix as
[ cos α cos β sin α cos β sin β sin α cos η + cos α sin β sin η cos α cos η sin α sin β sin η cos α sin η sin α sin η cos α sin β cos η cos α sin η + sin α sin β cos η cos α cos η ]
Similar to Figure 3, high–speed simulation mapping should be further described as a continuous motion process. Figure 5 shows that the platform sails from the position P n 1 to the position P n + 1 along a polyline path, in which the transmitting sensor radiates the detection acoustic beam at the initial position T n 1 and the receiving sensor continuously collects the echo signal along the track R n 1 R n . In the process of signal collection, each scattering point on the virtual seabed will determine its unique echo path by polling calculation. This model assumes that the attitude change only occurs at the polyline intersection P n and maintains this state until the next mapping stage P n P n + 1 .
A scattering point S m exists in the scanning area, and T n 1 S m + S m R v is its echo path. Then, there must be a unique intermediate position P v where the echo propagation delay is equal to the navigation time as
| R n 1 R v | v = | T n 1 S m | + | S m R v | c , | R n 1 R v | v T
By constructing the spatial triangle Δ R n R n 1 S m , there is a geometric relationship as
cos ( R n R n 1 S m ) = | R n 1 R n | 2 + | S m R n 1 | 2 | S m R n | 2 2 × | R n 1 R n | × | S m R n 1 |
According to the triangle Δ R v R n 1 S m , the acoustic ray S m R v can be solved as
| S m R v | 2 = | R n 1 R v | 2 + | S m R n 1 | 2 2 × | R n 1 R v | × | S m R n 1 | × cos ( R n R n 1 S m )
where relevant vectors can be determined through the known spatial coordinates, e.g.,
| T n 1 S m | = ( x T n 1 x S m ) 2 + ( y T n 1 y S m ) 2 + ( z T n 1 z S m ) 2
It is worth noting that the stop&hop path model simplifies this process: the sonar platform “stops” at position P n 1 to instantly complete the transmission and collection of acoustic signals, and then suddenly “hops” to position P n to perform the next scanning action, which does not support restoring the real receiving beam footprint. Figure 6 establishes a virtual seabed and shows the difference between two such path models.
Moreover, the incident angle γ of the acoustic ray S m R v can be expressed as
γ = arccos ( h S / | S m R v | )
where h s is the depth of the scattering point S m . Similarly, direction of angle (DOA) [31] θ S between the acoustic ray S m R v and the sensor R v can be expressed as
cos ( θ m , R v ) = ( S m R v R n R v ) / ( | S m R v | × | R n R v | )
Figure 7 shows the simulation results of the above parameters, which will be used for computing the echo signal later.

3.2. Echo Signal Fitting

An echo signal can be regarded as the superposition of the response signals from scattering points, so the fitting process consists in estimating the amplitude and phase characteristics of those response signals [32].

3.2.1. Amplitude Calculation

A sonar equation [33] can be used to estimate echo signal amplitude, e.g., from the echo level E L given by
E L = S L T L T T L R + T S
where the propagation loss T L T / T L R of the transmission path and the receiving path is determined by the acoustic diffusion mode and the echo propagation distance r as
T L = 20 log 10 r + α × r
where the absorption loss factor α is a function of operation frequency. A seabed is a special reverberation scattering target and its target strength T S can be calculated as
T S = 10 lg μ + 10 lg cos 2 γ
where μ is the seabed geological scattering coefficient, and γ is the incident angle of each scattering point. Therefore, the amplitude of the response signal of a single scattering point S m can be obtained by
A = 10 ( E L + M x ) / 20
where M x is the response sensitivity of the receiving sensor.

3.2.2. Array Signal Model

As shown in Figure 8, the receiving sensor is a uniform linear array (ULA) composed of 2 E 1 piezoelectric ceramic elements with the same frequency response characteristics. In the Fresnel zone, the echo signal x m ( t ) of the scattering point S m on the receiving sensor can be expressed as
x m ( t ) = e = 1 2 E 1 A m , e × s ( t u m , T u m , e )
where s ( t ) is the transmitted signal. u m , T and u m , e are the transmission propagation delay and receiving propagation delay, respectively,
u m , e = r 2 m , e + ( ( e E ) d ) 2 2 r m , e ( e E ) d cos ( 90 ° θ m , e ) / c
Summing up contributions from M scattering points, the echo signals y ( t ) on the receiving sensor can be expressed as
y ( t ) = m = 1 M e = 1 2 E 1 A m , e × s ( t u m , T u m , e )
Figure 9 is the algorithm architecture of the echo signal fitting. The wideband LFM signal can be decomposed into multiple narrowband components via fast Fourier transform (FFT) [34]. For each narrowband component, the time delay processing can be converted to phase shift compensation, i.e.,
Y ( f ) = m = 1 M e = 1 2 E 1 f A m , e × e j 2 π f ( u m , T + u m , e ) × S ( f ) , f = f 0 , f 0 + Δ f , , f N Δ f , f N
where a narrow frequency interval Δ f can improve waveform fidelity.
The doppler effect is also an inevitable problem in a high–speed acoustic mapping system, which refers to the signal frequency offset caused by the relative motion between the signal source and the receiver [35,36]. For the polyline path model in Figure 5, the frequency f m , T of the incident signal at the scattering point S m is
f m , T = ( c × f ) / ( c v × cos θ m , T )
where v × cos θ m , T is the velocity component along the transmitting ray T n S m in a single scanning period T . Similarly, the frequency f m , e of the response signal x m ( t ) from the scanning point S m is
f m , e = f S + ( v × f m , T × cos θ m , e ) / c
In summary, the frequency domain expression of the sensor array signal is
Y ( f ) = m = 1 M e = 1 2 E 1 f A m , e × e j 2 π [ f m , T u m , T + f m , e u m , e ] × S ( f ) , f = f 0 , f 0 + Δ f , , f N Δ f , f N
where the above result is equivalent to the output signals of the receiving sensor.

3.3. Simulation Experiment

This part adopts the virtual seabed in Figure 6a to conduct acoustic mapping simulation experiments on different side–scan sonar technologies to verify the effectiveness of the developed sonar simulator. For single–beam side–scan sonar, as shown in Figure 10, the low–speed mapping image shows that each curve target can be clearly distinguished, but its azimuth resolution degrades as the detection distance increases; the high–speed mapping image shows an apparent imaging fracture structure. The above simulation results are consistent with the actual characteristics of single–beam side–scan sonar.
Beamforming technology is the main principle of multi–beam side–scan sonar to achieve high–speed mapping. Figure 11 shows high–speed simulation mapping images under two different beamforming methods. The conventional beamforming technology based on multiple subarray sensors can indeed avoid imaging fracture structures at high speed, but its imaging false alarm may occur in the near field; the near–field dynamic focused beamforming technology, which is widely studied currently, can effectively avoid this phenomenon. In summary, the developed sonar simulator can faithfully feedback the characteristics of different side–scan sonar technologies; therefore, it can provide an effective virtual experimental condition for future sonar engineering.

4. Modeling Simplification Based on a New Energy Function

The echo signal fitting process of a large–scale virtual seabed is extremely computationally expensive. This section analyzes the geometric element deletion method based on the conventional energy function [37], and then proposes a new energy function exploiting the acoustic principle, which constructs a multi–resolution point cloud to simplify the virtual seabed, thus accelerating the simulation efficiency.

4.1. Conventional Energy Function

Hoppe et al. describe the virtual model as a piecewise linear mesh, consisting of triangular faces pasted together along their edges. Formally, a mesh can be defined as a pair of sets ( K , V ) ,where K is a simplicial complex representing the geometric elements, such as the vertices, edges, and faces, thus determining the topological type of the mesh; V = { v 1 , , v m } , v i R 3 is a set of vertex positions defining the shape of the mesh in R 3 (its geometric realization).
E ( K , V ) = E d i s t ( K , V ) + E r e p ( K ) + E s p r i n g ( K , V )
The above is the conventional energy function that evaluates the operation cost of the geometric element deletion method, and then simplifies elements with low fidelity to form a new multi–resolution topology K K . The distance energy E d i s t is equal to the sum of squared distances from the points X = { x 1 , , x n } to the geometric realization M = ϕ v ( | K | ) as
E d i s t ( K , V ) = i = 1 n d 2 ( x i , ϕ v ( | K | ) )
Each of these distances is itself the solution to the minimization problem as
d 2 ( x i , ϕ v ( | K | ) ) = min b i | K | x i ϕ v ( b i ) 2
in which a naive approach to computing b i | K | R m is to project x i onto all of the faces of M , and then find the projection with minimal distance. The representation energy E r e p eliminates meshes with a large number of vertices. It is set to be proportional to the number of vertices m of K and a user–selectable penalty weight c r e p .
The spring energy E s p r i n g places on each edge of the mesh a spring of rest length zero and spring constant κ as
E s p r i n g ( K , V ) = { j , k } K κ v j v k 2
which helps guide the optimization to a desirable minimum simplification cost.
Objectively, the conventional energy function focuses on the graphic rendering application of the solid geometric model, which pursues the global unified smoothness of simplified processing, but lacks the consideration of underwater acoustic principles.
Figure 12 shows the simulation results under different simplification scales. Although the simplified TM can always maintain its original appearance, it is the visual effect of triangular faces pasting. However, such triangular faces are extremely inefficient in the echo signal fitting process and the point cloud extracted from the simplified TM is impossible to restore to the original model appearance. Therefore, the conventional energy function cannot simplify the virtual seabed in an underwater acoustic simulation.

4.2. A New Energy Function Focusing on Acoustics

A new energy function is proposed as expression 28, which uses point cloud instead of TMs and fully considers the effect of underwater acoustic principles on modeling simplification. Due to the fact that the point cloud only needs to define a set of scattering point coordinates V = { v 1 , , v m } , v i R 3 of the virtual seabed, this avoids the redundant computing burden caused by topology operations.
E ( V ) = w s h a d o w × [ w c u r v a t u r e E c u r v a t u r e ( V ) + w s c a t t e r i n g E s c a t t e r i n g ( V ) + w v i e w E v i e w ( V ) ]
The occluded scattering points are unreachable to the acoustic ray, so this part can be directly simplified without causing echo signal distortion. As shown in Figure 13, along the same acoustic ray direction, the shadow area cannot meet the rule that the incidence angle γ m increases with the propagation distance. Formula (29) simplifies them by the shadow coefficient w s h a d o w ( m ) , which can eliminate the low–value points directly.
w s h a d o w ( m ) = { 0 , γ m < max ( γ 1 , γ m 1 ) 1 , γ m > max ( γ 1 , γ m 1 )
The surface structure with local protrusions or depressions is sensitive to acoustic signals, which should especially be reserved. The curvature energy E c u r v a t u r e ( V ) is obtained from the Gaussian curvature G ( V ) , which is calculated from the coordinate position of each scattering point as
{ E c u r v a t u r e ( v i ) = 10 log 10 G ( v i ) max ( G ( V ) ) , v i = ( x i , y i , z i ) V R 3 G ( v i ) = T W U 2 1 + t 2 + u 2 , t = z i x i , u = z i y i , T = 2 z i x i 2 , U = 2 z i x i y i , W = 2 z i y i 2
According to the Lambertian law [38], a large incident angle γ m of an acoustic ray tends to make large TS, and then the scattering energy E s c a t t e r i n g ( V ) also follows the rule as
E s c a t t e r i n g ( v i ) = 10 log 10 γ m ( v i ) max ( γ m ( V ) ) , v i V R 3
Generally, the receiving sensor is most sensitive to the scattering points near its acoustic axis. Thus, the axis energy E a x i s ( V ) is measured by the projection of the receiving beam in the scanning area. In practical applications, this new function needs to calculate the above energy components according to the real–time position of the sonar platform and the installation angle of the receiving sensor. For example, Figure 14 shows the simulation results under the same virtual model as Figure 12a.
In addition, this form also sets weight coefficients w c u r v a t u r e , w s c a t t e r i n g , w a x i s to balance each energy component. Figure 15 shows the simulation results for comparison with Figure 12c–h. It is worth noting that, under the same simplified scale, the scattering points near the curve’s contour and the acoustic axis can always be effectively retained, which is also the main contribution of the echo signal fitting. Different from the global uniform simplification characteristics of the conventional energy function, this new function shows the identification characteristics of the underwater acoustic signal’s sensitive structure.

4.3. Simulation Experiment

Figure 16 shows the simulation imaging results of single–beam side–scan sonar at three knots, where the virtual seabed is simplified by two methods presented in Section 4.1 and Section 4.2. It can be concluded after comparison that, with the increase in the simplified scale, the seabed model processed by the traditional energy function gradually exhibits imaging distortion, while the new energy function always keeps the imaging results consistent with the original model. This is due to the fact that the new energy function can identify the local structures that are valuable for echo signal fitting, while the conventional energy function tends to be simplified to global homogenization.

5. Comparative Analysis of Simulation and Actual Experiments

This section compares the simulation mapping results with the actual experiment to verify the fidelity of the developed sonar simulator. The mapping target is the pier of the cross–lake bridge and the sonar simulator loads the same engineering parameters of the tested single–beam side–scan sonar using LFM signal as center frequency 400 kHz, bandwidth 30 kHz, and pulse width 5 ms.
As shown in Figure 17, the underwater structure of the bridge pier is four cylindrical supporting structures, and its mapping results can clearly identify the tail shadow left by the cylinder at the bottom of the lake, which is consistent with the actual imaging results.
Figure 18 shows the simulated imaging results under the artificially modulated motion deviation curve, which can comprehensively verify the response ability of the sonar simulator to the virtual experimental conditions. For example, under the effect of a sway deviation curve, piers A and B have imaging positioning errors greater than 10 m along the transverse distance; under the effect of the deviation curve, the image of region B is more evident than that of region A in the lake bottom slash. The above phenomena meet the preset experimental parameters.

6. Conclusions

This paper presents a sonar simulator with a two–level network architecture, which can provide engineering guidance and conduct virtual experiments. Different from most open–source sonar simulators, the developed simulator first proposes an original polyline path model to achieve accurate echo signal fitting in high–speed mapping simulations, which is also applicable to other underwater acoustic simulation methods. Meanwhile, it adopts a modeling simplification algorithm based on a new energy function, which is improved from the conventional energy function of computer graphics. The improvement is that the underwater acoustic theory is used as the operation rule of modeling simplification for the first time, and then the model structure that has evident value to the echo signal is protected in the processing process, so as to accelerate the operation efficiency without causing imaging distortion. Finally, compared with the mapping results in an actual lake experiment, simulations for a similar scenario model yield consistent features. Overall, it is shown that the developed simulator is capable of supporting relevant virtual experiments and engineering research.
It is worth noting that the simulator has a modular network structure, which can be readily adjusted to fit other sonar systems. In particular, the two–level architecture facilitates the addition of new function modules. For example, currently, it is assumed that the sound velocity is constant; a ray–tracing submodule [39] can be added to the mapping simulation module to handle a depth–dependent sound velocity profile.

Author Contributions

Conceptualization, X.M.; Data curation, X.M.; Formal analysis, X.M.; Funding acquisition, X.G.; Investigation, X.M.; Methodology, X.M.; Project administration, B.S.; Resources, X.G.; Software, X.M.; Supervision, W.X. and B.S.; Validation, X.M., W.X., B.S. and X.G.; Visualization, X.M.; Writing—original draft, X.M.; Writing—review and editing, W.X. and B.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Strategic Priority Research Program (A) of the Chinese Academy of Sciences, grant number XDA22030302.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The source code of the sonar simulator proposed in this paper is completely open–source and can be found at https://github.com/MENGXiang–jian/Side–scan–sonar–simulator.git (accessed on 9 September 2022). Any questions are welcome as feedback to the author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Wang, Q.; Wu, M.; Yu, F.; Feng, C.; Li, K.; Zhu, Y.; Rigall, E.; He, B. RT–Seg: A Real–Time Semantic Segmentation Network for Side–Scan Sonar Images. Sensors 2019, 19, 1985. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Stenius, I.; Folkesson, J.; Bhat, S.; Sprague, C.I.; Ling, L.; Özkahraman, Ö.; Bore, N.; Cong, Z.; Severholt, J.; Ljung, C. A system for autonomous seaweed farm inspection with an underwater robot. Sensors 2022, 22, 5064. [Google Scholar] [CrossRef] [PubMed]
  3. Rosynski, M.; Buşoniu, L. A Simulator and First Reinforcement Learning Results for Underwater Mapping. Sensors 2022, 22, 5384. [Google Scholar] [CrossRef]
  4. Sun, S.; Qin, S.; Hao, Y.; Zhang, G.; Zhao, C. Underwater acoustic localization of the black box based on generalized second–order time difference of arrival (GSTDOA). IEEE Trans. Geosci. Remote Sens. 2020, 59, 7245–7255. [Google Scholar] [CrossRef]
  5. Pan, X.; Shen, Y.; Zhang, J. IoUT based underwater target localization in the presence of time synchronization attacks. IEEE Trans. Wirel. Commun. 2021, 20, 3958–3973. [Google Scholar] [CrossRef]
  6. Bouxsein, P.; An, E.; Schock, S.; Beaujean, P.-P. A SONAR Simulation Used to Develop an Obstacle Avoidance System. In Proceedings of the OCEANS 2006–Asia Pacific, Singapore, 16–19 May 2006; pp. 1–7. [Google Scholar]
  7. Sung, M.; Lee, M.; Kim, J.; Song, S.; Song, Y.-w.; Yu, S.-C. Convolutional–Neural–Network–Based Underwater Object Detection Using Sonar Image Simulator with Randomized Degradation. In Proceedings of the OCEANS 2019 MTS/IEEE SEATTLE, Seattle, WA, USA, 27–31 October 2019; pp. 1–7. [Google Scholar]
  8. Sac, H.; Leblebicioğlu, K.; Bozdaği Akar, G. 2D high–frequency forward–looking sonar simulator based on continuous surfaces approach. Turk. J. Electr. Eng. Comput. Sci. 2015, 23, 2289–2303. [Google Scholar] [CrossRef] [Green Version]
  9. Coiras, E.; Ramirez–Montesinos, A.; Groen, J. GPU–based simulation of side–looking sonar images. In Proceedings of the OCEANS 2009–EUROPE, Bremen, Germany, 11–14 May 2009; pp. 1–6. [Google Scholar]
  10. Gu, J.; Joe, H.; Yu, S. Development of Image Sonar Simulator for Underwater Object Recognition. In Proceedings of the 2013 OCEANS–San Diego, San Diego, CA, USA, 23–27 September 2013; pp. 1–6. [Google Scholar]
  11. Bell, J.M.; Linnett, L. Simulation and analysis of synthetic sidescan sonar images. IEEE Proc. Radar Sonar Navig. 1997, 144, 219–226. [Google Scholar] [CrossRef]
  12. Riordan, J.; Omerdic, E.; Toal, D. Implementation and Application of a Real–Time Sidescan Sonar Simulator. In Proceedings of the Europe Oceans 2005, Brest, France, 20–23 June 2005; pp. 981–986. [Google Scholar]
  13. Hamann, B. A data reduction scheme for triangulated surfaces. Comput. Aided Geom. Des. 1994, 11, 197–214. [Google Scholar] [CrossRef] [Green Version]
  14. Schroeder, W.J.; Zarge, J.A.; Lorensen, W.E. Decimation of Triangle Meshes. In Proceedings of the the 19th Annual Conference on Computer Graphics and Interactive Techniques, New York, NY, USA, 26–30 July 1992; pp. 65–70. [Google Scholar]
  15. Fanous, M.; Gold, S.; Muller, S.; Hirsch, S.; Ogorka, J.; Imanidis, G. Simplification of fused deposition modeling 3D–printing paradigm: Feasibility of 1–step direct powder printing for immediate release dosage form production. Int. J. Pharm. 2020, 578, 119–124. [Google Scholar] [CrossRef]
  16. Li, H.; Li, Y.; Yu, R.; Sun, J.; Kim, J. Surface reconstruction from unorganized points with l0 gradient minimization. Comput. Vis. Image Underst. 2018, 169, 108–118. [Google Scholar] [CrossRef]
  17. Liu, W.; Zhang, C.; Liu, J. Research on synthetic aperture sonar 3–D data simulation. J. Syst. Simul. 2008, 20, 3838–3841. [Google Scholar]
  18. Johnson, H.P.; Helferty, M. The geological interpretation of side–scan sonar. Rev. Geophys. 1990, 28, 357–380. [Google Scholar] [CrossRef] [Green Version]
  19. Zhang, N.; Jin, S.; Bian, G.; Cui, Y.; Chi, L. A Mosaic Method for Side–Scan Sonar Strip Images Based on Curvelet Transform and Resolution Constraints. Sensors 2021, 21, 6044. [Google Scholar] [CrossRef]
  20. Nian, R.; Zang, L.; Geng, X.; Yu, F.; Ren, S.; He, B.; Li, X. Towards characterizing and developing formation and migration cues in seafloor sand waves on topology, morphology, evolution from high–resolution mapping via side–scan sonar in autonomous underwater vehicles. Sensors 2021, 21, 3283. [Google Scholar] [CrossRef]
  21. Grabek, J.; Cyganek, B. Speckle noise filtering in side–scan sonar images based on the tucker tensor decomposition. Sensors 2019, 19, 2903. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Chang, Y.; Keh, J.-E.; Jo, H.-G.; Lee, M. Development of the Side Scan Sonar Using the Multi–Beam Sensors: Sensor Design. Trans. Korean Inst. Electr. Eng. 2005, 54, 581–586. [Google Scholar]
  23. Crocco, M.; Pellegretti, P.; Sciallero, C.; Trucco, A. Combining multi–pulse excitation and chirp coding in contrast–enhanced ultrasound imaging. Meas. Sci. Technol. 2009, 20, 104–107. [Google Scholar] [CrossRef]
  24. Ageev, A.; Igumnov, G.; Kostousov, V.; Agafonov, I.; Zolotorev, V.; Madison, E. Aperture synthesizing for multichannel side–scan sonar with compensation of trajectory instability. Izv. SFedU. Eng. Sci. 2013, 140, 140–148. [Google Scholar]
  25. Pailhas, Y.; Petillot, Y.; Capus, C.; Brown, K. Real–Time Sidescan Simulator and Applications. In Proceedings of the OCEANS 2009–EUROPE, Bremen, Germany, 11–14 May 2009; pp. 1–6. [Google Scholar]
  26. Reshetov, A.; Soupikov, A.; Hurley, J. Multi–level ray tracing algorithm. ACM Trans. Graph. 2005, 24, 1176–1185. [Google Scholar] [CrossRef] [Green Version]
  27. Lehnert, H. Systematic errors of the ray–tracing algorithm. Appl. Acoust. 1993, 38, 207–221. [Google Scholar] [CrossRef]
  28. Yun, Z.; Iskander, M.F. Ray tracing for radio propagation modeling: Principles and applications. IEEE Access 2015, 3, 1089–1100. [Google Scholar] [CrossRef]
  29. Wang, X.; Wang, L.; Li, G.; Xie, X. A robust and fast method for sidescan sonar image segmentation based on region growing. Sensors 2021, 21, 6960. [Google Scholar] [CrossRef] [PubMed]
  30. Zhang, X.; Chen, X.; Qu, W. Influence of the stop–and–hop assumption on synthetic aperture sonar imagery. In Proceedings of the 2017 IEEE 17th International Conference on Communication Technology (ICCT), Chengdu, China, 27–30 October 2017; pp. 1601–1607. [Google Scholar]
  31. Grall, P.; Kochanska, I.; Marszal, J. Direction–of–Arrival Estimation Methods in Interferometric Echo Sounding. Sensors 2020, 20, 3556. [Google Scholar] [CrossRef] [PubMed]
  32. Gueriot, D.; Sintes, C.; Garello, R. Sonar data simulation based on tube tracing. In Proceedings of the OCEANS 2007–Europe, Aberdeen, UK, 18–21 June 2007; pp. 1–6. [Google Scholar]
  33. Grimmett, D.; Coraluppi, S. Contact–level multistatic sonar data simulator for tracker performance assessment. In Proceedings of the 2006 9th International Conference on Information Fusion, Florence, Italy, 10–13 July 2006; pp. 1–7. [Google Scholar]
  34. Brigham, E.O.; Morrow, R. The fast Fourier transform. IEEE Spectr. 1967, 4, 80–111. [Google Scholar] [CrossRef]
  35. Marszal, J.; Salamon, R.; Zachariasz, K.; Schmidt, A. Doppler effect in the cw fm sonar. Hydroacoustics 2011, Nr 14, 157–164. [Google Scholar]
  36. Gough, P. A synthetic aperture sonar system capable of operating at high speed and in turbulent media. IEEE J. Ocean. Eng. 1986, 11, 333–339. [Google Scholar] [CrossRef]
  37. Hoppe, H. Progressive meshes. In Proceedings of the the 23rd annual conference on Computer graphics and interactive techniques, New York, NY, USA, 1 August 1996; pp. 99–108. [Google Scholar]
  38. Battaglia, C.; Boccard, M.; Haug, F.-J.; Ballif, C. Light trapping in solar cells: When does a Lambertian scatterer scatter Lambertianly? J. Appl. Phys. 2012, 112, 094504. [Google Scholar] [CrossRef] [Green Version]
  39. Zhan, D.; Wang, S.; Cai, S.; Zheng, H.; Xu, W. Acoustic localization with multi–layer isogradient sound speed profile using TDOA and FDOA. Front. Inf. Technol. Electron. Eng. 2023, 24, 164–175. [Google Scholar] [CrossRef]
Figure 1. Imaging principle of the single–beam side–scan sonar.
Figure 1. Imaging principle of the single–beam side–scan sonar.
Sensors 23 03083 g001
Figure 2. Sonar simulator framework as a two–level network architecture.
Figure 2. Sonar simulator framework as a two–level network architecture.
Sensors 23 03083 g002
Figure 3. Schematic diagram of the ray–tracing algorithm.
Figure 3. Schematic diagram of the ray–tracing algorithm.
Sensors 23 03083 g003
Figure 4. Self–coordinate system of the sonar platform.
Figure 4. Self–coordinate system of the sonar platform.
Sensors 23 03083 g004
Figure 5. Scanning process in the polyline path model.
Figure 5. Scanning process in the polyline path model.
Sensors 23 03083 g005
Figure 6. (a) A virtual seabed with 5 parallel harmonic curve targets; (b) the inaccurate receiving beam footprint of stop&hop path model; (c) the accurate receiving beam footprint of polyline path model; (d) acoustic propagation distance in the receiving beam footprint.
Figure 6. (a) A virtual seabed with 5 parallel harmonic curve targets; (b) the inaccurate receiving beam footprint of stop&hop path model; (c) the accurate receiving beam footprint of polyline path model; (d) acoustic propagation distance in the receiving beam footprint.
Sensors 23 03083 g006
Figure 7. Echo parameters in the receiving beam footprint (Figure 6c): (a) incident angle; (b) DOA.
Figure 7. Echo parameters in the receiving beam footprint (Figure 6c): (a) incident angle; (b) DOA.
Sensors 23 03083 g007
Figure 8. Sensor array and scattering point configuration.
Figure 8. Sensor array and scattering point configuration.
Sensors 23 03083 g008
Figure 9. Echo signal fitting algorithm.
Figure 9. Echo signal fitting algorithm.
Sensors 23 03083 g009
Figure 10. Simulation mapping images of the single–beam side–scan sonar used LFM signal as center frequency 400 kHz, bandwidth 30 kHz, and pulse width 5 ms: (a) at 3 knots; (b) at 10 knots.
Figure 10. Simulation mapping images of the single–beam side–scan sonar used LFM signal as center frequency 400 kHz, bandwidth 30 kHz, and pulse width 5 ms: (a) at 3 knots; (b) at 10 knots.
Sensors 23 03083 g010
Figure 11. Simulation mapping images at 10knots: (a) conventional beamforming; (b) dynamic focused beamforming. The receiving sensor consists of 5 subarrays using LFM signal as center frequency 400 kHz, bandwidth 30 kHz, and pulse width 5 ms.
Figure 11. Simulation mapping images at 10knots: (a) conventional beamforming; (b) dynamic focused beamforming. The receiving sensor consists of 5 subarrays using LFM signal as center frequency 400 kHz, bandwidth 30 kHz, and pulse width 5 ms.
Sensors 23 03083 g011
Figure 12. Simulation results under different simplification scales, where (a,c,e,g) are TM and (b,d,f,h) are the corresponding extracted point cloud: (a,b) are the original model composed of 42,936 data points; (c,d) are simplified to 3000 data points; (e,f) are simplified to 1000 data points; (g,h) are simplified to 176 data points.
Figure 12. Simulation results under different simplification scales, where (a,c,e,g) are TM and (b,d,f,h) are the corresponding extracted point cloud: (a,b) are the original model composed of 42,936 data points; (c,d) are simplified to 3000 data points; (e,f) are simplified to 1000 data points; (g,h) are simplified to 176 data points.
Sensors 23 03083 g012aSensors 23 03083 g012b
Figure 13. Geometric model for calculating shadow coefficient.
Figure 13. Geometric model for calculating shadow coefficient.
Sensors 23 03083 g013
Figure 14. The receiving sensor ( θ 3 dB = 0.56 ° , f c = 40 0 kHz ) looks down 30 ° horizontally at (0,10,30) coordinate: (a) the virtual seabed simplified by shadow coefficient w s h a d o w ( m ) ; (b) the curvature energy E c u r v a t u r e ( V ) ; (c) the scattering energy E s c a t t e r i n g ( V ) ; (d) the acoustic axis energy E a x i s ( V ) .
Figure 14. The receiving sensor ( θ 3 dB = 0.56 ° , f c = 40 0 kHz ) looks down 30 ° horizontally at (0,10,30) coordinate: (a) the virtual seabed simplified by shadow coefficient w s h a d o w ( m ) ; (b) the curvature energy E c u r v a t u r e ( V ) ; (c) the scattering energy E s c a t t e r i n g ( V ) ; (d) the acoustic axis energy E a x i s ( V ) .
Sensors 23 03083 g014
Figure 15. Scanning seabed samples processed under different simplification scales using a receiving sensor as center frequency 400 kHz, horizontal beam width 0.56 ° : (a) is simplified to 5125 data points; (b) is simplified to 3000 data points; (c) is simplified to 1000 data points; (d) is simplified to 176 data points.
Figure 15. Scanning seabed samples processed under different simplification scales using a receiving sensor as center frequency 400 kHz, horizontal beam width 0.56 ° : (a) is simplified to 5125 data points; (b) is simplified to 3000 data points; (c) is simplified to 1000 data points; (d) is simplified to 176 data points.
Sensors 23 03083 g015
Figure 16. Simulation imaging results using single–beam side–scan sonar using LFM signal as center frequency 400 kHz, bandwidth 30 kHz, and pulse width 5 ms, where (c,e,g) are simplified by the new energy function and (d,f,h) are simplified by the conventional energy function: (a) is the simulation image of the original model; (b) is simplified to 5125 data points using the new energy function; (c,d) are simplified to 3000 data points; (e,f) are simplified to 1000 data points; (g,h) are simplified to 176 data points.
Figure 16. Simulation imaging results using single–beam side–scan sonar using LFM signal as center frequency 400 kHz, bandwidth 30 kHz, and pulse width 5 ms, where (c,e,g) are simplified by the new energy function and (d,f,h) are simplified by the conventional energy function: (a) is the simulation image of the original model; (b) is simplified to 5125 data points using the new energy function; (c,d) are simplified to 3000 data points; (e,f) are simplified to 1000 data points; (g,h) are simplified to 176 data points.
Sensors 23 03083 g016aSensors 23 03083 g016b
Figure 17. (a) Qiandao lake experimental environment in Hangzhou; (b) actual mapping results of bridge piers carried out in December 2022; (c) virtual experimental environment consisting of bridge piers and lake bottom slash; (d) simulation imaging result using the developed sonar simulator.
Figure 17. (a) Qiandao lake experimental environment in Hangzhou; (b) actual mapping results of bridge piers carried out in December 2022; (c) virtual experimental environment consisting of bridge piers and lake bottom slash; (d) simulation imaging result using the developed sonar simulator.
Sensors 23 03083 g017aSensors 23 03083 g017b
Figure 18. (a) Artificially modulated motion deviation curve; (b) simulation imaging result.
Figure 18. (a) Artificially modulated motion deviation curve; (b) simulation imaging result.
Sensors 23 03083 g018
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Meng, X.; Xu, W.; Shen, B.; Guo, X. A High–Efficiency Side–Scan Sonar Simulator for High–Speed Seabed Mapping. Sensors 2023, 23, 3083. https://doi.org/10.3390/s23063083

AMA Style

Meng X, Xu W, Shen B, Guo X. A High–Efficiency Side–Scan Sonar Simulator for High–Speed Seabed Mapping. Sensors. 2023; 23(6):3083. https://doi.org/10.3390/s23063083

Chicago/Turabian Style

Meng, Xiangjian, Wen Xu, Binjian Shen, and Xinxin Guo. 2023. "A High–Efficiency Side–Scan Sonar Simulator for High–Speed Seabed Mapping" Sensors 23, no. 6: 3083. https://doi.org/10.3390/s23063083

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop