Elsevier

Computers & Fluids

Volume 36, Issue 8, September 2007, Pages 1319-1326
Computers & Fluids

Fast vortex method calculation using a special-purpose computer

https://doi.org/10.1016/j.compfluid.2007.01.006Get rights and content

Abstract

A mathematical formulation for the 3D vortex method has been developed for calculation using a special-purpose computer MDGRAPE-2 that was originally designed for molecular dynamics simulations. We made an assessment of this hardware for a few representative problems and compared the results with and without it. It is found that the generation of appropriate function tables, which are used to call libraries, embedded in MDGRAPE-2 is of primary importance in order to retain accuracy. The error arising from the approximation is evaluated by calculating a pair of vortex rings impinging to themselves. Consequently, acceleration about 50 times greater is achieved by MDGRAPE-2 while the error in the statistical quantities such as kinetic energy and enstrophy remain negligible.

Introduction

N-Body simulations were devised in the 1950s and have been widely used since the 1970s when digital computers became powerful enough and affordable. Today it is considered to be an orthodox method for studying particle systems. The classical N-body problem simulates the evolution of a system of N bodies, where the force exerted on each body arises due to its interaction with all other bodies in the system. N-Body algorithms have numerous applications in areas such as astrophysics, molecular dynamics, plasma physics and computational fluid dynamics using the vortex method. For each of these computational problems the calculation takes on a slightly different form but each share common features. The simulation proceeds over time steps, with each step computing the net force on every body and thereby updating its position and other attributes. The cost of a direct summation algorithm for force calculation is O(N2), therefore calculation time grows rapidly as the number of bodies N increases.

There are two ways to reduce the force calculation cost of an N-body simulation. One is to use fast algorithms such as the tree code developed by Barnes and Hut [1] or the fast multipole method (FMM) by Greengard and Rokhlin [2]. The tree code is an O(Nlog N) algorithm based on a hierarchical octree representation of space in three dimensions. It computes interactions between distant particles and reduces the number of operations by means of a first-order approximation. Many existing implementations of tree code algorithms only use up to quadropole moments and calculation costs rise quickly when high accuracy is required. In the FMM, the long-range forces are approximated by multipole expansion truncated at a certain degree, while the contributions from particles within nearby regions are calculated directly in a usual manner without approximation. Including higher order terms in multipole approximations and/or increasing the size of a nearby region can improve the computational accuracy. However, either effort substantially increases the computation time. In particular, the computation of a high-order term is very expensive.

The other way is to execute the N-body simulation with special-purpose hardware such as MDGRAPE-2 developed by Susukita et al. [3]. MDGRAPE-2, one of the GRAPE (Gravity Pipe, developed by Sugimoto et al. [5]) series machines, is a special-purpose computer designed for force calculations between point-charge or point-mass particles. Its performance is much higher than ordinary computers. It can speed up force calculations about 10–100 times when compared to general-purpose (defined as ’host’ hereafter) computers of the same cost.

The vortex method solves time-dependent incompressible flow problems by discretizing the vorticity into vortex elements and following these elements in time. This results in a volume mesh-free algorithm and saves significant time in preprocessing when compared to the conventional Navier–Stokes approach where grids need to be generated. The vortex methods have been developed and applied for the analysis of complicated, unsteady and vortical flows related to a wide range of problems found in industry, as it consists of a simple algorithm based on the physics of flow. For details see [6], [7].

The main difficulty with vortex methods as originally formulated is that the cost of the evaluation of the velocity field induced by N vortices is O(N2). This is expensive, particularly in three dimensions where a large number of elements are computed simultaneously. In the calculation of vortex methods, the largest computational load occurs in the routine that calculates the Biot–Savart law and the stretching term in the vorticity equation. In regions of high strain the spatial resolution becomes worse because the distance of each element becomes large. It is required to split vortex elements to keep the spatial resolution in the direction of the vorticity vector of the element. The result is a N-body interaction calculation for millions of particles having calculation cost of O(N2) with growing N. Nevertheless, these calculations have the same mathematical architecture as a multibody problem, thus permitting the use of special-purpose computers in multibody problems, e.g., MDGRAPE-2.

Our long-term objective is to solve high Reynolds number turbulent flows for engineering problems via a reasonable computational effort. The use of the 3D vortex method is attractive because of its simple formulation and flexibility in moving and/or deforming boundary problems. The long computation time due to the above-mentioned O(N2) problem may be reduced when we apply a special-purpose computer.

The purpose of the present paper is, therefore, to address a few issues that hindrance the application of MDGRAPE-2 to the vortex method. First, because of the simple architecture, it is required to generate an optimum function table when the embedded libraries are called from the main routine. Second, the cross-product calculation which is not considered in the original command set must be handled in a proper manner, which is treated in some previous works, e.g. [8], [9], [10], [11]. These points are discussed one after another in the subsequent sections after an introduction to the basic mathematical formulae.

Section snippets

Basic equations

We are studying the three-dimensional incompressible flow of a viscous fluid. The evolution equation for vorticity isDωDt=(ω·)u+ν2ωwhere ω is the vorticity defined as ω =  × u, u is the velocity of the vortex element, (ω·∇)u is called the stretching term and represents the rate of change of vorticity by deformation of vortex lines and the term ν2ω represents the change of vorticity by viscous diffusion. The velocity field in a three-dimensional problem is,u(x)=-14π(x-x)×ω(x)|x-x|3dV(x)

Mathematical formulations

MDGRAPE-2 is a special-purpose hardware for the calculation of force or potential between point-mass or point-charge particles that was originally designed for molecular dynamics simulation. The calculation of interactions between particles as represented by potential and force are carried out in MDGRAPE-2. In case of calculating the potential,Φi=j=1Nbijg(w)=j=1Nbijg(aij(|rij|2+ϵij2))and the force calculationsfi=j=1Nbijg(w)rij=j=1Nbijg(aij(|rij|2+ϵij2))rijare treated similarly, where g(w)

Function table

The hardware of MDGRAPE-2 is a board, which is mounted on a PCI-slot of a PC. The main program runs on the host PC, while the force calculation is done on the board via subroutine calls. Due to hardware specifications the subroutine runs partly with single precision, hence special care is necessary for floating-point operations. The important issue here is to rewrite the function table in MDGRAPE-2 that determines the formula of Eqs. (3), (6) so that the range of the function table contains all

Computational algorithm

We considered inclined collisions according to [12]. Here, we assumed that the initial radius of the vortex rings is R = 1 while the cross-section radius r = 0.05, see Fig. 3. The Reynolds number based on the ring circulation is ReΓ = 400, and the core radius σ = 0.065. The rings are inclined at an angle θ = 15 relative to the z-axis. The total number of elements used for the preliminary calculation was N = 6 × 104, with the number of cross sections in the circumference direction being 502, while 61

Conclusions

A special-purpose computer MDGRAPE-2 for N-body simulations was applied to the calculation of the vortex method. The definition of the function table range plays an essential role to achieve satisfactory accuracy in MDGRAPE-2. The improvement in speed was 50 times when compared with the calculation of a conventional PC. Although there are still certain areas that can be improved, further acceleration should be achievable with the combination of a fast algorithm.

References (18)

There are more references available in the full text version of this article.

Cited by (8)

  • High-resolution vortex particle simulations of flows around rectangular cylinders

    2011, Computers and Fluids
    Citation Excerpt :

    The comparisons indicate that the vortex methods are accurate enough to yield “acceptable statistics” in large and intermediate scales, and they appear to behave as accurately as LES models in the under-resolved scales “in the sense that they avoid accumulation of energy at the end of the spectrum, without excessive dissipation in the resolved scales” [16]. Vortex particle methods are still under active development, with new techniques, implementation improvements, and applications to different fields of study constantly being proposed; for the most recent progress see, among others, [19–28]. As pointed out by Anderson and Greengard [29] and Cottet et al. [16], time-step limitations are far less restrictive for vortex methods than for grid-based methods because vortex methods are free of convection-related stability conditions.

  • Fast multipole methods on a cluster of GPUs for the meshless simulation of turbulence

    2009, Computer Physics Communications
    Citation Excerpt :

    Using this library, Chatelain et al. [35] have performed a calculation of wing tip vortices using 10 billion vortex elements. Sheel et al. [25] used a special purpose computer originally designed for molecular dynamics (MDGRAPE-2) and showed a 100-fold acceleration of the direct interaction calculation. Later, they applied the FMM on the MDGRAPE-3 and observed a 16 times speed-up of the FMM [26].

  • Acceleration of vortex methods calculation using FMM and MDGRAPE-3

    2011, Progress In Electromagnetics Research B
  • Acceleration of bluff body calculation using MDGRAPE-2

    2010, International Journal of Engineering, Transactions A: Basics
  • High-performance computing techniques for vortex method calculations

    2010, Theoretical and Computational Fluid Dynamics
View all citing articles on Scopus
View full text