ACO-Kinematic: a hybrid first off the starting block

The use of robots in carrying out various tasks is popular in many industries. In order to carry out a task, a robot has to move from one location to another using shorter, safer and smoother route. For movement, a robot has to know its destination, its previous location, a plan on the path it should take, a method for moving to the new location and a good understanding of its environment. Ultimately, the movement of the robot depends on motion planning and control algorithm. This paper considers a novel solution to the robot navigation problem by proposing a new hybrid algorithm. The hybrid algorithm is designed by combining the ant colony optimization algorithm and kinematic equations of the robot. The planning phase in the algorithm will find a route to the next step which is collision free and the control phase will move the robot to this new step. Ant colony optimization is used to plan a step for a robot and kinematic equations to control and move the robot to a location. By planning and controlling different steps, the hybrid algorithm will enable a robot to reach its destination. The proposed algorithm will be applied to multiple point-mass robot navigation in a multiple obstacle and line segment cluttered environment. In this paper, we are considering a priori known environments with static obstacles. The proposed motion planning and control algorithm is applied to the tractor-trailer robotic system. The results show a collision and obstacle free navigation to the target. This paper also measures the performance of the proposed algorithm using path length and convergence time, comparing it to a classical motion planning and control algorithm, Lyapunov based control scheme (LbCS). The results show that the proposed algorithm performs significantly better than LbCS including the avoidance of local minima.


INTRODUCTION
Over the years, the use of robots has evolved due to improved capacities and abilities to carry out complex and diverse activities in areas such as manufacturing, logistics, home, travel, health, mining, civil, military, and transportation (Dunbabin & Marques, 2012;Khurshid & Bing-rong, 2004;Murphy et al., 2009;Napper & Seaman, 1989;Raj et al., 2018). In almost all cases, a robot must travel from one point to another in order to complete a task. A robot should also avoid collisions and dangerous situations while navigating through its surroundings in order to reach a certain point. This is generally known as findpath or robot navigation problem which invariably has four categories: localization, path planning, motion control, and cognitive mapping (Buniyamin et al., 2011). This paper focuses on the motion planning and control problem. Due to its usefulness in real-world applications, robot motion planning and control has been a widely researched topic over the past four decades. The primary goal of robot path planning and control is to identify the most efficient and safe route from point A to point B and subsequently control the robot to point B. There are two subtasks in robot motion planning and control: (1) plan a path which should be obstacle and collision free, and (2) control the robot to its destination.
Various methods are available in the literature for path planning which can be categorized into classical, heuristic and machine and deep learning. Artificial potential field (Lee & Park, 2003), cell decomposition (Kloetzer, Mahulea & Gonzalez, 2015), road map (Lingelbach, 2004), and virtual force field (Bortoff, 2000) are examples of classical or traditional approach. Optimization algorithms such as firefly (Patle et al., 2018), ant-colony (Brand et al., 2010), and particle swarm (Wang & Zhou, 2019) are examples of heuristic approaches. Algorithms such as neural networks, decision trees, Nave Baiyes, and others are used in machine and deep learning techniques for robot path planning (Otte, 2015). This paper will focus on a heuristic approach, in particular, the ant colony optimization. An Ant colony optimization (ACO) is a popular algorithm that has been applied to different problems, including path planning problems in robotics (Brand et al., 2010;Reshamwala & Vinchurkar, 2013). In this paper, given the nature of the problem, the authors use the ACO algorithm developed by Socha and Dorigo (Socha & Dorigo, 2008a;Socha & Dorigo, 2008b) for continuous domain (ACOR); however, there are different variants of ACO algorithms such as fuzzy heuristic based ACO (Shokouhifar, 2021), continuous ACO (CACO) (Bilchev & Parmee, 1995) and continuous interacting ant colony (CIAC) (Dréo & Siarry, 2004) which have been utilized for different problems and situations. The authors chose the variant of ACO proposed by Socha and Dorigo because it clearly outperformed other continuous ACO variants like CACO, API and CIAC in eight test functions (Socha & Dorigo, 2008a;Socha & Dorigo, 2008b) and it follows the original ACO formulation. Furthermore, Socha and Dorigo also compared ACOR with continuous genetic algorithm (CGA), enhanced continuous tabu search (ECTS), enhanced simulated annealing (ESA) and differential evolution (DE), where ACOR performed well in one third of the test problems and performed not much worse on other problems (Socha & Dorigo, 2008a;Socha & Dorigo, 2008b).
Once a path is planned the robot can track or follow the planned path to reach its destination. There are different methods in the literature for robot motion control such as kinematics, dynamics, artificial potential field, fuzzy logic and many more (Martınez-Alfaro & Gomez-Garcıa, 1998;Tanaka et al., 1998;Tsai & Wang, 2005;Watanabe et al., 1998). This paper will focus on kinematic equations of the robots for motion control.
Majority of the studies in the literature carry out motion control in two different phases: (1) path planning, and (2) subsequent robot tracking or control. This paper will address the problem of the motion planning and control differently. A robot's next step will be planned and the robot will move to that step. At the time of the robot's step planning, the obstacles and other robots will be considered and a collision free step will be determined. By repeating this process, the robot will reach its destination . Therefore, there is path planning and control at every step to its destination. This research will introduce a new hybrid algorithm that is a strategic combination of an ant colony optimization algorithm and kinematic equations of robot motion. The purpose of the algorithm is to plan a step (location) for the robot and the robot will use its kinematic equations to move to that step (location). This process is repeated until the final destination is reached. This is the main difference when compared to other algorithms and hybrids as most plan the entire path first and then the robot starts the journey. Selected scenarios will be used to showcase the new hybrid and a performance comparison in terms of path length and convergence time will be made with the Lyapunov based Control Scheme (LbCS), a classical approach for motion control.
The main contributions of this paper are as follows: 1. ACO-Kinematic algorithm: A new hybrid algorithm is proposed which plans a step for the robot and the robot moves to that step and this process continues until the robot reaches its destination. In literature, according to authors knowledge, there is no hybrid algorithm that plans next step location of robot and controls it to that step location. The proposed algorithm also solves the problem of local minima. 2. Multi-objective problem formulation: A new multi-objective problem is formulated in terms of path length and safety of the path. The safety objective is achieved through ant colony optimization and the path length objective is achieved by both, ant colony optimization and kinematic equations. 3. Application: The methodology derived for point-mass robots has been successfully applied to tractor-trailer robotic system to show the effectiveness of the proposed algorithm in real life applications. 4. Analysis: The performance of the new hybrid algorithm has been compared to that of lyapunov based control scheme (LbCS) in terms of path length and convergence time. Such a comparison using the LbCS has been carried out for the first time. The analysis show that ACO-Kinematic performed slightly better than LbCS including the avoidance of local minima. 'Related Work' presents the literature review on motion planning and control algorithms. The problem statement is discussed in 'Problem Statement and Objectives'. 'Ant Colony Optimization' discusses the ant colony optimization algorithm. The three objectives of motion planning namely, short, safe and smooth path are formulated and discussed in 'Robot Motion Planning and Control Formulation'. The proposed algorithm is presented in 'Proposed Algorithm'. The three case studies and example scenarios, including the kinematic equations for the tractor-trailer robot are discussed in 'Results'. 'Discussion' presents three different scenarios to measure performance of the proposed algorithm and the LbCS. Finally, the paper concludes in 'Conclusion and Future Work', discussing its contributions and recommendations for future work.

RELATED WORK
In literature, there are mostly instances of path planning and motion control being researched and implemented separately. There are a few algorithms that consider motion planning and control in parallel or simultaneously. The section will outline these algorithms and present a brief comparison with the proposed algorithm.
Firstly, there are algorithms that carry out path planning and then control the robots on these paths, usually known as path-tracking. For example, Saputro et al. implemented trajectory planning and tracking of mobile robots using a map and predictive control (Saputro, Rusmin & Rochman, 2018). A map of the environment is first created and then the collision free path is searched using A* algorithm. Then a model predictive control is used to track the robot on the reference path. Likewise, Ning et al. implemented a trajectory planning and tracking control scheme for autonomous obstacle avoidance of wheeled inverted pendulum (WIP) vehicles (Ning et al., 2020). Motion planning and trajectory control has been applied to car parking as well (Zips, Bck & Kugi, 2013), where the authors first find a path by solving a static optimization problem and then use a optimal controller for parking. The reader is referred to Chen, Peng & Grizzle (2017), Guo et al. (2018), Viana et al. (2021), Wang et al. (2020) and Zhang et al. (2019) for other examples of such algorithms.
Secondly, there are algorithms that consider path planning and motion control in parallel. Wahid et al. (2017) used artificial potential field method for motion planning and kinematics for the control to design vehicle collision avoidance assistance systems. Lyapunov based control scheme (LbCS) was developed by Sharma, Vanualailai & Singh (2014) and Sharma et al. (2008) and has been used by many researchers in different scenarios for robot motion planning and control (Devi et al., 2017;Kumar et al., 2021;Prasad, Sharma & Vanualailai, 2017;Prasad et al., 2021;Raj et al., 2021;Raj et al., 2018). LbCS is a time-invariant nonlinear method that is used to create velocity or accelerationbased controls enabling a robot to move safely in the workspace while avoiding obstacles. Raj et al. used LbCS to control a system of 1-trailer robots in a cluttered environment including a swarm of boids (Raj et al., 2021) and navigate car-like robots in 3-dimensional space (Raj et al., 2018). Prasad et al. used LbCS to derive the acceleration-based controllers for the mobile manipulator in 3-dimensional (Prasad et al., 2021) and to motion control a pair of cylindrical manipulators in a constrained 3-dimensional workspace (Prasad, Sharma & Vanualailai, 2017). Researchers also used LbCS for controlling quadrotors in different environments (Raj, Raghuwaiya & Vanualailai, 2020;Raj, Raghuwaiya & Vanualailai, 2020;Vanualailai, Raj & Raghuwaiya, 2021).
All of the motion planning and control algorithms outlined in the previous paragraph except LbCS first plan the path for the entire journey and then control the motion of the robot on the planned path. However, the proposed algorithm is different from these algorithms as it plans one step at a time and controls the motion of the robot to that step. LbCS also plans a step and then controls the motion of the robot to that step. Therefore, the proposed algorithm will be compared for performance with the LbCS.

PROBLEM STATEMENT AND OBJECTIVES
Suppose there is an initial position and a target position for each robot in a bounded workspace with several static obstacles of different shapes and sizes. The mobile robots will start at the initial position, avoid obstacles in path and reach their designated target position. Therefore, the main objective of the mobile robots is to reach their target by taking a shorter and safer route (avoid collision with obstacles and other robots).The following assumptions are made to achieve the objective of motion control in this paper: Assumption 1: The obstacles are of circular and rectangular shapes. In some cases, it is also represented as line segments. These obstacles are of different sizes and randomly distributed in the bounded workspace. The obstacles are static with known locations.
Assumption 2: The kinematic equations are used for the motion of point-mass and tractor-trailer robots. The robots can move in any direction.
Since this paper introduces first of a kind hybrid, more features such as handing uncertainties in the environment and locations of the static obstacles and the effects of noise will be added in the future work.
The research objectives of this paper are as follows: • Design and implement a hybrid algorithm composed of a heuristic and a classical method for planning a step location of robot and controlling it to that step, and hence reach a target with a series of such steps.
• Apply the hybrid algorithm to a real life application such as tractor-trailer robots.

ANT COLONY OPTIMIZATION
Ant colony optimization (ACO) was initially developed by Dorigo et al. (Socha & Dorigo, 2008a;Socha & Dorigo, 2008b) in the early 90 s for combinatorial optimization but later modified for continuous domains (Dréo & Siarry, 2004;Socha & Dorigo, 2008a;Socha & Dorigo, 2008b). ACO has been inspired from natural ants, which move out of their nest in search of food and move randomly in the surrounding area. Once an ant finds food, it evaluates and carries it on its back. On the way back to the nest, the ant deposits a pheromone trail on the ground which depends on the amount of food and quality. This pheromone trail guides other ants to the food source (Socha & Dorigo, 2008a;Socha & Dorigo, 2008b). In this paper, we have used the ant colony optimization for continuous domain (ACOR) proposed by Socha and Dorigo (Socha & Dorigo, 2008a;Socha & Dorigo, 2008b). The original ACO is based on discrete domain where pheromone and heuristic information are used to make different probabilistic choices. The main idea of ACOR is shifting from a discrete probability distribution to a continuous one that is, a probability density function (PDF). In ACOR, an ant samples a PDF instead of choosing a solution component when compared to ACO in discrete domain. ACOR closely follows the metaheuristic of ACO in discrete domain. ACO algorithm for continuous domain has two types of population: archive and new. The pheromone information is stored as a solution archive. The solutions in the archive are ordered according to their quality (determined through objective function evaluations). Each solution has an associated weight proportion to the solution quality. ACOR uses pheromone information to make the probabilistic choice. In the case of robot motion planning and control, the next step for the robot will be determined by the fittest ant (pheromone information) and the robot will move to that step using kinematic equations.
The algorithm is divided into the following phases:

Initialization phase
The algorithm starts with the creation of archive solution during the initialization of ants. ACOR utilizes Gaussian kernal which has three vectors of parameters: weights, means and standard deviations. The time complexity for this phase is O(n), where n is the number of ants.

Archive population phase
For the archive solution, the means and standard deviations are calculated using Eqs. (1) and (2): where µ i are the means and s i the archive solutions for i = 1...n, and where sd i is the standard deviation, k is the archive population, ξ is the convergence speed of the algorithm and s l is the chosen solution. ACOR stores in archive solution the values of the solutions' n variables and the value of their objective functions. This phase has a time complexity of O(n), where n is the number of ants.

New population creation phase
This phase involves creation of the new population array which is subsequently randomly initialized. This phase has a time complexity of O(1).

Solution construction phase
This phase starts which consists of the Gaussian kernel selection and then generating Gaussian random variable. Gaussian kernel selection is based on roulette wheel selection and probability. The probability is computed based on weights. The weights and probability are given in Eqs. (3) and (4): where, w i is the weight for individual solution, q is the intensification factor and k is the archive population, and where, P i is the probability of individual archive solution, k is the archive population and w n is the weight of individual archive solution.
An ant chooses probabilistically one of the solutions in the archive using Eq. (4). The position of the new population is the random variable generated using means and standard deviations from the Archive Population Phase and normally distributed random numbers. This phase has a time complexity of O(n), where n is the number of ants.

Evaluation phase
The new constructed solution is then evaluated using a fitness function and merged with the archive population. Finally, the total population is sorted to get the best solution and a new set of archive solution. The time complexity for this phase is O(1).
All phases except the Initialization phase will be repeated until the robot reaches its destination.

ROBOT MOTION PLANNING AND CONTROL FORMULATION
In this research, the path planning problem of robots is solved by the ACO while their motion controls by the kinematic equations. For the path planning problem, initial artificial ants and objective functions are used. For motion control, the kinematic equations will be used to control a robot to a point (step location) generated by ants. Kinematic equations which are essentially ODE's governing the motion of robot are used to control the motion of the robot. These equations are dependent on the type of the robot. For example, a point mass robot will have a set of different kinematic equations when compared that of a tractor-trailer robot because the latter may include nonholonomic constraints. This section is further divided into ants representation, multi-objective path planning problem, and the problem formulation of path planning and motion control of robots.

Multi-objective path planning problem
The robot path planning problem is formulated as the multi-objective problem. The two objectives are obtaining short path and safe path of the robots.
The following is the definition of a point-mass robot adopted from Prasad et al. (2020a): Definition 1. A jth point-mass P j is a disk of radius rp j ≥ 0 and is positioned at (x j (t ),y j (t )) ∈ R 2 at time t ≥ 0. Precisely, the point-mass is the set Definition 2. The target for P j is a disk of center (p j1 ,p j2 ) and radius rt j which is described as for j = 1,2,...,n.

Ant representation
The motion of each robot will be guided by a colony of ants which are randomly distributed in the working environment. Since we are considering n point-mass robots, there will be n colonies altogether with each colony having n j ants. The following is the definition of a moving ant in the jth colony: Definition 3. The ith ant in the jth colony A ij is a disk of radius ra ij ≥ 0 and is positioned at (xa ij (t ),ya ij (t )) ∈ R 2 at time t ≥ 0. Precisely, the ith ant in the jth colony is the set : (z 1 − xa ij ) 2 + (z 2 − ya ij ) 2 ≤ ra 2 ij } for i = 1,2,...,n and j = 1,2,...,n.

Short path
A robot will have a target seeking behaviour, that is, a robot should always be at a minimum distance from the target while it navigates through the cluttered environment. Therefore, the total length of the robot's path should be a minimum. Ants will be used to guide the robot to the target. In case of a multi-robot environment, each robot will have a set of ants associated with it for navigation. Since ants are used to plan the path for the robot, the fittest ant will be chosen for the robot's next step location. For each ant in the jth colony, an Euclidean formula shown in Eq. (6) is used to calculate the distance between the i th ant and the target:

Safe path
A path is safe if it has no obstacles in it. However, the workspace considered for this research has multiple obstacles, therefore obstacle avoidance becomes necessary. There are two types of obstacles used in this paper: (1) circular obstacles and (2)  ) and radius ro l > 0 on the z 1 z 2 plane is described as for l = 1,2,...,q. Definition 5. The kth line segment in the z 1 z 2 plane, from the point (a k1 ,b k1 ) to the point (a k2 ,b k2 ) is the set where λ k ∈ [0,1], k = 1,2,...,m. For a circular obstacle, Euclidean formula shown in Eq. (7) is used to calculate the shortest distance between ith ant in the j colony and the lth obstacle: for i = 1,2,...,n j , j = 1,2,...,n and l = 1,2,...,q. Since there are many obstacles, the distance between each ant and the obstacles will be calculated. The sum of the distances between ith ant in the jth colony and obstacles is given by: To avoid a line segment, the distance between an ant and several points on that line segment are calculated, and the point generating minimum distance is considered. This technique is known as minimum distance technique (MDT) that has been adopted from Sharma, Vanualailai & Singh (2014). Avoiding the closest point on a line segment at any given time will result in avoiding the entire line segment. Again, the Euclidean formula is used to calculate the distance of an ant with a point on the line segment: where λ ijk ∈ [0,1], i = 1,2,...,n j , j = 1,2,...,n and k = 1,2,...,m. Like circular obstacles, there are many line segments, therefore the distance a point on the line segment and an ant will be calculated for each line segment and will be summed as: In a multi-robot environment, the inter-collisions between robots must be avoided. Since ants determine the next step location of a robot, each ant in the jth colony must avoid other robots which is considered as a moving obstacle. The Euclidean distance as shown in Eq. (11) is used to avoid robots from colliding with each other: for i = 1,2,...,n j , j = 1,2,...,n, h = 1,2,...,n, h = j. The sum of the distances between each ant and different robots is given by:

Problem formulation
The problem is the minimization optimization problem which finds the optimal path for mobile robots in a cluttered environment. The fitness equation is designed by summing all the objective functions defined in this section: which is the fitness of ith ant for robot j and a, b, c and d are control parameters. The ant having the minimum f ij will be the fittest ant in the jth colony. It means that the ant is located at a safe distance from obstacles and at a minimum distance from the target. The jth robot will move to the fittest ant of the jth colony and this process will continue until the jth robot reaches its target. The control parameters a, b and c are the fitting parameters that decide path safety. With a high value of parameter a the ants will avoid the stationary circular obstacles from the greater distance. Similarly, a small value of b will mean that the ants will avoid the line segments from a closer distance which can compromise safety. However, when there is a decrease in the value of a, b and c, the chances of collision with obstacles, line segments and other robots are high. Likewise, a higher value of d will minimize the path length and a smaller value will maximize the path length. Therefore, a proper selection of these parameters decides the success of the objective function in planning the next step for a robot.

Motion control
The kinematic equations are used to control the robot to the step location generated ants. The kinematic equations will be used to generate smooth path for the robots in between the nodes.

PROPOSED ALGORITHM
The proposed new algorithm is a hybrid of the ant colony optimization and kinematic equations, named ACO-Kinematic. The choice of ACO variant was made from the results of Socha & Dorigo (2008a); Socha & Dorigo (2008b) where they showed that it outperformed other ACO variants and was equivalent to some heuristic algorithms for continuous domain. The robot's next step will be planned using the ant colony optimization algorithm and the robot will move to that step using its kinematic equations. In the literature, there are various hybrid models but according to the authors knowledge, there is none of this kind. The ACO-Kinematic pseudocode is shown in Algorithm 1.  Table 1 shows the initial parameters of the ACO-Kinematic algorithm used in the three case studies discussed in the following subsections. Parameters 1-8 are used for path planing while parameters 9-10 are used for motion control. Safety parameters a, b and c will be used by users to fine tune avoidance of obstacles, line segments and other robots, respectively. Convergence parameter d determines the time it will take for a robot to reach its destination. Faster convergence means compromising the safety of the robot while the slower convergence means that the operation can be costly. Therefore, the parameters in this research have been adjusted with precaution. In this research the authors have deployed the brute force method to generate the values of the control parameters.

Case study 1: single point-mass robot and multiple obstacles
The proposed algorithm has been used to navigate the point-mass robot from source to destination in a cluttered environment. The kinematic equations governing the motion of a point-mass robot from its initial position (x 0 ,y 0 ) to another point (p 1 ,p 2 ) arė where α 1 and α 2 are positive real numbers. Figures 1 and 2 show two scenarios where the point-mass robot avoids circular and line obstacles to reach its target. The path of the point-mass robot consists of points that have been generated by the ants. The robot moves from one step to another using its kinematic equations.

Case study 2: multiple point-mass robots and multiple obstacles
The proposed algorithm has been used to plan and control motion of multiple point-mass robots in a multiple obstacles (circular and rectangular shapes) environment. Figure 3 shows the paths of three point-mass robots. The first robot (R1) has a initial position of (5, 45) and the target placed at (45, 5). The second robot (R2) is placed at the initial position (5, 5) and has to reach the target at (45, 45). The initial and target positions for the third robot (R3) are (45, 25) and (5, 25). The three robots start journey from their initial positions and have a goal to achieve, that is, to reach their target positions safely by taking a shortest route moving from one step to another. The three robots avoid all obstacles in their paths and also avoid colliding with each other. Figure 4 shows the first robot (R1) and the second robot (R2) avoiding each other.

Application: tractor-trailer robot
The proposed algorithm has been used for motion planning and control of a tractor-trailer robot system. We consider a non-standard tractor-trailer robot which comprises of a rear wheel driven car-like vehicle and a hitched two-wheeled passive trailer attached to the rear axel of the vehicle (Fig. 5).
Let (x,y) represent the cartesian coordinates of the tractor robot, θ 0 be its orientation with respect to the x-axis, while φ gives the steering angle with respect to its longitudinal axis. Similarly, let θ 1 denote the orientation of the trailer with respect to the x-axis. Letting  L and L t be the lengths of the mid-axle of the tractor and trailer, respectively, the motion of the tractor-trailer robot is governed by the following kinematic equations (Prasad et al., 2020b) x where v and φ which are the translational velocity and the steering angle, respectively, of the tractor robot, given as Prasad et al.
where α is a positive real number and β = max{0,0.5 − cos|θ 1 − θ 0 |} · sign(θ 1 − θ 0 ). Note that (p 1 ,p 2 ) is the next step for the robot generated by ant colony optimization and (x,y) is the current position of the robot. ξ is obtained by numerically solving the differential equatioṅ Figsures 6 and 7 show the trajectories of one tractor-trailer robot in two different scenarios. Figures 8, 9, 10 and 11 show the paths of the three tractor-trailer robots. Table 2 shows the initial and target positions for each robot. Figure 8 shows that R1 is avoiding R3 by stopping and waiting for R3 to pass. R1 has successfully avoided R3 and R1 resumes its journey towards the target, as shown in Fig.  9. Figure 10 shows that R2 and R3 avoid each other. The complete paths for the three robots are shown in Fig. 11. The robots avoid each other using the fitness function given in  Eq. (13) which is used in ACO to determine the fittest ant. The robots are then controlled to the location of the fittest ants by the kinematic equations of the robots.

DISCUSSION
In this section, the performance of the proposed ACO-Kinematic algorithm will be compared with the Lyapunov-based Control Scheme (LbCS), which is a popular potential field-based method used to solve motion planning and control problem (Sharma et al., 2018). The performance will be measured in terms of path length and convergence time. Both algorithms have convergence and safety parameters. For LbCS, a larger convergence parameter value increases convergence time whereas a smaller convergence parameter value will decrease the convergence time. For ACO-Kinematic, a larger convergence parameter value decreases convergence time whereas a smaller convergence parameter value will increase the convergence time. Note that a quicker time to converge can affect a robot's safety. Therefore, the parameters need to be adjusted. There is no method in literature to adjust these parameters apart from the brute-force method. The authors have also used   the brute-force method to obtain optimal parameters for the two algorithms that have been used to measure performance as shown in Tables 3 and 4. The LbCS equations and parameters for the point-mass robot and tractor-trailer has been used from Vanualailai, Ha &Nakagiri (1998) andSharma et al. (2008), respectively. The parameter values depend on the type of the robot which is also shown in the two tables. The convergence parameters d for ACO-Kinematic, and delta1 and delta2 for LbCS have the same values for both robots.
Other parameters may differ in their values and are dependent on the type of the robots. Table 5 shows the average path lengths and the time it takes for a robot to reach the destination using ACO-Kinematic algorithm and LbCS. It shows the results for three scenarios. Robot motion planning and control with ACO-Kinematic algorithm for each scenario was iterated 30 times to calculate the average path length and time. LbCS inherently provides the same results for any run, therefore only 1 run was considered.
For Overall, in all 3 scenarios, ACO-Kinematic was able to achieve the shorter path in a time lesser than that of LbCS. Figures 18 and 19 show the trajectories of the point-mass robots using ACO-Kinematic and LbCS for Scenario 4. While, the point-mass robot controlled by ACO-Kinematic was able to reach the target, the point-mass robot through LbCS controllers could not. This is because the LbCS system had entered into the local minima, which is one issue that most artificial potential field methods face. The ACO-Kinematic algorithm was able to solve the problem of local minima and hence a better performer than a traditional motion planning and control algorithms like LbCS.

CONCLUSION AND FUTURE WORK
In this paper, a unique approach is proposed for solving motion planning and control problems. In particular, a new hybrid algorithm, ACO-Kinematic strategically made up of ant colony optimization and kinematic equations is presented. The new algorithm plans a step for a robot using ant colony optimization and the robot moves to that step using its kinematic equations. The algorithm is inherently capable of making the robot avoid obstacles and other robots while moving from initial to the target position. In the hybrid algorithm, the ACO plans the robot's next step while the kinematic equations controls the robot to that step location. In the authors' belief, this is the first time a hybrid algorithm of this kind is proposed for motion planning and control problem. The algorithm solves a multi-objective problem that consists of finding the safest and shortest path, successfully using kinematic equations to move the robot from one step to another and finally conveys to the final destination. The ACO-Kinematic algorithm was used in three case studies. In the first case study, a point-mass robot navigated from initial position to target while avoiding multiple circular and line obstacles. The obstacles were static and the locations were known to robots. The second case study extended to multiple point-mass robots in a cluttered environment. In addition, the robots also avoided each other. The third case study was an application involving the non-standard 1-trailer robots. The tractor-trailer robots avoided obstacles and other tractor -trailer robots to reach the target from initial position. The proposed algorithm, was also compared for performance with the Lypanouv based control scheme (LbCS) that has been used in a number of research on motion planning and control problems. Three scenarios were used for both algorithms and path lengths and convergence times were noted. The results showed that ACO-Kinematic algorithm was able to achieve shorter path lengths in relatively shorter convergence times in all three scenarios. It was also noted that LbCS was trapped in the local minima in the fourth scenario and the point-mass robot was not able to reach the target. The point-mass robot controlled by ACO-Kinematic algorithm was able to reach the target in the same scenario. This shows an arterial advantage of the ACO-Kinematic algorithm.
In the future work, the authors will apply ACO-Kinematic to static obstacles with unknown locations, dynamic obstacles and also to other mechanical systems. The authors will also carry out experimental analysis for verifications, comparisons and theoretical proofs of the new algorithm. Since this paper is a first for ACO-Kinematic hybrid , the authors will also upgrade the algorithm by adding new features including heuristic information to be part of ACO selection rule, handle noise in robot control and sensing, and handling imperfect knowledge of the environment.