R. Raja
ABSTRACT
In this paper, we propose a hybrid image based visual servoing for 6 degrees of freedom (DoF) robot manipulators. It avoids the drawbacks of classical position-based visual servoing. Contrary to the position-based visual servoing, this method does not require any knowledge of the geometric 3 DoF model of the object. On the other hand, the depth information of the object is required. In the proposed approach, a Kinect sensor is used as a camera, which provides depth information of the object from the point cloud. This method tracks the position of the target object. The method is simulated in Gazebo platform with Kinect sensor mounted on 6 DoF Universal Robot 5 (UR5) manipulator, where all the physical parameters of the robot and Kinect sensor is considered. The solution is developed in C++ integrated with ROS, OpenCV. The method illustrated with a variety of simulation results with an eye-in-hand robotic system which shows the convergence of the system and potential of our method.
- Francois Chaumette. 1998. Potential problems of stability and convergence in image-based and position-based visual servoing. In The confluence of vision and control. Springer, 66--78.Google Scholar
- Francois Chaumette and Seth Hutchinson. 2006. Visual servo control. I. Basic approaches. IEEE Robotics & Automation Magazine 13, 4 (2006), 82--90.Google ScholarCross Ref
- Peter I Corke and Seth A Hutchinson. 2000. A new hybrid image-based visual servo control scheme. In Decision and Control, 2000. Proceedings of the 39th IEEE Conference on, Vol. 3. IEEE, 2521--2526.Google ScholarCross Ref
- Bernard Espiau, Francois Chaumette, and Patrick Rives. 1993. A new approach to visual servoing in robotics. In Geometric reasoning for perception and action. Springer, 106--136. Google ScholarDigital Library
- Bernard Espiau, Francois Chaumette, and Patrick Rives. 2002. A new approach to visual servoing in robotics. ieee Transactions on Robotics and Automation 8, 3 (2002), 313--326.Google Scholar
- Seth Hutchinson, Gregory D Hager, and Peter I Corke. 1996. A tutorial on visual servo control. IEEE transactions on robotics and automation 12, 5 (1996), 651--670.Google ScholarCross Ref
- Farrokh Janabi-Sharifi, Lingfeng Deng, and William J Wilson. 2011. Comparison of basic visual servoing methods. IEEE/ASME Transactions on Mechatronics 16, 5 (2011), 967--983.Google ScholarCross Ref
- Kourosh Khoshelham and Sander Oude Elberink. 2012. Accuracy and resolution of kinect depth data for indoor mapping applications. Sensors 12, 2 (2012), 1437--1454.Google ScholarCross Ref
- Yun-Hui Liu, Hesheng Wang, Chengyou Wang, and Kin Kwan Lam. 2006. Uncalibrated visual servoing of robots using a depth-independent interaction matrix. IEEE Transactions on Robotics 22, 4 (2006), 804--817. Google ScholarDigital Library
- Ezio Malis, Francois Chaumette, and Sylvie Boudet. 1999. 2 1/2 D visual servoing. IEEE Transactions on Robotics and Automation 15, 2 (1999), 238--250.Google ScholarCross Ref
- Ezio Malis and Patrick Rives. 2003. Robustness of image-based visual servoing with respect to depth distribution errors. In Robotics and Automation, 2003. Proceedings. ICRA'03. IEEE International Conference on, Vol. 1. IEEE, 1056--1061.Google ScholarCross Ref
- Mohammed Marey and Francois Chaumette. 2008. Analysis of classical and new visual servoing control laws. In Robotics and Automation, 2008. ICRA 2008. IEEE International Conference on. IEEE, 3244--3249.Google ScholarCross Ref
- Amir massoud Farahmand, Azad Shademan, and Martin Jägersand. 2007. Global visual-motor estimation for uncalibrated visual servoing. In Intelligent Robots and Systems, 2007. IROS 2007. IEEE/RSJ International Conference on. IEEE, 1969--1974.Google ScholarCross Ref
- Eissa Nematollahi and Farrokh Janabi-Sharifi. 2009. Generalizations to control laws of image-based visual servoing. International Journal of Optomechatronics 3, 3 (2009), 167--186.Google ScholarCross Ref
- Azad Shademan, Amir-Massoud Farahmand, and Martin Jagersand. 2010. Robust jacobian estimation for uncalibrated visual servoing. In Robotics and Automation (ICRA), 2010 IEEE International Conference on. IEEE, 5564--5569.Google ScholarCross Ref
- Lee Elliot Weiss, Arthur C Sanderson, and CP Neuman. 1985. Dynamic visual servo control of robots: an adaptive image-based approach. In Robotics and Automation. Proceedings. 1985 IEEE International Conference on, Vol. 2. IEEE, 662--668.Google ScholarCross Ref
Recommendations
Autonomous Navigation of Mobile Robot Using Kinect Sensor
ICCCE '14: Proceedings of the 2014 International Conference on Computer and Communication EngineeringThe problem of achieving real time process in depth camera application, in particular when used for indoor mobile robot localization and navigation is far from being solved. Thus, this paper presents autonomous navigation of the mobile robot by using ...
ROS-Based SLAM for a Gazebo-Simulated Mobile Robot in Image-Based 3D Model of Indoor Environment
ACIVS 2015: Proceedings of the 16th International Conference on Advanced Concepts for Intelligent Vision Systems - Volume 9386Nowadays robot simulators have robust physics engines, high-quality graphics, and convenient interfaces, affording researchers to substitute physical systems with their simulation models in order to pre-estimate the performance of theoretical findings ...
Hybrid Position and Image Based Visual Servoing for mobile robots
Visual servoing requires the target object to be in the field of view of the camera all the time. At the same time, we also want to achieve optimal path planning and controllability of the robot pose. This paper presents a new hybrid fuzzy control ...
Comments