An improved feature point-based LK optical flow algorithm for robotic arm control

Xingrui Shi; Wei Xu; Jiyao Wang

doi:10.1117/12.2680052

31 May 2023 An improved feature point-based LK optical flow algorithm for robotic arm control

Xingrui Shi, Wei Xu, Jiyao Wang

Proceedings Volume 12704, Eighth International Symposium on Advances in Electrical, Electronics, and Computer Engineering (ISAEECE 2023); 127043G (2023) https://doi.org/10.1117/12.2680052
Event: 8th International Symposium on Advances in Electrical, Electronics and Computer Engineering (ISAEECE 2023), 2023, Hangzhou, China

Abstract

Robot vision technology has been widely used in many fields since its emergence, and real-time control of robotic arm control systems has long been a challenging problem. When using optical flow algorithms for tracking in conventional vision control, its accuracy and large movements are affected by the size of the integration window to track fast-moving objects, making it difficult to achieve real-time control in robotic arm vision control. By using a smaller integration window, the Pyramid Lucas-Kanade (LK) method can solve the problem that large motions cannot be tracked, but the basic Pyramid LK method is not very accurate. Therefore, an improved LK optical flow method is proposed for the practical application of the traditional LK method for robotic arm control with poor real-time performance and accuracy, applying a combination of the improved FAST (Features from Accelerated Segment Test) corner point detection and the pyramid LK optical flow algorithm. With the improved FAST algorithm, the corner points with the strongest grey-scale variations can be extracted quickly. This approach allows better estimation of optical flows with strong corner points to track moving objects. The corner points calculated by applying the improved FAST feature point detection are first used as candidate feature points; then the candidate feature points are re-extracted by setting filtering conditions with the information obtained from the robotic arm; and finally, the target feature points are tracked using the LK optical flow method.

Citation Download Citation

Xingrui Shi, Wei Xu, and Jiyao Wang "An improved feature point-based LK optical flow algorithm for robotic arm control", Proc. SPIE 12704, Eighth International Symposium on Advances in Electrical, Electronics, and Computer Engineering (ISAEECE 2023), 127043G (31 May 2023); https://doi.org/10.1117/12.2680052

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available