Open Access iconOpen Access



Computer Vision Based Robotic Arm Controlled Using Interactive GUI

Muhatasim Intisar1, Mohammad Monirujjaman Khan1,*, Mohammad Rezaul Islam1, Mehedi Masud2

1 Department of Electrical and Computer Engineering, North South University, Bashundhara, Dhaka-1229, Bangladesh
2 Department of Computer Science, College of Computers and Information Technology, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia

* Corresponding Author: Mohammad Monirujjaman Khan. Email: email

Intelligent Automation & Soft Computing 2021, 27(2), 533-550.


This paper presents the design and implementation of a robotic vision system operated using an interactive Graphical User Interface (GUI) application. As robotics continue to become a more integral part of the industrial complex, there is a need for automated systems that require minimal to no user training to operate. With this motivation in mind, the system is designed so that a beginner user can operate the device with very little instruction. The application allows users to determine their desired object, which will be picked up and placed by a robotic arm into the target location. The application allows users to filter objects based on color, shape, and size. The filtering along the three parameters is done by employing a Hue-Saturation-Value (HSV) mode color detection algorithm, shape detection algorithm, size determining algorithm. Once the target object is identified, a centroid detection algorithm is employed to find the object’s center coordinates. An inverse kinematic algorithm is used to ascertain the robotic arm’s joint positions for picking the object. The arm then goes through a set of preset positions to pick up the object, place the object, and then return the arm to the initial position. The joint coordinates are forwarded to a microcontroller that sets the arm’s joint angle at each position.


Cite This Article

APA Style
Intisar, M., Khan, M.M., Islam, M.R., Masud, M. (2021). Computer vision based robotic arm controlled using interactive GUI. Intelligent Automation & Soft Computing, 27(2), 533-550.
Vancouver Style
Intisar M, Khan MM, Islam MR, Masud M. Computer vision based robotic arm controlled using interactive GUI. Intell Automat Soft Comput . 2021;27(2):533-550
IEEE Style
M. Intisar, M.M. Khan, M.R. Islam, and M. Masud "Computer Vision Based Robotic Arm Controlled Using Interactive GUI," Intell. Automat. Soft Comput. , vol. 27, no. 2, pp. 533-550. 2021.

cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 3307


  • 4900


  • 0


Share Link