Vol.27, No.2, 2021, pp.533-550, doi:10.32604/iasc.2021.015482
Computer Vision Based Robotic Arm Controlled Using Interactive GUI
  • Muhatasim Intisar1, Mohammad Monirujjaman Khan1,*, Mohammad Rezaul Islam1, Mehedi Masud2
1 Department of Electrical and Computer Engineering, North South University, Bashundhara, Dhaka-1229, Bangladesh
2 Department of Computer Science, College of Computers and Information Technology, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia
* Corresponding Author: Mohammad Monirujjaman Khan. Email:
Received 24 November 2020; Accepted 19 December 2020; Issue published 18 January 2021
This paper presents the design and implementation of a robotic vision system operated using an interactive Graphical User Interface (GUI) application. As robotics continue to become a more integral part of the industrial complex, there is a need for automated systems that require minimal to no user training to operate. With this motivation in mind, the system is designed so that a beginner user can operate the device with very little instruction. The application allows users to determine their desired object, which will be picked up and placed by a robotic arm into the target location. The application allows users to filter objects based on color, shape, and size. The filtering along the three parameters is done by employing a Hue-Saturation-Value (HSV) mode color detection algorithm, shape detection algorithm, size determining algorithm. Once the target object is identified, a centroid detection algorithm is employed to find the object’s center coordinates. An inverse kinematic algorithm is used to ascertain the robotic arm’s joint positions for picking the object. The arm then goes through a set of preset positions to pick up the object, place the object, and then return the arm to the initial position. The joint coordinates are forwarded to a microcontroller that sets the arm’s joint angle at each position.
Application design; computer vision; Human Computer Interaction (HCI); inverse kinematics; microcontroller; robotics
Cite This Article
M. Intisar, M. M. Khan, M. R. Islam and M. Masud, "Computer vision based robotic arm controlled using interactive gui," Intelligent Automation & Soft Computing, vol. 27, no.2, pp. 533–550, 2021.
This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.