CFP last date
20 January 2025
Reseach Article

Experiment with Humanoid Robot Hand to Reach Object by Measuring Objects 3D Coordinates using Binocular Stereo Vision

by Noushad Sojib, Sheikh Nabil Mohammad
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 178 - Number 44
Year of Publication: 2019
Authors: Noushad Sojib, Sheikh Nabil Mohammad
10.5120/ijca2019919332

Noushad Sojib, Sheikh Nabil Mohammad . Experiment with Humanoid Robot Hand to Reach Object by Measuring Objects 3D Coordinates using Binocular Stereo Vision. International Journal of Computer Applications. 178, 44 ( Aug 2019), 1-4. DOI=10.5120/ijca2019919332

@article{ 10.5120/ijca2019919332,
author = { Noushad Sojib, Sheikh Nabil Mohammad },
title = { Experiment with Humanoid Robot Hand to Reach Object by Measuring Objects 3D Coordinates using Binocular Stereo Vision },
journal = { International Journal of Computer Applications },
issue_date = { Aug 2019 },
volume = { 178 },
number = { 44 },
month = { Aug },
year = { 2019 },
issn = { 0975-8887 },
pages = { 1-4 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume178/number44/30830-2019919332/ },
doi = { 10.5120/ijca2019919332 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-07T00:53:01.605908+05:30
%A Noushad Sojib
%A Sheikh Nabil Mohammad
%T Experiment with Humanoid Robot Hand to Reach Object by Measuring Objects 3D Coordinates using Binocular Stereo Vision
%J International Journal of Computer Applications
%@ 0975-8887
%V 178
%N 44
%P 1-4
%D 2019
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Stereo vision system adds the essential feature for robots to see the real world in a human-like manner by combining two 2D imaging systems. Robotic arm with end-effector helps robots to interact with real-world things by grabbing objects. Here in this research a 5 DOF human-like robot arm and a stereo vision set using two cameras mounted in parallel with 6cm distance was developed. Inverse kinematics is then calculated for the designed arm thus the robot can control the end-effector (gripper) position by adjusting motors angle. A software system was developed so the robot can perceive an objects 3d position using the stereo set and move the gripper through the help of kinematics.OpenCV blob detection technique was used to identify objects in an image. Summing up them the robot can now grip object seeing it in front of its stereo eye.

References
  1. Socker, Dennis George, et al. ”NASA Solar Terrestrial Relations Observatory (STEREO) mission heliospheric imager.” Instrumentation for UV/EUV Astronomy and Solar Missions. Vol. 4139. International Society for Optics and Photonics, 2000.
  2. Asfour, Tamim, and Rdiger Dillmann. ”Human-like motion of a humanoid robot arm based on a closed-form solution of the inverse kinematics problem.” Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003)(Cat. No. 03CH37453). Vol. 2. IEEE, 2003.
  3. Smisek, Jan, Michal Jancosek, and Tomas Pajdla. ”3D with Kinect.” Consumer depth cameras for computer vision. Springer, London, 2013. 3-25.
  4. Marr, David, and Tomaso Poggio. ”A computational theory of human stereo vision.” Proceedings of the Royal Society of London. Series B. Biological Sciences 204.1156 (1979): 301- 328.
  5. Loop, Charles, and Zhengyou Zhang. ”Computing rectifying homographies for stereo vision.” Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149). Vol. 1. IEEE, 1999.
  6. Murray, Don, and James J. Little. ”Using real-time stereo vision for mobile robot navigation.” autonomous robots 8.2 (2000): 161-171.
  7. Hirschmller, Heiko, Peter R. Innocent, and Jon Garibaldi. ”Real-time correlation-based stereo vision with reduced border errors.” International Journal of Computer Vision 47.1-3 (2002): 229-246.
  8. Claudio, Giovanni, Fabien Spindler, and Franois Chaumette. ”Vision-based manipulation with the humanoid robot Romeo.” 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids). IEEE, 2016.
  9. Gouaillier, David, et al. ”Mechatronic design of NAO humanoid.” 2009 IEEE International Conference on Robotics and Automation. IEEE, 2009.
  10. Mller, Judith, Udo Frese, and Thomas Rfer. ”Grab a mugobject detection and grasp motion planning with the Nao robot.” 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012). IEEE, 2012.
  11. Zhang, Zhengyou, et al. ”A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry.” Artificial intelligence 78.1-2 (1995): 87- 119.
  12. Saha, Ankan, and Ambuj Tewari. ”On the nonasymptotic convergence of cyclic coordinate descent methods.” SIAM Journal on Optimization 23.1 (2013): 576-601.
  13. Buss, Samuel R. ”Introduction to inverse kinematics with jacobian transpose, pseudoinverse and damped least squares methods.” IEEE Journal of Robotics and Automation 17.1-19 (2004): 16.
Index Terms

Computer Science
Information Sciences

Keywords

Humanoid Arm Stereo Vision Kinematics Robot Vision Epipolar Geometry