CFP last date
20 January 2025
Reseach Article

HGRIHCI: Hand Gesture Recognition for Intuitive Human Computer Interaction

by Arindam Sarkar, Shilpi Bose, Chandra Das
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 153 - Number 10
Year of Publication: 2016
Authors: Arindam Sarkar, Shilpi Bose, Chandra Das
10.5120/ijca2016912168

Arindam Sarkar, Shilpi Bose, Chandra Das . HGRIHCI: Hand Gesture Recognition for Intuitive Human Computer Interaction. International Journal of Computer Applications. 153, 10 ( Nov 2016), 15-20. DOI=10.5120/ijca2016912168

@article{ 10.5120/ijca2016912168,
author = { Arindam Sarkar, Shilpi Bose, Chandra Das },
title = { HGRIHCI: Hand Gesture Recognition for Intuitive Human Computer Interaction },
journal = { International Journal of Computer Applications },
issue_date = { Nov 2016 },
volume = { 153 },
number = { 10 },
month = { Nov },
year = { 2016 },
issn = { 0975-8887 },
pages = { 15-20 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume153/number10/26438-2016912168/ },
doi = { 10.5120/ijca2016912168 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T23:58:46.009033+05:30
%A Arindam Sarkar
%A Shilpi Bose
%A Chandra Das
%T HGRIHCI: Hand Gesture Recognition for Intuitive Human Computer Interaction
%J International Journal of Computer Applications
%@ 0975-8887
%V 153
%N 10
%P 15-20
%D 2016
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Gesture Recognition using Computer Vision opens up a whole new frontier in Human-Computer Interaction. Hand gestures are natural, intuitive, and require almost no learning, or remembering whatsoever. The proposed work involves developing a system to translate gestures (predetermined) performed by the user to control the active application on a computer. Viola-Jones Cascade Object Detector with Histogram of Orientation Gradients (HOG) features is used to detect Hand candidates (Open Palm or Fist). In this paper several heuristics are used to filter out false-positives. Drag patterns made by user, are then interpreted as one of the gestures in the database, using a simple pixel-wise distance based algorithm to match patterns. This approach results to robustness, and higher invariance to illumination changes, as compared to earlier works, which depend purely on known distribution of human skin-color.

References
  1. William T. Freeman, Craig D. Weissman. Television Control by Hand gestures. 1995. IEEE Intl. Workshop on Automatic Face and Gesture Recognition, Zurich, June.
  2. Viola, Paul and Michael J. Jones, Rapid Object Detection using a Boosted Cascade of Simple Features. 2001. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2001. Volume: 1, pp.511–518.
  3. Dalal, N., and B. Triggs, Histograms of Oriented Gradients for Human Detection. 2005. IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Volume 1, (2005), pp. 886–893.
  4. D. Chai, K.N. Ngan. Face segmentation using skin-color map in videophone applications. 1999. IEEE Trans. Circuits Syst. Video Technol. 9 (4).
  5. T. Kapuscinski and M. Wysocki. Hand Gesture Recognition for Man-Machine interaction. 2001. Second Workshop on Robot Motion and Control, October 18-20, 2001, pp. 91-96.
  6. C. Yu, X. Wang, H. Huang, J. Shen and K. Wu. Vision-Based Hand Gesture Recognition Using Combinational Features. 2010. IEEE Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing, pp. 543-546.
  7. M. Cote, P. Payeur, and G. Comeau. Comparative study of adaptive segmentation techniques for gesture analysis in unconstrained environments. 2006. In IEEE Int. Workshop on Imagining Systems and Techniques pages 28-33.
  8. R. Francois and G. Medioni. Adaptive colour background modelling for real-time segmentation of video streams. 1999. In Int. Conference on Imaging Science, Systems, and Technology, pages 227-232.
  9. J. Martin and J. Crowley. An appearance-based approach to gesture-recognition. 1997. In Int. Conf. on Image Analysis and Processing, pages 340-347, Florence, Italy.
  10. G. Bradski. Real time face and object tracking as a component of a perceptual user interface. 1998. In IEEE Workshop on Applications of Computer Vision, pages 214-219.
  11. M. Kampmann. Segmentation of a head into face, ears, neck and hair forknowledge-based analysis-synthesis coding of video-phone sequences. 1998. In Proc. International Conference on Image Processing (ICIP) volume 2, pages 876{880, Chicago, IL .
  12. R. Herpers, G. Verghese, K. Darcourt, K. Derpanis, R. Enenkel,J. Kaufman, M. Jenkin, E. Milios, A.Jepson, and J.1999. Tsotsos.An active stereo vision system for recognition of faces and related hand gestures. In Int. Conf. on Audio- and Video-based Biometric Person Authentication, pages 217-223, Washington,D. C.
  13. T. Kurata, T. Okuma, M. Kourogi, and K. Sakaue. The hand mouse: Gmm hand-color classification and mean shift tracking. In Int. 2001. Workshop on Recognition, Analysis and Tracking of Faces and Gestures in Real-time Systems, pages 119{124, Van-couver, BC, Canada.
  14. D. Saxe and R. Foulds. Toward robust skin identification in video images.1996. In IEEE Int. Conf. on Automatic Face and Gesture Recognition, pages 379-384.
  15. D. Chai and K. Ngan. Locating the facial region of a head and shoulders color image. 1998. In IEEE Int.Conference on Automatic Face and Gesture Recognition , pages 124-129, Piscataway, NJ.
  16. J. Yang, W. Lu, and A. Waibel. Skin-color modeling and adaptation. 1998. In ACCV, pages 687-694.
  17. A. A. Argyros and M. I. A. Lourakis. Real-time tracking of multiple skin-colored objects with a possibly moving camera. 2004. In Proc. European Conference on Computer Vision, pages 368-379,Prague, Chez Republic, May.
  18. W. Freeman and C. Weissman. Television control by hand gestures. 1995. In Int. Workshop on Automatic Face and Gesture Recognition, pages 179-183, Zurich, Switzerland.
  19. F. Quek. Eyes in the interface. 1995. Image and Vision Computing, 13(6):511-525.
  20. Y. Cui and J. Weng. Hand sign recognition from intensity image sequences with complex background. 1996. In Proc. IEEE Computer Vision and Pattern Recognition (CVPR), pages 88-93.
  21. R. Cutler and M. Turk. View-based interpretation of real-time optical flow for gesture recognition. 1998. In Proc. International Conference on Face and Gesture Recognition, pages 416-421, Washington, DC, USA, IEEE Computer Society.
  22. J. Martin, V. Devin, and J. Crowley. Active hand tracking. 1998. In IEEE Conference on Automatic Face and Gesture Recognition,pages 573-578, Nara, Japan.
  23. J. Crowley, F. Berard, and J. Coutaz. Finger tracking as an input device for augmented reality. 1995. In International Workshop on Gesture and Face Recognition, Zurich, June.
  24. R. O'Hagan and A. Zelinsky. Finger Track - a robust and real-time gesture interface. 1997. In Australian Joint Conference on Artificial Intelligence, pages 475-484, Perth, Australia, November.
  25. T. Darrell, I. Essa, and A. Pentland. Task-specific gesture analysis in real-time using interpolated views. 1996. IEEE Trans. Pattern Analysis and Machine Intelligence, 18(12):1236-1242.
  26. G. Hager and P. Belhumeur. Real-time tracking of image regions with changes in geometry and illumination.1996 In Proc. IEEE Computer Vision and Pattern Recognition (CVPR), pages 403-410, Washington, DC.
  27. W. Freeman and C. Weissman. Television control by hand gestures. In Int. 1995. Workshop on Automatic Face and Gesture Recognition, pages 179-183, Zurich, Switzerland.
  28. H. Birk, T. B. Moeslund, and C. B. Madsen. Real-time recognition of hand alphabet gestures using principal component analysis. 1997. In Proc. Scandinavian Conference on Image Analysis, Lappeenranta, Finland, June.
  29. T. Darrell and A. Pentland. Space-time gestures. 1993. In Proc. IEEE Computer Vision and Pattern Recognition (CVPR), pages 335-340, New York, NY.
  30. H. Fillbrandt, S. Akyol, and K. F. Kraiss. Extraction of 3D hand shape and posture from images sequences from sign language recognition. 2003. In Proc. International Workshop on Analysis and Modeling of Faces and Gestures, pages 181-186, Nice, France, October.
  31. W. Freeman and M. Roth. Orientation histograms for hand gesture recognition.1995. In Proc. International Conference on Automatic Face and Gesture Recognition (FG), pages 296-301,Zurich, Switzerland.
  32. http://in.mathworks.com/help/vision/ref/vision.cascadeobjectdetector-class.html
  33. Yoav Freund and Robert E. Schapire. A decision-theoretic generalization of on-line learning and an application to boosting. 1995. International Conference on computational Learning Theory: Eurocolt ’95, pages 23–37. Springer-Verlag.
  34. W. T. Freeman, K. Tanaka, J. Ohta, and K. Kyuma. Computer vision for computer games.1996. 2nd International Conference on Automatic Face and Gesture Recognition, Killington, VT, USA, pages 100–105, October.
  35. D. G. Lowe. Distinctive image features from scale-invariant keypoints. 2004. IJCV, 60(2): pp. 91–110.
  36. S. Belongie, J. Malik, and J. Puzicha. Matching shapes. 2001. The 8th ICCV, Vancouver, Canada, pages 454–461.
  37. F. Fleuret, J. Berclaz, R. Lengagne and P. Fua. Multi-Camera People Tracking with a Probabilistic Occupancy Map. 2008. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 30, Nr. 2, pp. 267 - 282, February.
  38. Chen-Chiung, Dung-Hua Lion, David Lee. A Real Time Hand Gesture Recognition System Using Motion History Image. 2010. 2nd International Conference on Signal Processing Systems (ICSPS).
  39. Hardy Francke, Javier Ruiz-del-Solar and Rodrigo Verschae. Real-time Hand Gesture Detection and Recognition using Boosted Classifiers and Active Learning.2007. Advances in image and video Technology, vol. 4872, pp. 533-547.
  40. Hong Duan, Yang Luo. A Algorithm for Static Gesture recognition Using combination of object features. 2013. Proceedings of the 2nd International Conference on Computer Science and Electronics Engineering (ICCSEE 2013).
  41. Pujan Ziaie, Alois Knoll, An invariant-based approach to static Hand-Gesture Recognition. 2008. 18th International Conference on Artificial Reality and Telexistence, ICAT2008.
Index Terms

Computer Science
Information Sciences

Keywords

Gesture Recognition Computer Vision histogram segmentation open-palm Fist.