Abstract

BEN JMAA, Ahmed; MAHDI, Walid; BEN JEMAA, Yousra  and  BEN HAMADOU, Abdelmajid. A New Approach For Hand Gestures Recognition Based on Depth Map Captured by RGB-D Camera. Comp. y Sist. [online]. 2016, vol.20, n.4, pp.709-721. ISSN 2007-9737.  https://doi.org/10.13053/cys-20-4-2390.

This paper introduces a new approach for hand gesture recognition based on depth Map captured by an RGB-D Kinect camera. Although this camera provides two types of information "Depth Map" and "RGB Image", only the depth data information is used to analyze and recognize the hand gestures. Given the complexity of this task, a new method based on edge detection is proposed to eliminate the noise and segment the hand. Moreover, new descriptors are introduce to model the hand gesture. These features are invariant to scale, rotation and translation. Our approach is applied on French sign language alphabet to show its effectiveness and evaluate the robustness of the proposed descriptors. The experimental results clearly show that the proposed system is very satisfactory as it to recognizes the French alphabet sign with an accuracy of more than 93%. Our approach is also applied to a public dataset in order to be compared in the existing studies. The results prove that our system can outperform previous methods using the same dataset.

Keywords : Sign Language (SL); Kinect camera; Depth sensor; Hand gesture recognition.

        · text in English     · English ( pdf )