Hand Part Labeling and Gesture Recognition from RGB-D Data

For depth sensor based hand gesture recognition, how to collect training data and built a gesture database with suitable size are challenging tasks.In this paper, we present a semi-automatic labeling scheme for establishing the real hand gesture dataset.A framework for developing hand gesture driven desktop applications is designed based on this scheme, which use RGB-D sensor as input.Moreover, a hand contour model is proposed to simplify the gesture matching process and reduce the computational complexity. The experimental evaluations and a demo application demonstrate the effectiveness of this framework.