Abstract: In order to solve the problems of vision-based hand pose estimation in human-computer interactive of virtual operations, this paper proposed a key point model for pose estimation based on Leap Motion. With the information obtained from Leap Motion, the proposed model calculated the positions of the key points as the parameters of hand pose. Our experiments showed that this estimation method could obtain the positions of key points in real time to drive virtual hands in virtual operation interactive based on hand gestures.