Abstract: Based on the geometric features of models’ surface decoration, this paper presents a new interactive approach to assemble the fractured fragments. The fractured surfaces of these fragments have been severely damaged, which leads to great challenges to previous methods. First, the geometric structure of models’ surfaces is obtained by generating apparent ridges. Then, according to the continuity of geometric structure of models’ surface decoration, user can determine the adjacency relationship of the fragments and define the surface adjacency constraints. A region growing strategy is employed to find the correct location of surface adjacency constraint point, then the initial matching points are obtained at the center of this point. After that, the optimal matching points are selected by the line segment constraint. In order to complete the registration of matching models, a shape matching method is proposed to calculate the rigid motion. We present some successful uses of our framework on some fragments of the terracotta warriors.