Abstract: Aiming at the problem of low efficient registration without mutual information and accurate corresponding points of 3D fragments in the process of the registration for the 3D cultural relic’s fragments, this paper proposes registration optimization algorithm based on swarm intelligence. The algorithm determines the initial matching points with Hausdorff’s distance of curvature feature points. The optimal corresponding points in coarse registration are obtained by discrete chaotic bacterial colony chemo taxis algorithm and the optimal coordinate transform is estimated by chaotic bacterial colony chemo taxis algorithm. The new method improves the precision and efficiency of registration, and expands the scope of application of the registration algorithm. Classical examples of Terra-Cotta Warriors broken fragments show that the method is effective in registration of the 3D cultural relic’s fragments.