Abstract: How to achieve the style transfer of figure paintings and maintain the harmony structure of body and consistency of face recognition at the same time, is a difficult problem in the style transfer of the figure paintings at present. For this purpose, the Yunnan heavy color painting is chosen as the target style to carry out the research of the style transfer of paintings with fine texture and figure paintings. Aimed at the aesthetic feeling of slender body of heavy color painting, the human body image restoring is put forward to reshaping the character in the image. To keep body structure and fine texture of the heavy color paintings, the technique of combining style transfer based on semantics and image analogy is proposed, and the regularization term of structure maintaining is added into loss function. For the distinct line in the heavy color painting, the image smoothing method via L0 gradient minimization, the anisotropic DoG(difference of Gaussians) filter and the gap detection are combined to extract the smooth and coherent line drawing from content images to enhance the line sense. This paper uses this algorithm to transfer the style of heavy color painting, the result shows the aesthetic of character body slender and the fine texture features and the sharp lines of heavy color painting.