Abstract: This paper put forward a framework for book recognition based on automatic location and segmentation,which includes the stage of book automatic location,ROI segmentation,standard shape correction,effective feature extraction and similarity matching.Automatic location and segmentation stage based on the geometric shape characteristic of book,takes effective regional orientation and ROI segmentation through the hough transform algorithm,and then correct the real book cover areas to a standard shape according to the inverse affine transformation.The stage of feature extraction and similarity matching mainly used the improved SIFT algorithm to conduct feature points detection and generate feature description,and then conduct the similarity matching by the popular BOW method which generates codebook and quantizes the features.The results of our experiments show that the accurate location and segmentation of the book cover from a image which contain some appropriate background and taking standard shape correction have a significant impact on the precision of recognition.