Abstract: Stereo matching is used to recover the depth of scene through computing disparity between matching pixels in the same scene under different viewpoints.A dual segmentation based stereo matching algorithm is presented by improving the traditional approaches.Firstly, it is to undersegment the reference image so that each region in the image contains sufficient cues for plane fitting.Secondly, it is to segment the initial disparity map for detecting and re-segmenting those undersegmented regions in reference image, and the processed results are plane fitted.Finally, to minimize processing time, only invalid regions are iteratively optimized by an inter-regional cooperative procedure.The experimental results on Middlebury test set show that our proposed algorithm achieves higher matching accuracy with less time than other well-established segmentation algorithms.