Abstract: The stereo matching technology is the difficulty in the field of stereo vision, and using the features of image to solve the correspondence problem is the focus of research.The color image stereo matching algorithm based on the region color information and geometry information is designed.Its basic method is detecting the affine invariant regions based on edge firstly;then quantizing the color space of regions detected, clustering the color by the distance between two colors, and computing the square distance of color histogram to measure the similarity of the correspondence regions;finally, eliminating the error matching region by geometrical information of regions.The experiment result show the algorithm can reduce the complexity to solve the corresponding, and improve the correct match rate.The method is important to object recognition, 3D reconstruction and non-contact measurement research.