Abstract: In order to improve the effect of the color image retrieval,a new algorithm is proposed based on FourierMellin moments,phase congruent and gradient magnitude in this paper.This method aims to extract phase congruent,gradient magnitude of an image smoothed with Hilbert transform,and Fourier-Mellin moments,which not only can fill up an efficiency of the contrast invariant of phase congruent,but also can fully utilize the rotation invariant of Fourier-Mellin moments.The retrieval experiments are conducted in three color databases to test the performance of our method.The experiments show that our method in this paper is more efficient comparing to traditional methods.