Age-related macular degeneration (AMD) is the most common cause of visual loss in the United States and is a growing public health problem. The presence and severity of AMD in current epidemiological studies is detected by the grading of color stereoscopic fundus photographs. The purpose of this study was to show that a mathematical technique, amplitude-modulation frequency modulation (AM-FM) can be used to generate multi-scale features for classifying pathological structures, such as drusen, on a retinal image. AM-FM features were calculated for N=120 40×40 regions from 5 retinal images presenting with age-related macular degeneration. The results show that with this technique, drusen can be differenced from normal retinal structures by more than three standard deviations using the AM-FM histograms. In addition, by using different color spaces highly accurate classification of structures of the retina is achieved. These results are the first step in the development of an automated AMD grading system. ©2009 IEEE.