The paper use the indicator of self- rated health as a measure of the health of the elderly,,utilize the data of China Health and Retirement Longitudinal Study (CHARLS), and adopt correlation analysis and ordered Logit regression model to analyze the influential factors of self-rated health of the elderly, and to discuss the differences of influential factors on self-rated health of the elderly in different qualifications from the four dimensions of sex, age,registered permanent residence, and marital status in socio-demographic factors. Studies have shown that : socio-demographic factors, lifestyle, physical health and mental health are significant for the influence of self- rated health. Research on the differences of influential factors find that there are big differences for influential factors under different qualification, and only ADL is the common significant factor. Therefore, when formulating programs to improve the health of the elderly,we should adopt diversified strategies for different groups, in this way can we improve the life quality of the elderly and achieve healthy aging.