This paper constructs a comprehensive evaluation system based on the CIPP model, covering multiple dimensions such as input evaluation and outcome evaluation, in order to comprehensively measure the effect of college students’ mental health education in the new media environment. In terms of weight determination, the subjective weights are obtained by hierarchical analysis method, then the objective weights of each index are calculated by entropy value method based on the actual data, and then the combination assignment method is used to organically combine the subjective and objective weights to obtain the ϐinal indexes. The relationship matrix was constructed on the basis of a large amount of collected data, and the fuzzy comprehensive evaluation method was used to comprehensively assess the implementation effect of college students’ mental health education. The results of the study show that the overall level of the effect of college students’ mental health education is good, with the ratings of 79.54 and 78.28 for their mental health knowledge and ideological awareness evaluation, respectively, and that the mastery of mental health methodology and the awareness of proactively seeking psychological help are the main factors affecting the mental health of college students. In addition, the mastery level of college students’ mental health practice ability is average (69.52), and there is an obvious deϐiciency in their theory to practice, which also adds difϐiculty to the construction of college students’ mental health. Therefore, the fuzzy comprehensive evaluation method can be used to optimize the evaluation system of college students’ mental health education in the new media environment.