Deep learning, as a multilayer neural network structure for deep learning of data features, can describe the nonlinear mapping relationship for the assessment of college civic education. Aiming at the current education quality assessment model based on deep learning, this paper proposes an optimized convolutional neural network (HOA-CNN) based on Hummingbird Optimization Algorithm to assess the quality of Civic and Political Education in colleges and universities. According to the correlation coefficient between the objective assessment results and the subjective assessment results, the objective assessment results of the quality of Civic and Political Education in colleges and universities are obtained. The test results show that the linear correlation coefficient and the rank correlation coefficient between the assessment results of this method and the subjective assessment results are closer to 1. The goodness-of-fit of the assessment of the quality of college civic education under the model of this paper is significantly higher than that of the two control models. The simulation test results show that the assessment results of the university civic education quality assessment model constructed by the optimized convolutional neural network based on the hummingbird optimization algorithm are more accurate.