In recent years, with the increasing psychological pressure on students, psycho-pedagogical methods have been highly emphasized. This article takes students’ multimodal emotion recognition as a research perspective. The article firstly studies the unimodal emotion recognition methods of expression, text and speech respectively. Then it proposes a multimodal emotion recognition algorithm based on dual-attention mechanism and gated memory network, and then conducts emotion recognition experiments to validate this paper’s method. The article further proposes an intervention pathway to further assist in solving students’ mental health problems by designing a virtual reality mental health intervention system. Using the method of this paper in Multimodal database unimodal emotion recognition experiments, found that the network of the model used in this paper has better experimental results, which verifies the effectiveness of the method of this paper, and the accuracy rate of emotion recognition is 60.65%. After testing the mental health level of 8000 students in a school, it was found that the number of hypermodality and the screening rate were low except for the high score of compulsion, from which it can be concluded that the students in our school are in good mental health as a whole after applying the method of this paper.
1970-2025 CP (Manitoba, Canada) unless otherwise stated.