Dress metaphor is a very important way of expression in the novel text of Ming Dynasty, and the recognition and interpretation of the metaphor play a very important role in really understanding the novel text. This paper proposes a dress metaphor recognition model based on Transformer and graph convolutional neural network, and a dress metaphor interpretation method based on Seq2seq framework. The apparel metaphor recognition model performs feature extraction of global and local information of apparel metaphor sentences by Transformer. Graph Convolutional Neural Network is utilized to obtain syntactic structure information and sentence dependencies, in order to complete multi-word dress metaphor recognition. Then the obtained deep metaphor features and syntactic structure information of the sentence are input to the classification layer. The metaphor decoding method carries out costume metaphor understanding through the encoder-decoder, which chooses the LSTM network structure for both encoder and decoder to better obtain the semantic features of the novel text. The dress metaphor recognition model improved the recognition correctness on the dataset by 17.97% and 7.28%. The dress metaphor interpretation method based on the Seq2seq framework elaborates the interpretation content and can more accurately interpret the dress metaphors in Ming Dynasty novels. It verifies the practicality of the metaphor recognition and interpretation model in this paper in the task of interpreting dress metaphors in Ming Dynasty novel texts.