Research on Multi-Label Legal Text Categorization Methods Based on Large Predicate Models

In this paper, the embedding vectors are obtained by Bert coding, and then the obtained embedding vectors are adaptively fused with features to realize legal text classification by a classifier, on the basis of which a multi-label text classification model (AFDAM) is proposed to capture the target words in a sentence. At the same time, the pre-trained continuous bag-of-words representation (CBOW) is used to initialize the vector representation of the label information, and then these label information is adaptively fused with the feature information of the text, which effectively promotes the multi-label legal text classification, and accelerates the development of informationization and intelligence in the legal field. The results show that the text feature enhancement module has the most prominent impact on the text classification effect, and its accuracy on the three datasets is improved by 0.46%-1.19%. In addition, the introduction of target vectors and text expansion also gained 0.54%-1.7% and 0.59%-1.53% and 1.08% increases in model accuracy, respectively. In addition, the addition of offense and statute information can significantly improve the prediction of sentence length, and the statute information improves the results more significantly than the offense information. And the classification effect of the AFDAM model proposed in this paper increased by 0.1453-0.257 than the other five models.