Using digital back camera to complete the traditional national costume image acquisition work, and then with the help of VOLO model to segment and colorize the image, the traditional national costume elements were successfully extracted. By fusing them with smart wearable devices, a detailed fusion implementation scheme is developed, which contains constraints and objective functions. In the context of numerical computation optimization, the fruit ϐly algorithm (FAO) is used to explore the fusion design scheme of the two in depth. The values of the four objective factors of the fusion design are 0.233, 0.232, 0.348, 0.144, and the ϐinal value of the objective function is 0.957, which indicates that the results of this paper not only can improve the comfort of the device and the user’s experience, but also can provide a new idea and method for the fusion of the apparel industry and the wearable device industry.