The work aims to explore the perceptual image factors and innovative derivative design of Zhuang brocade patterns in Guangxi, and enhance the plasticity of Zhuang brocade patterns in fashion design. Twelve typical Zhuang brocade flower and bird patterns were collected, selected and screened, and experimental samples were established by computer aided drawing. KJ analysis was used to obtain 8 pairs of perceptual image words, and a five-level Ricke scale was set up to conduct perceptual image evaluation experiments in combination with questionnaire survey. The experimental data were imported into SPSS software for cluster analysis, and three common factors of Zhuang brocade flower and bird patterns under the user's perceptual demand were obtained, namely, visual effect factor, modeling expression factor and style implication factor. The shape grammar was used to decompose the motif and deduce the shape of the pattern that ranked first in the user's favorite. Combined with the 2024PANTONE spring fashion color, AIGC technology was applied to carry out color transfer, and 90 innovative patterns were selected for coding. The top four innovative patterns in the evaluation were used in derivative practice. Finally, the fuzzy comprehensive evaluation method was used to evaluate and analyze the design practice. The perceptual image feature words which were highly consistent with the flower and bird patterns of Zhuang brocade were taken as the text setting of the algorithm, and the pattern layout and popular color transfer after the shape grammar were superimposed to optimize the rule setting and method mode of generating innovative patterns in AIGC. In conclusion, the extraction of perceptual factors, shape grammar deduction and intelligent innovative design of flower and bird patterns of Zhuang brocade provide a certain experimental basis and reference significance for the application of traditional Zhuang brocade patterns in the field of modern design, and contribute to the inheritance and innovative development of Zhuang brocade patterns in the field of modern design.