Fragrance and color are closely related to emotion. Color strongly affects the use feeling and experience of fragrance products. Based on synesthesia experiment, the corresponding hue and kansei image of fragrance can be obtained, which is convenient for constructing color network to assist the color design of fragrance products. On the basis of in-depth research on Chinese traditional fragrance, several representative fragrances were selected as research materials. Firstly, the fragrance-color synesthesia experiment was performed to get the corresponding hue, emotional relationship, and kansei image of fragrance. Secondly, based on the results of previous experiment, natural images were selected to adjust color details and build fragrance-color image database. Finally, colors were extracted from image database and color network model was built to obtain the corresponding advocate complementary color and the color relationship of fragrance, which were applied in Chinese traditional fragrance product color scheme and packaging design. The corresponding colors of fragrances obtained from the synesthesia experiment by the emotional correlation between olfactory and color vision are harmonious and natural, and the kansei image obtained is vivid and clear. The application of these colors and kansei image in the design of Chinese traditional fragrance products can arouse users' emotional resonance and bring a better use experience.