This research aims to explore the interaction design method of mobile museum in panoramic virtual display from the perspective of knowledge visualization theory. The methods include three steps. Firstly, the research summarized the status of mobile museum, and investigated the theory and practice of knowledge visualization. Secondly, this research analyzed the problems and characteristics of mobile museum in panoramic virtual display from the perspective of knowledge visualization theory, and proposed the opportunity and importance to do so. Finally, this research constructed interaction design methods of mobile museum in panoramic virtual display based on knowledge visualization theory by combining the previous research. In addition, this research demonstrated that knowledge visualization theory is important to make users accessible to efficient mobile interaction and learning. The results of this research proposed an integrated interaction design method of mobile museum in panoramic virtual display, which include four levels structure design of knowledge interaction from data, structure, interaction and user, and three directions design principles from visualization of knowledge characteristics, visualization of cognition processes, and visualization of graphic nature. It provides reference of theory and practice with related-researchers and related-designers.