In this study, Illumina Miseq sequencing technology was used to determine the diversity and community structure of arbuscular mycorrhizal (AM) fungi in the rhizosphere of Ophiopogon japonicus in both cultivated and wild habitats, and the correlation analysis was carried out in combination with soil physical and chemical factors, in order to clarify the distribution characteristics of AM fungi in the rhizosphere soil of O. japonicus in the two habitats and the distribution characteristics of dominant communities, explore the driving factors of the differences in the distribution of AM fungi communities, and provide theoretical basis and technical support for the application of AM fungi in the production of O. japonicus. The results showed that: (1) 10 species of AM fungi were identified from the rhizosphere soil of O. japonicus in different habitats. Among them, 7 species of AM fungi were identified from the rhizosphere soil of wild O. japonicus in 3 genera, belonging to the genera Acaulospora, Diversispora, and Glomus, respectively. 1 genus and 6 species of AM fungi were identified under the cultivation environment, belonging to the genus Glomus, and the dominant genus in both habitat were Glomus. (2) There were significant differences between the AM fungi in the rhizosphere of O. japonicus in different habitats. The AM fungi diversity index of the rhizosphere soil of O. japonicus in the wild habitat, ACE and Shannon, were both greater than those in the artificial habitat, while the Simpson index was the opposite. (3) Correlation analysis shows that AM fungal diversity index and community structure related to soil physical and chemical factors. Among them, total potassium (TK), total phosphorus (TP), and total nitrogen (TN) contributed to the differentiation of the AM fungal diversity index and community structure under different habitats. This study demonstrated that there are significant differences in the rhizosphere AM fungal community of O. japonicus in different habitats. Glomus is the key genus of O. japonicus mutually beneficial symbiosis. TK, TP and TN are the main driving factors for the differences in the rhizosphere AM fungal community of O. japonicus in different habitats.