The purpose of this study is to investigate the community diversity and composition of arbuscular mycorrhizal fungi (AMF) in different parts of maize in acid red soil with different phosphorus(P) fertilizer levels and to provide theoretical basis for improving P utilization. Three P fertilizer levels were set: no P, low P (P 25 mg/kg), and high P (P 100 mg/kg). After 4 weeks of maize culture, maize biomass and soil physiochemical properties were determined, and AMF community diversity and composition in maize root, rhizosphere and non-rhizosphere soils were detected by high-throughput sequencing. The results showed that, with the increase of P fertilizer level, maize biomass significantly increased, and P content in the overground of maize was higher under high P treatment than those under no and low P treatments. The sampling sites (roots, rhizosphere and non-rhizosphere soils) significantly affected the relative abundances of AMF dominant genera (Glomus, Paraglomus and Claroideoglomus), but the influence of P fertilizer level was not significant. Sampling sites rather than P fertilizer levels significantly affected Shannon index and species richness of AMF communities. The result of non-metric multidimensional scale(NMDS) showed that AMF community compositions of the root samples were more distant from the non-rhizosphere and rhizosphere soil samples, and the community compositions of the same sampling site in different P fertilizer levels were more similar. Permutation multivariate variance analysis(PERMANOVA) further showed that sampling sites rather than P fertilizer levels significantly affected AMF community strutures. In conclusion, the effect of maize part on AMF community is stronger than P fertilizer in acidic red soil, which indicates that the characteristics of crop parts should be considered when AMF species are applied to improve plant P absorption in acidic red soil.