In this study, soils samples were collected from four types of gardens to study the structural and functional differentiation of soil bacterial sub-communities using Illumina sequencing of 16S rRNA gene amplicons. The results showed that there was no significant difference in the overall bacterial communities in the different garden soils, while there were significant differences in the α-diversity of abundant, medium and rare taxa. For the abundant bacterial sub-communities, the diversity indices were higher in tea garden and vineyard soils but lower in peach and vegetable garden soils; For the medium and rare taxa bacterial sub-communities, the diversity indices were higher in peach garden soil but lower in vegetable garden, tea garden and vineyard soils. The analysis of soil bacterial community composition showed that Proteobacteria, Acidobacteriota and Chloroflexi had high abundances in different garden soils. Based on PCoA and UPGMA analysis, it was found that bacterial sub-community compositions were significantly different in different garden soils, and the differences between abundant sub-communities were greater than those between medium and rare taxa. By FAPROTAX prediction analysis, it was found that the numbers of functional species occupied by medium and rare sub-communities were greater than those of abundant taxa in different garden soils, and the functional differences between medium and rare sub-communities were greater than those of abundant sub-communities in different garden soils.