In this study, based on the data of precipitation and soil type, digital elevation model (DEM), and vegetation coverage index (NDVI) of the Shanxi section of the Yellow River Basin from 2000 to 2020, the characteristics of rainfall erosivity (R), soil erodibility (K), terrain factors (D), vegetation coverage factors (C) and soil and water conservation measure factors (P) were analyzed, the temporal and spatial distribution pattern of soil erosion were studied with the Revised Universal Soil Loss Equation (RUSLE), the location characteristics were identified for the high erosion intensity areas; and the main factors of the distribution pattern of soil erosion intensity and coupling relationships between the factors were quantitatively explored by using the geographical detector model. The results showed that: 1) During 2000—2020, soil erosion in the study area showed a weakening trend, which declined from 31.29 t/(hm²·a) in 2000 to 25.67 t/(hm²·a) in 2020, and showed spatial differentiation characteristics of weak in the southeast and strong in the northwest; 2) Cultural vegetation was the main vegetation type affecting soil erosion. The land use/cover type of grassland or unused land, the altitude of 629-932 m, the slope of 5°-8°, and the vegetation coverage of 30%-45% were the main sources of soil erosion; 3) Among the multiple factors for the formation of soil erosion patterns, vegetation coverage always played a leading role; the interaction and synergy between two factors manifested as double-factor enhancement or nonlinear enhancement, with vegetation coverage and slope having the largest interaction. Therefore, when carrying out soil erosion prevention and ecological protection and restoration in the study area, priority should be given to areas with vegetation coverage of 30%-45% and slopes of 5°-8°.