In order to improve the service function of the urban green space ecosystem and promote the sustainable development of the city, this study explored the distribution characteristics of physicochemical properties and microbial biomass in the surface soils of green lands in different functional areas in Nanjing, China. In general, the soils of these three green lands were all alkaline and the values of soil bulk density were all very high. Importantly, compared to roadside tree-soils, the contents of soil total nitrogen, available phosphorus and available potassium were significantly higher in the park green land. In addition, although there was no significant difference in the content of organic matter among the three green lands, soil microbial biomass carbon and microbial quotient in park green land were significantly higher than other two types of green land use. These results indicated that the soil structure and nutrients in park green land were better than roadside trees land. Furthermore, correlation analysis showed that soil microbial biomass carbon was significantly positively correlated with soil organic matter, total nitrogen and available potassium. Also, there was a significant positive correlation with available phosphorus, and a significant negative correlation with soil bulk density. Soil organic matter was significantly positively correlated with soil total nitrogen and available potassium, negatively correlated to soil bulk density and not correlated to available phosphorus and soil pH. Therefore, loosening the soil frequently, applying appropriate fertilizers, increasing the mulching of greenery wastes and improving soil conservation management level would play positive roles in restoring the soil ecology and urban ecological construction.