Aboveground-belowground interactions exert critical controls on the composition and function of terrestrial ecosystems, yet the fundamental relationships between plant diversity and soil microbial diversity remain elusive. Theory predicts predominantly positive associations but tests within single sites have shown variable relationships, and associations between plant and microbial diversity across broad spatial scales remain largely unexplored. We compared the diversity of plant, bacterial, archaeal and fungal communities in one hundred and forty-five 1m(2) plots across 25 temperate grassland sites from four continents. Across sites, the plant alpha diversity patterns were poorly related to those observed for any soil microbial group. However, plant beta diversity (compositional dissimilarity between sites) was significantly correlated with the beta diversity of bacterial and fungal communities, even after controlling for environmental factors. Thus, across a global range of temperate grasslands, plant diversity can predict patterns in the composition of soil microbial communities, but not patterns in alpha diversity.