Bacteria and fungi are of uttermost importance in determining environmental and host functioning. Despite close interactions between animals, plants, their associated microbiomes, and the environment they inhabit, the distribution and role of bacteria and especially fungi across host and environments as well as the cross‐habitat determinants of their community compositions remain little investigated. Using a uniquely broad global dataset of 13,483 metagenomes, we analyzed the microbiome structure and function of 25 host‐associated and environmental habitats, focusing on potential interactions between bacteria and fungi. We found that the metagenomic relative abundance ratio of bacteria‐to‐fungi is a distinctive microbial feature of habitats. Compared to fungi, the cross‐habitat distribution pattern of bacteria was more strongly driven by habitat type. Fungal diversity was depleted in host‐associated communities compared with those in the environment, particularly terrestrial habitats, whereas this diversity pattern was less pronounced for bacteria. The relative gene functional potential of bacteria or fungi reflected their diversity patterns and appeared to depend on a balance between substrate availability and biotic interactions. Alongside helping to identify hotspots and sources of microbial diversity, our study provides support for differences in assembly patterns and processes between bacterial and fungal communities across different habitats.