You can bake everything if you want to, but you can also keep baking to absolute minimum (close to zero). Take a look at the environments in Alien Isolation or Ruiner for examples. Large modular pieces wouldn't be baked (like you said, walls, roads, etc), but made with higher res geometry (chamfers) and tileable textures -…