Yeah, the crux of the issue is that a normal map can fake shading, but it can't fake the actual geometry, which is used for shadowing. For best results, the normal map should be used to represent fine detail that doesn't affect the silhouette, while the primary forms should be represented in the low poly. Of course, you'll…