I see your point, I think my problem is that I'm trying to use the normal map to compensate for low poly geometry, which is why it is struggling so much at certain angles. For instance, here is the low poly with a bit more detail (456 tris, vs 240 for the original), and it looks a lot better. I'm guessing that with smaller…