Oh I remember something about this, I think it might be because your unwrap isn't horizontal, so the mirrored version will get the wrong informations. Try look up mirror normals, apparently there is something about only mirror horizontal, and not vertical. I might be blowing smoke out of my cloak, but maybe just do a quick…