As soon as you change any lowpoly smoothing groups, you have changed your vertex normals, which means if your normal-map is tangent space (which it probably will be), then it will no longer match, since the normals are basically offsets from the corresponding lowpoly normal. If you change smoothing groups at all, you will…