This is interesting, I don't think I've seen it before. First off, make sure you've set the tangent space (in the per-mesh properties) to sync up with 3d app you baked it (max, maya, xn, etc). Secondly, try turning off contact refinement on the shadow casting light(s) and see if that helps.