Is the floor a one sided plane , or does it have some thickness? If it doesn't have, have you tried it with a mesh that has thickness? You could just slap a box there for testing, rebake, and see if the error is gone. If it is, just add some thickness to the floor mesh.