For PhongEnv you NEED to have a normal map. If you dont have a normal map, use PhongSimple instead, if you want diffuse + spec, but no normal, just created a 4x4 image of 127,127,255 and apply that as your normal map. Its likely doing wierd things because it is required to have something there.