Reflection problems inside TF2 with different angles!

Hey everyone!

Ran into another problem while previewing my hat in Team Fortress 2. I noticed that the reflection of the hat is really bright and becomes white in different angles?

I thought it was because of the alpha, but disabling it made no difference eaither! So I thought it was the Ambient Occlusion map, but since it is baked inside the diffuse and shadow and highlights, it cant be that eaither!

So, what is causing this and how do I make the material more "matte" as the rest of the clothes?

This is how it looks inside Blender:



This is how it looks inside Team Fortress 2 in two different angles:



I even checked if it had anything to do with materials inside Blender, but it does not! So, what can it be and how do I fix it?

Thanks in advance!