Yay for necro'ing threads. I don't feel like this question was answered and I have run into a similar problem. In my case one texture set is just the face, and even with it solo it tries to rotate it around the center point of the whole body. Makes for very awkward rotation especially on a small area. Is there a center on selection/piece button?
Replies