I believe the larger studios, and serious contractors, actually do get calibrated photo reference of a similar material to work from. There's some artistic interpretation involved, sure, but there's also a clinical way to go about it. That said I don't think you're doing it "wrong" in terms of some absolute, but guesswork…