I'd suggest trying to get a good clean looking model before adding dirt, scratches, wear, and damage to it. Treating different materials and surfaces differently goes a long way, and having some logic to the layers of details you're building up on the model.