Everything has a performance cost. Rather than worry about the performance cost of X, its more important to weigh the cost of X vs. Y, multiplied by time.
In the upper left hand corner under paint there's an "X" icon for the color swatches. Right click on it and the "X" should go away and you'll have re-enabled color.