Yeah Unity's texture packing method is really dumb. If you have a 32 bit image, you're using the same VMEM as 2 24 bit images (assuming you have compression enabled), which means you could use a full color specular map, and a RGB map packed with gloss, AO, and a 3rd map (height? alpha? emissive?) for the same cost.