Selection travels up the stack if you don't exit sub-object mode (vert, poly, ect...) first and click another modifier in the stack. Either select everything or exit sub-object mode before switching modifiers. I use 1,2,3,4,5 to switch modes, press your current mode again and it exits or press 6 to exit any sub-object…