Matcaps are the materials used in Zbrush. You want to look into using litspheres for mudbox. You can make your own. As for enabling AO, go to Viewport Filters on the top right hand corner (Provided you're using 2012). There is AO, Cavity, Normal Map, Tonemapper, DoF, and Screen distance. As for lighting presets,…