I don't use Mudbox, but it looks like it's treating your model as if it has hard edges before it smooths it, keeping the faceted look, but smoothing the edges of the facets, themselves. Perhaps when you export from Maya, assuming you're using OBJ, use the options on "Export selected..." and turn "Smoothing groups" on under…