um.. the script round corners is part of the mentalray A&D material. found under special effects. A good scene scale helps allot when using this feature.
Are you still having this problem? I posted a script a whileback that allows you to manually increase the memory mentalray gets to render with. it used to be a UI option prior to 2010 but they hid it in favor of an automatic method. http://www.robertfletcher.org/public_files/Scripts/set_memory_limit.ms It fixed the problem…
there are 2 ways to get the round corners. 1: roundcorners node in the bump slot of a standard mat. Its a hidden shader so the quickest way to get it is a script--Create a Standard Material with a round corners shadermat = standardMaterial()mat.bumpEnabled = onmat.bumpMapAmount = 100mat.bumpMap =…