As far as I know you can always delete verts, including borders.. But don't delete whole faces by deleting verts, always do that in face mode otherwise you might end up with "invisible" faces hidden in the border edges. Make sure you only have one vert selected when deleting, sometimes trying to delete multiple won't work…