It was just how the concept art was when I found it, so I stuck with it. Thanks for the tip guys, I will smooth out some edges. Can anyone post a good example vs. a bad example of baked edges?
Ok, I guess I exported the high poly with normals and smoothing groups on before. Just exported it without either of those and the results came out much better. Next question is this is a 4k normal map and the mesh is 12.5k polys. Would this be acceptable in a modern day PS4 game, for example?