That sounds fun. The downside might be anything about the realistic env that's not 100% realistic VS not stylized about the stylized version would clearly standout more. However, if you nailed the execution it wouldn't be a problem.
So, I've got this idea for my next series of projects... I want to make two environments, one realistic, one very stylized. But, they are both based off the same real world source and reference. So, yeah... is this a stupid idea? Either way I'm going to definitely going to go ahead make the realistic environment as my next…