It's not as bad as all that. Consider a World like a Character, build the bones and it fleshes out as you progress :3
I'd like to keep most of it under wraps but I'll point you towards my Comrade
and her characters, as well as a several of my own, including Baiulus.
Let's just say Willow Hilll Asylum was a Walk in the Daisies compared to what we have in the works for all of them