Couldn't agree with you more.There's always been a fairly decent amount people running around at the low levels; mostly new players trying out the game. In my experience, however, very few of them always level at a decent rate and thus reach the endgame. Some of them fail to reach the level cap altogether and quit.
With that said, I don't really think Withy'll be going away any time soon. I do think that it will have a dry spell for a while, as it has many times in the past, but the server always manages to rebound. By the time it does, I think the endgame community here will look quite a bit different than it has for the past year or so.
I'm not ashamed of leaving the server myself, simply because I was here since the beginning, and stuck it out with my kinship for as long as we possibly could. I think though that the biggest mistake I made was becoming a bit too isolationist, as opposed to trying to help out the server in the same way that Spicy and I both did when the server was still young. I think that Withy can indeed survive..the community just needs to stop being fragmented and work together a bit more for that to happen. So all this arguing on the forums and all the tension it causes, be it both in PvE and in the Ettens, really doesn't help. As cheesy as it sounds, I think people just need to work together, and get past their differences for the better of the entire community here.
That also means stop giving attention to a certain champion and just ignore him until he fades into the obscurity that he deserves.