For some reason, at least in my experiences and among my peers, we all agree that the drummer is like the Achilles tendon of the band: they seem to be the most difficult to acquire, keep, maintain, deal with, have the most gear, too loud, have the "easiest job" in the band, but are the biggest pain, etc. I don't mean to generalize or sound prejudiced, but that's been my road over the many years (almost 20) of playing in bands.
I know a few musician-friends of mine that have gone the one man band route, and they really love it.
I am sure it could maybe get lonely, but weather they are simply banging on a bass drum while strumming a guitar or bass, or they've engineered a whole multi-instrument getup, they are generally well-received, too.
If you really want to change things up, take a few months to learn how to sing, play guitar, and stomp out a beat with your feet. Be your own boss...