Running a league of any scale is a huge task. If things don't work as they should, you will be blamed for it. If things go well, shitheads looking in from the outside (like myself) will always know a quick simple solution that would fix that one problem that would make the league even better disregarding the other issues it would create.

It's not a thankful job to have, and I commend you for having taking it upon yourself. You deserve the newly found free-time you will find yourself having from stepping down. Good luck in the future.