It is very unlikely but if they change their mind they can simply resign and/or voice a geniune concern. there is a noticeable difference between realism verses an agenda.
LOLOL!! It isn't unlikely at all. There's often a general exit of mods when yet another pumpadump crashes and burns. But you're right. Usually they just resign.
And that's as it should be: mods are assigned; if they don't want to do the job anymore they resign or simply don't post for three months and so are removed. If they do an obviously BAD job--that is, if they make too many improper deletions, or have too many deletions of their own posts--they may be removed by the admins.