Tell him that if he wants to be warden, he needs to dedicate the required amount of time to serve the inmates properly.
Do you think you're in control of who is warden? Do you think it's wise for inmates to try to dictate to their keepers?
Fred has very clearly laid out the issues and what you need to accomplish to get out of jail. He offered a couple different solutions for you which you quickly rejected. If you don't like his solutions, come up with a style that works for you but remembering the key points he made.