Well, yes...........if you already traded homes with him, and, instead of filing for repossession you decided to talk him into selling your home back to you for a token price.......he, agrees, either in acknowledgement or to be rid of the problem, but, you decide that you don't even want to do that, you will just take it, contrary to your agreement. Your agreement that you went into with your eyes wide open.
This was not well done.