Unless the homeowner files bankruptcy, the "forgiven loan" would be considered "income" by IRS - so those walk-aways would face sizable tax bills.