That's correct. Sorta. You can't really "dispose" of them. If you click the "Remove" link, it moves them to the archive. They're not in your MailBox anymore.
If you've hit the Keep link on any messages, those aren't counted toward your MailBox count. I think.