That's true, and a very good point to remember. For example, many celebrities have "handlers" that act as a "spokesperson" for that individual. Other times, there are security breaches.
But, I tend to think Matt would know if someone was using his email address illegally.