That answer is "Yes" when you understand and properly fill out forms that show you are in fact NOT a "taxpayer". You have assumed you were because this is what you were told. And, you subsequently signed forms under penalty of perjury, however that was a incorrect understanding. This created a "presumption". Correct that and you set the record straight. After that, you can file for refunds on past years.
See here for refunds checks on formerly incorrectly filed taxes