yes it gets very complex the deeper you dig into it. For simplicity purposes yes you need a wallet. If you buy them on an exchange you could keep it in their hands, but i would not trust that.
Also make sure to put a good password on your wallet and consider additional steps here: