I really don't think that very many people can correctly match all fifty flags with their corresponding states. I don't even think that many could even name all fifty states correctly if they had a map in front of them.
You're going to have to bring a state flag book with you for the process of elimination.