You've put to rest that he's never said that to you. But have you asked him if he's said that to investors at the grand opening?
I think it's that specific instance that most people are up-in-arms about. More than likely, he's learned from that time and doesn't do that anymore(at least if he's as smart as he's touted to be).