Yes, the worm would explain a lot. And when he went to college, the "gentleman's C" was still an acceptable grade. And it was especially acceptable for the children of the rich. Mostly the male children of the rich. The girls had a greater sense of responsibility.
Don't forget that RFK Jr was also a heroin addict while at Harvard.