“My partner Charlie says there [are] only three ways a smart person can go broke: liquor, ladies and leverage,” the Oracle of Omaha said