3. Joe Louis
The world heavyweight champion and World War II veteran amassed over $4 million during his boxing career, but sadly he wasn't able to retain it all. Near the end of his life, the "Brown Bomber" owed $100,000 in taxes and never got around to paying it off before he died in 1981.