Look to the past...
Dr. Mudd attended to John Wilkes Booth. Once the public got wind of that, a series of steps locked up Dr. Mudd in the Tortuga prison in a small cell. The saying "Your name is Mudd" came from that episode... and is still with us today.
Bernie Madoff ( "made-off" with everyone's money ) may very well have bested Ponzi in notariety as time marches forward. Though it is a Ponzi scheme, it yields a "made-off" for the main player. How appropriate that Bernie carried that last name. Frankly, I'll always think of it that way.
And, like the saying that haunts the Mudd family, a saying might surface that will haunt the Madoff family. Regardless, it's that public perception that keeps them in prison.
There's more to the Mudd story than his imprisonment, but it's too detailed to put here (and I've forgotten most of the details!)