Correct.
But the idea is not to ban them for legit political and philosophical differences or for being stupid and annoying.. It is to ban them for spreading dangerous disinformation about vaccines, for example. Or for demeaning trans people or insisting elections were stolen or even, to a lesser degree, to be climate change deniers.. Even FB came to eventually realize that not all free speech is created equal.
If someone posts that vaccines are causing deaths, then simply refuting it with facts doesn't solve the problem. In my opinion, not that anyone's asked, the problem is that you've given them a platform to disseminate potentially harmful stuff, which can be taken to heart by less informed readers.
If someone is consistently being negative about the idea of trans people getting to live their lives as we live ours - which happens here on occasion - those people should be made to shut the fuck up. That's not free speech, that's hate speech.