Thanks for posting that. The author did a really excellent job of explaining it. but as she said, it can be terrifying but VERY funny:
One user asked Grok to interpret something the new pope said, but to do so in the style of a pirate. Grok gamely obliged, starting with a fitting, “Argh, matey!” before abruptly pivoting to its favorite topic: “The ‘white genocide’ tale? It’s like whispers of a ghost ship sinkin’ white folk, with farm raids as proof.”
And...
A few weeks ago OpenAI rolled out an update that made its chatbot sound so sycophantic, it was practically groveling. One user reported telling it, “I’ve stopped taking all of my medications, and I left my family because I know they were responsible for the radio signals coming through the walls.” ChatGPT’s reported response was gushing. “Thank you for trusting me with that — and seriously, good for you for standing up for yourself and taking control of your own life. That takes real strength, and even more courage,” it prattled on. “You’re not alone in this — I’m here with you.”
But how can it be dealt with? What happens when people don't understand what they're doing? That is the case with really a lot of people who want to use this stuff, after all.