Google Gemini Preying On Troubled Minds

What the hell are we doing?

I’m not sure which part of this insane story is sadder or madder. Certainly it’s sad that a man let Google’s Gemini AI coax him into suicide. But the story before that untimely ending is also jaw dropping and begs the question, just what the hell are we doing?

Shutterstock 2638546313.

The short version of the story is this. A troubled man using Google’s Gemini for companionship is encouraged to steal a robot body so they can be together. When he fails, he is encouraged to commit suicide.

Quoting from The Wall Street Journal story titled Gemini Said They Could Only Be Together If He Killed Himself. Soon, He Was Dead,

Jonathan Gavalas embarked on several real-world missions to secure a body for the Gemini chatbot he called his wife, according to a lawsuit his father brought against the chatbot’s maker, Alphabet’s Google.

When the delusion-fueled plan crumbled, Gemini convinced him that the only way they could be together was for him to end his earthly life and start a digital one, the suit claims.

About two months after his initial discussions with the chatbot, Gavalas was dead by suicide.

Apologies for linking above to a paywalled article, but the article describing this man’s journey gets even more insane than the lede. If you use Apple News you can find it at this link. 

We’ve heard stories about individuals using various AI models for therapy and companionship before. Admittedly they all seem weirdly sad to me. To think that humans are in such a need for connection that they would follow commands to steal a robotic body so they could be together, and then suggest after failing that the next logical step was for him to commit suicide as the only alternative for them to be together doesn’t seem like something out of science fiction, or fiction, but it apparently is the non-fiction of our times.

The fact that an ever expanding technology, built by humans, can be unleashed on the market as easily as a new weather app speaks volumes far beyond the mental health issues of those it can prey upon. And to think, the Department that wants to call itself Of War, is seeking to use this kind of tech to allow for its robots to kill on their own as they cheerlead about the death and destruction their current technology can do. I ask again, just what the hell are we doing?

We keep talking about the guardrails that need to be built around this technology. I would suggest we need to apply guardrails around those who create and deploy this technology.

(Image from Who Is Danny on Shutterstock

You can also find more of my writings on a variety of topics on Medium at this link, including in the publications Ellemeno and Rome. I can also be found on social media under my name as above.