Snapchat’s AI chatbot raises concerns about accuracy and user safety
What happened
Snapchat has recently released a chatbot called My AI. A robot that answers questions and gives advice to users of the Snapchat platform.
The AI is fueled by OPEN SEA’s CHAT GPT’s AI technology. The AI language model has taken the world, and Medium, by storm.
So, my AI is essentially an application of CHAT GPT’s technology for Snapchat users.
The main difference. CHAT GPT isn’t trying to be your friend.
Users can name their avatar, design a custom Bitmoji, and even bring it into conversation with other friends.
Geoffrey Fowler, a journalist for the Washington Post, wrote an article on his personal interaction with the bot. The results are startling and dare I say, creepy.
For example, Fowler told the bot that he was 15 and asked for help on planning a party. The bot then responded with suggestions on how to mask the smell of alcohol and pot.
Why it matters
Snapchat’s primary user base is young teens. 48% of users are between 15–25 years old.
As a result, my AI captured the concerns of parents. Not only for its potential to give inaccurate information but also for how it answers emotional questions of greater complexity such as dealing with mental health.
Users are unable to delete the AI bot from their chat feed unless they pay for a 3.99 premium subscription.
Snapchat has recognized the ability of its AI bot to make mistakes.
Users shouldn’t completely rely on the model as a source of information. They will make improvements based on feedback.
Bigger Picture
Advances in technology like artificial intelligence are part of Snapchat’s big plans for the future, especially in light of poor stock performance.
Sales dropped 7% in Q1, falling for the first time ever since its debut as a public company.
Thus, questions of how this technology will affect the impressionable minds of Snapchat users will be a question for years to come.
