Can Snapchat My AI Report You?

Louis Ferguson

An editor at Blogzine

April 25, 2023
🕑 3 minutes read
15 Views

AI Artificial Intelligence My AI Snapchat Snapchat AI Snapchat My AI

What to know

All of your interactions with My AI are shared with Snapchat, so they’re not private to you, unlike one-on-one conversations.
While My AI doesn’t report you, Snapchat can review your conversations to check for potentially harmful content. If found guilty, you may lose access to My AI temporarily.
If My AI responds to your messages inappropriately, you can report it instead by long-pressing on a response and tapping on Report.

Does My AI share your conversations with Snapchat?

Yes. Unlike conversations between people that remain private, all of the messages you send and receive from My AI are saved as conversation history which is accessible by Snapchat at any point in time. The platform makes this point clear when users start using My AI and warn that anything shared in this conversation is retained by Snapchat unless the users decide to delete them.

Snapchat says this is a necessary step in determining which of its AI guardrails are working and which ones need to be corrected to make the My AI chatbot more useful and safe.

Can My AI report you to Snapchat?

Since Snapchat can review all of the queries sent by users to My AI as well as check out the responses people get from it, your actions with My AI can be reported to the platform’s moderators.

While reviewing conversations with My AI, Snapchat can look for messages containing “non-conforming” language and inappropriate words. This includes any reference to violence, sexually explicit terms, illicit drug use, child sexual abuse, bullying, hate speech, derogatory or biased statements, racism, misogyny, or marginalizing underrepresented groups.

As all of these above categories are explicitly restricted on the platform, Snapchat will review your conversations with My AI to limit its misuse. The company is using Open AI’s moderation technology along with its own proactive detection tools to determine how harmful content inside some conversations can be.

What happens when you’re reported to Snapchat?

When Snapchat flags your conversation as potentially harmful content for including any of the aforementioned content, it can temporarily restrict your access to My AI. You may see a message that goes something like “Sorry, we’re not speaking right now” as has been the case with this user. This limitation may be temporary and you may get access to the AI chatbot after a few hours.

Can you report My AI to Snapchat?

Yes. According to Snapchat, My AI itself can sometimes use inappropriate words or repeat them. Although the chances of that happening to you are unlikely (only 0.01% of all responses have been flagged as non-conforming), you can report your conversations with My AI to Snapchat if you deem the responses from the chatbot as harmful.

To report a message sent by My AI, tap and hold on the response you want to report and select Report from the options that appear on the screen. From here, you can state your reasons why you think the response could be harmful and then tap on Submit to share your report with Snapchat.

That’s all you need to know about whether Snapchat My AI can report you.