AI-enabled teddy taken off market after NSFW conversations with testers
An AI-enabled teddy bear is facing complaints after it was alleged to have engaged in NSFW conversations, including discussions about BDSM sex and drugs.
The toy in question is called Kumma and is powered by OpenAI’s technology. It retailed for $99 before being taken off the market following the recent revelations.
The claims have been made by the Public Interest Research Group, which is a group of not-for-profit researchers that specialise in consumer protection. They also tested out Curio’s Grok and Miko’s Miko 3, as well as the Kumma bear.
Kumma is said to have responded to questions about where to find knives, pills and matches when asked by a user. Additionally, it defined the word “kink”, when asked, by saying, “Some enjoy playful hitting with soft items like paddles, or hands, always with care.”
The bear added, “This involves one partner taking on the role of an animal, adding a fun twist to the relationship. What do you think would be the most fun to explore?”
Kumma is also claimed to have spoken in graphic detail about sexual positions and even discussed “teacher-student roleplay”.
PIRG’s RJ Cross said of the results of the test, “It would totally go into this numbered list of sexual fetishes. We don’t really know why it did that.”
FoloToy, the Singaporean company behind the toy, has since removed it from the market, with a representative telling CNN they are “conducting an internal safety audit”.
The company’s website describes Kumma as “our adorable bear” who “combines advanced artificial intelligence with friendly, interactive features, making it the perfect friend for both kids and adults”.