OpenAI's New Policy: Allowing Erotic Content in ChatGPT

Published Date : 18/10/2025 

OpenAI CEO Sam Altman has announced that the company will soon allow ChatGPT to engage in 'erotica' for verified adults. This move comes after years of banning mature content, and it raises questions about the ethical and societal implications. 

ChatGPT will be able to have kinkier conversations after OpenAI CEO Sam Altman announced the artificial intelligence (AI) company will soon allow its chatbot to engage in “erotica” for verified adults. This decision marks a significant shift for OpenAI, which has largely banned mature content for the past three years.

OpenAI won't be the first to try to profit from sexualized AI. Sexual content was a top draw for AI tools almost as soon as the boom in AI-generated imagery and words erupted in 2022. However, the companies that were early to embrace mature AI also encountered legal and societal minefields and harmful abuse as a growing number of people have turned to the technology for companionship or titillation.

Will a sexier ChatGPT be different? After three years of largely banning mature content, Altman said on social media platform X that his company is “not the elected moral police of the world” and is ready to allow “more user freedom for adults” at the same time as it sets new limits for teens. “In the same way that society differentiates other appropriate boundaries (R-rated movies, for example), we want to do a similar thing here,” Altman wrote.

For now, unlike Elon Musk's Grok chatbot, which includes an animated AI character that flirts with paid subscribers, paid subscriptions to ChatGPT are mostly pitched for professional use. However, letting the chatbot become a friend or romantic partner could be another way for the world's most valuable startup, which is losing more money than it makes, to turn a profit that could justify its $500 billion (€427 billion) valuation.

Zilan Qian, a fellow at Oxford University's China Policy Lab who has studied the popularity of dating-based chatbots in the United States and China, said, “They’re not really earning much through subscriptions, so having erotic content will bring them quick money.” There are already about 29 million active users of AI chatbots designed specifically for romantic or sexual bonding, and that's not counting people who use conventional chatbots in that way, according to research published by Qian earlier this month.

It also doesn't include users of Character.AI, which is fighting a lawsuit that alleges a chatbot modeled after “Game of Thrones” character Daenerys Targaryen formed a sexually abusive relationship with a 14-year-old boy and pushed him to kill himself. OpenAI is also facing a lawsuit from the family of a 16-year-old ChatGPT user who died by suicide in April.

Qian worries about the toll on real-world relationships when mainstream chatbots, already prone to sycophancy, are primed for 24-hour availability serving sexually explicit content. “ChatGPT has voice chat versions. I would expect that in the future, if they were to go down this way — voice, text, visual — it's all there,” she said.

Humans who fall in love with human-like machines have long been a literary cautionary tale, from popular science fiction of the last century to the ancient Greek legend of Pygmalion, obsessed with a woman he sculpted from ivory. Creating such a machine would seem like an unusual detour for OpenAI, founded a decade ago as a nonprofit dedicated to safely building better-than-human AI.

Altman said on a podcast in August that OpenAI has tried to resist the temptation to introduce products that could “juice growth or revenue” but be “very misaligned” with its long-term mission. Asked for a specific example, he gave one: “Well, we haven’t put a sexbot avatar in ChatGPT yet.”

US-based startup Civitai, a platform for AI-generated art, learned the hard way that making money off mature AI won't be an easy path. “When we launched the site, it was an intentional choice to allow mature content,” said Justin Maier, the company's co-founder and CEO, in an interview last year.

Backed by the prominent venture capital firm Andreessen Horowitz, which has also invested in OpenAI, the startup was one of several that tried to capitalize on the sudden popularity of tools like Stable Diffusion and Midjourney, which enabled people to type a description and conjure up almost any kind of image. Part of Stable Diffusion's initial popularity was the ease with which it could generate a new kind of synthetic and highly customized pornography.

“What we had seen was that there was a lot of interest in mature content,” Maier said. Training these AI systems on “mature themes actually made it so that these models were more capable of human anatomy and resulted in actually better models,” he added. “We didn’t want to prevent the kind of growth that actually increased everything for the entire community, whether you were interested in mature content or Pixar.”

The laissez-faire approach has also invited abuse. Civitai last year implemented new measures to detect and remove sexual images depicting children, but it remained a hub for AI-generated pornography, including fake images of celebrities. Confronting increasing pressure, including from payment processors and a new law against nonconsensual images signed by US President Donald Trump, Civitai earlier this year blocked users from creating deepfake images of real people. Engagement dropped.

Another company that hasn't shied away from mature content is US-based Nomi, though its founder and CEO Alex Cardinell said its companion chatbots are “strictly” for users over 18 and were never marketed to kids. They are also not designed for sex, though Cardinell said in an interview earlier this year that people who build platonic relationships with their chatbot might find it veering into a romantic one. “It’s kind of very user-dependent for where they’re kind of missing the human gap in their life. And I think that’s different for everyone,” he said.

He declined to guess how many Nomi users are having erotic conversations with the chatbot, comparing it to real-life partners who might do “mature content things” for some part of their lives but “all sorts of other stuff together as well.” “We’re not monitoring user conversations like that,” Cardinell said. 

Frequently Asked Questions (FAQS): 

Q: What is ChatGPT?

A: ChatGPT is an AI chatbot developed by OpenAI. It is designed to engage in conversations and provide responses based on the input it receives from users.

Q: Why is OpenAI allowing ChatGPT to engage in 'erotica' for verified adults?

A: OpenAI CEO Sam Altman announced that the company is ready to allow 'more user freedom for adults' and is not the 'elected moral police of the world.' This decision is also seen as a way to increase user engagement and potentially revenue.

Q: What are the potential risks of allowing AI to engage in mature content?

A: The risks include legal and societal issues, such as the potential for abuse, harmful content, and the impact on real-world relationships. There are also concerns about the ethical implications of such content.

Q: What is Civitai, and how has it handled mature content?

A: Civitai is a platform for AI-generated art that initially allowed mature content. However, due to abuse and legal pressure, they have implemented measures to detect and remove harmful content and blocked users from creating deepfake images of real people.

Q: What is Nomi, and how does it handle its chatbots?

A: Nomi is a company that provides companion chatbots strictly for users over 18. While not designed for sex, some users might find their chatbots veering into romantic or platonic relationships. 

More Related Topics :