Last month, OpenAI CEO Sam Altman told his followers on X that some of the guardrails would be coming off his company’s flagship product for adult users. Altman wants to allow ChatGPT to act more like a human friend, form emotional relationships with its users, and even generate erotic content—all features banned in the past because of their potential to create unhealthy attachments between users and chatbots.1
The move makes clear that many AI executives see rolling back chatbot safety features as a potential boon for their businesses. Elon Musk’s xAI, for instance, has already launched provocative or unfiltered chat features, which it appears to be using as a product differentiator.2 Users who want services unrestrained by conventional norms might flock to these platforms in the short term.
In the long term, however, corporate irresponsibility could be a major drag. Companies that produce unsafe products open themselves to vast liabilities and appeal less to the talent and customers they depend on most. Worse, they may lose consumers in the long run, as people turn against technologies that do not fit their values or that make them feel bad in other ways.
News reports regularly detail accounts of people whose mental and physical well-being are degraded by their use of AI chatbots. One corporate recruiter in Toronto, for instance, became convinced that he had superpowers after a long conversation that began when he asked ChatGPT to help him with his son’s math homework.3 To reduce risk to AI companies and increase appeal to users, avoiding pitfalls like these should be a priority for everyone in the sector.
References
- Butts, D. (2025, October 15). OpenAI’s ChatGPT will soon allow ‘erotica’ for adults in major policy shift. CNBC.
- Conger, K. (2025, October 6). Elon Musk Gambles on Sexy A.I. Companions. The New York Times. https://www.nytimes.com/2025/10/06/technology/elon-musk-grok-sexy-chatbot.html
- Hill, K., & Freedman, D. (2025, August 8). Chatbots Can Go Into a Delusional Spiral. Here’s How It Happens. The New York Times. https://www.nytimes.com/2025/08/08/technology/ai-chatbots-delusions-chatgpt.html
- Graham, M., Cant, C., Muldoon, J., & Cant, M. G. C. (2024, July 6). Meet Mercy and Anita – the African workers driving the AI revolution, for just over a dollar an hour. The Guardian. https://www.theguardian.com/technology/article/2024/jul/06/mercy-anita-african-workers-ai-artificial-intelligence-exploitation-feeding-machine
- Harris, L., & Criddle, C. (2025, October 8). Insurers balk at multibillion-dollar claims faced by OpenAI and Anthropic. Financial Times.
- Creamer, E. (2025, April 4). US authors’ copyright lawsuits against OpenAI and Microsoft combined in New York with newspaper actions. The Guardian.
- Yousif, N. (2025, August 27). Parents of teenager who took his own life sue OpenAI. BBC. https://www.bbc.com/news/articles/cgerwp7rdlvo
- Skilled workers prefer environmentally conscious companies. (n.d.). The University of Chicago Booth School of Business. Retrieved 27 October 2025.
- Bhaimiya, S. (2025, September 6). Behind the AI talent war: Why tech giants are paying millions to top hires. CNBC. https://www.cnbc.com/2025/09/06/ai-talent-war-tech-giants-pay-talent-millions-of-dollars.html
- Burn-Murdoch, J. (2025, October 7). Has social media finally peaked? The rise of AI and decline of screen time. The Irish Times. https://www.irishtimes.com/business/2025/10/07/has-social-media-finally-peaked-the-rise-of-ai-and-decline-of-screen-time/
About the Author
About us
We are the leading applied research & innovation consultancy
Our insights are leveraged by the most ambitious organizations
“
I was blown away with their application and translation of behavioral science into practice. They took a very complex ecosystem and created a series of interventions using an innovative mix of the latest research and creative client co-creation. I was so impressed at the final product they created, which was hugely comprehensive despite the large scope of the client being of the world's most far-reaching and best known consumer brands. I'm excited to see what we can create together in the future.
Heather McKee
BEHAVIORAL SCIENTIST
GLOBAL COFFEEHOUSE CHAIN PROJECT
OUR CLIENT SUCCESS
$0M
Annual Revenue Increase
By launching a behavioral science practice at the core of the organization, we helped one of the largest insurers in North America realize $30M increase in annual revenue.
0%
Increase in Monthly Users
By redesigning North America's first national digital platform for mental health, we achieved a 52% lift in monthly users and an 83% improvement on clinical assessment.
0%
Reduction In Design Time
By designing a new process and getting buy-in from the C-Suite team, we helped one of the largest smartphone manufacturers in the world reduce software design time by 75%.
0%
Reduction in Client Drop-Off
By implementing targeted nudges based on proactive interventions, we reduced drop-off rates for 450,000 clients belonging to USA's oldest debt consolidation organizations by 46%


















