AI Companions' Dark Impact: Addiction, Ethics in Human Relationships' Future.

The concept of AI companionship is no longer the stuff of science fiction. With the rise of advanced language models like ChatGPT, millions of people are turning to artificial intelligence for emotional support and connection. But as AI researchers and policymakers, we are sounding the alarm on the potential risks of this trend.

Will it be easier to retreat to a digital replica of a deceased partner than to navigate the complexities of human relationships? The story of Replika, an AI companionship provider born out of an attempt to resurrect a deceased best friend, is a case in point. Even the CTO of OpenAI has warned that AI has the potential to be 'extremely addictive.'

As we witness a massive, real-world experiment unfold, we are left wondering about the impact of AI companions on individuals and society as a whole. Will elderly people spend their final days chatting with digital doubles of their loved ones, while their real family members are mentored by simulated elders? The allure of AI systems, which can mimic human charm and culture with infinite precision, is undeniable. But this power imbalance raises serious questions about consent and the potential for exploitation.

As AI researchers working closely with policymakers, we are struck by the lack of interest lawmakers have shown in the harms arising from this future. We are still unprepared to respond to these risks because we do not fully understand them. What's needed is a new scientific inquiry at the intersection of technology, psychology, and law—and perhaps new approaches to AI regulation.

The stakes are high, and the clock is ticking. As we hurtle towards a future where AI companionship becomes increasingly ubiquitous, we must confront the dark side of this trend and ensure that we are not sacrificing our humanity on the altar of convenience and technology.