27/02/2023
It's easy today to get caught up in discussions about the future of and its potentially negative consequences, but we can't ignore the fact that some dystopian scenarios might be already here.
As AI technology advanced, -powered apps like Replika have matured, offering virtual AI-powered companions with conversational abilities and digital behaviors that are remarkably close to real people's.
They're so close, in fact, that if someone wants or needs to believe they're building a relationship, it's easy to fall into the trap. This vulnerability to harmful consequences might not be there for the majority of users, but given the challenges that modern society faces in the relational aspects of life, it's easy to recognize that the potential for harm exists.
Looking at the community and power users of Replika makes it clear how many problematic consequences technologies like these can generate.
Most common and widespread ‘misusages’ (almost a euphemism) of the Replika app include engaging in AI erotic roleplay and investing too much time and emotional resources with the chatbot, mistaking fictitious digital relationships with real ones, ultimately steering away from reality.
It may seem far-fetched and dystopian, but this scenario has been unfolding already. What do you think?
Video excerpt via ColdFusion - full version: https://youtu.be/QGLGq8WIMzM