These digital interactions, while offering a form of comfort, could also lead to instances of psychological distress by creating a continuous presence that might feel like being haunted digitally. The study, detailed in the journal Philosophy and Technology, underscores the high-risk nature of this technology and the ethical complexities involved.
AI ethicists from Cambridge outline potential scenarios in the digital afterlife industry that reveal the risks associated with poorly designed AI systems. They highlight the unethical use of deadbots for advertising or the distress caused to children who might be told that a deceased parent is still "with you." This misuse could extend to companies spamming bereaved families with unwanted communications from deceased individuals' avatars.
Dr. Katarzyna Nowaczyk-Basinska, co-author of the study, emphasizes the importance of respecting the dignity of the deceased and safeguarding the rights of both the data donors and users. She suggests that the technology necessitates careful ethical consideration to avoid scenarios where digital afterlife services exploit emotional vulnerabilities for profit.
The paper also presents fictional scenarios to illustrate potential misuses of the technology, such as a service called "MaNana," where a deadbot simulating a deceased grandmother starts to push advertisements after a trial period. Another scenario, "Paren't," discusses the implications of a deadbot left by a terminally ill parent for a child, which could lead to confusing or psychologically troubling interactions.
Researchers advocate for the development of protocols that respect user consent and provide meaningful transparency to ensure users are aware they are interacting with AI. They also call for the design of digital afterlife services to include dignified ways to discontinue the use of deadbots, akin to digital funerals or other culturally appropriate ceremonies.
As AI continues to integrate deeply into personal aspects of human life, the study underscores the urgent need for ethical guidelines and safeguards to manage the social and psychological impacts of these technologies effectively.
Research Report:Griefbots, Deadbots, Postmortem Avatars: on Responsible Applications of Generative AI in the Digital Afterlife Industry
Related Links
University of Cambridge
All About Human Beings and How We Got To Be Here
| Subscribe Free To Our Daily Newsletters |
| Subscribe Free To Our Daily Newsletters |
