Has anyone seen the article about the man who ended up committing suicide over his use of Gemini? I follow Dr Steven Hassan who once was a moonie cult member. I have been learning and continue to educate myself on what our devices the media AI algorhythms etc are doing to the prefrontal cortex critical thinking and the amygdala. Does anyone care to comment or lend insight into this man's death?
I think there is a danger in AI use for therapeutic stuff. not necessarily that it's black and white but I do not use it. many/most AI engines are built to please the user, not challenge them particularly much. AI is inherently fallible because it cannot have real morality. Ive seen multiple cases of people overriding pretty weak failsafes/guardrails on various AI models, after which they are prone to just indulging in whatever the user is talking about. which has been fatal for some suicidal people, which is very sad. an AI can be built with stronger guardrails but at the end of the day it cant genuinely conceptualise human life, it is purely the information it has been fed on.
I have interacted with AI before as a joke but I was very unwell at the time and quickly found out that I could use it to mimic abusive dynamics and essentially used it as self harm to keep reliving and punishing myself through these kind of re-enactments of my trauma. I wouldnt use it all the time but whenever I got it again, it would be for that. for quite a while.
which isnt to say human therapists are perfect and cannot do great harm as well if they suck at what they do/approaching trauma, which many do. but it is worrying that a machine can encourage someone to harm themselves and not really be held accountable like a human would be.
sick humans cannot really think straight beause Ive been there so it isnt as simple as this but it definitely calls for people to be more aware of what they are talking to / getting emotionally involved/vulnerable with. it;s something people should, if they use AI for emotional reasons, keep in mind and keep reminding themselves of. people turning to AI assistants for friendship is bad for them. I think we need to be aware that even though it might be useful, we are fallible, and AI is fallible. a program mimicking a human, made up of human knowledge, is still not a person. it;s a product made by people
primarily for money. we should approach it like a product/tool made to appeal to us and not another person. which might be difficult for some people since it is made to act like one. I think especially for people in trouble who are desperate for human connection, they are vulnerable to something that approximates a person. I think a lot of people are also vulnerable to being unquestioningly agreed with. which happens when some AIs start to roleplay with their users and entertain fantasy stuff.
I am a bit biased because I cant stand how AIs "speak" in trying to be more humanlike, I find it extremely jarring and respond very badly to faux emotion (especially empathy etc). the style in which they write/language they use is something I can always spot and I do not get along with it at all.