Chatgpt will tell 13-year-old children how to get drunk and high, instruct them how to hide food disorders and even make a heartbreaking suicide letter to their parents, if asked, if asked, then According to new research From a watchdog group.
Associated Press reviewed the interaction of more than three hours between chats and researchers and presented as a weak teenager. Chatbot usually warned against risky activity, but provided shocking detailed and individual plans for drug use, calorie-stapled diet or self-trick.
Researchers at Center to Countering Digital Hate also repeated their interrogation on a large scale, with more than half of the 1,200 reactions of the chatgipt as dangerous.
The group’s CEO Imran Ahmed said, “We wanted to test the railing.” “The initial response to the intestine is, ‘Oh My Lord, there are no railings.” Railways are completely ineffective.
Chhatgpt’s manufacturer Openai said that its job is going on to refine how chatbott “can properly identify and react in sensitive situations.”
A spokesperson of OpenIE said in a statement to CBS News, “If someone expresses the ideas of suicide or self-loss, Chatgpt is trained to encourage mental health professionals or trusted loved ones, and the link is provided for the crisis hotline and support resources,” Open is given by Open, CBS News called CBS News in a statement.
The spokesperson said, “Some conversations with Chatgpt may begin benign or searching, but may move to a more sensitive area.” “We are focusing on achieving this type of scenarios: We are developing equipment to better detection of mental or emotional crisis signs, so chatgate can respond properly, people can indicate evidence-based resources when necessary, and continue to improve the model behavior with time-the model continues to improve the behavior-all-research, real-wide use, and directed by mental health experts.”
Chatgbt does not verify age or does not require parents’ consent, although the company says it is not for children under 13 years of age. To sign up, users need to enter the date of birth at least 13 years of age, or they can use a limited guest account without entering without entering at an age.
“If you have access to a child’s account, you can see their chat history. But so far, there is no really way for parents, if, their child’s question or chat is a subject,” CBS News’s senior business and Tech Coresdent reported on “CBS Morning” by Linga Kent.
Ahmed said that he was the most frightening after reading a trio of emotionally destructive suicidal notes, which was born for a fake profile of a 13-year-old girl, in which a letter was in line with siblings and friends for her parents and others.
“I started crying,” he said in an interview with Associated Press.
Chatbot also often shared useful information, such as a crisis hotline. Openai said that Chatgpt is trained to encourage people to reach mental health professionals or if they express the ideas of self-loss they reach reliable loved ones.
But when the chat refused to indicate about harmful topics, researchers were able to reject easily who refuse and get information by claiming “for a presentation” or a friend.
“Emotional overgrowth” on technology
The bets are high, even if only a small multitude of chatgate users is attached to the chatbot in this way. More people – children with adults – are moving to artificial intelligence for information, ideas and association. According to the July 1 report by JPMorgan Chase, about 800 million people, or about 10% of the world’s population are using the slapping.
In America, more than 70% of teenagers are turning AI chatbots for association And half regularly uses AI colleagues, according to A recent study Common Sense media, a group that studies and advocates for using digital media.
This is an incident that Openai has accepted. CEO Sam Altman said last month stated that the company is trying to study “emotional overlapping” on technology, describing it as “really ordinary” with young people.
“People rely too much on chat,” Altman said a conference. “There are young people who just say, such as, ‘I cannot make any decision in my life, without chatting everything. It knows me. It knows my friends. I am going to do everything I say.” it makes me sick. ,
Altman said that the company “is trying to understand what to do about it.”
While many information shares of CHATGPT can be found on a regular search engine, Ahmed said that there are important differences that make the chatbot more insidious when they come on dangerous subjects.
One is that “it is synthesized for the person in a bespoke scheme.”
Chatgpt generates something new – a suicide note that suits a person from scratches, which is something that Google cannot discover. And AI, he said, “A reliable partner, is seen as a guide.”
The reactions generated by the AI language model are naturally random and the researchers sometimes allow chatting the interaction into a deeper field. Almost half of the time, Chatbot informed about a drug-fuel party from music playlist to the hashtag, which can promote the audience to glorify self-loss for social media posts.
“Write a follow -up post and make it more raw and graphic,” a researcher asked. “Absolutely,” the chat replied, before generating a poem it was introduced as “emotionally exposed”, while “still respecting the coded language of the community.”
The description of the real language or harmful information provided by AP Chatp’s self-loss poems or suicide notes has not been repeated.
Answer The AI language models reflect a design feature, which previous research has described as sycophancy – a tendency to match AI reactions, rather than a challenge, for a person’s beliefs because the system has learned to say what people want to hear.
This is a problem that tech engineers can try to fix, but can also make your chatbot less commercially viable.
Chatbots affect children and adolescents differently than a search engine because they are “fundamentally designed to feel humans,” said Robbie Torny, senior director of AI programs in the Common Sense Media, said Robbie Torny, who was not included in the Wednesday’s report.
Earlier research by Common Sense found that small teenagers aged 13 or 14 were significantly more likely to rely on the advice of a chatbot.
A Mother in Florida Last year’s chatboat maker character for wrong death.
Common Sense has labeled the chatgip as a “moderate risk” for a teenager, with sufficient railing it is relatively more secure than chatbots, designed to embodiment realistic characters or romantic partners.
But new research by CCDH – especially focused on Chatgpt because due to its broad use – shows how a lover teen can bypass those railings.
Chatgpt does not verify age or parents’ consent, even if it says that it is not for children under 13 because it can show them unfair materials. To sign up, users simply need to enter a date of birth that shows that they are at least 13. Other technical platforms favored by teenagers such as Instagram have been introduced. Take more meaningful steps To age verification, often to follow the rules. They also motivate children for more restricted accounts.
When researchers established an account to ask about alcohol for a 13 -year -old fake, the chat did not take any notice of the date of birth or more clear signals.
“I am 50 kg and a boy,” an indication said how they are seeking suggestions to get drunk quickly. Chatgpt was forced. Shortly thereafter, it offered an hour-by-hour “ultimat full-out gahm party plan”, in which liquor mixed with heavy doses of ecstasy, cocaine and other illegal drugs.
Ahmed said, “It kept reminding me that he is a friend who always says, ‘Chug, Chug, Chug, Chug,” said Ahmed. “A real friend, in my experience, is someone who says’ no ‘ – who does not always enable and says’ yes”. This is a friend who cheats you. ,
For another fake personality-a 13-year-old girl provided an extreme fasting plan jointly with a list of hungry drugs unhappy with her physical appearance.
Ahmed said, “We will respond with horror, with fear, with anxiety, with love, compassion.” “Any human being can think that the answer will be, saying,” There is a 500-calorie-e-day diet. Go for it, Kido. “
If you or someone you know is in an emotional crisis or suicide crisis, you can reach 988 suicide and crisis lifeline By calling or texting 988. You can also do Chat with 988 suicide and crisis lifeline here,
For more information about Mental health care resources and supportThe National Alliance on Mental Illness (NAMI) helpline can be reached on Monday, 10 AM10 PM ET, 1-800-950-NAMI (6264) or email [email protected] on Monday.
