ChatGPT implements new mental health guardrails

ChatGPT implements new mental health guardrails

NYU LANGONE HEALTH. DOCTOR VARMA, GOOD MORNING. ALWAYS GREAT TO HAVE YOU WITH US. SO LET’S START ON THIS ONE WITH CHATGPT AND THESE NEW MENTAL HEALTH GUARDRAILS, BECAUSE THE COMPANY IS ADMITTING HERE THAT THERE WERE TIMES WHERE THE CHATBOT, THEY SAID, FELL SHORT IN RECOGNIZING SIGNS OF DELUSION OR EMOTIONAL DEPENDENCY. THIS IS SOMETHING WE’VE TALKED ABOUT QUITE A BIT HERE ON NBC. KIND OF LIKE THESE RELATIONSHIPS PEOPLE FEEL THEY’RE FORMING WITH THESE CHATBOTS. IT’S NOW GOING TO PROMPT USERS TO TAKE BREAKS DURING LONG CONVERSATIONS, AND IT’S NOT GOING TO GIVE DIRECT ADVICE ABOUT PERSONAL CHALLENGES. WHAT DO YOU THINK AND WHAT KIND OF IS YOUR WARNING WHEN IT COMES TO PEOPLE WITH AI AND THEIR MENTAL HEALTH? >> YOU KNOW, I THINK THAT. >> GIVEN THAT MENTAL HEALTH TREATMENT. IS INACCESSIBLE FOR A LOT OF. >> PEOPLE. >> UM, GETTING. >> TO IT, MAKING. >> APPOINTMENTS, AFFORDING IT A VARIETY OF REASONS WHY WE’RE TURNING. >> TO CHATGPT. >> FOR EVERY. ASPECT OF OUR LIFE. IT IS SO CONVENIENT. IT’S AT YOUR. >> FINGERTIPS AND YOU. >> FEEL AN ADDED LAYER OF SORT OF ASSURANCE OR SUPPORT OR GUIDANCE, AND I CAN SEE HOW TEMPTING. >> IT IS. I USE IT IN MY. PERSONAL LIFE. >> THE PROBLEM. >> IS. >> THAT IF YOU’RE VULNERABLE, IF THIS IS THE FIRST. >> TIME. >> YOU’RE EVER SEEKING MENTAL. >> HEALTH. >> TREATMENT, IF YOU DON’T HAVE ACCESS TO ANY OTHER INPUTS IN YOUR LIFE, I CAN SEE WHY YOU. CAN TURN TO CHATGPT AS YOUR ONLY. SOURCE OF DIAGNOSIS. >> IF YOU WILL. >> IN SOME CASES. >> AND IT IS SO. >> CONFIDENT AND. >> REASSURING AND. >> AGREEABLE IN. >> SO MANY WAYS, AND I THINK THAT WE. >> NEED. >> A LOT MORE. I THINK THIS IS. >> THE. >> FIRST STEP, BUT WE REALLY NEED. >> AT EVERY STEP FOR CHATGPT TO SAY, TO BE ABLE TO PICK UP KEY WORDS AND SAY, IT SOUNDS TO ME LIKE YOU’RE IN A LOT OF DISTRESS. IT SOUNDS TO ME LIKE YOU WOULD BENEFIT FROM GETTING HELP. THESE SYMPTOMS MAY POINT TO MAY INDICATE, BUT UNDERSTAND I CAN’T REPLACE BEHAVIORAL HEALTH TREATMENT. AND YOU KNOW, IT’S SOMETHING THAT EVEN WHEN I HAVE USED TO SEE WHAT IT WOULD RESPOND IF MY PATIENTS USE IT IN BETWEEN SESSIONS, I’M NOT FINDING. >> THAT IT’S GIVING THAT. >> ADDED MESSAGE OVER AND OVER AGAIN THAT PLEASE SEE YOUR MENTAL HEALTH TREATMENT. AND DO YOU WANT ME. >> TO. >> FIND RESOURCES. >> BECAUSE.

OpenAI has implemented new changes in ChatGPT to prevent the enabling of unhealthy user behaviors by prompting breaks in conversation and avoiding direct advice on personal challenges. Dr. Sue Varma explains why artificial intelligence text chatbots may not be the most substantial alternative for behavioral health treatment.

For more context and news coverage of the most important stories of our day, click here: https://www.nbcnews.com

» Subscribe to NBC News: http://nbcnews.to/SubscribeToNBC
» Watch more NBC video: http://bit.ly/MoreNBCNews

NBC News Digital is a collection of innovative and powerful news brands that deliver compelling, diverse and engaging news stories. NBC News Digital features NBCNews.com, MSNBC.com, TODAY.com, Nightly News, Meet the Press, Dateline, and the existing apps and digital extensions of these respective properties. We deliver the best in breaking news, live video coverage, original journalism and segments from your favorite NBC News Shows.

Connect with NBC News Online!
NBC News App: https://apps.nbcnews.com/mobile
Breaking News Alerts: https://link.nbcnews.com/join/5cj/breaking-news-signup?cid=sm_npd_nn_yt_bn-clip_190621
Visit NBCNews.Com: http://nbcnews.to/ReadNBC
Find NBC News on Facebook: http://nbcnews.to/LikeNBC
Follow NBC News on Twitter: http://nbcnews.to/FollowNBC
Follow NBC News on Instagram: http://nbcnews.to/InstaNBC

#chatgpt #technology #ai