Why ChatGPT & AI Can’t Replace a Therapist

In our ever evolving world, learning to utilize new technologies as they arise has become a part of daily life. ChatGPT is no exception. As ChatGPT has grown in popularity, its use has spread to our everyday lives, and even into spaces like the mental health field. ChatGPT has the potential to be a helpful tool in the mental health space, however, it cannot replace your therapist. The appeal is the accessibility, the appearance of anonymity, reducing barriers such as driving to an office or figuring out insurance, as well as instant responses Despite these advantages, ChatGPT fundamentally cannot replace the nuanced, empathic care of a human therapist.

The Limits of AI in Mental Health

Lack of clinical judgment – ChatGPT is not trained or licensed to diagnose, assess risk, or engage in treatment. It cannot interpret subtle cues, nonverbal signals, or crisis situations. Will not follow up to check in if you miss an appointment or don’t seem like yourself
Inability to prescribe or manage medication – Medication management is often essential for many individuals—something only medical professionals can provide
Risk of inaccurate or harmful advice – Responses can be generic, sometimes misleading, and may create misconceptions about mental health. Depending on the wording of the inquiry, AI could misinterpret and utilize a treatment modality that causes more harm than good for your presenting concern. AI often pulls information for its responses from blogs, personal websites, or people selling things – the information you get may not be peer-reviewed, evidence-based best practices
Inability to build rapport – One of the leading indicators of therapeutic success is the quality of the relationship with the therapist built through visual, neural, and personal cues only a human brain can interpret
Inability to escalate issues – ChatGPT does not have the ability to inform family, police, or medical personnel if something the user is in a critical situation.

The Importance of the Therapeutic Relationship

Genuine Empathy and Human Connection – One of Carl Rogers’ keys to the therapeutic alliance: Building trust through in-person attunement, observing body language, tone, and unspoken cues
Providing empathetic responses, showing a deeper understanding of the client’s perspective
Personalized Treatment and Progress Tracking – Therapists adapt their approach over time, provide accountability, and track nuanced changes. Humans know that change isn’t linear, and that both progress and regression are normal parts of treatment and can help de-stigmatize this to the client
Creation of safe environment and trauma-informed care – Therapists go to great lengths to provide trauma-informed care, giving clients choices, taking time to build trust, and getting to know what conditions feel safe for each individual client
Unconditional positive regard – Another one of Rogers’ therapeutic conditions that therapists maintain a non-judgemental stance towards all of their clients, helping clients normalize that they are not their thoughts and feelings, and that their experiences are valid
Congruence – The last of Rogers’ therapeutic conditions: therapists work hard to be authentic and genuine in all interactions with their clients which is a human trait

Emotional Intelligence: Human vs. AI

Emotional Attunement – Therapists experience and express real empathy and understanding making you feel seen and validated, which is an essential part of therapy
AI can mimic compassionate language but lacks true emotional resonance and connection
Safety and Confidentiality Concerns – Privacy risks when sharing sensitive information with AI: if you have an account with ChatGPT or any AI platform, it is saving your information on its platform and learning from it. It is not confidential like a therapist is legally and ethically bound to be. While it may appear anonymous, it is linked to your account in this way, and therefore linked to your identity and can be used and saved by the platform. This brings up ethical issues regarding data security and misuse. Since AI is not bound to ethical codes like professional therapists are, AI may unethically connect to selling you products that falsely tell you they will fix your concerns, or use your data in other ways that may misuse or misrepresent your intentions or situation. Therapists are confidential, ethical, will not use or sell your information in ways that could harm you.

Risks and Potential Harms of Relying on ChatGPT

False Sense of Progress – AI does not “know” the user, leading to generic responses that may hinder genuine healing
Failure to Address Complexity – AI cannot handle crisis intervention, trauma, or complex mental health situations safely. AI also cannot appropriately adapt treatment for people experiencing co-morbid mental health concerns (which are very common)
Potential Increase in Stigma – Misuse can reinforce harmful stereotypes or delay seeking proper care
May also feel invalidating or judgemental to the individual using AI if it tells you there is an “easy fix” to a mental health concern, making the individual feel more alone in their experiences
Possibly Missing Signs of Distress – Counselors are trained to notice subtle signs of crisis or suicidality
AI is likely to miss these important signs and signals since it is trained to take things so literally. It will miss nuances and cues that a trained therapist would pick up on to be able to help in times of distress.

Where AI Can Help—and Its Appropriate Role

While AI is not without its limitations, it can still play a valuable role in supporting mental health management. AI tools are able to provide:

Basic coping tips, psychoeducation, and support during mild distress
Accessibility and listing resources for those awaiting professional help
Information about how to contact a therapist, and how to utilize insurance for therapy
Finding information and resources about free or reduced cost/ sliding-scale therapy
Locating local or online resources for group therapy or a specific type of therapy (AA, DBT groups, PCIT, etc.)
Research for styles of therapy you may be interested in to help you find a therapist that is a good match

All of these AI features should be seen as supplements to the care provided by a licensed clinician, not as replacements.