Project Type(s):
Clinical Research

This project aims to evaluate LLMs’ bias and accuracy in conveying the causes of mental health disorders (e.g., anxiety). We will address the absence of related data and the challenge of annotating data by responsibly collecting human-LLM conversations about mental health advice and working with domain experts to create fact sheets about mental health conditions’ social and individual determinants. We will then analyze data to assess the extent to which LLMs present social determinants of health (SDOH) versus individual factors and the accuracy of the connections and causations they draw between SDOH, individual factors, and specific disorders. Our study will examine a range of increasingly popular LLMs, such as ChatGPT.

---