Demo: PeerCoPilot: A Language Model-Powered Assistant for Behavioral Health Organizations

Gao Mo, Naveen Janaki Raman, Megan Chai, Cindy Peng, Shannon Pagdon, Nev Jones, Hong Shen, Fei Fang

Keywords: LLM, copilot, RAG, Assistant, Behavioral Health, Mental Health

TL;DR: We develop PeerCoPilot, an LLM-based tool to assist behavioral health organizations construct goals, discover resources, and suggest follow-up questions

Abstract: Behavioral health conditions, which include mental health and substance use disorders, are the leading disease burden in the United States. Peer-run behavioral health organizations (PROs) critically assist individuals facing these conditions by combining mental health services with assistance for needs such as income, employment, and housing. However, limited funds and staffing make it difficult for PROs to address all service user needs. To assist peer providers at PROs, we introduce PeerCoPilot, a large language model (LLM)-powered assistant that helps peer providers create wellness plans, construct step-by-step goals, and locate organizational resources. PeerCoPilot ensures information reliability through a retrieval-augmented generation pipeline backed by a large database of over 1,300 vetted resources. We conducted human evaluations with 15 peer providers and 6 service users and found that over 90% of users supported using PeerCoPilot. Moreover, we demonstrate that PeerCoPilot provides more reliable and specific information than a baseline LLM. PeerCoPilot is now used by a group of peer providers at a large behavioral health organization serving between 15 and 100 individuals daily through its network of 15 community wellness.

Submission Number: 26