The Adaptation Dilemma: Cultural Fit Does Not Guarantee Safety in Mental-Health LLMs

A critical review arguing that cultural adaptation and safety are separate constructs in mental-health LLMs. A model can cause harm in two directions: by imposing its own framing of distress on users it doesn't fit, or by adapting so well to a user's framing that it sustains the patterns keeping them unwell. The paper synthesizes the existing literature into a taxonomy of culture-related failure modes for evaluating deployed systems.

Current focus

The manuscript is fully drafted and being finalized for preprint release, with the taxonomy of culture-related failure modes as its core contribution.

Collaborators

  • Maya LowThe Decision Lab
  • Sekoul KrastevThe Decision Lab

About this research

As mental-health chatbots are deployed across markets, the dominant safety strategy has been cultural adaptation: making models fit the user's language, values, and framing of distress. This review argues that fit is the wrong target. Cultural fit and cultural safety are distinct constructs, and optimizing for one does not deliver the other.

The failure runs in both directions. An under-adapted model imposes its own framing of distress on users it doesn't fit, misreading symptoms and pushing interventions that don't land. An over-adapted model mirrors the user's framing so faithfully that it reinforces the very patterns keeping them unwell. Both look like success on standard satisfaction metrics, which is precisely the problem: satisfaction signals are poor proxies for user welfare.

The paper synthesizes the literature on culture-related failure modes in mental-health LLMs into a working taxonomy, giving builders and evaluators a shared vocabulary for auditing deployed systems before harm shows up in the field.

GET IN TOUCH

Speak to our team.

Fill in the form and a member of our team will reach out.

info@thedecisionlab.com