Quillivic, Robin; Dolan, Raymond J; Fradkin, Isaac; (2025) Characterizing the Paradoxical Interplay of Semantic Perseveration and Derailment in Psychiatry Using Theory-Driven Generative Language Simulations. Schizophrenia Bulletin , Article sbaf205. 10.1093/schbul/sbaf205. (In press).

Text Characterizing the Paradoxical Interplay of Semantic Perseveration and Derailment.pdf - Accepted Version Access restricted to UCL open access staff until 29 November 2026. Download (3MB)

Abstract

Background and Hypothesis: Formal thought disorder (FTD), characterized by derailment and perseveration, is a central feature in psychosis and can partially appear in other psychiatric conditions. Despite their clinical co-occurrence, derailed speech and perseveration have opposing effects on common natural language processing (NLP) metrics of FTD (eg, cosine distance metrics). We propose a set of novel NLP metrics suitable for capturing perseveration, separate from any degree of (dis)organization and derailment. // Study Design: We generate a synthetic dataset using large language models to simulate narratives while independently manipulating semantic perseveration (via paraphrase insertion during generation) and derailment (by increasing word selection stochasticity). We developed novel metrics aiming to capture perseveration by probing semantic structure and density (using clustering and dimensionality reduction). These metrics were compared against traditional cosine distance metrics in the synthetic dataset, as well as in a transdiagnostic general population sample (n = 811). // Study Results: Traditional cosine distance metrics performed well in detecting derailment but underperformed for perseveration. Conversely, density-based metrics showed superior performance in detecting perseveration and dissociating it from derailment. Density metrics also outperformed traditional metrics in revealing perseveration in psychopathological dimensions associated with repetitive thinking and speech, including depressive symptoms and difficulty initiating conversation (ie, negative FTD). // Conclusions: Integrating density-based metrics with traditional semantic distance measures may better capture FTD symptoms, though further validation in clinical samples is needed. This approach improves understanding of perseveration and its interaction with (dis)organization in thought and speech, with potential clinical applications.

Download activity - last month

Export as XMLJSONCSV

Download activity - last 12 months

Export as CSVJSONXML

Downloads by country - last 12 months

Export as CSVJSONXML

Archive Staff Only

View Item