UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Measuring group social interactions following acquired brain injury: an inter-rater reliability evaluation

Howell, S; Varley, R; Sinnott, EL; Pring, T; Beeke, S; (2021) Measuring group social interactions following acquired brain injury: an inter-rater reliability evaluation. Aphasiology , 35 (11) pp. 1505-1517. 10.1080/02687038.2020.1836315. Green open access

[thumbnail of Beeke_Measuring group social interactions following acquired brain injury.pdf]
Preview
Text
Beeke_Measuring group social interactions following acquired brain injury.pdf - Accepted version

Download (443kB) | Preview

Abstract

Background: Social communication impairments following acquired brain injury (ABI) are well-documented. There is evidence that group interventions are beneficial but research into validated instruments to measure group outcomes is a new field of investigation. / Aims: This study reports on the inter-rater reliability of three established social communication measures for use with group interaction data: the Profile of Pragmatic Impairment in Communication (PPIC), the Behaviorally Referenced Rating System of Intermediate Social Skills (BRISS-R), the Adapted Measure of Participation in Conversation (MPC). Inter-rater reliability of the Interactional Network Tool (INT), a new digital tool designed for group interactional behaviours, is also evaluated. / Method: Thirty-one video samples of ABI group interactions were independently rated by two rater pairs using the four outcome measures. Inter-rater reliability was calculated using intra-class correlations (ICC). / Results: ICC estimates and their 95% confidence intervals were calculated for the different measures. The measures showed differential sensitivity. Rater agreement on the MPC interaction (ICC = 0.77) and transaction (ICC = 0.74) scales was moderate to good. The INT initiation frequencies (ICC = 0.83) were moderate to excellent and the INT response frequencies (ICC = 0.69) were poor to good. Poor to moderate reliability was achieved on the BRISS-R PCSS (ICC = 0.49) and PDBS (ICC = 0.50) scale and PPIC findings were moderate but showed presence of skew. / Conclusion: Acceptable reliability was achieved on two measures of participation (MPC and INT). The INT shows promise as a new method to characterise interactions and detect change in group communication behaviour.

Type: Article
Title: Measuring group social interactions following acquired brain injury: an inter-rater reliability evaluation
Open access status: An open access version is available from UCL Discovery
DOI: 10.1080/02687038.2020.1836315
Publisher version: https://doi.org/10.1080/02687038.2020.1836315
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
Keywords: Brain injury, rehabilitation, rating scales, outcome measurement, social networks, group
UCL classification: UCL
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Experimental Psychology
UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > Language and Cognition
URI: https://discovery.ucl.ac.uk/id/eprint/10114869
Downloads since deposit
9Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item