Milana, Federico;
Costanza, Enrico;
Musolesi, Mirco;
Ayobi, Amid;
(2025)
Understanding Interaction with Machine Learning through
a Thematic Analysis Coding Assistant: A User Study.
Proceedings of the ACM on Human-Computer Interaction
, 9
(2)
, Article CSCW197.
(In press).
Preview |
Text
Understanding_Interaction_with_Machine_Learning_through_a_Thematic_Analysis_Coding_Assistant__FINAL_.pdf - Accepted Version Download (3MB) | Preview |
Abstract
Interactive Machine Learning (ML) enables users, including non-experts in ML, to iteratively train and improve ML models. However, limited research has been reported on how non-experts interact with these systems. Focusing on thematic analysis as a practical application, we report on a user study where 20 participants interacted with TACA, a functioning Interactive ML tool. Thematic analysis involves individual interpretation of ambiguous data, hence it is suited for and can benefit from the iterative customization of models supported by Interactive ML. Through a combination of interaction logs and semi-structured interviews, our findings revealed that, by using TACA, participants critically reflected on their analysis, gained new thematic insights, and adapted their interpretative stance. We also document misconceptions of ML concepts, positivist views, and personal blame for poor model performance. We then discuss how applications could be designed to improve the understanding of Interactive ML concepts and foster reflexive work practices.
| Type: | Article |
|---|---|
| Title: | Understanding Interaction with Machine Learning through a Thematic Analysis Coding Assistant: A User Study |
| Open access status: | An open access version is available from UCL Discovery |
| Publisher version: | https://dl.acm.org/journal/pacmhci |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Human-centered computing, Interactive systems and tools; Computing methodologies, Machine learning, interactive machine learning, thematic analysis |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Brain Sciences > Div of Psychology and Lang Sciences > UCL Interaction Centre |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10206159 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
