Ruttenberg, David; (2023) Multimodality and Future Landscapes: Meaning Making, AI, Education, Assessment, and Ethics. Presented at: 11th Annual International Conference on Multimodality (ICOM-11), London, UK.

Text ICOM-11 Ruttenberg 5 Minute Presentation.mp4 - Other Download (68MB)

Abstract

David Ruttenberg is a final year PhD candidate at the UCL Institute of Education. His research intersects multimodal systems design, cognitive neuroscience, and ethics relating to technologies that may specifically assist autistic adults in sensory-laden contexts of higher education, employment, and social venues. A majority of participants reported that sensory issues cause barriers to their daily functioning and arise from psychophysiological responses stemming from atypical reactivity to auditory, visual, and other cues. Research suggests that technologies might help, manage, and/or alleviate impacts of these disturbances; and this study focuses on whether and what types of technology-supported accommodations might be desired and tolerated as expressed by autistic adults. Despite the documented fragility of autistic populations’ physical and cognitive states, technologists are said often to misunderstand neurodiversity by designing for non-disabled people. Methods employing participatory research may help identify what sensor types and accommodations would support autistic individuals in their daily routines. Patient Public Involvement methodology were employed to understand opinions and existential viewpoints about the impacts of visual, auditory, and physical distractions. These resulted in Mediating Models predicted how mental health becomes a conduit between cues and distractibility—and provided design specification for real-time sensory tools to reduce susceptibility to distraction. In-field Sustained Attention to Response Task experiments using a Wizard of Oz methodology revealed how personalised accommodations alleviated distractions and improved sensitivity, distractibility, and mental health. This study highlights how massive data counts require design and collection considerations that protect against accidental or intentional data disclosure, increased autistic vulnerability, and other issues of security or harm. The study recommends how accommodations embedded within ethical systems and fairness architectures may reduce sensory, attention and mental health while safeguarding at-risk population.

Downloads since deposit

Loading...

7Downloads

Download activity - last month

Export as CSVJSONXML

Loading...

Download activity - last 12 months

Export as XMLJSONCSV

Loading...

Downloads by country - last 12 months

Export as XMLJSONCSV

1.	United Kingdom	1
2.	United States	1

102550all

Archive Staff Only

View Item