eprintid: 10196395 rev_number: 12 eprint_status: archive userid: 699 dir: disk0/10/19/63/95 datestamp: 2024-09-02 11:23:48 lastmod: 2024-10-03 09:58:22 status_changed: 2024-09-02 11:23:48 type: proceedings_section metadata_visibility: show sword_depositor: 699 creators_name: Zhong, Shu title: Design Digital Multisensory Textile Experiences ispublished: inpress divisions: UCL divisions: B04 divisions: F48 keywords: Human-AI interaction, AI for Social Good, Sustainability, Machine Learning, Multimodal Large Language Models, Agents note: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. abstract: The rise of Machine Learning (ML) is gradually digitalizing and reshaping the fashion industry, which is under pressure to achieve Net Zero. However, the integration of ML/AI for sustainable and circular practices remains limited due to a lack of domain-specific knowledge and data. My doctoral research aims to bridge this gap by designing digital multisensory textile experiences that enhance the understanding of the textile domain for both AI systems and humans. To this end, I develop TextileNet, the first fashion dataset using textile taxonomies for textile materials identification and classification via computer vision, and TextileBot, a domain-specific conversational agent. TextileBot integrates textile taxonomies with large language models (LLMs) to engage consumers in sustainable practices. Additionally, my research explores how multisensory experiences can improve user understanding and how AI perceives textiles. The overarching goal is to embed human expertise into machines, design immersive multisensory experiences, and facilitate natural human-AI interactions that promote sustainable practices. date: 2024-11-04 date_type: published publisher: ACM official_url: https://icmi.acm.org/2024/ oa_status: green full_text_type: other language: eng primo: open primo_central: open_green verified: verified_manual elements_id: 2308632 doi: 10.1145/3678957.3688621 lyricists_name: Zhong, Shu lyricists_id: SZHON47 actors_name: Zhong, Shu actors_id: SZHON47 actors_role: owner full_text_status: public pres_type: paper place_of_pub: San Jose, Costa Rica event_title: 26th ACM International Conference on Multimodal Interaction book_title: Proceedings of the 26th ACM International Conference on Multimodal Interaction citation: Zhong, Shu; (2024) Design Digital Multisensory Textile Experiences. In: Proceedings of the 26th ACM International Conference on Multimodal Interaction. ACM: San Jose, Costa Rica. (In press). Green open access document_url: https://discovery.ucl.ac.uk/id/eprint/10196395/1/icmi24a-sub1019-cam-i15.pdf