Gatti, Elia;
Giunchi, Daniele;
Numan, Nels;
Steed, Anthony;
(2024)
AIsop: Exploring Immersive VR Storytelling Leveraging Generative AI.
In:
(Proceedings) 31st IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (IEEE VR 2024).
IEEE: Orlando, FL, USA.
Preview |
Text
IEEEVR2024_Poster_Storytelling.pdf - Accepted Version Download (1MB) | Preview |
Abstract
We introduce AIsop, a system that autonomously generates VR storytelling experiences using generative artificial intelligence (AI). AIsop crafts unique stories by leveraging state-of-the-art Large Language Models (LLMs) and employs Text-To-Speech (TTS) technology for narration. Further enriching the experience, a visual representation of the narrative is produced through a pipeline that pairs LLM-generated prompts with diffusion models, rendering visuals for clusters of sentences in the story. Our evaluation encompasses two distinct use cases: the narration of pre-existing content and the generation of entirely new narratives. AIsop highlights the myriad research prospects spanning its technical architecture and user engagement.
| Type: | Proceedings paper |
|---|---|
| Title: | AIsop: Exploring Immersive VR Storytelling Leveraging Generative AI |
| Event: | 31st IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (IEEE VR 2024) |
| Open access status: | An open access version is available from UCL Discovery |
| Publisher version: | https://ieeevr.org/2024/program/posters/ |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10190409 |
Archive Staff Only
 |
View Item |
