Digital scholarship is expressed through different types of publications from traditional digital journal to xR research creations and experimental research with human subjects. The descriptions of research below represent a wide variety of research and its mobilization that I have been engaged in. Many have integrated some aspects of artificial intelligence throughout the creative process.
Creative Prototyping with Generative AI Book & Media
Creative Prototyping with Generative AI Book & MediaFor centuries the dominant form of media has been the written word but for scholarly expression in a digital age that is no longer the case. Increasingly, there are peer-reviewed calls for scholarly writing that transform readers by immersing them within unique worlds based on the writing itself. The image here shows my book published with Springer Nature’s Apress and on the screen behind me you can see Kaiber AI’s interpretation of the first two pages of the Shakespeare Folio.
Shakespeare xR
Shakespeare xRShakespeare xR includes a series of projects for different type of media that explore new ways to bring Shakespeare to new audiences. Recent research creations have focused on bringing scanned pages of the entire First Folio which contains many of Shakespeare’s works to touchtable interactions. Upcoming ones integrate text-speech AI for Elizabethan English and search functionality on the touch table.
Shakespeare AR
Shakespeare ARThe visual model shows an iterative process that involved integrating new GPT script co-created with GPT and a dramaturg then bringing those scripts to life by actors and with a director in a motion capture studio. These characters were then rigged and animated for an Augmented Reality application.
Generating Shakespeare
Generating ShakespeareThis recorded presentation as part of the proceedings of the Spark Animation Festival experimented with the entire presentation being created with different gen AI multi-modally. Within the presentation there is text-speech with GPT and other LLM inspired scripts, text-image, image-image, image-video, and video-video generated content.
Typology for Mixed Reality in Public Spaces
Typology for Mixed Reality in Public SpacesAn important contribution to the field of location based mixed reality, this typology was developed from the research creation known as the Fun Palace: Carnival of Mixed Reality. It was presented at ISEA 2022 and can help guide designers of mixed reality experiences in public spaces to more intentionally design for the human experience.
A Fun Palace: Carnival of Mixed Reality
A Fun Palace: Carnival of Mixed RealityThe invited paper traced the development and detailed the 11 works, augmented reality, sound design and audience experience of the Fun Palace. Cedric Price And Joan Littlewood’s Fun Palace was an idea – a concept sketched out in 1964. Over 50 years later, their low-fidelity sketch came to life with a mix of AR, VR, and MR art installations. The research team was challenged to prototype an engaging mixed realities layer, drawing from(but not limited to) cybernetics, cognitive psychology, and art.
Many professionals working with teams in the digital media industry (games, web development, XR, IoT, mobile) are drawn to teaching others, but may not know how or where to start. Many might be a subject expert but may not have the structure and skills in place to be able to teach others effectively in workplace and institutional settings. This handbook will give professionals a guide on how to mentor junior designers, developers and other learners in formal and informal learning environments. 
Mentoring Digital Media ProjectsMany professionals working with teams in the digital media industry (games, web development, XR, IoT, mobile) are drawn to teaching others, but may not know how or where to start. Many might be a subject expert but may not have the structure and skills in place to be able to teach others effectively in workplace and institutional settings. This handbook will give professionals a guide on how to mentor junior designers, developers and other learners in formal and informal learning environments. 
Curiosis Digitalis
Curiosis DigitalisOne of the 11 installations at the Carnival of Mixed Realities, Curiosis Digitalis was inspired by Curiosity booths of old. This one at a time audience experience presented audience members with the choice of selecting from 3 curiosity performances, each of which demanded some type of interaction from the audience member. Audience and performer were separated by a small window in a wall and the performer was signaled to begin based on remote technologies that triggered music associated with each act.
Fun Palace: Floor plans
Fun Palace: Floor plansOne of several iterations of floor plans that were drawn out for the Fun Palace: Carnival of MR to depict where each of the 11 installations would be placed to allow for maximal audience distribution. The event consisted of three rotating audiences who had an hour to experience installations. The floor plan was critical for the turn overs to occur smoothly. Presented at SIGGRAPH 2019.
SIGGRAPH Education
SIGGRAPH EducationSIGGRAPH Education sig features peer-reviewed entries from post-secondary institutions. The xR Prototyping Lab had presence in 2018, featuring an AR research creation co-constructed by grad students in 3 weeks for dance producer Small Stage. The digital dancer’s choreography and music were shorter versions of live dances performed outdoors in a summer festival in Vancouver. QR codes allowed audiences to “take the dance home with them”.
Generating Shakespeare
Generating ShakespeareMost of the time when we design we have specific workflows and pipelines. In the case of Generating Shakespeare, part of proceedings of the Spark Animation Festival (2023), I wanted to visualize the entire pipeline to show where, when and how AI was used throughout the presentation.
Taiko at the Electronic Theatre Opening
Taiko at the Electronic Theatre OpeningTo commemorate 30 years of submissions to the Electronic Theatre at SIGGRAPH I was commissioned to compose for Taiko drummers and electronica. The work accompanied a review of over 30 animations to an audience of 2500. Compositions and sound designs form part of a large portfolio of research sound creations.
A Virtual Anatomy Lab
A Virtual Anatomy LabThis research creation is an ongoing collaboration between Dr. Claudia Krebs, myself and others with various research outputs over the years. The Van VR application is in steady use by medical students at UBC, University of Glasgow and other universities and communities worldwide. It was particularly useful during the Covid-19 pandemic and is an exemplar in the ethical use of donated organs that have been digitized.
Sirius: Research Creation & Human Isolation Research Object for Astronauts
Sirius: Research Creation & Human Isolation Research Object for AstronautsMy collaborations with Dr. Riecke’s iSpace Lab at SFU’s School of Interactive technology, are numerous and ongoing. The development of research creations for the intention of research and teaching have been mobilized widely at conferences like SIGGRAPH, CHI, IEEE, ISEA and one paper was published in MIT’s Leonardo journal. Sirius was part of an isolation study for cosmonauts and astronauts who gathered for 18 months during the Covid-19 pandemic. We are still awaiting data from Moscow.
SIGGRAPH, Birds of a Feather. Augmenting Workflows with Generative AI
SIGGRAPH, Birds of a Feather. Augmenting Workflows with Generative AIBirds of a Feather are an opportunity to present content that doesn’t always fit SIGGRAPH’s other formats. Presenting on the subject of Generative AI as a creative tool allowed me to mobilize my recent book research creation Creative Prototyping with Generative AI. The event resulted in a strong turnout and has led to further opportunities in the AI space with NVIDIA and local Vancouver companies.