Published: Feb. 25, 2022 By

She鈥檚 a trapeze artist. He鈥檚 a computer scientist. Together, they鈥檙e hoping to redefine immersive performance.听

Anna Pillot, a master鈥檚 student in the Department of Theatre and Dance, was on a run in Boulder when her fitness watch alerted her to a spike in her heart rate.

She adjusted her pace.听

Slowed her breathing.

Caroline Butcher performing

Pillot and Butcher performing

Dance MFA candidates Anna Pillot and Caroline Butcher performing at听the ATLAS B2 Blackbox Experimental Studio. (Credit: Elliot Whitehead)听

Through the tiny screen on her wrist, she watched as her heart rate slowly recovered.

Her experience sparked an idea: What if she could use the same technology in her watch to show an audience what was happening within her body during a performance?

This was the inspiration behind Pillot鈥檚 latest show at the ATLAS B2 Blackbox Experimental Studio.

IMbalance | INbalance,鈥 which ran Feb. 25鈥26, blended aerial dance and computational creativity to reveal the inner workings of a dancer in motion.听

Using the same biometric sensors in fitness watches combined with a state-of-the-art 3D motion capture system, the performance synchronized the dancer's heart rate with sound, lighting and video projections, allowing the audience to share in the experience. 听

鈥淚f it's going to feel truly immersive, then there shouldn't be a separation of performer and observer,鈥 Pillot said. 鈥淲e wanted to build an instantaneous connection, where the audience was in the performance with us.鈥

Pillot, who trained as a trapeze artist with some of the world鈥檚 top circus producers before coming to 兔子先生传媒文化作品 in 2020, partnered with fellow Dance MFA candidate Caroline Butcher to create and perform the choreography.听

As they danced, their heart rates were projected onto the backdrop in beats per minute (BPM). They coordinated with each other verbally and physically throughout the show, performing various tricks and sequences with the goal of controlling and synchronizing their heart rates.听

鈥淲hen you externalize the internal, it creates this sort of feedback loop,鈥 Pillot said. 鈥淗ow we鈥檙e interacting with each other on stage affects the audience鈥檚 reaction, which in turn affects us as performers.鈥

At the end of the show, when PIllot and Butcher reached a peak of 170 BPM, they laid on the floor and took deep breaths. The music slowed with their heart rate and听the colors faded from fiery reds to cool blues until the theater was silent and the dancer鈥檚 were at rest.听

Mixing cirque and science

The performance by Pillot and fellow Dance MFA candidate Caroline Butcher is part of the ATLAS B2 Center for Media, Arts & Performance鈥攁n interdisciplinary innovation hub that co-mingles art and technology.

That's where Pillot met Brad Gallagher, a doctoral candidate in Intermedia Art, Writing and Performance.听

Gallagher worked with a computational astrophysics group at the University of Chicago for 13 years, visualizing datasets to make 3D simulations of star explosions and supernovas.听

鈥淒uring that time, I was very active in making music and always thought of myself as somebody who's interested in art, 鈥 Gallagher said.听

Since joining the B2 Center, he鈥檚 been experimenting with their state-of-the-art 3D motion capture system鈥攖echnology that records the movement of people or objects, and converts it into data used to generate a 3D view of the performance. Similar technology is used in Hollywood to create real-life fictional characters, like Gollum in Lord of the Rings or Caesar in Planet of the Apes.

Gallagher鈥檚 interest lies in the live performance applications of the system鈥攈ow a performer鈥檚 movement can trigger sound, lighting and video in real time. In teaming up with Pillot, he was able to bring his ideas to the stage.听

Pillot resting

Pillot's heart rate projected on the backdrop as she rests. (Credit: Elliot Whitehead)

By attaching biometric sensors to the dancer鈥檚 bodies, Gallagher will use computation, coding and creativity to completely automate and sync the performance projections.听

鈥淚 think the technology will really help pull the audience in and immerse them in the show,鈥 Gallagher said. 鈥淏ut I think what's even going to be more effective is the performance that Anna and Caroline are going to bring to this, and seeing how their presence as human bodies can make the audience sympathize even more.鈥澨

After this weekend鈥檚 performance, Gallagher plans to continue this research by exploring the implications of artificial intelligence in live performance.听

鈥淚 think we're headed towards a place听where听performing a particular art piece could create additional art,鈥 he said.听

Specifically, he鈥檚 hoping to investigate ways to reverse causality between music and dance.听

鈥淩ight now we have music dictating the choreography of a performance, but imagine a world where the dancer鈥檚 movement could create the musical score in real time.鈥

"IMbalance|INbalance" is made possible by the Arts and Cultural Enrichment Grant, Graduate Research in Dance Fund, and MFA Excellence in Research Micro Grant.

You can register for free tickets to this weekend鈥檚 performance.听