Our story
Software September 2026 completed

Researchers’ Night: the Miller Theater in Augusta, on headphones

On 25 September 2026, in the former Carmine church in Piacenza, we brought The Four Turandot to the European Researchers’ Night: with a joystick and a pair of headphones you could walk through the stalls of the Miller Theater in Augusta while Calaf sings «Nessun dorma», with the hall’s real acoustics. The sound comes from an audio renderer we developed.

Calaf rebuilt digitally and seen from below: the tenor’s face and his pale costume, simulated as real fabric, on a black background.

On Friday 25 September 2026 the former Carmine church in Piacenza, home of the Laboratorio Aperto, hosted the European Researchers’ Night: stands, workshops and talks by the city’s universities and research centres, as part of the Festival del Pensare Contemporaneo.

The Nicolini Conservatory’s programme included «Attraversare il suono» (Crossing sound), an immersive listening experience for one person at a time, open from 8:30 to 14:00 to young people aged fifteen and over. Inside it was The Four Turandot, the Conservatory’s project for which we hold scientific responsibility. This time the focus was entirely on the audio software.

What you saw

In the three-dimensional reconstruction of the Miller Theater in Augusta, Georgia, built in Unreal Engine 5, Calaf sings «Nessun dorma». He is a MetaHuman animated with the optical motion capture data recorded during the performance. The lip sync is generated directly from the vocal track, and the costume is simulated as fabric, in real time.

What you heard

With a joystick you move freely through the stalls, and the tenor’s voice reaches you with the real acoustics of the Miller Theater. The sound is produced by convolution with the ambisonic impulse responses measured in the hall, the ARIRs, which describe how the voice reflects off the walls, the stage and the stalls. It reaches your headphones in binaural form, and changes with the listener’s position and orientation.

Under the frescoed arches of the Carmine, a person seated with their back to the camera, wearing headphones, looks at a screen with Calaf on stage; beside them another person standing with their back turned and two people in the festival’s blue T-shirt.
The station at the Carmine: headphones, joystick and the theatre on screen.

How image and sound talk to each other

The graphics engine talks to an audio renderer we developed, through a dedicated plugin. Unreal sends it the listener’s position up to 60 times per second. The renderer drives the scene time, and on that time animation, lip sync and voice stay in sync.

The result is the feeling of really being inside the theatre, during the opera.

A woman wearing headphones sits in front of a laptop connected to an audio interface; around her three people in the festival’s blue T-shirt, one of them listening on another pair of headphones.
A listening test on headphones.

The video

This is the demo video of «Nessun dorma»: Calaf, the stage and the hall are entirely reconstructed. At the Carmine the same moment could be heard from the point in the stalls chosen with the joystick.

Two people in the festival’s blue T-shirt standing in the nave of the Carmine; behind them the station and a screen reading «Attraversare il suono».
Behind them, on the screen, the name of the station: «Attraversare il suono».

The rest of the project, with the performances in Augusta, Milan, Daegu and Hangzhou, is told in The Four Turandot.

The earlier Nights, from 2022 to 2024

The Conservatory had already taken part in the Researchers’ Night. In 2022, 2023 and 2024 we helped the departments and the teacher in charge of research to design and organise the events linked to the Night; in 2024 also in the XNL Musica spaces, opened specially for the evening.

In 2023 we brought “Nebulacusmatica”, an audiovisual composition to be watched with a headset: particles of light reacting to sound. For the evening we also prepared a looping video. It follows the same path as the virtual reality research begun that year with the University of Georgia.

On a black background, clouds of yellow and pink particles stretching through space, a few streaks of light; at the bottom right the words “Nebulacusmatica, composizione audio visuale sound reactive per visore”.
“Nebulacusmatica”, at the 2023 Researchers’ Night.