Virtual Revolution

AUT has opened its virtual production studio, putting top-end Hollywood production technology in the hands of today’s students.

Associate Professor Dafydd Sills-Jones, Head of AUT’s Virtual Creative Precinct, says the virtual production studio fits with AUT’s history of equipping students for great careers by allowing students to learn by doing.

“AUT, Aotearoa’s only university of technology, is all about how people use and interact with technology. Virtual production mashes the stages of creative production – script writing, VFX and design, set building and physical performance – together in one location, collapsing some of the walls and facilitating robust creativity.

“AUT is already a conduit for talent into the creative industry. Many of our graduates are already working in VFX roles on movies made in New Zealand overseas. Our new studio will mean not only students studying filmmaking, visual effects or digital design will have access, but our future engineers, architects, designers, journalists and artists will too.”

The launch of the virtual production studio means the technology used to create hit shows like The Mandalorian are right on city campus, ready for students to use.

Students will learn how to use the technology and be able to enter into well paid jobs in a lucrative industry, facilitated by AUT’s strong industry connections, exemplified by its partnership with the Society of Motion Picture and Television Engineers (SMPTE).

Virtual Production combines a wall of LED screens with rendering engines like Unreal Engine (UE5) and Disguise. Staff, students and industry partners at AUT will use the latest technology for not only film and television production, but for engineering, science and architecture applications.

New graduates from a range of degrees will be able to join an industry worth more than $3.5b to the New Zealand economy, and foster research into innovative use of the technology.

Unlike green-screen production, virtual production allows real-time interaction between the virtual and actual elements of the set. Issues such as colour correction to deal with the ‘green glow’ of green screens are gone, and reflective costumes or props can be used without fear they’ll reflect a green screen. The screens become part of the lighting of the set, and because actors can interact with the virtual set, actors don’t have to imagine with a computer-generated character that historically would have been added in post-production is.

Film makers already using virtual production say the ability to shoot sunset for 10 hours is incredible. Once they’ve captured images of the film locations once, those locations become part of the visual set and the crew aren’t trapped by weather or time of day.

Virtual production also brings lots of historically separate parts of film production together on set. The visual effects team are on set, meaning changes can be made then and there to both the physical and virtual elements of the set. This helps streamline postproduction and allows for high production values.

Examples of films or TV shows using virtual production include The Mandalorian, Our Flag Means Death, Barbie, which combined beautifully built sets like the Barbie Dream House with virtual production and MCU movies like Thor: Love and Thunder.

While allowing huge flexibility and creativity, virtual production also creates a whole range of high-paying careers.

Beyond entertainment

Virtual production techniques are applicable to multiple sectors. If you’ve ever looked at an artist’s impression of an urban development, or wanted to see an architectural design come to life, virtual production makes that possible.

“Anything designed in CAD can be rendered in virtual production to create a seamless blend of the real and the virtual,” says Gregory Bennett, senior lecturer in the School of Art and Design at AUT.

“We’re excited about the potential applications and creative output that will come from collaborations from across AUT, and with our industry partners. Computer science, spatial design, engineering, architecture – students and staff in these areas will have the opportunity to use these creative spaces to further their study and their career opportunities.

“We’ve already seen a lot of commercial applications for virtual production being driven by the architecture industry and our School of Future Environments’ staff and students will be able to do the same.”

AUT Virtual Production Volume is part of the Virtual Creative Precinct, which includes TV, radio and art studios, motion-capture, robotics, modelling, fine arts, podcasting, streaming, greenscreen spaces and more.