Virtual Production is the integration of real-time computer-generated imagery (CGI) into live-action filming.
The Future of Film-making
This process allows filmmakers to create and control complex visual effects in real-time during filming, rather than having to add them in post-production. This involves the use of real time compositing and set extension software, real time 3D CG rendering, motion capture, and virtual cameras to produce realistic visual effects and environments, while maintaining a high level of creative control over the final output. Virtual Production can reduce the need for costly reshoots and allow for more efficient and flexible filmmaking ultimately also lowering production costs.
One crucial element is the camera tracking system, which syncs the camera’s movement with the real time CG rendering system. This synchronisation ensures that the virtual background reacts accurately to the camera’s perspective, creating a sense of depth and immersion. This seamless integration of physical and digital elements is what sets virtual production apart from traditional post VFX.
Customers actively using our Virtual Production Products
Our staff members have been supplying this exciting new technology to the production industry since 2017. During this time, we’ve assembled key pieces of leading technology, thereby providing a comprehensive end-to-end solution for virtual production.
This capability includes media servers for real-time compositing and layout, LED walls for background display, real-time camera tracking, and application software for 3D set creation and visualisation. Additionally, we employ the Unreal and Notch 3D engines for environment design
Virtual Production Software and Compositing Servers
This software allows users to create and control virtual environments, characters, and special effects in real-time, and to integrate these elements with live-action footage. Our virtual production solutions can be used by the Broadcast and Film industry as well as in Education and eSPORT.
“The Player”
Behind the scenes of a short film created using Aximmetry and Virtual Production workflows.
The entire film was created in under 14 days, including storyboarding, creating the CG environment, on-set filming and post-production.
Pioneering Virtual Production at New Zealand’s Southern Institute of Technology
User Story
With local partners Protel what is probably the closest virtual production setup to Antarctica was installed and commissioned.
The installation took place at the Southern Institute of Technology (SIT) in Invercargill, on the tip of the South Island of NZ. Intraware and Protel supplied a turnkey solution including Liantronics Pilot LED display, real time camera tracking hardware, and Aximmetry real time compositing engine and server with Bluefish SuperNova video control.
The Liantronics Pilot LED is the first LED virtual wall to be installed in an educational institution in New Zealand.
Students in all areas of the Bachelor of Screen Arts programmes will have access to the Liantronics Pilot LED. This advanced technology allows for training in both traditional green screen techniques and cutting-edge virtual production pipelines. As a result, collaborative projects involving all students can be undertaken. Ms. Mann emphasised the diverse opportunities this will provide for the students’ learning experiences.
Four SIT staff members received training while they were in Invercargill. The training focused on supporting the Pilot panels and using the Aximmetry real-time compositing software. This software compiles the camera tracking data and 3D content to drive the LED display. “We’ve had quite a bit of training,” said Rachel Mann, the manager of the Screen Arts Programme at SIT.
“We tested it last week and it does more than we thought it would – we’re pretty stoked and amazed [with its capabilities and that was on the first day…” Wayne Morphew from Imagineering said “SIT is the second school in ANZ to choose Liantronic Pilot panels for their virtual production process classes after AIE in Australia. The Pilot is the best value for money when you are looking for high-end colour gamut for film and drama work. This is because the Pilot has been purpose-built for virtual production whereas the competition is geared towards live events, and so carries a lot of extra baggage and cost.”
Notch and Unreal Engine
Unreal and Notch are groundbreaking real-time 3D engines used to create virtual environments. These environments are designed for ROE LED walls or projection systems, leveraging Disguise servers. Data from StarTracer, a real-time tracker, is relayed to the 3D engines through the Disguise server, enabling real-time camera tracking.