- Virtual production is a real-time set that follows the camera.
- There are two paths: chroma key with a virtual set, or an LED volume.
- Camera tracking is the piece that makes the illusion work.
- The real-time graphics engine renders the set every frame.
- A virtual set needs a content team, not just equipment.
On this page
Virtual production is the technique of recording or broadcasting with a computer-generated set in real time, which changes perspective as the camera moves. It works with three pieces: a tracking system that reports the camera's position, angle and zoom; a graphics engine that renders the 3D set every frame from that data; and a way to combine people and set, either by chroma key, keying out a green background, or by an LED volume, where the set appears on a screen behind the talent. XR is the LED variant that extends the set beyond the edges of the screen.
The XR and virtual production page shows what i9TV delivers in this system. This guide explains how it works and what to plan.
Two paths: chroma key or LED
On the chroma key path, the talent stands in front of a green or blue background, the system keys out that color and puts the virtual set in its place. It is cheaper to build and allows sets of any size. It needs care with lighting, green spill on people and transparent or fine objects such as hair and glass.
On the LED path, the set appears on an LED wall, and the camera records the final result, with no keying. The talent sees the set, the screen light falls on the scene in the right colors and reflections appear naturally. The cost is higher, and the wall needs a fine pitch and a high refresh rate. The LED vs chroma key comparison puts the two side by side.
What XR is
XR (extended reality) is the use of an LED volume where the graphics engine extends the set beyond the edges of the screen, inside the camera frame. That way, even an LED wall and floor of limited size look like a full environment. It is widely used in shows, corporate events, launches and broadcast concerts, where the camera opens wider than the screen.
Camera tracking
For the set to change perspective with the camera, the system has to know exactly where the camera is. Tracking can be optical, with markers on the ceiling or around the studio read by a sensor on the camera, or mechanical, with encoders on cranes and heads. Lenses need zoom and focus data, from sensors or from lenses with a data protocol. Low, stable latency between tracking and the graphics engine is what keeps the set from sliding against the people. Before each shoot, the team calibrates the lenses and checks the alignment between the real studio and the virtual one.
Real-time graphics engine
The graphics engine renders the 3D set every frame, at the production's resolution and frame rate. Tools such as Aximmetry and other market platforms do this job, combining set, tracking, keying and, in some cases, control of the LED screen. The computer running the engine needs a powerful graphics card and professional video input and output synced with the cameras.
- Sets: built in 3D by artists, optimized to run in real time.
- Virtual lighting: adjusted to match the real studio light.
- Augmented reality elements: graphics that appear in front of the presenters.
- Operation: someone switches sets, virtual cameras and elements during the show.
Where virtual production makes sense
- Shows with several sets in the same studio, switched without building and striking.
- Newscasts and business shows with data, maps and 3D charts.
- Corporate events and launches with environments that would be impossible to build.
- Commercials and drama that need hard-to-reach or expensive locations.
- Podcasts and online shows with a simple virtual set on a green background.
In newscasts and business shows, virtual production lets you change the set between blocks, bring graphics into the studio and use the same physical space for several shows. In commercials, it cuts travel and lets the director see the final result on the monitor during the shoot, which shortens decisions and reshoots.
What to plan first
- 01Define the formatWhat kind of show, how many cameras, which moves and how many sets.
- 02Choose the pathChroma key or LED, by budget, studio size and type of scene.
- 03Plan the studioSize of the backdrop or volume, ceiling height, lighting, cooling and power.
- 04Choose tracking and engineCompatible with the cameras, lenses and production workflow.
- 05Create the contentOptimized 3D sets, tested with the real cameras.
- 06Test and trainFull rehearsals with the camera crew, graphics operation and the director.
A virtual set is a production in itself. Set aside time and budget to build and adjust the 3D content, not just for the equipment.
Common mistakes
- Buying equipment before defining the show format.
- Underestimating the time to build and tune the 3D sets.
- Real lighting that does not match the virtual set lighting.
- Tracking without lens calibration, with the set sliding on zoom.
- Different delays between cameras and set, which show up on the cuts.
Virtual production with i9
i9TV designs and integrates virtual production systems, with chroma key or LED, tracking, the graphics engine and the link to the control room and real-time graphics. The work starts from your show format and arrives at the right system for it. Tell us the format and the studio you have, and get a virtual production design.
If you do not have a space to shoot yet, see the i9 Studios 667 m² stage with an 8 m ceiling in São Paulo.
i9 does this every day: production, broadcast, engineering and equipment, with one team accountable from start to finish.