Mo-Sys showcases new approach to hybrid virtual production workflows at HPA

Mo-Sys Engineering will demonstrate a new hybrid approach to final pixel (ICVFX) virtual shooting at the HPA Tech Retreat (booth 720, Innovation Zone, Mission Hills Rancho Mirage, 20 – 23 February 2023).

Hybrid Virtual Production Workflow

This innovation gives directors and cinematographers great flexibility and can significantly reduce costs without compromising quality in any way. To give directors the freedom to create a cinematic experience including wide shots and close-ups in final pixel LED virtual production, up until now you needed a very large LED volume which is expensive to implement. Mo-Sys’ solution is to shoot wide shots against a green screen, and the mids and closer shots in an LED volume which can now be much smaller. 

For this approach to work, the image quality has to be precisely matched, and the director needs to be able to switch immediately from one to the other to meet production workflows and timescales. With the green screen and smaller LED volume on the same stage, the lighting can be matched and the performers and technicians can move freely from one to the other. 

Underpinning this is a unified system for content serving and camera tracking. Mo-Sys StarTracker is widely recognized as the leader in precision camera and lens tracking for movie and television production. VP Pro XR is the company’s powerful LED content server solution, built as a plugin which sits natively within the Unreal Engine, and tied closely to StarTracker to ensure perfect synchronization, and even focus pulls between real and virtual objects. 

“The industry is learning how best to use virtual production and is keen to use the benefits within practical production workflows and budgets,” said Michael Geissler, CEO of Mo-Sys. “We have taken the largest exhibition booth at HPA to show how practical it is to use multiple techniques in a single scene, so the actors and crew can work through the shots as they would do on a physical set. This is a real game-changer in the viability of virtual, final pixel production.”

Mo-Sys brings CGI avatars to life for Netflix Dance Monsters

Mo-Sys is a world leader in image robotics, virtual production and remote production solutions. With over 25 years’ experience, Mo-Sys holds an enviable position as production partner to high-profile prime time entertainment shows and live sports broadcasts. The Mo-Sys product range spans turnkey LED virtual studio system integration, remote heads and broadcast robotics, mechanical and optical camera tracking for augmented reality and Virtual Production, and on-set visualization.

Mo-Sys brings CGI avatars to life for Netflix Dance Monsters
Dance Monsters Virtual Production

Mo-Sys is proud to announce its involvement with Netflix latest hit Dance Monsters, a powerful heart-warming competition where amateur dancers are disguised as CGI avatars competing to win $250,000. The creative vision behind the show pushed the boundaries of possible and led technology partners to adopt a collaborative, knowledge sharing approach to overcome complex challenges and develop workflow improvements to achieve ambitious goals. 
 
The resulting show successfully pioneers the use of performance capture for dancers, targeted onto avatars for a live audience. The ground-breaking combined use of technology meant contestants could see themselves in real-time as their Monsters, empowering them to push past personal inhibitions and perform with confidence, immersing singers into their character and the overall creative concept. 
 
Mo-Sys deployed VP Pro, its complete solution for virtual production with a full suite of creative tools embedded directly within Unreal Engine for augmented graphics, virtual sets and mixed reality. The team also utilised Mo-Sys’ award-winning StarTracker optical camera tracking to precisely track the position of six moving cameras, and deliver live compositing. The resulting camera and lens data was combined with the Motion Capture data in Mo-Sys VP Pro and Unreal, to render the monsters in AR live on stage. 

James Uren, Mo-Sys Technical Director explains: “It has been a real pleasure to work with Lime Pictures on this technically challenging project. The early collaboration across all technology partners to deliver a world-class production has been key to the success of Dance Monsters.”

James adds “A total of six Mo-Sys VP Stations  – synchronised on-set Virtual Production rendering carts were used. One for each camera chain and one for recording and backup. Mo-Sys recorded the movement of the cameras, lenses and lights, so the Monsters could be re-rendered at an even higher quality in an automated post-production pipeline.” 
 
Mo-Sys’ VP Stations reveal some impressive production numbers; 856 takes amounting to 20 full days of recordings and 40 million key frames of data. And the result was the ability to have a Live preview of the show with AR ‘monsters’ on a real stage, allowing the production team to film complex camera sequences of dances and interviews, with all data recorded and delivered to post-production to enable an automated re-render pipeline. 
 
Mo-Sys is delighted to learn that Dance Monsters has been nominated for the 2023 Producers Guild of America Innovation Award which recognises production of noteworthy, impactful new media programs that significantly elevate the audiences viewing experience. We wish our friends and colleagues at Lime Pictures every success at the PGA Awards ceremony. 

Watch now on Netflix.

Mo-Sys Unleashes Storytelling Creativity at new XR LED Studio

Mo-Sys had the pleasure of attending PLAZAMEDIA GmbH’s grand opening of their new Extended Reality (XR) LED studio, briX|woRk on February 10th. Mo-Sys was one of the presenters at the event, showcasing the tools available to help storytellers unleash their creativity.

briX|woRk LED studio Grand Opening

As a leading provider in image robotics, virtual production and remote production, Mo-Sys is uniquely positioned to offer both a Cinematic XR solution (VP Pro XR) and the leading camera tracking solution in the market, StarTracker. With these tools, Mo-Sys can deliver new innovations in on-set real-time production and solve existing LED/XR challenges.

One of the Key features showcased by Mo-Sys at the event was Cinematic XR Focus. This feature of VP Pro XR allows filmmakers to pull focus between real and virtual elements in an on-set real-time shoot, making it a major creative storytelling solution when using an on-set real-time LED volume.

We are proud to have been a part of this incredible event. With the new XR LED studio, there are now even more possibilities for innovative and sustainable productions for film and production companies, broadcasters, advertising companies, and event and creative agencies. 

To see our presentation at the event, check out the video below.