Maggie Lane is a author and producer of digital actuality experiences and covers the trade for varied publications.
Extra posts by this contributor
Does Prepared Participant One reveal the way forward for VR?
Final month at San Diego Comedian Con, I fulfilled my childhood (and let’s be trustworthy, present) dream of stepping inside a NickToon. In Nickelodeon Leisure Lab’s Rise of the Teenage Mutant Ninja Turtles VR Interview Expertise, I interacted with turtles Mikey and Donnie—voiced dwell by collection expertise, Brandon Mychal Smith and Josh Brener, respectively.
I stood in opposition to a inexperienced display screen, chosen an avatar (I selected Arnold from Hey Arnold!), placed on an Oculus Rift headset, and was transported onto a New York Metropolis rooftop. I inhabited a 3D kind, however as I regarded forward, I noticed two 2D turtles. I interviewed the characters in actual time, and their actions completely corresponded to their solutions–there was no discernable lag.
Provided that AI isn’t in a position to match the conversational pace and nimbleness of actual people simply but, corporations like Oculus are experimenting with utilizing dwell actors of their VR experiences to approximate in-person interactions. Nevertheless, this was the primary time I’ve skilled a dwell melding of 3D and 2D worlds in VR.
Behind the scenes, this “magic” was made doable by 4 computer systems, two puppeteers, two voice actors and a group of eight individuals working the assorted stations. (The crew had been all carrying ninja bandanas, naturally). Adobe Character Animator, Epic Unreal Engine, and NewTeK NDI had been all used to create the interview expertise. The pièce de résistance was the brilliant purple keyboard that was piloted by two group members (one for every turtle). Every key featured a distinct animated pose, and so the actions of the turtles could possibly be “animated” in actual time, akin to enjoying an emblem piano.
In response to Chris Younger, SVP of the Leisure Lab, the impetus of the activation was that his group was on the lookout for an modern method to assist socialize Nickelodeon’s Rise of the Teenage Mutant Ninja Turtles at SDCC and they also got here up with the concept of a VR press junket.
Mikey and Donnie in Nickelodeon’s “Rise of the Teenage Mutant Ninja Turtles Live” digital actuality interview expertise
The Leisure Lab has been exploring all features of digital cinema pipelines with animated characters; utilizing full physique and facial efficiency seize, and doing real-time playback in sport engines. Per Chris: “Whether it’s streaming live performances into virtual experiences or recorded for a more traditional linear output, these techniques create another tool that we can use to create compelling content for our audience.”
Even with out the bandanas, the group had nice synergy: “The best part about my team is that everyone brings a different expertise. From artists to engineers, the combination of skills and background made this creatively and technically possible” mentioned Chris.
Though I teased the turtles for being “flat” in my interview, I really like that this inventive selection was made. It will have been unsettling to immediately see what’s 2D in 3D.
For instance, I benefit from the premise and plot of Digital Rick-Ality, however considered one of my essential criticisms of the sport is the connection between property. Rick and Morty the animated collection is 2D, however the sport makes them into bulbous characters. This disconnect is off-putting and hurts the immersion of the sport.
Though the VR Interview Expertise was created particularly for Comedian-Con and Nickelodeon doesn’t at the moment have plans to launch a model to the general public, they’re toying round with different activations for followers.
Nevertheless, VR isn’t the place exploration ends for Nickelodeon, they’re additionally dabbling in AR. Nick’s new SCREENS UP initiative, first launched on the Nickelodeon Children Alternative Sports activities Awards, permits viewers to carry their cellular units (or extra doubtless, father or mother’s cellular units) as much as the display screen whereas watching to disclose hidden AR content material.
This app-driven TV and cellular expertise is likely one of the first within the U.S. designed for teenagers and households. Count on to see extra hybrids like this sooner or later, because it encourages the watching of dwell TV in addition to app downloads; two fascinating outcomes for tv content material suppliers.
Total, the most effective a part of my Ninja Turtles Comedian Con demo was how foolish and good-natured all of it was. With heavy headsets and an onslaught of first particular person shooters, VR could be type of severe! This felt social and pleasant — the improvisational nature of the dialog allowed me to overlook I used to be in a digital house, I used to be simply hanging out with some dope turtles. It’s a credit score to Nickelodeon that they may make one thing this complicated seem like youngster’s play.
The “Rise of the Teenage Mutant Ninja Turtles Live” digital actuality expertise was constructed completely in-house by Nickelodeon’s Leisure Lab, which spearheads long-range analysis and growth efforts round new applied sciences for Nickelodeon and its viewers. Chris Younger is the SVP of the Leisure Lab, overseeing its creation. The brand new Rise of the Teenage Mutant Ninja Turtles collection premieres September 17th on Nickelodeon.