(4 minute read)
In this series entitled Virtual Production 101, we journey into some of the state-of-the-art film techniques that fall under what is known as Virtual Production, a technical workflow in which virtual characters and environments are created to look alive and real.
We will highlight some of the best use cases of Virtual Production by identifying what is standard in the VFX (Visual Effects) industry.
Today we are introducing Motion Capture, a very common method that is now ubiquitous in big VFX films.
In the example above from Rise of the Planet of the Apes (2011), the actor is clothed in this bodysuit and helmet while he behaves like an ape. There typically will be multiple cameras and light sources aimed at the subject as he performs. Then later on an animator will add layers of 3D models to his face and body to replicate a real-life ape on screen. If you've heard of CGI (Computer Generated Imagery), this is where that comes in.
Creators are able to perform this technique by making use of those markers as anchoring points, which act as a skeleton for the finished animation to sit on. The moving skeleton are again enhanced by adding layers of specific facial features like larger eyes, smaller ears, or scruffy hair to portray a realistic photograph. Each marker essentially acts as an indicator of light – either emitting light itself or reflecting natural lighting. In the example below, during production of Alita: Battle Angel (2019), the actor, Rosa Salazar, has all these black dots glued to her face which is used to capture every single facial movement from her eyebrows rising to every jaw muscle motion.
- Avatar: https://www.youtube.com/watch?v=1wK1Ixr-UmM
- Alita Battle Angel: https://www.youtube.com/watch?v=9YBRj3BEkEc
Thoughts? Did you like this post? Let me know in the comments below! You can respond as Anonymous. :)
In this series entitled Virtual Production 101, we journey into some of the state-of-the-art film techniques that fall under what is known as Virtual Production, a technical workflow in which virtual characters and environments are created to look alive and real.
We will highlight some of the best use cases of Virtual Production by identifying what is standard in the VFX (Visual Effects) industry.
Today we are introducing Motion Capture, a very common method that is now ubiquitous in big VFX films.
 |
| What is Motion Capture? from Full Sail University |
What is it?
Motion Capture, or Mocap or also Performance Capture, is a method of digitally recording real-life movement of a person or object. You probably have already seen this being done in behind the scenes clips of actors dressed in these tight bodysuits covered in small bright circles. During production they record these actors wearing bright green markers on their face or suit, which allows them to make manipulate the characters' looks in post-production and make the final product look natural.How does it look?
 |
| Rise of the Planet of the Apes BTS from Weta Digital Studios |
Creators are able to perform this technique by making use of those markers as anchoring points, which act as a skeleton for the finished animation to sit on. The moving skeleton are again enhanced by adding layers of specific facial features like larger eyes, smaller ears, or scruffy hair to portray a realistic photograph. Each marker essentially acts as an indicator of light – either emitting light itself or reflecting natural lighting. In the example below, during production of Alita: Battle Angel (2019), the actor, Rosa Salazar, has all these black dots glued to her face which is used to capture every single facial movement from her eyebrows rising to every jaw muscle motion.
 |
| Alita: Battle Angel BTS from Flicks And The City Clips |
What are some of the needed Materials?
- A powerful camera that lends itself to motion capture i.e. one that increases light transmission and has long capturing range
- A body suit
- A helmet with attachments
- Attached Mic and Boom to capture the actor's voice clearly
- Attached mini-camera facing the actor to capture facial movements
- Gloves
- Markers (can be any color)
- 3D Animation Software
Quotes
"I knew when I did Avatar...that Alita would not only be possible but she would be spectacular."
~ James Cameron, Producer/Writer for Alita: Battle Angel
"Performance Capture tends to lend a lot of credibility because you get a lot of the weight. You get the physics."
~ Richard Baneham, Visual Effects Creative Supervisor for Alita: Battle Angel
"Cameras have improved. Helmet cams have improved. But I think it's what you actually do with that information that you collect that made the difference on [Avengers: Infinity War]."
~ Dan Deleeuw, Visual Effects Supervisor for Avengers: Infinity War
"It's nice for the actors to be in a set acting with each other and not necessarily in a sanitized motion capture volume. So, instead of that, the sets were peppered with a lot of motion capture cameras...which is very helpful for overall improvement of the actor's performance. They're already having a hard enough time in the silly motion capture suits or lots of blue screen around them, but to make it as helpful to them as possible...was a big benefit."
~ Kelly Port, Senior Visual Effects Supervisor for Avengers: Infinity War
Examples and Resources
- Optitrack Hardware & Software: https://optitrack.com/motion-capture-animation/- Avatar: https://www.youtube.com/watch?v=1wK1Ixr-UmM
- Alita Battle Angel: https://www.youtube.com/watch?v=9YBRj3BEkEc
- How Thanos was Created: https://www.youtube.com/watch?v=d7pWHQX9QqA
- Still from Avengers: Endgame. Spider-Man, War Machine, and the Hulk all used Motion Capture so that their hero counterparts would appear and move as if they were real.
- Still from Avengers: Endgame. Spider-Man, War Machine, and the Hulk all used Motion Capture so that their hero counterparts would appear and move as if they were real.
 |
| Avengers: Endgame BTS (Link) |
Thoughts? Did you like this post? Let me know in the comments below! You can respond as Anonymous. :)