Return to Video

How volumetric video brings a new dimension to filmmaking

  • Not Synced
    I love making movies.
  • Not Synced
    Motion pictures have been in existence
  • Not Synced
    for more than a hundred years.
  • Not Synced
    Filmmaking hasn't changed
    for the dimensional mindset.
  • Not Synced
    Placing the camera in a scene
    and pressing "record" hasn't changed.
  • Not Synced
    Filmmaking is still a frontal experience,
  • Not Synced
    and creating the film has the possibility
  • Not Synced
    to follow the same direction
    of the content creation.
  • Not Synced
    We still stand in front of a flat image
  • Not Synced
    watching the fiction.
  • Not Synced
    There's nothing wrong with it.
  • Not Synced
    I love watching movies
    and going to the theaters.
  • Not Synced
    The experiences can be
    such emotional experiences.
  • Not Synced
    The arts and crafts of emotional
    experiences within a frame
  • Not Synced
    can be so strong
  • Not Synced
    to drive a stronger emotion.
  • Not Synced
    The question we're asking is,
  • Not Synced
    how the experience of motion pictures
    can exist beyond the flat screen?
  • Not Synced
    How can we start creating content
  • Not Synced
    for the next generation
    of content experiences?
  • Not Synced
    Traditionally, when we imagine a scene,
  • Not Synced
    we look at the frame and the composition.
  • Not Synced
    We have to think about how we create
    depth and parallax
  • Not Synced
    using foreground, background elements
    as the camera moves.
  • Not Synced
    With the technology today
    and devices of VR glasses,
  • Not Synced
    AR glasses, smart devices,
  • Not Synced
    allowing three dimensional
    and full navigation in space,
  • Not Synced
    we have the possibility
    to enable audiences
  • Not Synced
    to experience content
    from multiple perspectives.
  • Not Synced
    What we have to think about
  • Not Synced
    is how we take this technology,
  • Not Synced
    all the capabilities
  • Not Synced
    enabling the experience
    to move farther away inside the scene.
  • Not Synced
    Now, we're not talking about video games
    or computer-generated actors,
  • Not Synced
    which looks tremendously realistic.
  • Not Synced
    We're talking about real actors
    and real performance,
  • Not Synced
    performing onstage.
  • Not Synced
    We have to start thinking
  • Not Synced
    how we capture the actors
  • Not Synced
    and how we capture the real scene
  • Not Synced
    in order to emerge inside.
  • Not Synced
    Now, we're familiar
    with the 360-degree video,
  • Not Synced
    where you place the camera
    inside the scene
  • Not Synced
    and you can create this beautiful
    panoramic image all around you,
  • Not Synced
    but from the same aspect,
  • Not Synced
    filmmaking is still frontal.
  • Not Synced
    In order to emerge fully inside the scene,
  • Not Synced
    we will need to capture the light
    from all the possible directions.
  • Not Synced
    We will have to surround the scene
    with an enormous amount of sensors,
  • Not Synced
    with all possible capabilities
    to capture the light,
  • Not Synced
    and enable us to emerge
    inside afterwards again.
  • Not Synced
    Now, in this setup,
  • Not Synced
    there's no more foreground or background
  • Not Synced
    or a camera placed in space,
  • Not Synced
    but hundreds of sensors
  • Not Synced
    capturing the light
  • Not Synced
    and capturing the motion
    from all the possible directions.
  • Not Synced
    With the new technological advancements,
  • Not Synced
    we can start looking at 3D photography,
  • Not Synced
    capturing the light
    from multiple perspectives,
  • Not Synced
    enabling us to reconstruct the object.
  • Not Synced
    This is like photography in 3D space.
  • Not Synced
    Now,
  • Not Synced
    with these technological advancements,
  • Not Synced
    we can record video
  • Not Synced
    not just as a flat image
  • Not Synced
    but as a volume.
  • Not Synced
    This is what we call "volumetric video,"
  • Not Synced
    and it is the capability to record
    every action of the scene
  • Not Synced
    as a full three-dimensional volume.
  • Not Synced
    Now, what is a voxel?
  • Not Synced
    A voxel is like a three-dimensional pixel,
  • Not Synced
    but instead of being a flat image square,
  • Not Synced
    staying light and colored,
  • Not Synced
    it's like a three-dimensional cube
  • Not Synced
    in space,
  • Not Synced
    with x, y, and z positions.
  • Not Synced
    This enable us to create
    a full capture of the scene
  • Not Synced
    from any perspective.
  • Not Synced
    Now, this renders
    a fully light-immersive scene
  • Not Synced
    from multiple perspectives.
  • Not Synced
    This capability requires an insane amount
    of information to be processed.
  • Not Synced
    We will have to capture the light
    from an enormous amount of cameras
  • Not Synced
    to create this information.
  • Not Synced
    Now, in order to do such a thing,
  • Not Synced
    we would need a setup that would host
    a numerous amount of cameras
  • Not Synced
    installed in a stage,
  • Not Synced
    and a stage big enough in order
    to fit a full cinematic experience.
  • Not Synced
    Now, that sounds like a crazy idea,
    but that's exactly what we did.
  • Not Synced
    For the last three years,
  • Not Synced
    we have been building
    a huge volumetric camera chamber.
  • Not Synced
    It's 10,000 square feet of a stage,
  • Not Synced
    enabling to capture the action
    from any location.
  • Not Synced
    We have deployed hundreds of cameras,
  • Not Synced
    sending a tremendous amount of information
  • Not Synced
    to a huge data center
  • Not Synced
    powered by the Intel supercomputers.
  • Not Synced
    The ability to have this 10,000 feet
  • Not Synced
    enables us to fit any kind of action,
  • Not Synced
    any kind of performance.
  • Not Synced
    It is the size of
    an average Broadway stage.
  • Not Synced
    We call it Intel Studios
Title:
How volumetric video brings a new dimension to filmmaking
Speaker:
Diego Prilusky
Description:

more » « less
Video Language:
English
Team:
closed TED
Project:
TEDTalks
Duration:
11:43

English subtitles

Revisions Compare revisions