Rockstar’s Amazing Facial Expression Technology

Rockstar’s Amazing Facial Expression Technology

by Steve Napierski to Videos

Since I haven’t been keeping up with anything about Rockstar Games’ L.A. Noire this video comes as complete surprise to me. Nonetheless, this development video looks friggin’ awesome and I can honestly say that L.A. Noire is on my personal radar now.

Discussion (30)¬

  1. Nuckel
    Nuckel says:
    December 17, 2010 at 2:33 pm #

    They used a similar technologie for Resident Evil 5 but without reaching this quality. This is bringing games way further to life and it should spread throughout the whole industrie.

    • rohan
      rohan says:
      December 23, 2010 at 7:31 pm #

      learn to fucking spell.

  2. Rob
    Rob says:
    December 17, 2010 at 9:49 pm #

    Is that the dad from Bill and Ted’s excellent adventure at 3:25? I think it is… but it doesn’t say his name or anything.

  3. KommieCid
    KommieCid says:
    December 17, 2010 at 9:53 pm #

    this is a game? holy crap- I thought it was a bloody movie!

  4. Anonymous
    Anonymous says:
    December 17, 2010 at 11:33 pm #

    That was friggin unbelievable. If only it was possible to do that technologie WITHOUT using actors… It would be one step forward for creating the real Matrix!

    • dj357
      dj357 says:
      December 22, 2010 at 12:08 pm #

      once they do this enough they’ll get enough data points to accurately apply them to virtual characters without the need for real actors and that’s when shit starts to get crazy, imagine applying that kind of knowledge to sci-fi characters e.g. aliens everything get’s a whole lot more realistic!

  5. muyfuerte
    muyfuerte says:
    December 18, 2010 at 5:37 am #

    Looks Awesome!

  6. TomTom
    TomTom says:
    December 18, 2010 at 2:05 pm #

    Now will the game be any good? Rockstar has been pretty consistently good, so I think it should be. But it’s almost worth owning just because of the ridiculous facial expression technology. Given personable characters and a good story and we have a runner that matches Mass Effect 2 here.

  7. casketsalesman
    casketsalesman says:
    December 18, 2010 at 7:01 pm #

    that is an incredible thing, i gotta play it

  8. amckern
    amckern says:
    December 18, 2010 at 10:43 pm #

    Good to see there are still Aussie studios making there own IP

  9. jaxsun
    jaxsun says:
    December 19, 2010 at 1:47 am #

    It’s a bit of a shame really, the great quality of the faces trumps the rest of the visuals making them look archaic in contrast :P

  10. Dave Kliman
    Dave Kliman says:
    December 19, 2010 at 12:56 pm #

    The way the heads move is still not realistic… maybe this comes from recording people while seated for standing dialog… but whatever it is, the head moves around unnaturally… this problem is also evident in some spots in avatar… it’s going to be a holy grail for programmers to figure out what they’re doing wrong.

  11. genewitch
    genewitch says:
    December 19, 2010 at 5:04 pm #

    Kliman: i think you are right, it is almost as if they were pasting the 2d video onto a 3d sphere (the face in game) – some things looked really good, some looked really weird.

    They should literally just hire people to walk around and speak lines to cover the motion capture for standing scenes. the nice thing is, you can have a different voice actor than body actor and face actor…

  12. Christopher David Smedley
    Christopher David Smedley says:
    December 19, 2010 at 5:10 pm #

    This is what I thought games should do for ages! Sure, the technology wasn’t the best, but you know… I always thought at least around lips and things! This looks great!

  13. Chris Smedley
    Chris Smedley says:
    December 19, 2010 at 5:11 pm #

    Ooops, don’t know what happened with my last comment :S

  14. TuxRug
    TuxRug says:
    December 20, 2010 at 1:08 am #

    Too bad I don’t have a PS3 or an XBox360… Of course the Wii isn’t powerful enough to do this kind of stuff, and there’s too many variables in PC performance for them to release a PC version, I guess.

  15. Radioactive24
    Radioactive24 says:
    December 20, 2010 at 3:23 am #

    I half-expected to see Quantum Dreams tagged on there. It looked similar to Heavy Rain.

  16. Kirk
    Kirk says:
    December 20, 2010 at 5:59 am #

    @Kliman: I agree, it might not be the best idea to film the actors faces while sitting. They should’ve done it like they did with Avatar. If an actor acts the entire scene in one take, and the facial data is captured at the same time as the rest of the body, the result will look much more natural.

    @genewitch:
    The problem with overdubbing a scene that was captured by some other actor is, that it never sounds natural. The people who did “Uncharted” actually realized that, and did motion capture and voice tracks at the same time, with the same actors. The result sounds much more convincing.

    • zwenkwiel
      zwenkwiel says:
      December 22, 2010 at 5:49 am #

      don’t think they can do that at the same time though
      the guy has to sit down because he’s surrounded by camera’s and lights
      a lot of head movement would probably mess up the scan

  17. Martin
    Martin says:
    December 20, 2010 at 9:09 am #

    Well, Avatar did use about the same technology for capturing the actors face. They had a head-camera and motion-capture points on their faces, as well as many cameras everywhere to capture their body movement.

  18. Lord of Numa
    Lord of Numa says:
    December 21, 2010 at 1:57 am #

    Walter, what are you doing in L.A.? Come on, Olivia needs us back at the lab

  19. the rick
    the rick says:
    December 21, 2010 at 7:05 am #

    fix that issue and give the tech to bethesda softworks :) they need it

  20. Sean
    Sean says:
    December 21, 2010 at 12:43 pm #

    OK… so the “stupid” question has to be asked… why not just shoot video instead?

    • jmack
      jmack says:
      December 22, 2010 at 5:53 am #

      cuz its a video game

  21. KC
    KC says:
    December 21, 2010 at 4:13 pm #

    @Lord of Numa – I was thinking that exact same thing.

  22. Gonz
    Gonz says:
    December 21, 2010 at 6:29 pm #

    So, my mind was just blown and this is one of the most awesome things i’ve ever seen but, i think this still leaves out nonhuman characters unless they are very humanlike. which thinking about it now… they mostly would be.

  23. bobo
    bobo says:
    December 21, 2010 at 10:09 pm #

    Oh my god…some of the animations look so real. yet so dead.

  24. jmack
    jmack says:
    December 22, 2010 at 5:51 am #

    the head does kinda look off from the body still looks great but why cant they use that same technology to just capture the actors full body movement instead of just the head if they can capture the face with that much detail then why not the body movement. i mean even the kinect can pretty much sense the movement of your body pretty accurately and thats only one camera. then games can have real actors in them that would be awesome. once they figure this out it will change alot of things in the gaming industry and movie industry

  25. Overlord
    Overlord says:
    December 24, 2010 at 3:39 am #

    mind = blown