Applying motion capture from Perception Neuron to rigs from TF2?

Hi guys!

This might be a long story, but I'll try to keep it short. I just got a motion capture kit called Perception Neuron. It's pretty good, but now I actually need to figure out how to make it work with Source Filmmaker and its very disproportionate rigs from TF2.

Perception Neuron is using its own rigs, with normal proportions. 

So I hit the record button (I do not record fingers, only main bones), do my little tap dance and export it as 3ds max biped (*.bvh).

Then I open my latest 3ds Max, and follow all the steps from this guide. And as you can see, the model in the end of the video is messed up, due to shoulders being not as wide, hands not as long etc. I tried all kinds of retargeting - it's wrong every time. Even if I move the rotation and position of the mesh so it matches the mocap pose as close as possible - it's just not right.

This is the example of what it looks like if I do the Automap thing. Not only that it looks like something out of Silence of the Lambs, but the main problem as you can see is the CATRig is smaller and limbs have very different proportions compared to the Heavy model.


So I wonder if there is a way of rescaling the CATRig so it matches the Heavy from TF2. Or maybe there's a way of applying mocap data directly on to the Heavy rig, not via mapping from CATRig.

At the end of the day, messing around with a bone positioning on a Heavy mesh all day, and manual CATRig rescaling (that doesn't even work properly) is not practical, because I plan on importing a lot of animations like this for all TF2 classes. Doing it for every mocap file would take more time than animating them manually from SFM. 

I include the *.bvh motion capture file I created from Perception Neuron in case some of you guys want to try it. I do the T-pose sometime at the frame 700.

Any help is appreciated! Thanks!

Update: So using this video I managed to figure out how to fix the height of the CATRig problem, so it doesn't look as freaky. But the lenght and proportions of the limbs is still an issue. So any tips on that are still appreciated. 

Replies

  • Sexy.KOT69
    Okay after a day of messing around and a lot of help from awesome MaxOfS2D, I've managed to export it as *.fbx, converted it to *.dmx and now I get this problem in SFM. 

    Can anybody tell me, why is my sniper a pancake? And what should I do to fix it? He's moving around perfectly (meaning the pelvis got imported properly). 


    Edit: Help no longer needed, I've figured it out guys! Thanks!
  • Quzga
    Offline / Send Message
    Quzga polycounter lvl 3
    How did you make it work? have had my neuron for a few months but still no luck :S 
  • Aabel
    Offline / Send Message
    Aabel polycounter lvl 5
    I've got a couple perception neuron systems and have worked out a solid pipeline of  getting data out of it and into unity. Maybe some of what I have to say will help you. First avoid FBX right now. The neuron axis software exports a severely flawed skeleton if you use fbx, it's very asymmetrical and those assymetries will affect your retargetting and data. 

    For the kind of retargetting you are doing you need to use one of these three programs if you do not wish to write your own retargetting solver: Maya (LT works fine too), Motion Builder, Ikinema Web animate. Those 3 packages out of the box should be able to handle retargeting to the source skeleton. I am less sure about web animate, but in theory it should be able to handle it.

     I would suggest exporting as processesd bvh, with a tpose at head, load that into max(hopefully) and then export that from max to maya or web animate and retarget there. Just avoid fbx out of neuron axis at all costs, especially for retargetting.
  • Quzga
    Offline / Send Message
    Quzga polycounter lvl 3
    Aabel said:
    I've got a couple perception neuron systems and have worked out a solid pipeline of  getting data out of it and into unity. Maybe some of what I have to say will help you. First avoid FBX right now. The neuron axis software exports a severely flawed skeleton if you use fbx, it's very asymmetrical and those assymetries will affect your retargetting and data. 

    For the kind of retargetting you are doing you need to use one of these three programs if you do not wish to write your own retargetting solver: Maya (LT works fine too), Motion Builder, Ikinema Web animate. Those 3 packages out of the box should be able to handle retargeting to the source skeleton. I am less sure about web animate, but in theory it should be able to handle it.

     I would suggest exporting as processesd bvh, with a tpose at head, load that into max(hopefully) and then export that from max to maya or web animate and retarget there. Just avoid fbx out of neuron axis at all costs, especially for retargetting.
    So I managed to actually get everything working using Maya and Motionbuilder (Jimer Lins guide). Retargetting works fine and everthing looks good, my problem is that when I export the file from Maya to .DMX and open it in SFM there is no animation at all. The character changes position but no animations are applied. You have any clue what I can do?

    edit: Maya seems kinda outdated when it comes to valve's plugin so maybe my best shot is to use 3dsmax instead?
Sign In or Register to comment.