Using Nuitrack skeleton tracking to drive a Metahuman skeleton

I used the new Nuitrack plugin for UE5 to drive a MetaHuman skeleton using my depth camera

Below is an example of Nuitrack connecting an Intel RealSense camera to Unreal Engine 5.2 and then adding an animation blueprint to a MetaHuman which is driven by the same model as the mannequin provided in the plugin.

In order to create the animation blueprint, I had to add the default rotations in the metahuman blueprint and subtract out the difference between the MetaHuman's A pose and Nuitrack's T pose.

I also had to change the joint names used to modify the bones of the animation to a map of bones contained in the metahuman skeleton (as opposed to the names of the bones in the animated skeleton).