Hand Mudra Reconstruction

Pose and shape estimation of complex hand mudras.

Check out this blog which explains nicely about the hasta mudras. Hasta Mudra are very complex hand poses. Getting correct poses and shape for such images is very difficult. Even there is no dataset for it.

Hence, we generate the dataset of such complex hand mudras in Blender. The dataset include

  • RGB image
  • Depth image
  • 2D and 3D joints
  • per-joint segmentation mask
Synthetic data generation

Once data is generated, we train a mesh convolution network to estimate the pose and shape of the hand mudra from monocular image.