Dexterous Manipulation via Embedded Posture Graphs of Hands with N-DoF
Building a co-embedded graph of hand postures across end effectors with differing morphology and degrees of freedom, for generalized posture mapping. Our method captures posture connections and enables representation learning via a nonlinear manifold, learning a shared representation across hands.
The embedding acts as input to train a neural cross-embodiment retargeter between N-DoF hands, and as a compact posture representation for improved sample efficiency in RL-based and other downstream tasks.