Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

QOL for keypoint standardization #78

Open
talmo opened this issue Oct 31, 2024 · 0 comments
Open

QOL for keypoint standardization #78

talmo opened this issue Oct 31, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@talmo
Copy link
Contributor

talmo commented Oct 31, 2024

When bringing in keypoint data from the wild, we often have to do a bit of alignment to get it into an initial state that is feasible for optimization.

We should provide some quality of life utilities to make this a bit simpler on the enduser:

  1. Keypoint-to-site mapping (Automate site-keypoint mapping #17): Many (if not most) experiments will induce different keypoint sets due to differences across experimental setups. 3D mocap data is hard to acquire, so we need to work with this. Right now we need to establish 1-to-1 correspondences between mocap keypoints and body model sites. It would be great to have an easier way to establish this mapping, possibly aided by a visualizer.
  2. Rotation and origin: The global coordinate system for mocap data is also arbitrary. Right now we need to do this entirely by hand on the mocap data. We should be able to (at a minimum) provide these so that mocap data doesn't need to be re-generated by the user. A better solution would be to be able to do automatically (e.g., via Procrustes) or interactively (e.g., via a visualizer GUI).
  3. Scaling: Due to lack of standardization at the camera calibration step (and the scale invariance of triangulation), units of keypoint coordinates might not be metric. We currently do this by specifying model and mocap scaling in the YAML files (example). It'd be very useful to be able to interactively or automatically (e.g., Procrustes?) do this.
@talmo talmo added the enhancement New feature or request label Oct 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant