3D Human Pose Estimation

Question

I am working on human pose estimation work. I am able to generate 2d coordinates of different joints of a person in an image. But I need 3d coordinates to solve the purpose of my project.

Is there any library or code available to generate 3d coordinates of joints ?

Please help.

Answer 1

for 3d coordinates on pose estimation there is a limit for you. you cant get 3d pose with only one camera (monocular). you have 2 way to estimate those :

1. use RGBD ( red, green, blue and depth) cameras like Kinect

2. or use stereo vision with using at least two camera.

for RGBD opencv contrib has a library for that.

but if you want to use stereo vision you have some steps:

1.Get camera calibration parameters

for calibration you can follow this.

2.then you should get undistorted of your points with using calibration parameters.

3.then you should get projection matrix of your both cameras.

4.at last, you can use opencv triangulation for getting 3D coordinates.

for more info about each step, you can search about stereo vision, camera calibration, triangulation and etc.