[go: nahoru, domu]

Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About MeshNet with 3D gt as input! #61

Open
Z-Z-J opened this issue Mar 31, 2023 · 7 comments
Open

About MeshNet with 3D gt as input! #61

Z-Z-J opened this issue Mar 31, 2023 · 7 comments

Comments

@Z-Z-J
Copy link
Z-Z-J commented Mar 31, 2023

QQ截图20230331085820
Can you tell me more details about MeshNet's individual training?

@Z-Z-J
Copy link
Author
Z-Z-J commented Mar 31, 2023

QQ截图20230331090410
when 3D pose GT is taken as input, in Tab.4 the performance: 29.0 MPJPE and 23.0 PA-MPJPE on H36M. But in Tab.13, the performance: 13.9MPJPE 9.9 PA-MPJPE on H36M.
Why performance is inconsistent?

@hongsukchoi
Copy link
Owner
hongsukchoi commented Mar 31, 2023

Hi, as written in the paper, MeshNet is trained with GT 3D pose in Table 13, while Pose2Mmesh is trained with GT 2D pose + synthesized errors in Table 4

@Z-Z-J
Copy link
Author
Z-Z-J commented Mar 31, 2023

I attempt to train MeshNet with GT pose as input on H36M (using SMPL skeleton).
QQ截图20230331133227
QQ截图20230331133244
In training set, we observe that MPVE: 6.3 mm, MPJPE: 11.9mm
But in testing set, MPVE: 20.9591mm, MPJPE: 33.7mm

Compared with using H36M skeleton (MPJPE: 13.9mm in Tab. 13), the results are very different. Can you tell me the code about MeshNet's individual training?

@hongsukchoi
Copy link
Owner

Train input: H36M skeleton
Test input: H36M skeleton
GT for evaluation: H36M skeleton

And also refer to yaml here.
I don't have the MeshNet training yaml file now, but I believe you can make it.

@Z-Z-J
Copy link
Author
Z-Z-J commented Apr 1, 2023

Thank you for your reply! Can you provide the pre-training model (only training MeshNet with 3D GT)?

@felixshing
Copy link

Thank you for your reply! Can you provide the pre-training model (only training MeshNet with 3D GT)?

Hey I would like to ask do you train such pre-training model for MeshNet? I am also looking for that.

@hongsukchoi
Copy link
Owner

Hi all,

It's been a while after this project and I cannot find the pre-trained MeshNet model now. But it's easy to train MeshNet, referring to the code here: https://github.com/hongsukchoi/Pose2Mesh_RELEASE/blob/202ce98fce2bac74ff3787c7e30352a64d027950/lib/core/base.py

If you don't wanna train yourself, load the pre-trained Pose2Mesh and just use the MeshNet part by feeding the 3D pose to the MeshNet.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants