Conversion to SMPL parameter (Choreographic for music in the wild, positional data --> rotational data)

[h0han]

Hello, thank you for your wonderful work.
I'm seeking a way to take the choreography for music in the wild as a .fbx format.
For this, I have tried to convert the 3D position into SMPL parameter, using the commend of python -u main_actor_critic.py --config configs/actor_critic_demo.yaml --train and rotmat=True in the config file.
In this process, I have a question about the function of visulizeAndWrite() in functional.py. In the function, the dance motion data (maybe predicted 3D position sequence) is got into the get_closest_rotmat() and rotmat2aa. As I know, the SMPL model can predict its parameters using the 3D rotational data, but in the code, there is no function for converting positional data to rotational data.

So, is there a way of converting positional data to rotational data? Or do I implement the function using the IK method and so on?

If there's anything I'm misunderstanding, I would appreciate it if you could correct me.

[Ancolie18]

https://github.com/wangsen1312/joints2smpl
hi, this project seems can do what you want. I tried it, but meet some error. you can try it too~

[juhayna-zh]

https://github.com/wangsen1312/joints2smpl hi, this project seems can do what you want. I tried it, but meet some error. you can try it too~

hey, i find this project useful. i successful converted it to a pickle file that can be imported into Blender, and then i got a 3D model dance using the SMPL-to-FBX plugin.

however, i still cannot drive custom 3D models (such as mixamo), i can only drive SMPL's default human body. i asked some of my Blender-familiar friends, and they say that driving custom 3D models may be difficult, because SMPL is not a common skeleton format in their industry.

so i decide to stop here.
but i hope someone who is good at 3D modeling can continue to explore how to drive it. for all those interested, i also find the discussion in this link useful: google-research/mint#39

[h0han]

Dooray! 메일 발송 실패 안내 메일 발송 실패 안내 ***@***.***) 님께 보낸 메일이 전송되지 못하였습니다. 실패 사유를 확인해보세요. * 받는 사람 :  ***@***.***) * 발송 시간 :  2025-01-08T00:28:56 * 메일 제목 :  Re: [lisiyao21/Bailando] Conversion to SMPL parameter (Choreographic for music in the wild, positional data --> rotational data) (Issue #56) * 실패 사유 :  받는 사람이 회원님의 메일을 수신차단 하였습니다. 이 메일은 발신전용으로 회신되지 않습니다. 더 궁금하신 사항은 ***@***.*** 으로 문의해 주시기 바랍니다. © Dooray!.