How to generate more flexible face structures with InstantID?

[duongna21]

InstandID is amazing, thank you for your great work!

However, I noticed a problem with my output in that the face structure/pose is fixed and similar to the original input. For example:

How can InstantID create more dynamic face structures/poses as can be done by IPAdapter FaceID reducing the face structure weight?

[haofanwang]

For novel-view synthesis, you can provide a different pose by mean of another image. You may also try to generate without pose (set it to a black image), but the performance is not guaranteed.

[zsxkib]

Which line of code loads the pose image? Could you give some direction?

[johndpope]

@zsxkib - if you're using comfyui - there's a workflow example here https://github.com/ZHO-ZHO-ZHO/ComfyUI-InstantID/tree/main/INSTANTID%20WORKFLOWS

[nosiu]

Which line of code loads the pose image? Could you give some direction?

https://github.com/InstantID/InstantID/blob/main/gradio_demo/app.py#L229

image_embeds (face) from one image, and a different image as face_kps