Can this be used with aDetailer?

[andupotorac]

As you know aDetailer automatically passes through an image and detects the faces and the hands, and it then inpaints on them what you ask it to. I'm curious if this could be used with it, so that when it passes through it fixes the hands with HandRefiner.

[andupotorac]

Another question - could this work with feet also?

[wenquanlu]

Hi, for using it with aDetailer, you can find more information on this post Mikubill/sd-webui-controlnet#2400

For the question about feet, the same technique is also applicable to feet, but we need a different image-to-mesh reconstruction model, (the hand meshgraphormer will not work in this case). You can try other whole-body reconstruction models and only extract the foot mesh, or try the reconstruction model specifically for feet (which is rarer). It is a do-able task from the technical perspective, but it requires some engineering and experimentation to make it work.

[andupotorac]

Hi, for using it with aDetailer, you can find more information on this post Mikubill/sd-webui-controlnet#2400

For the question about feet, the same technique is also applicable to feet, but we need a different image-to-mesh reconstruction model, (the hand meshgraphormer will not work in this case). You can try other whole-body reconstruction models and only extract the foot mesh, or try the reconstruction model specifically for feet (which is rarer). It is a do-able task from the technical perspective, but it requires some engineering and experimentation to make it work.

Thanks for the link regarding aDetailer. I hope someone picks up the slack on the feet effort, as my skills aren't there! :)

[andupotorac]

@wenquanlu I wanted to follow-up on the Foot Refiner idea, as I found a data set I believe you might be able to use:

1. https://github.com/OllieBoyne/Foot3D
2. https://github.com/OllieBoyne/FIND