TG/RC Lip Sync Test (NSFW Version) (Patreon)

So after 18 hours or so, I finally managed to get this to look decent! The main reason it took so long was failing with the ComfyUI version of Live Portrait. For anyone interested in trying this themselves, this gradio interface is much better: https://huggingface.co/cleardusk/LivePortrait-Windows

I think the main issue with this test is that the realistic facial movement makes everything else look very stiff and wooden. At least, I think that's the issue. So this will be a challenge to solve with AnimateDiff going forward. I'll post an update on the next project shortly. Thanks for your support as always!

Edit 9/10/24: Wasn't particularly happy with this and tried a slightly different workflow - Live Portrait for the eyes and facial expression into Runway for lip sync. Let me know if you like it better or worse. https://drive.google.com/file/d/1WVER_FrNg-MeghConzJu6VIrhGBipX2S/view?usp=sharing