Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

请教各位高手,有效果类似,但是可以在手机端(ios、Android)运行的对口型模型或者算法吗? #565

Open
baojuqiang opened this issue Oct 13, 2023 · 2 comments

Comments

@baojuqiang
Copy link

服务器运算用户等待时间和成本有点扛不住,想看看能不能有类似轻量级算法或者方案,在客户端来实现。
谢谢各位高手。

@potatoker
Copy link

看到有用Live2d+https://developer.oculus.com/documentation/unity/audio-ovrlipsync-unity/ 这个的,但是好像效果和兼容性有待考察。目前wav2lip等视频处理技术一般都要加个超分来缓解嘴部替换的闪烁,模糊等问题,很难想象视频嘴型替换嘴型技术直接跑在端上效果还能有保证,,,同跟踪这个问题吧

@cacard
Copy link

cacard commented Jun 24, 2024

看到有用Live2d+https://developer.oculus.com/documentation/unity/audio-ovrlipsync-unity/ 这个的,但是好像效果和兼容性有待考察。目前wav2lip等视频处理技术一般都要加个超分来缓解嘴部替换的闪烁,模糊等问题,很难想象视频嘴型替换嘴型技术直接跑在端上效果还能有保证,,,同跟踪这个问题吧

端侧跑?——目前可用的有live2d+MotionSync / Meta lipSync;端侧跑wav2lip那不太行的;NeRF流派估计有可能。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants
@cacard @potatoker @baojuqiang and others