how to animate mouth with mesh2motion?

[karelrosseel]

I like the idea of a robothead with talking mouth: check this 2 videos
how can I do animation with up and down lips?
see lego AI mindstorms bot https://youtu.be/MghrMAWsfi8?si=9yPuC-B43DEsl20E&t=392
old lego AI mindstorms bot https://www.youtube.com/watch?v=E0FiSvLp0QY
so kids can also make BEP https://www.youtube.com/watch?v=Dx8DfVJK0MU&sttick=0

[scottpetrovic]

I will need more information on what you are trying to do. This seems like something that should be done later after Mesh2Motion when you actually have something like audio to make the mouths go up and down. The human doesn't have any mouth bones, but all the other rigs do to later manipulate in something like a game engine or other tool

[karelrosseel]

Thanks to answer, the idea is here 'only moving the mouth'
, I want seperate objects to be moved up and down, so the rig must be triggerd for the mouth lips vertical line, extra: when the mouth is moving the chin body part should be moving also withit, any idea how to rig that? you can find my 3D https://github.com/karelrosseel/model3d/blob/main/legohead/Scene.gltf
example video found http://youtube.com/watch?v=egQFAeu6Ihw
and using https://github.com/DanielSWolf/rhubarb-lip-sync
and see final idea https://r3f-lipsync-tutorial.vercel.app/ : tip: you can turn around the stage to see layers
with free avatar at https://readyplayer.me/learn you can download the avatar.glb here https://models.readyplayer.me/646d9dcdc8a5f5bddbfac913.glb
find more info at https://github.com/wass08/r3f-vite-starter
check example file https://github.com/Anish-Someashwara/Threejs-Mouth-LipSync

[karelrosseel]

maybe try it with this robot https://threejs.org/examples/webgl_animation_skinning_morph
found into this article https://discourse.threejs.org/t/facial-morphs-on-a-skinnedmesh-character/27606

[karelrosseel]

I found also face https://discourse.threejs.org/t/add-lip-sync-to-existing-3d-model-of-head/49943/2
to be able to change with black rectangles editor here https://3dpk.co.uk/morphtargets/
with more beautiful grey face https://threejs.org/examples/webgl_morphtargets_face