Rhubarb Lipsync NG is a user-friendly add-on that integrates the Rhubarb Lip Sync engine with Blender, providing a streamlined and intuitive interface for generating and applying automated lip-sync animations directly to character models.
This rework of the well-established add-on focuses on simplicity and ease of use while ensuring good results with reasonable effort.

Key Features

• Automated Lip Sync Generation: Create lip-sync animations from audio files with minimal effort.
• Flexible Sound-to-Animation Mapping: Supports various animation mapping methods, including shape keys, armature bones, and action sheets, allowing for a wide range of scenarios.
• Low Shape Count Required: Requires only 5-8 shapes (+ one idle) for basic animations, based on the classic Hanna-Barbera chart, making it easy to achieve good results quickly.
• Multi-Object Mapping and Baking: Supports mapping and baking animations for multiple Blender objects simultaneously, useful for characters with separate parts such as tongues or teeth.
• 3D and 2D Animation Support: Compatible with 3D animations using strip blending and also with 2D animations with no blending.
• NLA Baking: Bake animations to NLA tracks and strips, allowing for easy further tweaking. The strips can then be converted to a single action using Blender's built-in baking tools.
• Inbuilt Audio Converter: Utilizes Blender's built-in converter to convert sound files directly within Blender UI to the format supported by the Rhubarb engine.
• User-Friendly Interface: Features a preview button for captured cues and mapped actions, detailed validations, result report, and background processing with progress indicators. Disabled buttons reveal reasons for error or issue when hovered over, making the interface more intuitive.

More details

• Documentation
• FAQ
• Troubleshooting Guide

Attribution

• Ellie Pose Library - Blender Demo Files
• Character base model - Rellusion