Live Portrait

What is Live Portrait?

Live Portrait is a cutting-edge technology that allows users to transform static images into lifelike animations with incredible precision and control. With features like multi-style portrait animation, precise eye and lip movement control, and advanced self-reenactment capabilities, Live Portrait sets itself apart as a versatile and efficient tool for portrait animation. The website, Live Portrait, offers a user-friendly interface and step-by-step guidance on how to animate static portraits in just three simple steps. Users can upload their portrait image, select or upload a driving video, and generate a realistic animation with ease. Live Portrait's high-quality animations are generated from a single source frame, showcasing its superior performance in recreating dynamic video sequences. Additionally, Live Portrait supports powerful cross-reenactment, allowing for seamless motion transfer between different portraits in diverse scenarios. Overall, Live Portrait is a game-changer in the world of portrait animation, offering unparalleled control, efficiency, and versatility.

Live Portrait leverages cutting-edge AI technology to efficiently synthesize lifelike videos from a single source image, showcasing its commitment to better generalization, controllability, and efficiency for practical usage. The features of Live Portrait, such as self-reenactment, cross-reenactment, eye and lip retargeting control, and various animation styles, highlight its versatility and adaptability in various portrait animation scenarios. Developed by a team of researchers from Kuaishou Technology, University of Science and Technology of China, and Fudan University, Live Portrait incorporates state-of-the-art technologies like the implicit-keypoint-based framework and mixed image-video training strategy to achieve exceptional performance. With a generation speed of 12.8ms on an RTX 4090 GPU, Live Portrait demonstrates its efficiency in generating high-quality animations in real-time. The project's open-source code and models are available on GitHub for further exploration and experimentation, making Live Portrait accessible to a wider audience of AI enthusiasts and researchers.

Live Portrait offers a plethora of application scenarios, ranging from self-reenactment to portrait animation from still images, portrait video editing, and animation across different styles. Its advanced features, such as eye and lip retargeting control and fine-tuning for animal animation, make Live Portrait a versatile tool for creating dynamic and lifelike animations. The performance of Live Portrait is impressive, with a generation speed of 12.8ms on an RTX 4090 GPU, showcasing its ability to generate high-quality animations efficiently. Users can start using Live Portrait for free by visiting the free playground on the website, where they can experience the power and versatility of this innovative AI tool. Overall, Live Portrait stands out as a groundbreaking solution for transforming static images into lifelike animations, offering unparalleled control, efficiency, and performance.

Live Portrait Features

Multi-Style Portrait Animation

Multi-Style Portrait Animation is a key feature of Live Portrait that allows users to animate still images across various styles and sizes using stitching technology.

• Live Portrait uses advanced stitching technology to seamlessly animate still images in different styles and sizes.
• Users can select the desired style for their portrait animation and let Live Portrait handle the rest.
• The technology ensures smooth transitions between different styles and sizes, resulting in lifelike animations.

Portrait Video Editing with Stitching

Portrait Video Editing with Stitching is another standout feature of Live Portrait that offers dynamic video-to-video face animation and editing capabilities using stitching technology.

• Users can upload a driving video that shows facial movements, which will guide the facial motion generation for the portrait image.
• Live Portrait seamlessly stitches the video content with the portrait image to create a cohesive and realistic animation.
• The technology ensures precise alignment between the driving video and the portrait image, resulting in accurate facial expressions and movements.

Precise Eye Animation Control

Live Portrait offers Precise Eye Animation Control, enabling users to dynamically adjust eye openness using scalar inputs for nuanced expression control.

• Users can fine-tune the eye animations of their portraits by adjusting the scalar inputs for eye openness.
• Live Portrait ensures precise control over eye movements, allowing users to create lifelike expressions with detailed eye animations.
• The technology dynamically adjusts the eye expressions based on the input parameters, resulting in realistic and emotive animations.

Accurate Lip Movement Control

Accurate Lip Movement Control is a key feature of Live Portrait that allows users to fine-tune lip positions with scalar-based inputs for precise speech and expression animation.

• Users can adjust the lip positions of their portraits using scalar inputs to ensure accurate lip movements during speech and expression animation.
• Live Portrait enables users to control the nuances of lip synchronization, leading to realistic and convincing speech animations.
• The technology takes scalar-based input parameters for lip movement control, resulting in lifelike lip animations that enhance the overall quality of the portraits.

How to Use Live Portrait?

• Navigate to the Live Portrait website at https://live-portrait.org.
• Sign in or create a free account to access the features.
• Locate the 'Animate' section on the Live Portrait homepage.
• Click on the 'Upload Portrait Image' button.
• Select a clear portrait photo from your device. Ensure that the face is clearly visible and well-lit.

• Once the portrait image is uploaded, you will be prompted to choose a driving video.
• You can either select from the pre-existing videos available on Live Portrait or upload your own.
• Click 'Select Driving Video' if you want to use a pre-existing video.
• If uploading your own, click 'Upload Driving Video' and choose a video file from your device. The driving video should clearly show facial expressions and movements that you want to map onto the portrait image.

• After selecting or uploading the driving video, you will see an 'Animate' button. Click on it.
• A configuration panel will appear, offering options to adjust various parameters like eye openness and lip positions.
• You may keep the default settings for optimal results or tweak the parameters to suit your specific needs.
• Click the 'Generate' button to start the animation process.
• Wait for Live Portrait to process and generate the animated portrait. This may take a few moments depending on the complexity of the animation.

• Once the animation is generated, you will see a preview of your lifelike animated portrait.
• If satisfied with the result, click 'Download' to save the animated video to your device.
• You can also directly share the animation via social media platforms or email by clicking the 'Share' button.
• If you wish to make further adjustments, you can go back to the previous steps and reconfigure the settings as needed.

Live Portrait Frequently Asked Questions