Must Cut Studio is the first free digital doppelganger customisation tool launched by B station (BiliBili), using advanced AI technology, allowing users to upload their personal video and voice data, generating highly simulated digital doppelganger models to achieve realistic out of the camera effects, helping video and audio creators to improve the efficiency of their creations. In addition, Must Cut Studio also provides tone customisation, after users submit their audio, the system can generate a personalised tone model and input text to generate voice, simplifying the creation process. The tool aims to promote the application of AI technology in the field of video creation, while ensuring the security and privacy of user data.
Key features of Must Cut Studio
- Digital Doppelganger Generation: Using AI technology, BE Cut Studio is able to accurately generate a digital model that looks and sounds highly similar to a real person based on the user's uploaded real-life video and voice data. This digital doppelganger can be used in the production of a variety of video content without the need for a real person to appear in the film, which greatly improves the efficiency of creation.
- Tone Customisation and Synthesis: Users only need to submit a 30-minute audio sample, and BE CUT Studio can learn and simulate the user's tone characteristics through AI technology to create a personalised tone model. Afterwards, the user only needs to input the text, and the system can intelligently synthesise the digital voice with the user's characteristics to achieve rapid dubbing.
- Text and audio-driven: In addition to timbre customisation, Must Cut Studio also supports text and audio-driven digital split dictation synthesis. This means that users can choose text input or audio upload according to their needs, and the system will automatically convert these into a dynamic representation of the digital doppelganger.
- Green screen and live-action footage support: In order to increase the diversity and professionalism of videos, BE-CUT Studio supports users to upload green screen or live-action video footage to be used in conjunction with the digital split in order to achieve richer and more realistic video effects.
- One-stop creation process: BE Cut Studio provides a one-stop service from the creation of digital doppelgangers to video production. Users can complete all the creation steps on one platform without switching between multiple tools or software, greatly simplifying the complexity of video production.
Challenges Solved by Must Cut Studio
- No professional equipment: BE CUT Studio allows users to record video and audio using existing ordinary cameras and microphones, generating high-quality digital split videos without the need for expensive professional equipment.
- Don't want to arrange the background: The tool supports green screen technology, users can record in front of any simple background, then by uploading the green screen material, the system will automatically replace it with the desired background, avoiding the tedious background arrangement.
- Lazy make-up and dressing up: Using digital split technology, users can create a virtual image without make-up and dressing up, and this image can appear in the video on behalf of the user, saving the time of actual make-up and dressing up.
- Recording is too cumbersome: Must Cut Studio's tone customisation feature allows users to record an audio sample once, after which the system can generate a personalised tone model based on that sample, simplifying the recording process, and allowing users to even generate a voice directly by typing in text.
- Low efficiency in making videos: The tool's one-stop service, from the creation of digital split to video production, can be completed through a single platform, which reduces the time spent switching between different software and tools, and significantly improves the efficiency of video production.
