ElevenLabs, the AI voice startup, has just released a new tool called the AI Voice Isolator. This tool is designed to remove unwanted ambient noise and sounds from any type of content, such as films, podcasts, and YouTube videos. While this tool is not entirely new in the market, with other creative solution providers like Adobe offering similar tools, the effectiveness of the Voice Isolator remains to be seen.
The AI Voice Isolator works by processing the content in the post-production stage. Users simply need to upload the content they want to enhance, and the tool will detect and remove unwanted noise, extracting clear dialogue as output. According to ElevenLabs, the quality of speech extracted by the product is similar to that of content recorded in a studio.
To test the real-world applicability of the voice isolator, three tests were conducted. In all cases, the tool was able to process the audio within seconds and remove various background noises, such as opening/closing doors, clapping, and moving household items. However, there were a few sounds that the tool failed to recognize and remove, such as banging on the wall and finger snapping. It’s worth noting that at this stage, the tool does not work on music vocals.
While the Voice Isolator stands out from other tools due to its ability to remove irregularly occurring background noise, there is still room for improvement. ElevenLabs has not shared much about the underlying models powering the tool or whether user recordings are used for training purposes. However, users can opt out of the use of their personal data for training by filling out a form linked in ElevenLabs’ privacy policy.
Currently, the Voice Isolator is only available through ElevenLabs’ platform. However, the company plans to open API access in the future. Users can access the tool for free with certain usage limits, and there are paid plans available for those looking to remove background noise from larger audio files.
Overall, the AI Voice Isolator from ElevenLabs presents a promising solution for creators looking to enhance the quality of their content by removing unwanted ambient noise. While there is still room for improvement, this tool offers an accessible and efficient option for creators, especially those with limited resources.