Automatic multilingual subtitling and dubbing of video lectures
Jorge Civera
Universitat Politècnica de València, Spain
Abstract
Open educational resources (OER) are rapidly growing, but are not usually offered in multiple languages due to the lack of cost-effective solutions to translate the different objects comprising them and particularly videos. However, current state-of-the-art natural language processing (NLP) technologies including automatic speech recognition (ASR), machine translation (MT) and speech synthesis (SS) have reached a level of maturity which opens the possibility of producing automatic multilingual videos of publishable quality at low cost. More precisely, multilingual subtitles and speaker-adapted dubbed tracks can be automatically provided with minimum intervention from the lecturer. In this talk, we present our experience providing multilingual video lectures describing the systems, tools and integration components employed for such purpose. Finally, multilingual videos generated with our own NLP technology will be shown.