| | --- |
| | language: |
| | - nl |
| | pipeline_tag: automatic-speech-recognition |
| | license: cc-by-nc-4.0 |
| | --- |
| | |
| | # Model |
| |
|
| | This repository contains the third version of our Automatic Speech Recognition and Subtitle Generation model for Flemish Dutch. |
| | Compared to the [second version](https://huggingface.co/nelfproject/ASR_subtitles_v2), the model is a fully Pytorch-based model without dependency on Kaldi-features, facilitating simple deployment and finetuning. |
| |
|
| | The model has been trained on 300 hours of verbatim annotated Flemish data from CGN (with 3-fold noise augmentation), 700 hours of Netherlands Dutch data from CGN, as well as 14000 hours of weakly-supervised subtitled Flemish broadcast media data. |
| | Additionally, we enriched the training data by generating contextualised verbatim pseudo-labels conditioned on the subtitles, to improve rare word recognition in verbatim transcripts. |
| |
|
| | The model can generate both an exact verbatim transcription with annotation tags as well as a fully formatted and cleaned up subtitle transcription. It outputs both modalities with separate decoders. |
| | The model consists of 180M parameters and requires 2-6GB GPU RAM for inference. |
| |
|
| | **Version**: August 2025 |
| |
|
| | # Usage |
| |
|
| | This repository only hosts the pre-trained model itself and the configuration files. To download this repository, follow the instructions by Huggingface. |
| |
|
| | Usage of this model and an example test file to perform inference - fully integrated with a VAD pipeline - can be found on [Github](https://github.com/nelfproject/NeLF_Speech2Text_Pytorch). |
| | We incorporated the [Silero VAD](https://github.com/snakers4/silero-vad) in this pipeline, which is uploaded as part of the model files. |
| |
|
| | The model is released under a Creative Commons Non-Commercial license. |
| |
|
| | # Citation |
| |
|
| | If you use this model, please cite the research paper: |
| | ```bibtex |
| | @article{poncelet2024, |
| | author ={Poncelet, Jakob and Van hamme, Hugo}, |
| | title ={Leveraging broadcast media subtitle transcripts for automatic speech recognition and subtitling}, |
| | year={2026}, |
| | booktitle={Journal on Audio, Speech and Music Processing}, |
| | volume={11}, |
| | } |
| | ``` |
| |
|
| | # Contact |
| | Jakob Poncelet: jakob.poncelet@kuleuven.be |
| |
|
