Slovene Punctuation and Capitalisation model RSDO-DS2-P&C 3.6

PID

This Punctuation and Capitalisation model was trained following the NVIDIA NeMo Punctuation and Capitalisation recipe (for details see the official NVIDIA NeMo P&C documentation, https://docs.nvidia.com/deeplearning/nemo/user-guide/docs/en/stable/nlp/punctuation_and_capitalization.html, and NVIDIA NeMo GitHub repository https://github.com/NVIDIA/NeMo). It provides functionality for restoring punctuation (,.!?) and capital letters in lowercased non-punctuated Slovene text.

The training corpus was built from publicly available datasets, as well as a small portion of proprietary data. In total the training corpus consisted of 38.829.529 sentences and the validation corpus consisted of 2.092.497 sentences.

Identifier
PID http://hdl.handle.net/11356/1735
Related Identifier https://github.com/clarinsi/Slovene_punctuator
Related Identifier https://rsdo.slovenscina.eu/en/speech-technologies
Metadata Access http://www.clarin.si/repository/oai/request?verb=GetRecord&metadataPrefix=oai_dc&identifier=oai:www.clarin.si:11356/1735
Provenance
Creator Lebar Bajec, Iztok; Bajec, Marko; Bajec, Žan; Rizvič, Mitja
Publisher Faculty of Computer and Information Science, University of Ljubljana
Publication Year 2022
Rights Apache License 2.0; https://opensource.org/licenses/Apache-2.0; PUB
OpenAccess true
Contact info(at)clarin.si
Representation
Language Slovenian; Slovene
Resource Type toolService
Format text/plain; charset=utf-8; application/octet-stream; downloadable_files_count: 1
Discipline Linguistics