SuperGLUE is a benchmark styled after GLUE with a new set of more difficult language understanding tasks, improved resources, and a public leaderboard. It is comprised of 8 corpora (BoolQ, CB, COPA, MultiRC, ReCoRD, RTE, WiC, WSC), which cover 4 different types of tasks (QA, NLI, WSD, coref.). Slovene translation of SuperGLUE consists of machine and human translations of the benchmark. BoolQ, CB, COPA, MultiRC, and RTE are completely translated by the Google Machine Translation service. Human translators translated COPA and WSC completely, and BoolQ, CB, MultiRC, ReCoRD, and RTE in different ratios. Slovene translation of SuperGLUE is provided in three different file formats: jsonl, csv, and txt.
Tools for conversion between file formats are available on https://github.com/clarinsi/SuperGLUE