Probing Linguistic Knowledge in Italian Neural Language Models across Language Varieties

In this paper, we present an in-depth investigation of the linguistic knowledge encoded by the transformer models currently available for the Italian language. In particular, we investigate how the complexity of two different architectures of probing models affects the performance of the Transformer...

ver descrição completa

Na minha lista:
Detalhes bibliográficos
Publicado no:URI:https://journals.openedition.org/ijcol,
Auteurs principaux: Miaschi, Alessio, Sarti, Gabriele, Brunato, Dominique, Dell’Orletta, Felice, Venturi, Giulia
Formato: Article ou chapitre numérique
Idioma:Anglais
Publicado em: IJCoL 2022
Acesso em linha:Accès Université d'Orléans et IFPM
Accès Université d'Orléans et IFPM
Descrição
Resumo:In this paper, we present an in-depth investigation of the linguistic knowledge encoded by the transformer models currently available for the Italian language. In particular, we investigate how the complexity of two different architectures of probing models affects the performance of the Transformers in encoding a wide spectrum of linguistic features. Moreover, we explore how this implicit knowledge varies according to different textual genres and language varieties.