GCG-Based Artificial Languages for Evaluating Inductive Biases of Neural Language Models

Recent work has investigated whether extant neural language models (LMs) have an inbuilt inductive bias towards the acquisition of attested typologically-frequent grammatical patterns as opposed to infrequent, unattested, or impossible patterns using artificial languages (White and Cotterell, 2021;Kuribayashi et al., 2024).The use of artificial languages facilitates isolation of specific grammatical properties from other factors such as lexical or realworld knowledge, but also risks oversimplification of the problem.In this paper, we examine the use of Generalized Categorial Grammars (GCGs) (Wood, 2014) as a general framework to create artificial languages with a wider range of attested word order patterns, including those where the subject intervenes between verb and object (VSO, OSV) and unbounded dependencies in object relative clauses.In our experiments, we exemplify our approach by extending White and Cotterell (2021) and report some significant differences from existing results.