On Efficiently Acquiring Annotations for Multilingual Models
Joel Ruben Antony Moniz, Barun Patra, Matthew R. Gormley
Abstract
When tasked with supporting multiple languages for a given problem, two approaches have arisen: training a model for each language with the annotation budget divided equally among them, and training on a high-resource language followed by zero-shot transfer to the remaining languages. In this work, we show that the strategy of joint learning across multiple languages using a single model performs substantially better than the aforementioned alternatives. We also demonstrate that active learning provides additional, complementary benefits. We show that this simple approach enables the model to be data efficient by allowing it to arbitrate its annotation budget to query languages it is less certain on. We illustrate the effectiveness of our proposed method on a diverse set of tasks: a classification task with 4 languages, a sequence tagging task with 4 languages and a dependency parsing task with 5 languages. Our proposed method, whilst simple, substantially outperforms the other viable alternatives for building a model in a multilingual setting under constrained budgets.
Create a lesson
Related papers
The Silent Cost of Conversation History in LLM Reasoning
Ali Şenol
Mandarin Wh-Indefinites Follow Nonveridicality in Multilingual LLMs, Unlike English any
Guofang Tang
A Dataset for Misogyny Detection in Polish Social Media: Transferability of Hateful Speech Detection from General to Specific Types of Hate
Ewelina Gajewska
Offline-First Quantized AI: Design and Evaluation of an On-Device Maternal-Health Assistant for Low-Connectivity Environments
Okenla AbdulQahhar Abimbola, Maurice Abraham John, Adepoju Jeremiah Moyondafoluwa et al.
The novelty exposed: ablation, reproducibility and transparency in 40 technical reports of open-weight large language models (LLMs)
Bahaeddin Türkoğlu
Anatomy of an Agent Harness: Decisions, Invariants and Corner Cases
Resham Joshi