article thumbnail

ML and NLP Research Highlights of 2021

Sebastian Ruder

2021) 2021 saw many exciting advances in machine learning (ML) and natural language processing (NLP).   2021 saw the continuation of the development of ever larger pre-trained models. 2021 saw the development of alternative model architectures that are viable alternatives to the transformer. style loss.

NLP 52
article thumbnail

AI2 at ACL 2023

Allen AI

NLPositionality: Characterizing Design Biases of Datasets and Models Sebastin Santy, Jenny Liang, Ronan Le Bras*, Katharina Reinecke, Maarten Sap* Design biases in NLP systems, such as performance differences for different populations, often stem from their creator’s positionality, i.e., views and lived experiences shaped by identity and background.

professionals

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

SQuARE: Towards Multi-Domain and Few-Shot Collaborating Question Answering Agents

ODSC - Open Data Science

QA is a critical area of research in NLP, with numerous applications such as virtual assistants, chatbots, customer support, and educational platforms. Euro) in 2021. Iryna is co-director of the NLP program within ELLIS, a European network of excellence in machine learning. Sung-Hyon Myaeng.

article thumbnail

Supporting Human-AI Collaboration in Auditing LLMs with LLMs

ML @ CMU

Trends Human Computer Interaction. [2] Adaptive Testing and Debugging of NLP Models. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). [3] In CHI Conference on Human Factors in Computing Systems. [5] 2] Marco Tulio Ribeiro and Scott Lundberg.

article thumbnail

The Geographic Diversity of NLP Conferences

Marek Rei

The growth of interest in NLP technology, fuelled largely by investment in AI applications, has been accompanied by unprecedented expansion of the preeminent NLP conferences: ACL, NAACL and EMNLP in particular. Paper count by country at the 2018 NLP conferences. Normalized paper count by country at the 2018 NLP conferences.

NLP 52
article thumbnail

The State of Multilingual AI

Sebastian Ruder

At the same time, a wave of NLP startups has started to put this technology to practical use. I will be focusing on topics related to natural language processing (NLP) and African languages as these are the domains I am most familiar with. This post takes a closer look at how the AI community is faring in this endeavour.

article thumbnail

Multi-domain Multilingual Question Answering

Sebastian Ruder

This post expands on the EMNLP 2021 tutorial on Multi-domain Multilingual Question Answering. 2021 ), among others. The tutorial was organised by Avi Sil and me. In this post, I highlight key insights and takeaways of the tutorial. The slides are available online. 2018 ), college-level exam resources such as ReClor ( Yu et al.,

BERT 52