Sebastian Ruder

JANUARY 24, 2022

2021) 2021 saw many exciting advances in machine learning (ML) and natural language processing (NLP).   2021 saw the continuation of the development of ever larger pre-trained models. 2021 saw the development of alternative model architectures that are viable alternatives to the transformer. style loss.

NLP 52

NLP ML BERT Computational Linguistics 52

ML @ CMU

SEPTEMBER 22, 2023

An algorithm audit 1 is a method of repeatedly querying an algorithm and observing its output in order to draw conclusions about the algorithm’s opaque inner workings and possible external impact. Auditing Algorithms: Understanding Algorithmic Systems from the Outside In Found. Trends Human Computer Interaction. [2]

Computational Linguistics 112

Computational Linguistics LLM Large Language Models Algorithm 112

Allen AI

JULY 8, 2023

This research posits that simply scaling up models will not imbue them with theory of mind due to the inherently symbolic and implicit nature of the phenomenon, and instead investigate an alternative: can we design a decoding-time algorithm that enhances theory of mind of off-the-shelf neural language models without explicit supervision?

Computational Linguistics 52

Computational Linguistics NLP Explainability OpenAI 52

Sebastian Ruder

NOVEMBER 14, 2022

For a recent study [3] , we similarly reviewed papers from ACL 2021 and found that almost 70% of papers only evaluate on English. Initiatives   The Association for Computational Linguistics (ACL) has emphasized the importance of language diversity, with a special theme track at the main ACL 2022 conference on this topic.

Natural Language Processing 52

Natural Language Processing NLP Computational Linguistics AI 52

The Stanford AI Lab Blog

JANUARY 21, 2022

Indeed, this recipe of massive, diverse datasets combined with scalable offline learning algorithms (e.g. Replicating these impressive generalization and adaptation capabilities in robot learning algorithms would certainly be a step toward robots that can be used in unstructured, real world environments. Chen, Suraj Nair, Chelsea Finn.

Robotics 40

Robotics Computational Linguistics Computer Vision BERT 40

Topbots

JANUARY 30, 2023

400k AI-related online texts since 2021) Disclaimer: This article was written without the support of ChatGPT. We are quick to attribute intelligence to models and algorithms, but how much of this is emulation, and how much is really reminiscent of the rich language capability of humans? Association for Computational Linguistics. [2]

Large Language Models 52

Large Language Models LLM Computational Linguistics Natural Language Processing 52

Applied Data Science

DECEMBER 23, 2022

In our review of 2019 we talked a lot about reinforcement learning and Generative Adversarial Networks (GANs), in 2020 we focused on Natural Language Processing (NLP) and algorithmic bias, in 202 1 Transformers stole the spotlight. This trend started in 2021, with OpenAI Codex , a GPT-3 based tool. How is this even possible?

Neural Network 52

Neural Network AI AI Data Science 52