article thumbnail

Common Flaws in NLP Evaluation Experiments

Ehud Reiter

We discovered early on in the project that none of the papers we considered replicating had sufficient information for replicability and that only 13% of authors were willing and able to provide the missing information ( paper ) ( blog ). Once Computational Linguistics. They have too many papers to review in a tight timeframe. However

NLP 259
article thumbnail

Stanford AI Lab Papers and Talks at ACL 2022

The Stanford AI Lab Blog

The 60th Annual Meeting of the Association for Computational Linguistics (ACL) 2022 is taking place May 22nd - May 27th. We’re excited to share all the work from SAIL that’s being presented, and you’ll find links to papers, videos and blogs below. Fu, Mayee F.

professionals

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

What are they thinking?

Allen AI

In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 1115–1127, Seattle, United States. Association for Computational Linguistics. Association for Computational Linguistics. What are they thinking?

article thumbnail

ClarifyDelphi

Allen AI

2022; Levine et al., arXiv preprint arXiv:2201.07763 (2022). In Findings of the Association for Computational Linguistics: EMNLP 2020 , pp. ClarifyDelphi was originally published in AI2 Blog on Medium, where people are continuing the conversation by highlighting and responding to this story. 2020; Awad et al.,

article thumbnail

AI2 at ACL 2023

Allen AI

2022) tasks showcase a scenario where initial predictions by a learned model (yˆ) are incorrect. Read more on the blog here. AI2 at ACL 2023 was originally published in AI2 Blog on Medium, where people are continuing the conversation by highlighting and responding to this story. Two examples for action planning (Tandon et al.,

article thumbnail

Instruction fine-tuning for FLAN T5 XL with Amazon SageMaker Jumpstart

AWS Machine Learning Blog

arXiv preprint arXiv:2210.11416 (2022). [2] Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). “Scaling instruction-fine tuned language models.” 2] Rajpurkar, Pranav, Robin Jia, and Percy Liang. Know What You Don’t Know: Unanswerable Questions for SQuAD.”

article thumbnail

Explainable AI and ChatGPT Detection

Mlearning.ai

2019 Annual Conference of the North American Chapter of the Association for Computational Linguistics. [7] 57th Annual Meeting of the Association for Computational Linguistics [9] C. 2022) Shtetl-Optimized: The Blog of Scott Aaronson. [11] Resources and References [1] A. OpenAI [4] E. Mitchell, Y.