Google Research AI blog

MARCH 10, 2023

Co-authors: Igor Mordatch, Andy Zeng, Aakanksha Chowdhery, Klaus Greff, Mehdi S. Acknowledgements This work was done in collaboration across several teams at Google, including the Robotics at Google team and the Brain team, and with TU Berlin. Danny is a PhD student advised by Marc Toussaint at TU Berlin.

Robotics 124

Robotics Large Language Models Auto-complete Neural Network 124

AWS Machine Learning Blog

APRIL 26, 2024

Resources SageMaker JumpStart documentation SageMaker JumpStart foundation models documentation SageMaker JumpStart product detail page SageMaker JumpStart model catalog About the Authors Shikhar Kwatra is an AI/ML Specialist Solutions Architect at Amazon Web Services, working with a leading Global System Integrator.

Python 101

Python ML LLM Generative AI 101

Towards AI

JULY 21, 2023

Last Updated on July 21, 2023 by Editorial Team Author(s): Sebastian Poliak Originally published on Towards AI. Image by Author. The resulting combined vector is then passed through a fully-connected layer and finally the output layer. This architecture is demonstrated in the following picture.

Natural Language Processing 52

Natural Language Processing Deep Learning Neural Network Machine Learning 52

Topbots

JUNE 15, 2023

This article was originally published on the author’s blog and re-published to TOPBOTS with permission from the author. Screenshot taken by author. Figure created by author. Figure created by author. Figure created by author. Screenshot taken by author. Sourced from similarweb.com on May 2, 2023.

Natural Language Processing 59

Natural Language Processing Computational Linguistics NLP ChatGPT 59

Marek Rei

NOVEMBER 12, 2019

They cover a wide range of different topics, authors and venues. The authors construct a new dataset of 1490 sentences and annotate it for metaphorical or literal meaning. The authors investigate two extensions for directly applying supervision to the attention weights. Tartu, Stuttgart. NAACL 2018. CoNLL 2018.

Machine Learning 52

Machine Learning NLP Neural Network BERT 52

AWS Machine Learning Blog

MAY 1, 2024

About the authors Marco Punio is a Solutions Architect focused on generative AI strategy, applied AI solutions and conducting research to help customers hyperscale on AWS. Sebastian Bustillo is a Solutions Architect at AWS. We value customer feedback and are always looking to engage with ML practitioners and builders.

ML 87

ML Auto-complete Deep Learning Generative AI 87

Sebastian Ruder

JULY 31, 2020

Citation For attribution in academic contexts, please cite this work as: @misc{ruder2020beyondenglish, author = {Ruder, Sebastian}, title = {{Why You Should Do NLP Beyond English}}, year = {2020}, howpublished = {url{[link] } Thanks to Aida Nematzadeh, Laura Rimell, and Adhi Kuncoro for valuable feedback on drafts of this post.

NLP 78

NLP Natural Language Processing Machine Learning ML 78

Sebastian Ruder

NOVEMBER 14, 2022

For instance, while we can observe a slight upward trend in the number of authors affiliated with African universities publishing at top machine learning (ML) and NLP venues, this increase pales compared to the thousands of authors from other regions publishing in such venues every year. The Masakhane logo. Lucassen, T.,

Natural Language Processing 52

Natural Language Processing NLP Computational Linguistics AI 52

Marek Rei

JANUARY 17, 2018

The authors use two neural variational components to model a distribution over latent variables z that captures the semantics of a sentence being translated. Spithourakis, Isabelle Augenstein, Sebastian Riedel. link] The authors construct a neural network for automated essay scoring. Soochow University, Xiamen University.

Machine Learning 52

Machine Learning NLP Neural Network Convolutional Neural Networks 52

AWS Machine Learning Blog

MARCH 28, 2024

About the Authors Niithiyn Vijeaswaran is a Solutions Architect at AWS. Sebastian Bustillo is a Solutions Architect at AWS. With SageMaker JumpStart, you gain access to an extensive assortment of open and closed source models, streamlining the process of getting started with ML and enabling rapid experimentation and deployment.

LLM 113

LLM Auto-complete Auto-classification Generative AI 113

Explosion

DECEMBER 28, 2019

The main event was sold out with 200 attendees and we had 13 speakers including Yoav Goldberg and Sebastian Ruder as keynotes. We had already decided at the end of 2018 that we wanted to do this and after seven months of planning and hard work, we couldn’t have been happier with the result. Oct 1: Sebastián Ramírez joined the Explosion team

NLP 52

NLP BERT Machine Learning Python 52

Sebastian Ruder

AUGUST 18, 2019

Author released checkpoints  Checkpoint files generally contain all the weights of a pretrained model. Hubs are generally simple to use; however, they act more like a black-box as the source code of the model cannot be easily accessed. In addition, modifying the internals of a pretrained model architecture can be difficult.

NLP 75

NLP BERT Natural Language Processing Computational Linguistics 75

Sebastian Ruder

JANUARY 19, 2021

Citation For attribution in academic contexts, please cite this work as: @misc{ruder2021researchhighlights, author = {Ruder, Sebastian}, title = {{ML and NLP Research Highlights of 2020}}, year = {2021}, howpublished = {url{[link] } Thanks to Sameer Singh whose Twitter thread reviewing NLP research in 2020 provided inspiration for this post.

NLP 52

NLP ML Computer Vision Natural Language Processing 52

Sebastian Ruder

JANUARY 24, 2022

Removing bias from models such as toxicity, however, comes with trade-offs and can lead to reduced coverage for texts about and authored by marginalized groups [90]. Citation For attribution in academic contexts or books, please cite this work as: Sebastian Ruder, "ML and NLP Research Highlights of 2021" [link] 2022.

NLP 52

NLP ML BERT Computational Linguistics 52

Probably Approximately a Scientific Blog

AUGUST 30, 2019

I recommend reading Sebastian Ruder's article NLP's ImageNet moment has arrived that summarizes it very nicely. New York Times), date, authors, and headline. The effect is similar to the effect that pre-trained word embeddings had on NLP in 2013. This blog post will focus on text generation.

NLP 52

NLP BERT OpenAI Natural Language Processing 52

Sebastian Ruder

FEBRUARY 24, 2021

Citation For attribution in academic contexts, please cite this work as: @misc{ruder2021lmfine-tuning, author = {Ruder, Sebastian}, title = {{Recent Advances in Language Model Fine-tuning}}, year = {2021}, howpublished = {url{[link] }

Natural Language Processing 52

Natural Language Processing BERT NLP Computer Vision 52

Sebastian Ruder

OCTOBER 26, 2019

Citation If you found this post helpful, consider citing the tutorial as: @inproceedings{ruder2019unsupervised, title={Unsupervised Cross-Lingual Representation Learning}, author={Ruder, Sebastian and S{o}gaard, Anders and Vuli{'c}, Ivan}, booktitle={Proceedings of ACL 2019, Tutorial Abstracts}, pages={31--38}, year={2019} }

BERT 52

BERT NLP Natural Language Processing Neural Network 52

Jay Alammar

DECEMBER 16, 2020

We follow the authors' suggestion to use Non-negative Matrix Factorization (NMF) as a natural candidate for reducing the dimensionality into groups that are potentially individually more interpretable. Even after clustering, looking directly at activations is a crude and noisy affair. As presented in Olah et al. ,

Explainability 52

Explainability Auto-complete Auto-classification Neural Network 52

AWS Machine Learning Blog

APRIL 26, 2024

Previously, you would have to set up a knowledge base, invoking a data ingestion workflow to make sure only authorized recruiters can access the data. About the authors Suman Debnath is a Principal Developer Advocate for Machine Learning at Amazon Web Services.

Data Ingestion 103

Data Ingestion Generative AI Python Software Engineer 103

AI News

MAY 11, 2023

The new law also promotes regulatory sandboxes – or controlled environments established by public authorities – to test AI before its deployment. Photo by Denis Sebastian Tamas on Unsplash ) Related: UK details ‘pro-innovation’ approach to AI regulation Want to learn more about AI and big data from industry leaders?

Big Data 130

Big Data AI AI Artificial Intelligence 130

Sebastian Ruder

DECEMBER 6, 2021

Citation If you found this post helpful, consider citing the tutorial as: @inproceedings{ruder-sil-2021-multi, title = "Multi-Domain Multilingual Question Answering", author = "Ruder, Sebastian and Sil, Avi", booktitle = "Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing: Tutorial Abstracts", (..)

BERT 52

BERT NLP Natural Language Processing Computational Linguistics 52

Sebastian Ruder

AUGUST 23, 2021

Citation For attribution in academic contexts, please cite this work as: @misc{ruder2021benchmarking, author = {Ruder, Sebastian}, title = {{Challenges and Opportunities in NLP Benchmarking}}, year = {2021}, howpublished = {url{[link] }

NLP 52

NLP Natural Language Processing ML Deep Learning 52

Lexalytics

APRIL 5, 2021

Note that Geoff Hinton was a co-author on this paper: his interest in neural networks was finally vindicated. Many of the papers published with “deep” in their title were authored by a just small group of people, typically Hinton, LeCun, Bengio, and their students. It would not be the last time that happened.) Martinez; Avinash C.

Neural Network 52

Neural Network Convolutional Neural Networks Natural Language Processing BERT 52

ML Review

MAY 3, 2018

The authors note that ‘ LipNet addresses the issues of generalisation across speakers,’ i.e. the variance problems seen in earlier approaches, ‘and the extraction of motion features ’, originally classed as open problems in Zhou et al. 5) The authors also corrupt said datum with storm noises (i.e. Source : Assael et al.

Neural Network 52

Neural Network Computer Vision Deep Learning Convolutional Neural Networks 52