AWS Machine Learning Blog

NOVEMBER 22, 2023

Model category Number of models Examples​ NLP​ 157 BERT, BART, FasterTransformer, T5, Z-code MOE Generative AI – NLP 40 LLaMA, CodeGen, GPT, OPT, BLOOM, Jais, Luminous, StarCoder, XGen Generative AI – Image 3 Stable diffusion v1.5 opt/qti-aic/exec/qaic-exec -m=bert-base-cased/generatedModels/bert-base-cased_fix_outofrange_fp16.onnx

BERT 101

BERT Deep Learning Python Auto-classification 101

Mlearning.ai

JULY 23, 2023

1️⃣ Autoencoders  — In auto-encoders, the decoder part of the transformer is discarded after pre-training and only the encoder is used to generated the output. The widely popular BERT and RoBERTa models were based on this architecture and performed well on sentiment analysis and text classification .

LLM 52

LLM Auto-classification BERT Large Language Models 52

Mlearning.ai

JUNE 22, 2023

In this article, we will delve into the three broad categories of transformer models based on their training methodologies: GPT-like (auto-regressive), BERT-like (auto-encoding), and BART/T5-like (sequence-to-sequence). Auto Regression is common in more than just Transformers.

Auto-classification 52

Auto-classification Auto-complete BERT Deep Learning 52

Marktechpost

NOVEMBER 25, 2023

Such a representation makes many subsequent tasks, including those involving vision, classification, recognition and segmentation, and generation, easier. Therefore, encoders, decoders, and auto-encoders can all be implemented using a roughly identical crate design. Check out the Paper , Project , and Github.

Deep Learning 128

Deep Learning Auto-classification Auto-complete BERT 128

AWS Machine Learning Blog

MARCH 2, 2023

Transformer-based language models such as BERT ( Bidirectional Transformers for Language Understanding ) have the ability to capture words or sentences within a bigger context of data, and allow for the classification of the news sentiment given the current state of the world. Solutions Architect in the ML Frameworks Team.

BERT 75

BERT Deep Learning Metadata Auto-complete 75

Google Research AI blog

FEBRUARY 10, 2023

Robust algorithm design is the backbone of systems across Google, particularly for our ML and AI models. Google Research has been at the forefront of this effort, developing many innovations from privacy-safe recommendation systems to scalable solutions for large-scale ML. You can find other posts in the series here.)

Algorithm 110

Algorithm Neural Network Auto-classification ML 110

DataRobot Blog

FEBRUARY 2, 2023

Then you can use the model to perform tasks such as text generation, classification, and translation. As an example, getting started with a BERT model for question answering (bert-large-uncased-whole-word-masking-finetuned-squad) is as easy as executing these lines: !pip pip install transformers==4.25.1 datarobot==3.0.2

BERT 52

BERT Large Language Models Natural Language Processing Machine Learning 52