AWS Machine Learning Blog

MAY 9, 2024

Encourage knowledge sharing, establish a knowledge repository, and facilitate cross-functional projects to maximize the impact of AI/ML initiatives. Strategies such as model encryption, using secure environments, and continuous monitoring for anomalies can help protect against adversarial attacks and malicious misuse.

ML 100

ML Generative AI AI AI 100

Mlearning.ai

AUGUST 24, 2023

The Best Linux VPS Hosting ensures that your data is safeguarded against potential threats, giving you peace of mind. Whether you’re running a small blog or a large e-commerce site, Linux VPS hosting can be tailored to suit your specific requirements, ensuring optimal performance. SSD Storage : Speed and reliability are paramount.

Artificial Intelligence 52

Artificial Intelligence Artificial Intelligence LLM Automation 52

BAIR

OCTOBER 16, 2023

Background Figure 2: A description of the three stages of RLHF from an OpenAI blog post. These two reward functions result in the same loss for any response pairs, but they differ significantly when optimized against with RL. We compare our algorithm P3O with several effective and representative approaches for LLM alignment.

Algorithm 225

Algorithm Large Language Models LLM OpenAI 225

BAIR

OCTOBER 16, 2023

Background Figure 2: A description of the three stages of RLHF from an OpenAI blog post. These two reward functions result in the same loss for any response pairs, but they differ significantly when optimized against with RL. We compare our algorithm P3O with several effective and representative approaches for LLM alignment.

Algorithm 100

Algorithm Large Language Models LLM OpenAI 100

AWS Machine Learning Blog

JULY 24, 2023

When deploying Deep Learning models at scale, it is crucial to effectively utilize the underlying hardware to maximize performance and cost benefits. Inf2 instances are ideal for Deep Learning workloads like Generative AI, Large Language Models (LLM) in OPT/GPT family and vision transformers like Stable Diffusion.

BERT 73

BERT Deep Learning Python Machine Learning 73

AssemblyAI

MAY 3, 2023

The size of the dataset the model will be trained against is obviously a crucial aspect for the final outcome. But, how to determine how much data one needs to train an LLM? On the other hand, even an ideal model that perfectly replicates the whole internet knowledge represents by no means the “ultimate LLM.”

Large Language Models 363

Large Language Models Neural Network LLM Chatbots 363

AssemblyAI

AUGUST 18, 2023

The maxim "bigger is better" has been a defining ethos in the AI industry, with the notion that scaling up an AI model amplifies its performance. In what follows, we focus on the following questions: What drives the scaling of LLMs? What challenges and trade-offs exist in engineering LLM-based solutions?

Large Language Models 130

Large Language Models LLM Chatbots Generative AI 130

Bugra Akyildiz

MARCH 9, 2024

They provide ready-to-use Colab and Kaggle notebooks , alongside integration with popular tools such as Hugging Face , MaxText , NVIDIA NeMo and TensorRT-LLM , make it easy to get started with Gemma. Google wrote a blog post on a new visual encoder for their video understanding. Jack Cook wrote an excellent blog post on Mamba.

LLM 52

LLM Large Language Models Explainability Deep Learning 52

AWS Machine Learning Blog

APRIL 22, 2024

Alongside external data acquisition, prioritize internal data management to maximize the potential of generative AI and use its capabilities in analyzing your organizational data and uncovering new insights. Figure 4: AWS generative AI stack 6. Use the right approach Generative AI isn’t a one-size-fits-all solution.

Generative AI 114

Generative AI ESG AI AI 114

AWS Machine Learning Blog

MAY 9, 2024

LLM Linguistics – Although appropriate context can be retrieved from enterprise data sources, the underlying LLM handles linguistics and fluency. Verisk’s solution represents a compound AI system, involving multiple interacting components and making numerous calls to the LLM to furnish responses to the user.

Insight Engine 106

Insight Engine Generative AI LLM AI 106

Unite.AI

MARCH 21, 2024

However, as these models grow in size, the computational requirements for training and inference become increasingly demanding, pushing against the limits of available hardware resources. In this technical blog, we'll delve into the world of MoE, exploring its origins, inner workings, and its applications in transformer-based language models.

Large Language Models 147

Large Language Models Neural Network Natural Language Processing LLM 147

AWS Machine Learning Blog

JANUARY 4, 2024

You can use supervised fine-tuning based on your LLM to improve the effectiveness of text-to-SQL. This overall approach maximizes efficiency while still allowing customization if purely prompt-based methods are insufficient. This adapts the model to the target task. This avoids reprocessing repeated queries.

Prompt Engineer 122

Prompt Engineer Prompt Engineering Generative AI LLM 122

Allen AI

DECEMBER 6, 2023

Highlighted Papers from AI2 Selected works involving AI2 researchers appearing at this year’s conference ( * denotes AI2 affiliation ): Figure 2: Examples of SELF-REFINE: an initial output generated by the base LLM and then passed back to the same LLM to receive feedback to the same LLM to refine the output. computing 7 × 49).

Large Language Models 52

Large Language Models LLM Algorithm Machine Learning 52

AWS Machine Learning Blog

JUNE 7, 2023

This blog post is co-written with Dr. Ebtesam Almazrouei, Executive Director–Acting Chief AI Researcher of the AI-Cross Center Unit and Project Lead for LLM Projects at TII. Trained on 1 trillion tokens, TII Falcon LLM boasts top-notch performance while remaining incredibly cost-effective.

LLM 90

LLM Machine Learning ML AI Researcher 90

AWS Machine Learning Blog

APRIL 25, 2024

The overall goal of this post is to demystify summarization evaluation to help teams better benchmark performance on this critical capability as they seek to maximize value. The FMEval library provides built-in support for Amazon SageMaker endpoints and Amazon SageMaker JumpStart LLMs. You can also use a combination of metrics.

BERT 111

BERT NLP Algorithm Neural Network 111

AWS Machine Learning Blog

JANUARY 29, 2024

When deploying a large language model (LLM), machine learning (ML) practitioners typically care about two measurements for model serving performance: latency, defined by the time it takes to generate a single token, and throughput, defined by the number of tokens generated per second. A similar curve exists for every deployed LLM endpoint.

LLM 98

LLM Machine Learning ML Algorithm 98

AWS Machine Learning Blog

APRIL 16, 2024

You can run queries against a diverse collection of data source backends and bring the results directly into the Python space for further analysis or visualization. This adaptation is facilitated through the use of LLM prompts. To host your LLM as a SageMaker endpoint, you generate several artifacts.

Data Scientist 93

Data Scientist Generative AI ML Machine Learning 93

AWS Machine Learning Blog

MAY 24, 2023

Solution overview This innovative solution combines OCR for information extraction, a local deployed large language model (LLM) for dialogue and autonomous tasking, VectorDB for embedding subtasks, and LangChain-based task automation for integration with external data sources to transform the way businesses process and analyze document contexts.

IDP 73

IDP LLM Automation Generative AI 73

The MLOps Blog

MARCH 1, 2024

Against this backdrop, model-optimization techniques such as pruning, quantization, and knowledge distillation are essential to refine and simplify deep neural networks, making them more computationally efficient without compromising their deep learning applications and capabilities.

Deep Learning 59

Deep Learning Neural Network Categorization Machine Learning 59

AssemblyAI

AUGUST 22, 2023

RLHF - The key to human-LLM interaction While LLMs were demonstrated to be capable as general-purpose agents as early as 2020, this status does not exist without some caveats. Therefore, changing the input phrasing can have an effect on the output text of an LLM.

LLM 242

LLM ChatGPT AI Modeling Chatbots 242

IBM Journey to AI blog

FEBRUARY 9, 2024

” Model optimization is getting more accessible The trend towards maximizing the performance of more compact models is well served by the recent output of the open source community. The outcome of the high-profile lawsuit filed by the New York Times against OpenAI may significantly affect the trajectory of AI legislation.

AI 267

AI AI Generative AI Artificial Intelligence 267