AWS Machine Learning Blog

NOVEMBER 9, 2023

Building out a machine learning operations (MLOps) platform in the rapidly evolving landscape of artificial intelligence (AI) and machine learning (ML) for organizations is essential for seamlessly bridging the gap between data science experimentation and deployment while meeting the requirements around model performance, security, and compliance.

Data Drift 94

Data Drift Auto-complete ML Automation 94

AWS Machine Learning Blog

AUGUST 29, 2023

In this post, we describe how to create an MLOps workflow for batch inference that automates job scheduling, model monitoring, retraining, and registration, as well as error handling and notification by using Amazon SageMaker , Amazon EventBridge , AWS Lambda , Amazon Simple Notification Service (Amazon SNS), HashiCorp Terraform, and GitLab CI/CD.

Data Scientist 70

Data Scientist Data Quality Python ML 70

AWS Machine Learning Blog

OCTOBER 2, 2023

A successful deployment of a machine learning (ML) model in a production environment heavily relies on an end-to-end ML pipeline. Although developing such a pipeline can be challenging, it becomes even more complex when dealing with an edge ML use case. Now it’s time to draft an architecture for our MLOps pipeline.

DevOps 85

DevOps Automation ML Computer Vision 85

AWS Machine Learning Blog

MAY 8, 2024

Solution overview To reduce customer churn, Dialog Axiata used SageMaker to build a predictive model that assigns each customer a churn risk score. The training pipeline is responsible for developing the base model, which is a CatBoost model trained on a comprehensive set of features.

ML 88

ML AI AI Categorization 88

AWS Machine Learning Blog

FEBRUARY 27, 2024

However, even though the pace of innovation is high, the different teams had developed their own ways of working and were in search of a new MLOps best practice. We decided to put in a joint effort to build a prototype on a best practice for MLOps.

Machine Learning 106

Machine Learning DevOps Data Quality Data Scientist 106

AWS Machine Learning Blog

JUNE 27, 2023

This blog post is co-written with Marat Adayev and Dmitrii Evstiukhin from Provectus. Machine Learning Operations (MLOps) provides the technical solution to this issue, assisting organizations in managing, monitoring, deploying, and governing their models on a centralized platform.

DevOps 90

DevOps ML Machine Learning Automation 90

The MLOps Blog

JANUARY 23, 2023

By now, everyone must have seen THE MLOps paper. Machine Learning Operations (MLOps): Overview, Definition, and Architecture” By Dominik Kreuzberger, Niklas Kühl, Sebastian Hirschl Great stuff. In this article, I share how our reality as the MLOps tooling company and my personal views on MLOps agree (and disagree) with it.

DevOps 59

DevOps Metadata Software Engineer Data Scientist 59

AWS Machine Learning Blog

OCTOBER 2, 2023

This is Part 3 of our series where we design and implement an MLOps pipeline for visual quality inspection at the edge. In this post, we focus on how to automate the edge deployment part of the end-to-end MLOps pipeline. In Part 2 , we showed how to automate the labeling and model training parts of the pipeline.

Automation 84

Automation DevOps ML Machine Learning 84

Pickl AI

MAY 15, 2024

As a Data Analyst, you’ve honed your skills in data wrangling, analysis, and communication. But the allure of tackling large-scale projects, building robust models for complex problems, and orchestrating data pipelines might be pushing you to transition into Data Science architecture.

Data Scientist 52

Data Scientist Data Science Machine Learning Data Quality 52

AWS Machine Learning Blog

JUNE 14, 2023

Amazon SageMaker is a fully managed service to prepare data and build, train, and deploy machine learning (ML) models for any use case with fully managed infrastructure, tools, and workflows. For more information, refer to MLOps foundation roadmap for enterprises with Amazon SageMaker.

ML 74

ML Automation Data Scientist DevOps 74

AWS Machine Learning Blog

OCTOBER 20, 2023

Addressing those challenges builds the framework and foundations for mitigating risk and responsible use of ML-driven products. Governing ML lifecycle at scale is a framework to help you build an ML platform with embedded security and governance controls based on industry best practices and enterprise standards.

ML 95

ML Data Scientist ML Engineer Data Science 95

AWS Machine Learning Blog

JANUARY 5, 2024

Integrating multiple tool stacks to build a compact solution might involve building custom connectors or workflows. In this post, we discuss model development and MLOps framework implementation for one of Wipro’s customers that uses Amazon SageMaker and other AWS services.

Data Science 103

Data Science Data Drift DevOps Auto-complete 103

AWS Machine Learning Blog

FEBRUARY 22, 2023

An experienced developer knows at the onset of a new task what their code base will look like generally, but the process of building this code base is extensive and there’s no clear starting point. Boomi’s Step Suggest solution needs automated training and inference pipelines.

Data Science 68

Data Science Data Scientist ML Algorithm 68

The MLOps Blog

MARCH 28, 2023

In this second installment of the series “Real-world MLOps Examples,” Paweł Pęczek , Machine Learning Engineer at Brainly , will walk you through the end-to-end Machine Learning Operations (MLOps) process in the Visual Search team at Brainly. Watch this video to learn how the Content AI team does MLOps. “If

Machine Learning 59

Machine Learning Automation Data Scientist ML 59

The MLOps Blog

JUNE 27, 2023

As you delve into the landscape of MLOps in 2023, you will find a plethora of tools and platforms that have gained traction and are shaping the way models are developed, deployed, and monitored. Below, you will find some key factors to consider when assessing MLOps tools and platforms, depending on your needs and preferences.

Machine Learning 134

Machine Learning Metadata Data Scientist Data Quality 134

The MLOps Blog

MARCH 21, 2023

From gathering and processing data to building models through experiments, deploying the best ones, and managing them at scale for continuous value in production—it’s a lot. As the number of ML-powered apps and services grows, it gets overwhelming for data scientists and ML engineers to build and deploy models at scale.

Machine Learning 69

Machine Learning Data Scientist ML Metadata 69

AWS Machine Learning Blog

JUNE 16, 2023

In this post, we discuss how SambaSafety used AWS machine learning (ML) and continuous integration and continuous delivery (CI/CD) tools to deploy their existing data science application for batch inference. The solution delivered by Firemind for SambaSafety’s data science team was built around two ML pipelines.

Automation 73

Automation Data Science Data Scientist Software Development 73

The MLOps Blog

MAY 9, 2023

One of the most prevalent complaints we hear from ML engineers in the community is how costly and error-prone it is to manually go through the ML workflow of building and deploying models. Building end-to-end machine learning pipelines lets ML engineers build once, rerun, and reuse many times.

ML 98

ML Machine Learning Metadata Automation 98

AWS Machine Learning Blog

AUGUST 31, 2023

As Artificial Intelligence (AI) and Machine Learning (ML) technologies have become mainstream, many enterprises have been successful in building critical business applications powered by ML models at scale in production. Output of these pipelines will deploy the model in SageMaker endpoints to be consumed for inference purposes.

ML 85

ML Data Scientist Machine Learning Automation 85

AWS Machine Learning Blog

SEPTEMBER 1, 2023

In this post, we discuss how to operationalize generative AI applications using MLOps principles leading to foundation model operations (FMOps). MLOps engineers are responsible for providing a secure environment for data scientists and ML engineers to productionize the ML use cases.

Generative AI 97

Generative AI Prompt Engineer Prompt Engineering AI 97

AWS Machine Learning Blog

OCTOBER 16, 2023

Apart from GPU provisioning, this setup also required data scientists to build a REST API wrapper for each model, which was needed to provide a generic interface for other company services to consume, and to encapsulate preprocessing and postprocessing of model data. These ensembles can be run as if they were a single Triton model.

Data Scientist 79

Data Scientist Computer Vision DevOps ML 79

Heartbeat

OCTOBER 5, 2023

." This revolutionary approach is reshaping how we develop, deploy, and maintain LLMs in production, transforming how we build and maintain AI-powered systems and products, solidifying its place as a pivotal force in AI. The Rise of LLMOps LLMOps exists within the same realm as MLOps but introduces a fresh perspective and new dimensions.

Large Language Models 52

Large Language Models DevOps Prompt Engineer Prompt Engineering 52

AWS Machine Learning Blog

FEBRUARY 21, 2023

After you build, train, and evaluate your machine learning (ML) model to ensure it’s solving the intended business problem proposed, you want to deploy that model to enable decision-making in business operations. However, as previously mentioned, for this post, we only cover MLOps deployment patterns using single-model endpoints.

ML 68

ML Automation Software Development Metadata 68

AWS Machine Learning Blog

NOVEMBER 29, 2023

With these tools in hand, the next challenge is to integrate LLM evaluation into the Machine Learning and Operation (MLOps) lifecycle to achieve automation and scalability in the process. In this post, we show you how to integrate Amazon SageMaker Clarify LLM evaluation with Amazon SageMaker Pipelines to enable LLM evaluation at scale.

LLM 78

LLM Data Scientist Algorithm Generative AI 78

Becoming Human

MAY 15, 2023

Prerequisite to follow this roadmap of data science There are such prerequisites to follow this roadmap, your dedication of 2–3 hours per day till 6–8 months, where your first 4–6 months cover all your learning part and the last 2–3 months cover your end-to-end projects, resume building, networking, and applying for a job.

Data Science 75

Data Science Neural Network Machine Learning Data Analysis 75

AWS Machine Learning Blog

SEPTEMBER 28, 2023

To effectively train this model, we establish an MLOps infrastructure to streamline the model development process by automating data preprocessing, feature engineering, hyperparameter tuning, and model selection. The following diagram illustrates the architecture of the training pipeline. Let’s discuss the steps in more detail.

Machine Learning 84

Machine Learning Automation ML Natural Language Processing 84

AWS Machine Learning Blog

FEBRUARY 29, 2024

Creating scalable and efficient machine learning (ML) pipelines is crucial for streamlining the development, deployment, and management of ML models. In this post, we present a framework for automating the creation of a directed acyclic graph (DAG) for Amazon SageMaker Pipelines based on simple configuration files.

Automation 86

Automation Python Machine Learning ML 86

TensorFlow

JANUARY 18, 2023

TFX’s power lies in its flexibility to run ML pipelines across different compatible orchestrators such as Kubeflow, Apache Airflow, Vertex AI Pipelines, etc., The pipeline also uses a custom TFX component that is integrated with Hugging Face ? The last one is about automation and implementing CI/CD using GitHub Actions.

Data Ingestion 52

Data Ingestion ML DevOps Automation 52

The MLOps Blog

MAY 31, 2023

But how to build it? In this article, I will share my learnings of how successful ML platforms work in an eCommerce and what are the best practices a Team needs to follow during the course of building it. And because of that, many companies decide to centralize this effort in an internal ML platform.

ML 59

ML Data Drift Algorithm Data Platform 59

AWS Machine Learning Blog

AUGUST 31, 2023

As Artificial Intelligence (AI) and Machine Learning (ML) technologies have become mainstream, many enterprises have been successful in building critical business applications powered by ML models at scale in production. Output of these pipelines will deploy the model in SageMaker endpoints to be consumed for inference purposes.

ML 52

ML Data Scientist Machine Learning Automation 52

DataRobot Blog

MARCH 16, 2023

That focus often leads to over-rotatation on building a better algorithm or neural-network or finding more data to improve model performance as opposed to the improvement of business performance. blog series and deep dive into the new 9.0 This helps teams collaborate over all the ML assets in one location so they can experiment faster.

AI 98

AI AI DevOps Neural Network 98

ODSC - Open Data Science

JUNE 29, 2023

There are numerous types of constraints that you can set on your data (that numerical data will always fall within a certain range, that text data will always be in a JSON format, etc) and, if your dataset fails to satisfy a constraint, you can fail your unit tests or your CI/CD pipeline.

Natural Language Processing 104

Natural Language Processing Data Science Data Quality Data Scientist 104

The MLOps Blog

MARCH 12, 2024

TL;DR LLMOps involves managing the entire lifecycle of Large Language Models (LLMs), including data and prompt management, model fine-tuning and evaluation, pipeline orchestration, and LLM deployment. How LLMOps compares to and diverges from traditional MLOps practices. This article serves as your comprehensive guide to LLMOps.

Prompt Engineer 52

Prompt Engineer Prompt Engineering LLM Large Language Models 52

AWS Machine Learning Blog

APRIL 26, 2023

The first is by using low-code or no-code ML services such as Amazon SageMaker Canvas , Amazon SageMaker Data Wrangler , Amazon SageMaker Autopilot , and Amazon SageMaker JumpStart to help data analysts prepare data, build models, and generate predictions. AWS conducts Immersion Days to inspire your builders and build momentum for the party.

ML 84

ML Machine Learning Data Science Data Drift 84

AWS Machine Learning Blog

APRIL 21, 2023

In this post, we show how to create repeatable pipelines for your batch use cases using Amazon SageMaker Pipelines , Amazon SageMaker model registry , SageMaker batch transform jobs , and Amazon SageMaker Model Monitor. We use the first pipeline to train the model and baseline the training data.

Data Drift 71

Data Drift Metadata Data Quality ML 71

AWS Machine Learning Blog

JULY 19, 2023

Amazon SageMaker Model Cards enable you to standardize how models are documented, thereby achieving visibility into the lifecycle of a model, from designing, building, training, and evaluation. Build, train, evaluate, and register the first version of the model package version (for example, Customer Churn V1).

Metadata 77

Metadata ML Machine Learning Python 77

The MLOps Blog

JANUARY 11, 2023

Overall, implementing MLOps in an IoT edge company is important because IoT systems often involve relatively large volumes of data, high levels of complexity, and real-time decision-making. If the machine learning tasks required by your use cases can be implemented using AI services, then you don’t need an MLOps solution.

Machine Learning 52

Machine Learning Automation ML Python 52