AWS Machine Learning Blog

DECEMBER 19, 2023

Artificial intelligence (AI) and machine learning (ML) are becoming an integral part of systems and processes, enabling decisions in real time, thereby driving top and bottom-line improvements across organizations. However, putting an ML model into production at scale is challenging and requires a set of best practices.

Machine Learning 107

Machine Learning ML Engineer DevOps ML 107

Towards AI

SEPTEMBER 2, 2023

How is our model impacted in the evolving world? An analysis focusing on drift examples, and implementing Python-based monitoring strategies This member-only story is on us. Machine Learning (ML) model development often takes time and requires technical expertise. Upgrade to access all of Medium.

Machine Learning 119

Machine Learning Python Data Science ML 119

Heartbeat

JUNE 12, 2023

Source: Author Introduction Machine learning model monitoring tracks the performance and behavior of a machine learning model over time. There are several aspects to model monitoring, including data monitoring, model performance monitoring, and feedback monitoring.

Machine Learning 98

Machine Learning Data Drift Explainability Data Quality 98

IBM Journey to AI blog

JUNE 29, 2023

Enterprises are constantly looking for new ways to optimize performance, increase reliability and extend asset lifespans—all without adding unnecessary costs. Asset reliability is the ability of an asset to perform under certain conditions over a specified period without breaking down. What is asset reliability?

Data Analysis 221

Data Analysis Machine Learning Computer Vision Artificial Intelligence 221

AWS Machine Learning Blog

APRIL 29, 2024

In recent years, large language models (LLMs) have gained attention for their effectiveness, leading various industries to adapt general LLMs to their data for improved results, making efficient training and hardware availability crucial. This is a guest post by Mark McQuade, Malikeh Ehghaghi, and Shamane Siri from Arcee.

Large Language Models 103

Large Language Models NLP Machine Learning Artificial Intelligence 103

Marktechpost

APRIL 14, 2024

Significant progress has been made in LLMs, or large-scale language models, which have absorbed a fundamental linguistic understanding of the environment. However, as Moravec’s paradox suggests, even the most advanced models of today still can’t match human performance in EQA. EQA could help you locate it.

LLM 103

LLM AI AI Robotics 103

AWS Machine Learning Blog

FEBRUARY 26, 2024

Large Language Models (LLMs) have revolutionized the field of natural language processing (NLP), improving tasks such as language translation, text summarization, and sentiment analysis. However, as these models continue to grow in size and complexity, monitoring their performance and behavior has become increasingly challenging.

Large Language Models 114

Large Language Models LLM Big Data Natural Language Processing 114

AWS Machine Learning Blog

NOVEMBER 22, 2023

The IDP Well-Architected Custom Lens follows the AWS Well-Architected Framework, reviewing the solution with six pillars with the granularity of a specific AI or machine learning (ML) use case, and providing the guidance to tackle common challenges. This post focuses on the Performance Efficiency pillar of the IDP workload.

IDP 95

IDP ML Machine Learning Automation 95

IBM Journey to AI blog

OCTOBER 16, 2023

Machine learning (ML)—the artificial intelligence (AI) subfield in which machines learn from datasets and past experiences by recognizing patterns and generating predictions—is a $21 billion global industry projected to become a $209 billion industry by 2029. At Facebook Messenger, ML powers customer service chatbots.

Machine Learning 129

Machine Learning ML Algorithm Chatbots 129

DataRobot Blog

SEPTEMBER 1, 2022

For example, a recent IDC study 1 shows that it takes about 290 days on average to deploy a model into production from start to finish. But we can take the right actions to prevent failure and ensure that AI systems perform to predictably high standards, meet our business needs, and unlock additional resources for financial sustainability. .

Data Drift 145

Data Drift AI AI Data Science 145

Heartbeat

FEBRUARY 1, 2023

Machine learning has become an essential part of our lives because we interact with various applications of ML models, whether consciously or unconsciously. Machine Learning Operations (MLOps) are the aspects of ML that deal with the creation and advancement of these models. What is MLOps?

DevOps 96

DevOps Machine Learning Data Scientist Software Engineer 96

IBM Journey to AI blog

JULY 25, 2023

Smart grids turn this model on its head. Sensors and automation devices: These are installed throughout the grid to monitor voltage, current, and load capacity (among other metrics). Phasor measurement units (PMUs) monitor electrical waves on the electricity grid using a common time source for synchronization.

Automation 155

Automation Algorithm ML Artificial Intelligence 155

AWS Machine Learning Blog

JANUARY 26, 2024

Generative artificial intelligence (AI) applications built around large language models (LLMs) have demonstrated the potential to create and accelerate economic value for businesses. All the principles of the AWS Shared Responsibility Model are applicable to generative AI solutions.

Generative AI 125

Generative AI LLM ML AI 125

Heartbeat

OCTOBER 30, 2023

Ensuring Long-Term Performance and Adaptability of Deployed Models Source: [link] Introduction When working on any machine learning problem, data scientists and machine learning engineers usually spend a lot of time on data gathering , efficient data preprocessing , and modeling to build the best model for the use case.

Machine Learning 52

Machine Learning Data Drift ML Data Scientist 52

AWS Machine Learning Blog

FEBRUARY 13, 2024

In this post, we discuss how BigBasket used Amazon SageMaker to train their computer vision model for Fast-Moving Consumer Goods (FMCG) product identification, which helped them reduce training time by approximately 50% and save costs by 20%. To keep pace with new products, a new model was produced each month using the latest training data.

Computer Vision 103

Computer Vision Convolutional Neural Networks AI AI 103

AWS Machine Learning Blog

NOVEMBER 16, 2023

This is a joint blog with AWS and Philips. Amazon SageMaker provides purpose-built tools for machine learning operations (MLOps) to help automate and standardize processes across the ML lifecycle. In this post, we describe how Philips partnered with AWS to develop AI ToolSuite—a scalable, secure, and compliant ML platform on SageMaker.

Data Scientist 91

Data Scientist ML Data Science Automation 91

IBM Journey to AI blog

JULY 11, 2023

Better machine learning (ML) algorithms, more access to data, cheaper hardware and the availability of 5G have contributed to the increasing application of AI in the healthcare industry, accelerating the pace of change. AI and automation can perform many of those mundane tasks, freeing up employee time for other activities.

Deep Learning 152

Deep Learning Natural Language Processing Artificial Intelligence Artificial Intelligence 152

DataRobot Blog

MARCH 8, 2023

Leveraging DataRobot’s JDBC connectors, enterprise teams can work together to train ML models on their data residing in SAP HANA Cloud and SAP Data Warehouse Cloud, as well as have an option to enrich it with data from external data sources.

Machine Learning 105

Machine Learning Data Drift ML Data Scientist 105

AWS Machine Learning Blog

MAY 16, 2024

For this reason, we built the MLOps architecture to manage the created models and provide real-time services. Solution architecture The following diagram illustrates the solution architecture for serving Neural Collaborative Filtering (NCF) algorithm-based recommendation models as MLOps.

Deep Learning 88

Deep Learning Auto-complete Algorithm ML 88

Heartbeat

OCTOBER 5, 2023

Unsurprisingly, Machine Learning (ML) has seen remarkable progress, revolutionizing industries and how we interact with technology. The emergence of Large Language Models (LLMs) like OpenAI's GPT , Meta's Llama , and Google's BERT has ushered in a new era in this field. Their mission?

Large Language Models 52

Large Language Models DevOps Prompt Engineer Prompt Engineering 52

Heartbeat

SEPTEMBER 18, 2023

Unleashing Innovation and Success: Comet — The Trusted ML Platform for Enterprise Environments Machine learning (ML) is a rapidly developing field, and businesses are increasingly depending on ML platforms to fuel innovation, improve efficiency, and mine data for insights.

ML 52

ML Data Scientist ML Engineer Machine Learning 52

Marktechpost

JULY 14, 2023

Industry and academia increasingly focus on machine learning (ML) optimization in computer architecture research to meet stringent domain-specific requirements. These include ML for computer architecture, ML for TinyML acceleration, DNN accelerator datapath optimization, memory controllers, power consumption, security, and privacy.

Machine Learning 98

Machine Learning Algorithm ML AI 98

AWS Machine Learning Blog

NOVEMBER 22, 2023

This approach ensures that the IDP’s performance expectations are in harmony with the larger workflow objectives, providing a clear and consistent standard for processing speed, accuracy, and reliability. Monitor Operational Health Ensure a shift from mere monitoring to advanced observability within your IDP framework.

IDP 86

IDP Data Extraction Automation ML 86

AWS Machine Learning Blog

DECEMBER 1, 2023

Launched in 2019, Amazon SageMaker Studio provides one place for all end-to-end machine learning (ML) workflows, from data preparation, building and experimentation, training, hosting, and monitoring. As a web application, SageMaker Studio has improved load time, faster IDE and kernel start up times, and automatic upgrades.

ML 99

ML Machine Learning DevOps Computer Vision 99

Heartbeat

JANUARY 9, 2024

Large language models have emerged as ground-breaking technologies with revolutionary potential in the fast-developing fields of artificial intelligence (AI) and natural language processing (NLP). Selection of a Foundation Model The selection of an appropriate foundation model is the first stage in LLMOps. What is LLMOps?

Large Language Models 52

Large Language Models Natural Language Processing LLM Machine Learning 52

AWS Machine Learning Blog

APRIL 21, 2023

Batch inference is a common pattern where prediction requests are batched together on input, a job runs to process those requests against a trained model, and the output includes batch prediction responses that can then be consumed by other applications or business functions. In this post, we focus on the second scenario.

Data Drift 75

Data Drift Metadata Data Quality ML 75

AWS Machine Learning Blog

MAY 23, 2023

This is a guest blog post co-written with Vik Pant and Kyle Bassett from PwC. With organizations increasingly investing in machine learning (ML), ML adoption has become an integral part of business transformation strategies. Many organizations start their journey into the world of ML with a model-centric viewpoint.

Machine Learning 74

Machine Learning Neural Network ML Data Scientist 74

Heartbeat

JUNE 26, 2023

A guide to performing end-to-end computer vision projects with PyTorch-Lightning, Comet ML and Gradio Image by Freepik Computer vision is the buzzword at the moment. Today, I’ll walk you through how to implement an end-to-end image classification project with Lightning , Comet ML, and Gradio libraries.

ML 59

ML Auto-classification Deep Learning Computer Vision 59

Allen AI

DECEMBER 31, 2023

It is not sufficient to build state-of-the-art models; 1) we need to build solutions that directly address specific technical problems, and 2) we need to deploy them. At the inaugural NeurIPS sustainability meeting , David Rolnick distinguished the principles of impact-oriented innovation from the canonical paradigm used in ML research.

Computer Vision 94

Computer Vision AI AI Artificial Intelligence 94

DataRobot Blog

FEBRUARY 28, 2023

Integrating different systems, data sources, and technologies within an ecosystem can be difficult and time-consuming, leading to inefficiencies, data silos, broken machine learning models, and locked ROI. Exploratory Data Analysis After we connect to Snowflake, we can start our ML experiment. Learn more about Snowflake External OAuth.

Data Drift 72

Data Drift Data Analysis ML AI 72

Heartbeat

JUNE 5, 2023

However, managing machine learning projects can be challenging, especially as the size and complexity of the data and models increase. Without proper tracking, optimization, and collaboration tools, ML practitioners can quickly become overwhelmed and lose track of their progress. This is where Comet comes in. Hugging Face ?

ML 59

ML Machine Learning Natural Language Processing Data Scientist 59

AWS Machine Learning Blog

NOVEMBER 30, 2023

Amazon SageMaker makes it straightforward to deploy machine learning (ML) models for real-time inference and offers a broad selection of ML instances spanning CPUs and accelerators such as AWS Inferentia. The endpoint uniformly distributes incoming requests to ML instances using a round-robin algorithm.

Machine Learning 91

Machine Learning Software Development ML Computer Vision 91

AWS Machine Learning Blog

SEPTEMBER 1, 2023

Nowadays, the majority of our customers is excited about large language models (LLMs) and thinking how generative AI could transform their business. However, bringing such solutions and models to the business-as-usual operations is not an easy task. Our approach applies to both open-source and proprietary models equally.

Generative AI 106

Generative AI Prompt Engineer Prompt Engineering AI 106

Heartbeat

SEPTEMBER 22, 2023

Introduction In the world of machine learning, where algorithms learn from data to make predictions, it’s important to get the best out of our models. But how do we ensure that our models perform at their best? Model Performance (Image by Author) 1. This is where hyperparameter tuning comes in.

Machine Learning 64

Machine Learning ML Algorithm Automation 64

Heartbeat

MAY 8, 2023

As more and more companies adopt computer vision models for various applications, it has become increasingly important to monitor the performance of these models over time to ensure they continue to deliver accurate results. About Comet Comet is a powerful tool for monitoring and analyzing machine learning experiments.

Computer Vision 52

Computer Vision Machine Learning Data Scientist Deep Learning 52

AWS Machine Learning Blog

FEBRUARY 13, 2024

Amazon SageMaker Feature Store is a fully managed, purpose-built repository to store, share, and manage features for machine learning (ML) models. Features are inputs to ML models used during training and inference. Additionally, usage details of shared resources can be monitored with Amazon CloudWatch and AWS CloudTrail.

ML 108

ML ML Engineer Machine Learning Data Scientist 108

AWS Machine Learning Blog

FEBRUARY 6, 2024

These events can be reported anywhere, from hospitals or at home, and must be responsibly and efficiently monitored. In this post, we show how to develop an ML-driven solution using Amazon SageMaker for detecting adverse events using the publicly available Adverse Drug Reaction Dataset on Hugging Face.

Large Language Models 100

Large Language Models BERT NLP Data Scientist 100