We’re excited to announce new capabilities with Amazon SageMaker Debugger with real-time monitoring of system resources for efficient utilization. With these new capabilities, you can now get automatic recommendations to re-allocate resources for your training jobs, helping you train better and reduce time and costs.

Today we are introducing two new distributed training libraries for Amazon SageMaker, providing integrated methods for you to quickly train large deep learning models. Using partitioning algorithms, these SageMaker distributed training libraries automatically split large deep learning models and training datasets across AWS GPU instances in a fraction of the time it takes to do manually. SageMaker achieves these efficiencies through two techniques: model parallelism and data parallelism. Model parallelism splits models too large to fit on a single GPU into smaller parts before distributing across multiple GPUs to train, and data parallelism splits large datasets to train concurrently in order to improve training speed.

Today, Amazon announced Amazon Neptune ML, a new capability of Amazon Neptune that uses Graph Neural Networks (GNNs), a machine learning (ML) technique purpose-built for graphs, to make easy, fast, and accurate predictions using graph data. With GNNs, you can improve the accuracy of most predictions for graphs by over 50% when compared to making predictions using non-graph methods based on published research from Stanford University. 

Amazon Redshift ML makes it possible for data warehouse users such as data analysts, database developers, and data scientists to create, train, and deploy machine learning (ML) models using familiar SQL commands. Amazon Redshift is the most widely used cloud data warehouse and, with Amazon Redshift ML, you can now leverage Amazon SageMaker, a fully managed machine learning service, using SQL and without moving your data or learning new skills.

Amazon Kendra is a highly accurate and easy to use intelligent search service powered by machine learning. Starting today, customers can centralize content from over 40+ data sources and make it discoverable, with the launch of the Amazon Kendra connector library.

Amazon Kendra is a highly accurate and easy to use intelligent search service powered by machine learning. Starting today, Amazon Kendra will use incremental learning to continuously optimize search results based on end-user search patterns and feedback.

Amazon SageMaker JumpStart helps you easily and quickly bring machine learning (ML) applications to market using pre-built solutions for common use cases and open source models from popular model zoos.

AWS Audit Manager is a new service that helps you continuously audit your AWS usage to simplify how you assess risk and compliance with regulations and industry standards. Audit Manager automates evidence collection to make it easier to assess whether your policies, procedures, and activities, also known as controls, are operating effectively. When it is time for an audit, AWS Audit Manager helps you manage stakeholder reviews of your controls and enables you to build audit-ready reports with much less manual effort and in less time.

We’re excited to announce the Amazon Forecast Weather Index, which can increase your forecasting accuracy, by automatically including the latest local weather information to your demand forecasts with one click and at no extra cost. Weather conditions influence consumer demand patterns, product merchandizing decisions, staffing requirements and energy consumption needs; however, acquiring, cleaning, and effectively using live weather information for demand forecasting is challenging and requires ongoing maintenance. With this launch, you can now include 14-day weather forecasts for US and Europe locations with one click to your demand forecasts.  

Amazon Kendra is a highly accurate and easy to use intelligent search service powered by machine learning. Starting today, AWS customers can automatically index and search content that is contained in Google Drive repositories using Amazon Kendra’s new built-in Google Drive connector.