Today, Amazon SageMaker launched a new version (0.25.0) of Large Model Inference (LMI) Deep Learning Container (DLC), with support for NVIDIA’s TensorRT-LLM Library . With these upgrades, customers can easily access state-of-the-art tooling to optimize Large Language Models (LLMs) on SageMaker. Amazon SageMaker LMI TensorRT-LLM DLC reduces latency by 33% on average and improves throughput by 60% on average for Llama2-70B, Falcon-40B and CodeLlama-34B models, compared to previous version.

Today, Amazon Web Services (AWS) announces an expanded portfolio of proactive benefits for AWS Partners that leverage the extensive cloud expertise of AWS Support. Participating partners will enhance their customers’ experience using new tools and receive the benefit of scalable pricing, and will have the opportunity to showcase Backed by AWS Support to help customers easily identify partners who offer AWS Partner-Led Support.

Today, AWS announces the general availability of AWS HealthScribe, a HIPAA eligible, generative AI-powered service designed to help healthcare application builders automatically create preliminary clinical documentation from patient-clinician conversations. With AWS HealthScribe, you can integrate speech recognition and generative AI, specifically trained to assist with healthcare industry documentation, into your application to help accelerate clinical documentation and enhance the consultation experience. AWS HealthScribe makes it easier and faster for healthcare software providers to include generative AI capabilities without the need to manage the underlying machine learning (ML) infrastructure or train their own healthcare-specific large language models (LLMs).

We are excited to announce public availability of AWS Mainframe Modernization Data Replication with Precisely for IBM i. The capability, already available to mainframe augmentation customers, is now also available for midrange systems including IBM i, iSeries, System i, or AS/400. It leverages data replication offered by Precisely to enable near real-time replication of midrange data to the AWS Cloud with support for heterogeneous source and target databases. It builds resilient high-performance data pipelines that replicate data changes via Change Data Capture (CDC) from midrange data stores to AWS database services like Amazon Aurora and Amazon RDS. As a result, businesses can modernize and augment midrange applications by offloading data processing, building new business functions or channels, and driving business insights and intelligence with analytics, Machine Learning (ML) and Artificial Intelligence (AI) on the AWS Cloud to speed modernization and deliver cost savings, agility, and innovation.

Today, AWS Backup announces support for EBS Snapshots Archive, allowing customers to automatically move EBS Snapshots created by AWS Backup to EBS Snapshots Archive. EBS Snapshots Archive is low-cost, long-term storage tier meant for your rarely-accessed snapshots that do not need frequent or fast retrieval, allowing you to save up to 75% on storage cost. 

Today, we are excited to announce a public preview of AWS Mainframe Modernization Application Testing, an AWS Mainframe Modernization service feature that automates functional equivalence testing of mainframe applications being modernized with the AWS cloud. This new feature provides cloud-native testing capabilities including test capture, on-demand automated test replays, comparisons, and regression testing at scale. Available as a part of AWS Mainframe Modernization service console, the Application Testing feature is designed to offer a simplified testing experience that is highly scalable across a wide range of mainframe testing use cases, with support for parallel test runs and visualization of testing results.

AWS Control Tower is excited to announce 65 new AWS-managed controls and enhanced Region deny capabilities to help you meet your digital sovereignty requirements. With this release, you can discover 245+ controls under a new digital sovereignty group in the AWS Control Tower console. You can use these controls to help prevent actions, enforce configurations, and detect resource changes for data residency, granular access restriction, encryption, and resiliency capabilities. 

AWS Elastic Disaster Recovery (AWS DRS) now allows you to automate validations when launching EC2 instances for recovery and drills. This saves you time used to perform tedious manual verifications, as AWS DRS empowers you to define custom automated validations tailored to your specific needs. Also, you can leverage the convenience of pre-defined validations such as volume free space detection and network connectivity verification, providing you with the tools to conduct thorough drills to ensure robust and resilient production environments.

Amazon Inspector now offers continuous monitoring of your Amazon EC2 instances for software vulnerabilities without installing an agent or additional software. Currently, Amazon Inspector leverages the widely deployed AWS Systems Manager (SSM) Agent to assess your EC2 instances for third-party software vulnerabilities. With this new capability, you can expand your vulnerability assessment coverage across your EC2 infrastructure with Amazon Inspector agentless scanning for EC2 instances that do not have SSM Agents installed or configured. For agentless scanning, Amazon Inspector takes snapshots of EBS volumes to collect software application inventory from the instances to perform vulnerability assessments. Once you enable EC2 scanning within Amazon Inspector, it automatically discovers all your EC2 instances and starts evaluating them for software vulnerabilities. Customers can enable agentless scanning by simply visiting the EC2 settings page within the Amazon Inspector console and selecting hybrid scan mode. In hybrid scan mode, Amazon Inspector relies on SSM Agents to collect information from instances to perform vulnerability assessments, and automatically switches to agentless scanning for instances that do not have SSM Agents installed or configured. 

We are excited to announce public availability of AWS Mainframe Modernization File Transfer with BMC. This capability relies on BMC’s mainframe data set transfer technology to discover, transfer, and convert mainframe data sets for use on the AWS Cloud.