Amazon EMR release 5.28.0 now supports Apache Hudi (Incubating). Data engineers using Amazon EMR for data pipeline development and data processing can now use Apache Hudi to simplify incremental data management and data privacy use cases requiring record-level insert, updates, and delete operations. Apache Hudi enables Amazon S3-based data lakes to comply with data privacy laws, consume real time streams and change data capture logs, reinstate late arriving data, and track change history and rollback. Apache Hudi is open-source and supports storing data on Amazon S3 in vendor neutral, open source formats such as Apache Parquet and Apache Avro.

AWS App Mesh has increased the default limits for a set of App Mesh resources – virtual nodes, backends, routers, and routes. These limit increases make it easier for you to manage larger applications with App Mesh. The number of virtual nodes per mesh, which map to your services, tasksets, or deployments that can be connected to the mesh, increased from 20 to 200. The number of backends per node; the number of dependent services that a specific service can connect with, increased from 25 to 50. The number of virtual routers per mesh increased from 20 to 200, to enable routing on all mesh connected services. The number of routes per virtual router increased from 20 to 50, to enable matching on multiple parameters for routing decisions.  

Elastic Fabric Adapter (EFA) is now compatible with Intel® MPI Library 2019 Update 6. Intel® MPI Library is a multi-fabric message passing library that implements the Message Passing Interface (MPI). Customers can use the library to create, maintain, and test applications that perform better on HPC clusters based on Intel® processors.

Today, AWS Systems Manager Parameter Store launched enhanced search capability to enable you to search for parameters easily by parameter name. The new search experience enables easy discovery of parameters when you have large number of parameters in your account or when you do not remember the exact name of a parameter.  

Amazon Redshift now offers a new console for Redshift users. The new user interface and new features simplify management and improve insights into the health and performance of your Redshift clusters and workloads .

Amazon DynamoDB adaptive capacity now handles imbalanced workloads better by isolating frequently accessed items automatically. If your application drives disproportionately high traffic to one or more items, DynamoDB will rebalance your partitions such that frequently accessed items do not reside on the same partition. This latest enhancement helps you maintain uninterrupted performance for your workloads. In addition, it helps you reduce costs by enabling you to provision throughput capacity more efficiently, instead of overprovisioning to accommodate uneven data access patterns. 

You can now set a dead-letter queue (DLQ) to an Amazon Simple Notification Service (SNS) subscription to capture undeliverable messages. Amazon SNS DLQs make your application more resilient and durable by storing messages in case your subscription endpoint becomes unreachable.

Amazon Redshift now supports cross-instance restore to allow you to restore Redshift snapshots to clusters that are different sizes or running different node types. This simplifies snapshot restore workflows to support your evolving use cases. You can change instance type and count based on compute resources, storage capacity and cost requirements of your specific workloads. For example, you can cross-instance restore a snapshot of your production dense-compute cluster with small instances into a cluster with powerful large instances to serve more demanding workloads, or to a lower-cost development cluster. Once a cluster is restored, you can resize it as your performance and capacity needs change over time.

You can now use Amazon WorkSpaces APIs to register your directories with WorkSpaces and to modify directory details. The new APIs enable you to automate your workflows that require registering a directory with WorkSpaces or modifying directory level WorkSpaces properties including default WorkSpace creation settings, self-service permissions, and access controls.

AWS Elemental MediaConvert now offers support for Dolby Vision high dynamic range (HDR) video encoding for better color, contrast, and brightness on consumer display devices and support for Dolby Atmos audio encoding for immersive surround sound. MediaConvert used in combination with these technologies from Dolby Laboratories give video providers the ability to create premium experiences for consumers.