Starting today, you can use the Apache Spark UI to monitor and inspect Glue ETL jobs. The Apache Spark UI provides a web interface to visualize a Directed Acyclic Graph (DAG) representing different stages in Glue ETL job execution, analyse Spark SQL query plans and check the event timeline of running or terminated Spark executors. The Spark UI can be used in conjunction with job metrics and continuous logging to monitor and troubleshoot complex Glue jobs. The Spark UI is available for both Glue ETL jobs and Glue Development Endpoints .
AWS IoT Device Tester v 2.0 for AWS Greengrass is now available
AWS IOT Device Tester v 2.0 for AWS Greengrass is now available.
Amazon EKS Announces Beta Release of Amazon EFS CSI Driver
The Amazon Elastic File System (EFS) CSI driver has reached beta status and is now supported by Amazon Elastic Kubernetes Service (EKS). The EFS CSI driver makes it simple to configure elastic file storage for both EKS and self-managed Kubernetes clusters running on AWS using standard Kubernetes interfaces. Applications running in Kubernetes can use EFS file systems to share data between pods in a scale-out group, or with other applications running within or outside of Kubernetes. EFS can also help Kubernetes applications be highly available because all data written to EFS is written to multiple AWS Availability zones. If a Kubernetes pod is terminated and relaunched, the CSI driver will reconnect the EFS file system, even if the pod is relaunched in a different AWS Availability Zone.
AWS CloudFormation updates for Amazon EC2, Amazon ECS, Amazon ElastiCache, Amazon ElasticSearch, and more
You can now use CloudFormation templates to configure and provision additional features for Amazon Elastic Compute Cloud (Amazon EC2), Amazon Elastic Container Service (Amazon ECS), Amazon ElastiCache, Amazon ElasticSearch Service(Amazon ES), and more AWS resources. CloudFormation periodically releases additional support, making it easier for developers to configure and provision AWS services.
AWS Glue now supports the ability to test your Glue ETL scripts on development endpoints using Apache Spark 2.4.3 and Python 3
AWS Glue has updated its Apache Spark infrastructure to support Apache Spark 2.4.3 (in addition to Apache Spark 2.2.1 ) for Glue scripts submitted on development endpoints. This enables you to take advantage of stability fixes and new features available in this version of Apache Spark.
AWS Elemental MediaConvert Now Supports IMSC 1.1 Captions
AWS Elemental MediaConvert now supports Internet Media Subtitles and Captions (IMSC) 1.1 text profile captions. IMSC is a file format that uses XML to describe text, timing, layout, and styling for subtitles and captions. MediaConvert can ingest IMSC text profile sidecar files and can read IMSC from IMF packages. IMSC text sources can be burned in as subtitles, converted to other text-based outputs such as SRT or WebVTT, or output as IMSC sidecar files. To learn more, please read the user guide .
Amazon CloudFront announces new Edge location in Shenzhen, China
Details: Amazon CloudFront announces the launch of a new CloudFront Edge (POP) location in Shenzhen, China. With this new POP operated by Ningxia Western Cloud Data Co. Ltd. (NWCD), CloudFront has 4 POPs in 4 cities across China. With this launch, viewers in Shenzhen would see an improvement of 62% in average latency when accessing content through CloudFront.
To view pricing for CloudFront China delivery, please refer to here . For developer guide, please refer here . To get started, log in to the AWS Management Console and start accelerating your content.
Amazon EC2 P3dn Instances are Now Available in AWS GovCloud (US) Regions
Starting today, Amazon EC2 P3dn instances are available in AWS GovCloud (US) Regions. P3dn instances were first introduced in December of 2018 and feature eight NVIDIA Tesla V100 GPUs with 32GB of GPU memory each, 100 Gbps networking, 96 Intel Skylake-based vCPUs, and 768 GB of system memory that expands the P3 portfolio on the top end for faster distributed machine learning (ML) training workloads.
Amazon S3 introduces Same-Region Replication
Amazon S3 now supports automatic and asynchronous replication of newly uploaded S3 objects to a destination bucket in the same AWS Region. Amazon S3 Same-Region Replication (SRR) adds a new replication option to Amazon S3, building on S3 Cross-Region Replication (CRR) which replicates data across different AWS Regions. Together, SRR and CRR form Amazon S3 Replication to deliver enterprise-class replication features such as cross-account replication for protection against accidental deletion and replication to any Amazon S3 storage class, including S3 Glacier and S3 Glacier Deep Archive to create backups and long-term archives. With SRR, new objects uploaded to an Amazon S3 bucket are configured for replication at the bucket, prefix, or object tag levels. Replicated objects can be owned by the same AWS account as the original copy or by different accounts, to protect from accidental deletion.
Amazon EKS provides EKS-Optimized AMI metadata via SSM Parameters
Amazon Elastic Kubernetes Service (Amazon EKS) now allows you to dynamically retrieve the latest EKS-Optimized Amazon Machine Image (AMI) ID when adding nodes to a cluster.