You can now use AWS Glue to find matching records across a dataset (including ones without identifiers) by using the new FindMatches ML Transform, a custom machine learning transformation that helps you identify matching records. By adding the FindMatches transformation to your Glue ETL jobs, you can find related products, places, suppliers, customers, and more.
AWS Lake Formation is now generally available
AWS Lake Formation is a service that makes it easy to set up a secure data lake in days. A data lake is a centralized, curated, and secured repository that stores all your data, both in its original form and prepared for analysis. A data lake enables you to break down data silos and combine different types of analytics to gain insights and guide better business decisions.
Amazon Redshift now supports column level access control with AWS Lake Formation
Amazon Redshift Spectrum now supports column level access control for data stored in Amazon S3 and managed by AWS Lake Formation. Column level access control can be used to limit access to only the specific columns of a table rather than allowing access to all columns of a table.
AWS Elemental MediaConvert Simplifies Editing and Sharing of Settings
AWS Elemental MediaConvert has added several new features to the AWS Management Console to make the service easier to use. You can now export and import JSON files for your job settings, output presets, and job templates. This makes it simpler to edit and share jobs, presets, and templates, even between AWS accounts. You can also now update and duplicate job templates and presets, in addition to jobs. These features make it easy to create new presets and templates from existing ones, and to experiment and iterate to find the settings that produce the best video for your viewers. You can also now customize the fields that are displayed within the jobs list to build the view that works best for your use case. And finally, the tool tips in MediaConvert have been streamlined to help you quickly understand the function of each setting in the Console.
Use AWS Systems Manager to resolve operational issues with your .NET and Microsoft SQL Server Applications
AWS Systems Manager now integrates with Amazon CloudWatch Application Insights for .NET and SQL Server, enabling you to easily and quickly resolve problems impacting your application health. CloudWatch Application Insights helps you set up and analyze important monitors across your application resources to detect anomalies and errors with those resources and common application technologies such as Microsoft IIS, .NET framework and SQL Server. With the new built-in integration, you can now easily view, investigate, and resolve these problems using AWS Systems Manager OpsCenter, helping you further reduce your mean time to resolution (MTTR).
Amazon Athena adds Support for AWS Lake Formation Enabling Fine-Grained Access Control on Databases, Tables, and Columns
Amazon Athena now supports enforcing AWS Lake Formation policies for fine-grained access control to new or existing databases, tables, and columns defined in the AWS Glue Data Catalog for data stored in Amazon S3.
Amazon EMR Integration With AWS Lake Formation Is Now In Beta, Supporting Database, Table, and Column-level access controls for Apache Spark
Amazon EMR now supports enforcing AWS Lake Formation-based fine-grained access control policies for Apache Spark. You can enforce Databases, Tables, and Columns-level policies for data stored in Amazon S3. Policies defined in AWS Lake Formation are enforced when Spark applications are submitted using Apache Zeppelin or EMR Notebooks. Also included in this release is SAML-based single sign-on (SSO) to EMR Notebooks and Apache Zeppelin, simplifying authentication for organizations using Active Directory Federation Services (ADFS), Okta, or Auth0. With the combination of SAML-based SSO, and AWS Lake Formation policies, customers can securely run Spark applications on shared multi-tenant clusters with column-level access to data stored in Amazon S3.
Amazon WorkDocs Migration Service
Amazon WorkDocs is making generally available a migration service to help you migrate your organization’s files to Amazon WorkDocs.
The Amazon WorkDocs migration service helps you move your users’ files and your departmental file shares to Amazon WorkDocs. The service can migrate large amounts of data, from tens of gigabytes to multiple terabytes from Amazon Simple Storage Service (S3) .
Using the Amazon WorkDocs migration service application, you can configure migration tasks, and target WorkDocs account and site to migrate data to. You can schedule the migration task to execute during a specific period as a one-time data transfer operation or have regular migrations so as to minimize downtime for your users. The migration service application provides up-to-date information and status on migration jobs including detailed reports once migration has successfully completed. The migration service application can be used by administrators of Amazon WorkDocs sites.
For file migration from network file shares, Amazon WorkDocs migration service leverages AWS DataSync which automatically handles many of the tasks related to data transfers such as network optimization and data integrity validation, which can slow down migrations or burden your IT operations. For more information about Amazon WorkDocs Migration Service see the Amazon WorkDocs Administration Guide .
Amazon Rekognition now detects violence, weapons, and self-injury in images and videos; improves accuracy for nudity detection
Amazon Rekognition is a deep learning-based image and video analysis service that can identify objects, people, text, scenes, as well as support content moderation by detecting unsafe content. Starting today, you can detect content related to ‘Violence’ and ‘Visually Disturbing” themes, such as blood, wounds, weapons, self-injury, corpses, and more. Further, Amazon Rekognition’s ability to identify ‘Explicit Nudity’ and ‘Suggestive’ content has been improved through a 68% lower false positive rate and a 36% lower false negative rate (on average). Additionally, Amazon Rekognition now supports detection of new categories of adult content, such as unsafe anime or illustrated content, adult toys, and sheer clothing.
Amazon Aurora with PostgreSQL Compatibility Supports Publishing PostgreSQL Log Files to Amazon CloudWatch Logs
You can now publish logs from your Amazon Aurora with PostgreSQL Compatibility database instances to Amazon CloudWatch Logs in Amazon RDS. Supported logs include PostgreSQL system logs.