AWS Glue now offers support for custom visual transforms and version control in the AWS GovCloud (US) Regions. AWS Glue is a serverless data integration service that uses reusable jobs to perform extract, transform, and load (ETL) tasks on data sets of nearly any scale.
With version control, customers can use GitHub and AWS CodeCommit to maintain a history of changes to their AWS Glue jobs and apply their existing DevOps practices to deploy them. Previously, customers needed to set up their own integrations with their code versioning systems and build tooling to move jobs from development environments to production environments. Git integration in AWS Glue works for all AWS Glue job types, whether visual or code-based. Additionally, AWS Glue Studio’s visual editor now supports custom visual transforms, which allow you to create transforms and make them available for use in AWS Glue Studio jobs. Now, data engineers can write reusable transforms for the AWS Glue visual job editor. Reusable transforms increase consistency between teams and help keep jobs up to date by minimizing duplicate effort and code.
This feature is available in all AWS Regions and AWS GovCloud (US) regions where AWS Glue is available.
To learn more about version control, visit our documentation
and blog post
. To learn more about custom visual transforms, visit our documentation
and blog post
.