AWS Glue now supports the ability to run ETL jobs on Apache Spark 2.4.3 (with Python 3)

July 25, 2019 By admin

AWS Glue has updated its Apache Spark infrastructure to support Apache Spark 2.4.3 (in addition to Apache Spark 2.2.1 ) for ETL jobs, enabling you to take advantage of stability fixes and new features available in this version of Apache Spark.