3 documented AWS Glue cost inefficiencies, each with how to detect it and how to fix it.
AWS GlueCER-0249
Newer AWS Glue versions - such as Glue 5.0, with 5.1 (now the default for new jobs) and 6.0 also available - include significant performance optimizations in the Spark runtime for Glue for Spark ETL jobs, whether written in PySpark or...
AWS GlueCER-0393
AWS Glue Spark jobs run in the standard execution class unless configured otherwise, which provides fast startup on dedicated resources and is billed at the standard DPU-hour rate. Glue also offers a Flex execution class that runs jobs on...
AWS GlueCER-0394
AWS Glue Spark jobs are commonly configured with a fixed NumberOfWorkers sized for the heaviest stage, the largest expected input or a generous guess. Without Auto Scaling, every allocated worker is billed for the whole run, including...