AWS Glue large instance types are now generally available
Today, AWS announces the general availability of AWS Glue G.4X and G.8X, the next series of AWS Glue workers for your most demanding serverless data integration workloads. Glue G.4X and G.8X workers provide higher compute, memory, and storage resources than current Glue workers. These new types of workers help you scale and run your most demanding data integration workloads, such as memory-intensive data transforms, skewed aggregations, machine learning transforms, and entity detection checks with petabytes of data.
Today, AWS announces the general availability of AWS Glue G.4X and G.8X, the next series of AWS Glue workers for your most demanding serverless data integration workloads. Glue G.4X and G.8X workers provide higher compute, memory, and storage resources than current Glue workers. These new types of workers help you scale and run your most demanding data integration workloads, such as memory-intensive data transforms, skewed aggregations, machine learning transforms, and entity detection checks with petabytes of data.
G.4X and G.8X workers provides the most Data Processing Units (DPU) of the workers in Glue, with each G.4X worker providing 4 DPUs and each G.8X providing 8 DPUs. To use G.4X and G.8X workers, set the worker type parameter of your jobs to G.4X or G.8X from the CLI, API, or Glue Studio.
AWS Glue G.4X and G.8X workers are available today in US East (Ohio), US East (N. Virginia), US West (Oregon), Asia Pacific (Singapore), and Asia Pacific (Sydney), Asia Pacific (Tokyo), Canada (Central), Europe (Frankfurt), Europe (Ireland), Europe (Stockholm). To learn more, visit the AWS Glue product page and our documentation.