AWS Glue Studio jobs can now update AWS Glue Data Catalog tables
AWS Glue Studio now supports updating the AWS Glue Data Catalog during job runs. This feature makes it easy to keep your tables up to date as AWS Glue writes new data into Amazon S3, making the data immediately queryable from any analytics service compatible with the AWS Glue Data Catalog.
AWS Glue Studio now supports updating the AWS Glue Data Catalog during job runs. This feature makes it easy to keep your tables up to date as AWS Glue writes new data into Amazon S3, making the data immediately queryable from any analytics service compatible with the AWS Glue Data Catalog.
Previously, you needed to write to a pre-existing table in the AWS Glue Data Catalog or write data to an Amazon S3 location and then run an AWS Glue crawler on it to catalog it. This feature simplifies the process of making your data available for analytics by optionally adding new tables to the Data Catalog, updating table partitions, and/or updating the schema of your tables directly from the job.
AWS Glue Studio is available in the following AWS Regions: US East (N. Virginia), US East (Ohio),US West (N. California), US West (Oregon), Asia Pacific (Hong Kong), Asia Pacific (Mumbai), Asia Pacific (Seoul), Asia Pacific (Singapore), Asia Pacific (Sydney), Asia Pacific (Tokyo), Canada (Central), Europe (Frankfurt), Europe (Ireland), Europe (London), Europe (Milan), Europe (Paris), Europe (Stockholm), Middle East (Bahrain), and South America (São Paulo).
To learn more about this feature, visit our documentation.