AWS Glue now provides continuous logs in AWS Glue Job Monitoring
AWS Glue now displays continuous logs on the job run details page of AWS Glue Studio. AWS Glue is a serverless data integration and ETL service that helps discover, prepare, move, and integrate data for analytics and machine learning (ML). As your ETL and data integration jobs run, you can now see the logs update in real-time.
AWS Glue now displays continuous logs on the job run details page of AWS Glue Studio. AWS Glue is a serverless data integration and ETL service that helps discover, prepare, move, and integrate data for analytics and machine learning (ML). As your ETL and data integration jobs run, you can now see the logs update in real-time.
With this new feature, customers can view consolidated CloudWatch logs for the Apache Spark driver and executors in AWS Glue Job Monitoring as well as in the “Runs” tab in AWS Glue Studio’s job authoring interface. This makes it possible to track job run progress and identify errors without leaving AWS Glue.
This feature is available in the same AWS Regions as AWS Glue. To learn more, visit our documentation.