Announcing Job Completion Metadata Logging for AWS Parallel Computing Service (PCS)

Today, AWS announced support for job metadata logs for AWS Parallel Computing Service (PCS). With this launch, PCS can be configured to emit job completion logs to Amazon CloudWatch Logs, Amazon S3, and Amazon Data Firehose. Each job log will contain detailed metadata including information such as job submission time, start time, completed time, user who submitted the job, queue that processed the job, and Amazon EC2 instances used to run the job. Using these logs, you can analyze usage patterns, identify and troubleshoot job failures, track job wait times in the queue, generate user-level usage reports, and more.

This feature is available in all AWS Regions where PCS is available. You can enable job completion metadata logging on all newly-created PCS clusters in just a few clicks using the AWS Management Console. Visit our job completion documentation page to learn more.