Amazon MSK can now stream broker logs to CloudWatch Logs, Amazon S3, or Amazon Elasticsearch Service

Amazon Managed Streaming for Apache Kafka (Amazon MSK) can now continuously stream Apache Kafka broker logs to Amazon Cloudwatch Logs, Amazon S3, or Amazon Elasticsearch Service via Amazon Kinesis Data Firehose. With access to broker logs, customers can more easily troubleshoot and understand the performance of their applications that use Amazon MSK clusters as a data store. Broker Logs are available for both new and existing clusters and can be enabled from the Amazon MSK Console or AWS CLI. To learn how to setup broker log delivery, see the Amazon MSK broker logs documentation.

Amazon MSK is a fully managed service for Apache Kafka that makes it easy for you to build and run applications that use Apache Kafka as a data store. Amazon MSK is 100% compatible with Apache Kafka, which means you can quickly migrate your existing Apache Kafka workloads to Amazon MSK with confidence or build new ones from scratch. With Amazon MSK, you spend more time innovating on applications and less time managing clusters. Visit the Amazon MSK developer guide to get started.

Recent Announcements Amazon MSK increases the default broker limit per cluster to 30 brokers
Amazon MSK is now available in the AWS Middle East (Bahrain) Region
Amazon MSK now supports Apache Kafka 2.3.1
Monitor your Amazon MSK clusters using Open Monitoring with Prometheus
Run fully managed Apache Flink applications with Amazon MSK
Dynamically expand your Amazon MSK clusters