Amazon MSK customers can now use Cruise Control to more easily scale and balance resource utilization within clusters

You can now use Cruise Control to more easily scale and balance I/O in your Amazon Managed Streaming for Apache Kafka (Amazon MSK) clusters. Cruise Control is a popular tool among Apache Kafka users because it drastically simplifies partition management. Cruise Control can also be used to monitor the state and health of clusters using an optional user interface dashboard.

Cruise Control integrates with Amazon MSK’s open monitoring for Prometheus feature and is also compatible with any Apache Kafka cluster that uses Prometheus for metric aggregation. Amazon MSK contributed to Cruise Control to make this integration possible, and was supported by other contributors to the open source project.

Amazon MSK offers free virtual workshops where customers can learn how to build solutions, including setting up an end-to-end clickstream analytics pipeline, and how to use MirrorMaker 2.0 for migration or replication. We’ve also added a new lab that shows you how to setup and use Cruise Control with Amazon MSK. Visit the Amazon MSK Cruise Control workshop to get started. You can also visit the Amazon MSK Documentation or the Cruise Control project page for more information.

Amazon MSK is a fully managed service for Apache Kafka that makes it easy for you to build and run applications that use Apache Kafka as a data store. Amazon MSK is 100% compatible with Apache Kafka, which enables you to quickly migrate your existing Apache Kafka workloads to Amazon MSK with confidence or build new ones from scratch. With Amazon MSK, you spend more time innovating on applications and less time managing clusters. To learn how to get started, see the Amazon MSK Developer Guide.