New Kinesis Client Library 3.0 reduces stream processing compute costs by up to 33%

You can now reduce compute costs to process streaming data with Kinesis Client Library (KCL) 3.0 by up to 33% compared to previous KCL versions. KCL 3.0 introduces an enhanced load balancing algorithm that continuously monitors resource utilization of the stream processing workers and automatically redistributes the load from over-utilized workers to other underutilized workers. This ensures even CPU utilization across workers and removes the need to over-provision the stream processing compute workers which reduces cost. Additionally, KCL 3.0 is built with the AWS SDK for Java 2.x for improved performance and security features, fully removing the dependency on the AWS SDK for Java 1.x.

KCL is an open-source library that simplifies the development of stream processing applications with Amazon Kinesis Data Streams. It manages complex tasks associated with distributed computing such as load balancing, fault tolerance, and service coordination, allowing you to solely focus on your core business logic. You can upgrade your stream processing application running on KCL 2.x by simply replacing the current library using KCL 3.0, without any changes in your application code. KCL 3.0 supports stream processing applications running on Amazon EC2 instances or containers such as Amazon ECS, Amazon EKS, or AWS Fargate.

KCL 3.0 is available with Amazon Kinesis Data Streams in all AWS regions. To learn more, see the Amazon Kinesis Data Streams developer guide, KCL 3.0 release notes, and launch blog.