You can now run fully managed Apache Flink applications with Apache Kafka
You can now run Apache Flink and Apache Kafka together using fully managed services on AWS. AWS provides a fully managed service for Apache Flink through Amazon Kinesis Data Analytics, enabling you to quickly build and easily run sophisticated streaming applications. You can use these fully managed Apache Flink applications to process streaming data stored in Apache Kafka running within Amazon VPC or on Amazon MSK, a fully managed, highly available, and secure Apache Kafka service.
You can now run Apache Flink and Apache Kafka together using fully managed services on AWS. AWS provides a fully managed service for Apache Flink through Amazon Kinesis Data Analytics, enabling you to quickly build and easily run sophisticated streaming applications. You can use these fully managed Apache Flink applications to process streaming data stored in Apache Kafka running within Amazon VPC or on Amazon MSK, a fully managed, highly available, and secure Apache Kafka service.
Apache Flink is a distributed framework and engine for processing data streams. With Amazon Kinesis Data Analytics, developers use Apache Flink to build streaming applications to transform and analyze data in real time.
Apache Kafka is an open-source platform for building real-time streaming data pipelines and applications. With Amazon MSK, you can use Apache Kafka APIs to populate data lakes, stream changes to and from databases, and power machine learning and analytics applications.
To get started building your first application, visit the AWS Management Console to easily attach a streaming application to your Amazon MSK cluster. You can learn how to build an Apache Flink application that integrate with Amazon MSK in the Amazon Kinesis Data Analytics Developer Guide.
For a list of where Amazon MSK and Amazon Kinesis Data Analytics are available, please see the AWS Region Table. This integration is available in US East (N. Virginia) and EU (Ireland). The integration is coming soon in all other regions where Amazon Kinesis Data Analytics is available.