Kafka#

Managing Kafka clusters manually can be complex, especially when considering factors like scalability, monitoring, and security. Fortunately, it is possible to access several managed Kafka solutions via AWS Marketplace. The two primary options are Amazon MSK and Confluent Cloud.

Amazon Managed Streaming for Apache Kafka - Amazon MSK#

Amazon Managed Streaming for Apache Kafka (MSK) is a fully managed service that simplifies deploying, managing, and scaling Apache Kafka clusters on AWS. It allows to use Apache Kafka without handling the operational complexity of running it manually.

Confluent Cloud#

Confluent Cloud is a managed Kafka service that extends the Apache Kafka with advanced features and tools. Built by the Kafka creators, it provides additional capabilities on top of Kafka that helps to build robust data streaming pipelines.

This solution can be subscribed through AWS Marketplace. With this, the setup is simplified, as the marketplace allows to subscribe and deploy the Kafka cluster in a easy way, it offers flexible pricing models, the integration is seamless with other AWS services.