Red Hat AMQ Streams

Red Hat AMQ Streams is a massively scalable, distributed, and high-performance data streaming platform based on the Apache Kafka® project. AMQ Streams provides an event streaming backbone that allows microservices and other application components to exchange data with extremely high throughput and low latency. AMQ Streams supports only OCP 4.10 to 4.13! The core capabilities include: A pub/sub messaging model, similar to a traditional enterprise messaging system, in which application components publish and consume events to/from an ordered stream

• The long-term, fault-tolerant storage of events
• The ability for a consumer to replay streams of events
• The ability to partition topics for horizontal scalability

Upgrades

Direct upgrade from AMQ Stream 1.7 or earlier is not supported! You have to upgrade first to one of the previous versions of AMQ Streams. You will also need to convert the CRD resources. For more information, see the documentation for AMQ Streams on OpenShift.

Supported Features

• Manages the Kafka Cluster - Deploys and manages all of the components of this complex application, including dependencies like Apache ZooKeeper® that are traditionally hard to administer.
• Includes Kafka Connect - Allows for configuration of common data sources and sinks to move data into and out of the Kafka cluster.
• Topic Management - Creates and manages Kafka Topics within the cluster.
• User Management - Creates and manages Kafka Users within the cluster.
• Connector Management - Creates and manages Kafka Connect connectors.
• Includes Kafka Mirror Maker 1 and 2 - Allows for mirroring data between different Apache Kafka® clusters.
• Includes HTTP Kafka Bridge - Allows clients to send and receive messages through an Apache Kafka® cluster via HTTP protocol.
• Cluster Rebalancing - Uses built-in Cruise Control for redistributing partition replicas according to specified goals to achieve the best cluster performance.
• Monitoring - Built-in support for monitoring using Prometheus and provided Grafana dashboards

Upgrading your Clusters

The AMQ Streams Operator understands how to run and upgrade between a set of Kafka versions. When specifying a new version in your config, check to make sure you aren't using any features that may have been removed. For more information on upgrading, see the documentation for AMQ Streams on OpenShift.

Storage

An efficient data storage infrastructure is essential to the optimal performance of Apache Kafka®. Apache Kafka® deployed via AMQ Streams requires block storage. The use of file storage (for example, NFS) is not recommended. The AMQ Streams Operator supports three types of data storage:

• Ephemeral (Recommended for development only!)
• Persistent
• JBOD (Just a Bunch of Disks, suitable for Kafka only. Not supported in Zookeeper.) AMQ Streams also supports advanced operations such as adding or removing disks in Apache Kafka® brokers or resizing the persistent volumes (where supported by the infrastructure).

Documentation

Documentation for the current release can be found on the Red Hat Customer Portal.

Ref: https://access.redhat.com/documentation/en-us/red_hat_amq_streams/