Kafka Connect

Kafka Connect is an API/tool for scalably and reliably streaming data between Apache Kafka and other systems. Kafka Connect makes it simple to quickly define connectors that move large collections of data into and out of Kafka. Solace provides two free, open source connectors based on the Kafka Connect specification — one Source and one Sink — that make it easy to integrate Kafka and Solace so information can flow seamlessly between the environments.

The Solace Source Kafka Connector for PubSub+ uses the Kafka Connect API to consume Solace queue or topic data events and stream them to a Kafka topic. Solace PubSub+ supports popular messaging APIs and protocols like AMQP, JMS, MQTT, REST, WebSocket and more so the Connector can move any message to a Topic (Keyed or not Keyed) on the Kafka Broker.

The Solace Sink Kafka Connector for PubSub+ uses the Kafka Connect API to consume Kafka topic records and stream the data events to the Solace PubSub+ event broker as a Topic and/or Queue data event. Therefore, from the single Solace Sink Connector any Kafka Topic (Key or not Keyed) Sink Record is instantly available for consumption by any consumer that uses one of the Solace supported open standards languages or transport protocols.

Source Code

Connector Setup Walkthrough

In this video Heinz Scaffner demonstrates how to install and configure a Solace Sink Kakfa Connector and Solace Source Kafka Connector.