Kafka Connect is an API/tool for scalably and reliably streaming data between Apache Kafka and other systems. Kafka Connect makes it simple to quickly define connectors that move large collections of data into and out of Kafka. Solace provides two free, open source connectors based on the Kafka Connect specification — one Source and one Sink — that make it easy to integrate Kafka and Solace so information can flow seamlessly between the environments.
The PubSub+ Connector: Kafka Source uses the Kafka Connect API to consume Solace queue or topic data events and stream them to a Kafka topic. Solace PubSub+ supports popular messaging APIs and protocols like AMQP, JMS, MQTT, REST, WebSocket and more so the Connector can move any message to a Topic (Keyed or not Keyed) on the Kafka Broker.
The PubSub+ Connector: Kafka Sink uses the Kafka Connect API to consume Kafka topic records and stream the data events to the Solace PubSub+ event broker as a Topic and/or Queue data event. Therefore, from the single Solace Sink Connector any Kafka Topic (Key or not Keyed) Sink Record is instantly available for consumption by any consumer that uses one of the Solace supported open standards languages or transport protocols.
Connector Setup Walkthrough
In this video Heinz Schaffner demonstrates how to install and configure a PubSub+ Connector Kafka Source and PubSub+ Connector Kafka Sink.