ETLBox ETLBox ETLBox Buy Try Buy

Overview

Messaging systems play a key role in distributed architectures and event-driven data flows. With ETLBox, you can integrate queue- or stream-based communication into your pipelines using connectors for platforms like Azure Service Bus and Apache Kafka. These connectors support reading messages as input and writing structured output events, helping you build flexible and reactive data workflows.

Supported Messaging Systems

While each system has its own characteristics and API behavior, the ETLBox connectors abstract the complexity and provide a consistent way to incorporate message-based inputs and outputs into your ETL workflows.

SystemTypePackage
Apache KafkaDistributed LogETLBox.Apache.Kafka
Azure Service BusQueue / Pub-SubETLBox.Azure.ServiceBus

Refer to the individual connector documentation for usage examples and configuration options.

Installation

To use a messaging connector, install the corresponding NuGet package. For example, to use the Kafka integration:

dotnet add package ETLBox.Apache.Kafka
PM> NuGet\Install-Package ETLBox.Apache.Kafka
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package   .
<PackageReference Include="ETLBox.Apache.Kafka" Version="latest" />
For projects that support PackageReference   , copy this XML node into the project file to reference the package.
> #r "nuget: ETLBox.Apache.Kafka, latest"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
Edit this page on GitHub
Prev
Redis
Next
Apache Kafka