ETLBox
Title here
Summary here
Overview
ETLBox provides specialized connectors for working with in-memory data, custom sources, and DataFrames.
These connectors allow flexible data processing by supporting lists, collections, custom sources, and columnar storage with Microsoft.Data.Analysis.DataFrame.
Some connectors are included in the ETLBox core package, while others require additional dependencies.
Available Connectors
| Connector | Package | Description |
|---|---|---|
| MemorySource | ETLBox (Core) | Reads from in-memory lists and collections. |
| MemoryDestination | ETLBox (Core) | Stores data in an in-memory list. |
| ConcurrentMemoryDestination | ETLBox (Core) | Thread-safe version of MemoryDestination using BlockingCollection<T>. |
| CustomSource | ETLBox (Core) | Reads data from any custom source. |
| CustomBatchSource | ETLBox (Core) | Reads data in batches from a custom source. |
| CustomDestination | ETLBox (Core) | Processes each incoming record with a custom action. |
| CustomBatchDestination | ETLBox (Core) | Processes data in batches before storing it. |
| DataFrameSource | ETLBox.Analysis | Reads data from a Microsoft.Data.Analysis.DataFrame. |
| DataFrameDestination | ETLBox.Analysis | Writes processed data into a Microsoft.Data.Analysis.DataFrame. |
| VoidDestination | ETLBox (Core) | Discards records, useful for filtering operations. |
Installation
All connectors except DataFrameSource and DataFrameDestination are included in the ETLBox core package.
To use the DataFrame connectors, install the ETLBox.Analysis package:
Prev
XMLNext
Custom Connector