Recipes

Examples and code recipes for the aggregation

This article contains example codes that demonstrate the usage of the Aggregation transformation.

Example: how to use ETLBox with Azure Functions

This example shows the basics deployment of an Azure Function App using ETLBox as dependency.

Examples and code recipes for the BlockTransformation

This article contains example code that shows the usage of the BlockTransformation.

Examples and code recipes for the ColumnRename component.

This article contains example code that shows the usage of the ColumnRename component.

Example: Control and data flow basics

This purpose of this example is to give you a brief overview of the basic concepts of ETLBox. It demonstrates the basic idea of a very simple data flow and shows how to use the ControlFlow objects to manage your database metadata.

Examples and code recipes for the CrossJoin component.

This article contains example code that shows the usage of the CrossJoin component.

Examples and code recipes for the CsvDestination component.

This article contains example code that shows the usage of the CsvDestination component.

Examples and code recipes for the CsvSource component.

This article contains example code that shows the usage of the CsvSource component.

Example code how to transform a Csv to a Json

This example shows how to read data from a csv and transform it into a json - one time using strongly typed object and also using the dynamic ExpandoObject.

Examples and code recipes for the CustomBatchDestination component.

This article contains example code that shows the usage of the CustomBatchDestination component.

Examples and code recipes for the CustomBatchSource component.

This article contains example code that shows the usage of the CustomBatchSource component.

Examples and code recipes for the CustomDestination component.

This article contains example code that shows the usage of the CustomDestination component.

Examples and code recipes for the CustomSource component.

This article contains example code that shows the usage of the CustomSource component.

Example: Copy data from Sql Server into Azure blob storage

This example shows how data from SqlServer are transferred into Azure blob storage. It shows how to setup an Azure function that runs periodically to move freshly created data rows from the database into a blob container.

Various examples how to use the lookup transformation

This article contains examples which show how to use the lookup transformation and shows other techniques to lookup data..

Examples and code recipes for the DbDestination component.

This article contains example code that shows the usage of the DbDestination component.

Examples and code recipes for the DbSource component.

This article contains example code that shows the usage of the DbSource component.

Examples and code recipes for the Distinct component.

This article contains example code that shows the usage of the Distinct component.

Different methods to filter duplicates in your source

This example shows how different methods to filter out duplicates in your input data.

Examples and code recipes for the FilterTransformation component.

This article contains example code that shows the usage of the FilterTransformation component.

Example: flatten nested array in a xml file

This example shows how to denormalize a nested data array within a xml structure.

Example: From files and databases

Sometimes you are in need to transfer data across databases on different server or to integrate flat files. ETLBox is an excellent tool of choice for integrating data from different sources. This example will guide you through the most common scenarios.

Example code how to use Json from REST endpoints or other web services

This example demonstrates how json data can be received and send between web endpoints. It will read json data from a REST endpoint, rename some properties and send each entry from the source into a different endpoint.

Examples and code recipes for the JsonDestination component.

This article contains example code that shows the usage of the JsonDestination component.

Example: Using json path with dynamic objects

This purpose of this example is demonstrate how json path can be used to simplify navigation in dynamic objects.

Examples and code recipes for the JsonSource component.

This article contains example code that shows the usage of the JsonSource component.

Examples and code recipes for the LookupTransformation component.

This article contains example code that shows the usage of the LookupTransformation component.

Examples and code recipes for the MemoryDestination component.

This article contains example code that shows the usage of the MemoryDestination component.

Examples and code recipes for the MemorySource component.

This article contains example code that shows the usage of the MemorySource component.

Examples and code recipes for the MergeJoin component.

This article contains example code that shows the usage of the MergeJoin component.

Examples and code recipes for the Multicast component.

This article contains example code that shows the usage of the Multicast component.

Example: how to run multiple data flows in parallel

This purpose of this example is to show how multiple data flows can be executed in parallel.

Example: pivot data from a csv file

This example shows how to use the RowMultiplication to pivot data in a csv file.

Example: Rating orders

This example demonstrates how the different data flow components can be used together, simulating a real-life scenario. In this scenario, we will to read some orders from a csv file, lookup the customer key by using the customer name, write the orders into an orders table and also create a customer rating based on the total amount of purchases.

Examples and code recipes for the RowDuplication component.

This article contains example code that shows the usage of the RowDuplication component.

Examples and code recipes for the RowMultiplication component.

This article contains example code that shows the usage of the RowMultiplication component.

Examples and code recipes for the RowTransformation component.

This article contains example code that shows the usage of the RowTransformation component.

Examples and code recipes for the Sort component.

This article contains example code that shows the usage of the Sort component.

This example shows how unit tests could be constructed for data flow.

This recipe demonstrate how unit tests could be written to test data flows. The described approach here is very basic and should only be considered as a starting point - there are a lot of different possibilities to write unit tests for ETLBox - as the library is written in .NET, all test framework and other test packages are fully supported.

Example: Web scraping

This example demonstrates how content from a web site can be scraped and used to store, aggregate and display the retrieved data.

Examples and code recipes for the XmlDestination component.

This article contains example code that shows the usage of the XmlDestination component.

Examples and code recipes for the XmlSource component.

This article contains example code that shows the usage of the XmlSource component.