Batch transformation

The BatchTransformation let you transform batches of ingoing data.

Overview#

The normal RowTransformation will execute custom code for every processed row. Sometimes it can be beneficial not only to process every row, but batches of incoming. For this purpose you can use the BatchTransformation.

Buffer#

The BatchTransformation has an input buffer and an output buffer. It will block execution until the buffer size is equal the batch size, or the source component has completed.

Code snippet#

BatchTransformation<MyInputRow,MyOutputRow> batchtrans =
    new BatchTransformation<MyInputRow,MyOutputRow>();
batchtrans.BatchSize = 3;
batchtrans.BatchTransformationFunc =
    batchdata =>
    {
        List<MyOutputRow> result = new List<MyOutputRow>();
        foreach (var row in batchdata)
            result.Add(new MyOutputRow(row));
        return result;
    };