Class CachedBatchTransformation<TInput, TOutput>

A batch transformation will transform batches of data. The default batch size are 100000 rows. The batch transformation function allows you to process and modify each batch of data. You can use the BatchSize property to choose a smaller batch size. The batch size must always be smaller than the max buffer size. The default batch size are 1000 rows per batch. The batch transformation is a partial blocking transformation - it will always need at least enough memory to store a whole batch.

Inheritance
object
DataFlowTransformation<TInput, TOutput>
BatchTransformation<TInput, TOutput>
CachedBatchTransformation<TInput, TOutput, TInput>
CachedBatchTransformation<TInput, TOutput>
Inherited Members
object.Equals(object)
object.Equals(object, object)
object.GetHashCode()
object.GetType()
object.MemberwiseClone()
object.ReferenceEquals(object, object)
object.ToString()
Namespace: ETLBox.DataFlow
Assembly: ETLBox.dll
Syntax
    public class CachedBatchTransformation<TInput, TOutput> : CachedBatchTransformation<TInput, TOutput, TInput>, ILoggableTask, IDataFlowLogging, IDataFlowTransformation<TInput, TOutput>, IDataFlowSource<TOutput>, IDataFlowSource, IDataFlowDestination<TInput>, IDataFlowDestination, IDataFlowComponent where TInput : class
Type Parameters
NameDescription
TInput

Type of ingoing data

TOutput

Type of outgoing data

Constructors

CachedBatchTransformation()

Declaration
    public CachedBatchTransformation()

CachedBatchTransformation(int, Func<TInput[], IEnumerable<TInput>, TOutput[]>)

Declaration
    public CachedBatchTransformation(int batchSize, Func<TInput[], IEnumerable<TInput>, TOutput[]> batchTransformationFunc)
Parameters
TypeNameDescription
intbatchSize
System.Func<T1, T2, TResult><TInput[], System.Collections.Generic.IEnumerable<T><TInput>, TOutput[]>batchTransformationFunc

CachedBatchTransformation(int)

Declaration
    public CachedBatchTransformation(int batchSize)
Parameters
TypeNameDescription
intbatchSize

Implements