Release notes

Release notes are starting with version 2.3.0

Version 2.4.3

Features

  • SqlConnectionManager exposes parameter to use row locks instead table lock for bulk insert operations
  • DbSource: Sql property now allows query parameter

Bugs

  • Improved exception handling for DbMerge: Added check for IdColumn
  • XmlSource now correctly reads all tags if xml contains no line breaks

Version 2.4.2

Features

  • DataTypeConverter: Added helper method to convert from CLR type to SqlServer specific data type
  • ExcelSource exposes ExcelColumns property, allowing to manual set column configuration
  • All components now have delegate for progress tracking
  • New destination: ExcelDestination

Bug fixes

  • ExcelSource: EndColumn value in ExcelRange now starts counting at with 1 instead 0

Version 2.4.1

Features

  • Adding GetNextUri/HasNextUri pattern to DataFlowStreamDestinations
  • ResourceType.File is now default for all streaming sources and destinations
  • Streaming sources: New property CreateStreamReader allows usage of existing streams
  • Streaming destinations: New property CreateStreamWriter allows to write into existing streams
  • Adding integration to Azure Blob Storage for streaming sources and destinations (ResourceType.AzureBlob)
  • ExcelSource&CsvSource: ReadFieldHeaders will read header data based on current configuration (can be called before the actual data flow started)
  • DbMerge now exposes ColumnMapping property
  • New transformation: FilterTransformation as alternative to linking with predicates
  • ColumnRename: RenameFunc let you define a custom function to rename each column/prop separately with a custom function

Bug fixes

  • SqlServer: fixing bug for Query parameter types without length (e.g. DECIMAL)
  • DbSource: Using a sql query where the column names include white spaces, these white spaces are kept

Version 2.4.0

Features

  • TextSource: ParseLineAction changed to ParseLineFunc
  • StreamMetaData holds number of processed rows per request
  • Added Redis source/destination (package ETLBox.Redis)
  • Added Couchbase source/destination (package ETLBox.Couchbase)
  • Added MongoDb source/destination (package ETLBox.MongoDb)
  • Network class: Network.Cancel(..) allows to cancel a running complete data flow

Bug fixes

  • DbMerge: For missing compare columns, the non-Id columns are now properly used detecting exists/updates
  • Db2ConnectionManager/UseSqlBulkInsert: Fixed bug when parameter where exceeding Db2 maximum
  • Network class: Networks now correctly cancels when exception in error path is thrown

Version 2.3.2

Features

General:

  • Auto generated xml documentation added to package - now visible with Intellisense or when browsing package content.

DataFlow:

  • ExcelSource exposes parsed header names in FieldHeaders property.
  • DbSource has ColumnConverters property

Version 2.3.1

Features

ConnectionManagers:

  • ODBC/OleDb now have ConnectionManagerType property settable.

ControlFlow:

  • Db2 now has support for schemas
  • CreateTableTask: Now offers functionality to alter tables (Alter() / CreateOrAlter())
  • CreateSchemaTask supports authorization
  • Added GetTableListTask (return all tables in database)

DataFlow:

  • UnparsedData property for streaming sources now contains data of skipped rows.
  • All executable sources allow to set limit for records to read
  • Added property KeepIdentity to DbDestination which allows overwriting of Identity columns
  • DataConverters available for DbDestination (allows to add custom column converter)
  • (Breaking Change) DbSource: Replace ListColumnNames prop with ICollection ColumnMapping
  • (Breaking change) Improved naming in ColumnMap Attribute (NewName = PropertyName, CurrentName = DbColumnName)
  • (Breaking change) ColumnRename now uses RenameColumn attribute instead ColumnMapping.

Bug fixes

  • Postgres connection manager now has full support for jsonb columns.
  • DbSource/Sql property: Whitespace in column aliases are now properly parsed as column names.