Interface IDataFlowStreamSource

Implemented by data flow sources that allow reading data from a stream source

Namespace: ETLBox.DataFlow
Assembly: ETLBox.dll
Syntax
    public interface IDataFlowStreamSource

Properties

GetNextUri

This func returns the next url that is used for reading data. It will be called until HasNextUri returns false. The incoming StreamMetaData holds information about the current progress and other meta data from the response, like unparsed json data that contains references to the next page of the response. This property can be used if you want to read multiple files or if you want to paginate through web responses.

Declaration
    Func<StreamMetaData, string> GetNextUri { get; set; }
Property Value
TypeDescription
System.Func<StreamMetaData, System.String>

HasNextUri

This func determines if another request is started to read additional data from the next uri. StreamMetaData has information about the current progress and other meta data from the response.

Declaration
    Func<StreamMetaData, bool> HasNextUri { get; set; }
Property Value
TypeDescription
System.Func<StreamMetaData, System.Boolean>

HttpClient

The System.Net.Http.HttpClient uses for the request. Use this client if you want to add or change the http request data, e.g. you can add your authorization information here.

Declaration
    HttpClient HttpClient { get; set; }
Property Value
TypeDescription
System.Net.Http.HttpClient

HttpRequestMessage

The System.Net.Http.HttpRequestMessage use for the request from the HttpClient. Add your request message here, e.g. your POST body.

Declaration
    HttpRequestMessage HttpRequestMessage { get; set; }
Property Value
TypeDescription
System.Net.Http.HttpRequestMessage

ResourceType

Specifies the resource type. By default requests are made with HttpClient. Specify ResourceType.File if you want to read from a json file.

Declaration
    ResourceType ResourceType { get; set; }
Property Value
TypeDescription
ResourceType

Uri

The Url of the webservice (e.g. https://test.com/foo) or the file name (relative or absolute).

Declaration
    string Uri { get; set; }
Property Value
TypeDescription
System.String