This connector allows to download data from CatalogDB database.
Storage data
This connector saves last read RecVersion property. When Input schema is not filled or Input schema is filled and RecVersion is empty, last Storage data are used as RecVersion.
Storage format:
{
"LastRead": "0x00000000000007D3"
}
Configuration
Connection String configuration
Connection string
Input data can be obtained with input data placeholders.
${input.DbName} will be replaced by value in DbName of the very first row.
Microsoft SQL Server
Windows authentication
Persist Security Info=False;Integrated Security=true;Initial Catalog=AdventureWorks;Server=MSSQL1
Persist Security Info=False;Integrated Security=SSPI;database=AdventureWorks;server=(local)
Persist Security Info=False;Trusted_Connection=True;database=AdventureWorks;server=(local)
SQL Server authentication
Persist Security Info=False;User ID=*****;Password=*****;Initial Catalog=AdventureWorks;Server=MySqlServer
Connect to a named instance of SQL Server
Data Source=MySqlServer\MSSQL1
For more examples of connection strings, see official documentation.
MySQL
Connection to single server
server=127.0.0.1;uid=root;pwd=12345;database=test
server=localhost:3306;uid=root;pwd=12345;database=test
Windows authentication
Server=myServerAddress;Database=myDataBase;IntegratedSecurity=yes;Uid=auth_windows;
Opening a Connection for Multiple Hosts with Failover
Use this to connect to a server in a replicated server configuration without concern on which server to use.
server=10.10.10.10:3306,192.101.10.2:3305,localhost:3306;uid=test;password=xxxx
For more examples of connection strings, see official documentation or unofficial documentation.
PostgreSQL
Standard
Host=myserver;Username=mylogin;Password=mypass;Database=mydatabase
User ID=root;Password=myPassword;Host=localhost;Port=5432;Database=myDataBase;Pooling=true;Min Pool Size=0;Max Pool Size=100;Connection Lifetime=0;
Using windows security
Server=127.0.0.1;Port=5432;Database=myDataBase;Integrated Security=true;
Setting command timeout
Server=127.0.0.1;Port=5432;Database=myDataBase;User Id=myUsername;Password=myPassword;CommandTimeout=20;
Setting connection timeout
Server=127.0.0.1;Port=5432;Database=myDataBase;User Id=myUsername;Password=myPassword;Timeout=15;
For more examples of connection strings, see official Npgsql documentation or unofficial documentation.
Oracle
Windows Authentication
Data Source=myOracleDB;User Id=/;
Specifying username and password
Data Source=MyOracleDB;User Id=myUsername;Password=myPassword;Integrated Security=no;
Omiting tnsnames.ora
SERVER=(DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=MyHost)(PORT=MyPort))(CONNECT_DATA=(SERVICE_NAME=MyOracleSID)));uid=myUsername;pwd=myPassword;
Using Connection Pooling
Data Source=myOracleDB;User Id=myUsername;Password=myPassword;Min Pool Size=10;Connection Lifetime=120;Connection Timeout=60;Incr Pool Size=5;Decr Pool Size=2;
Proxy Authentication
Data Source=myOracleDB;User Id=myUsername;Password=myPassword;Proxy User Id=pUserId;Proxy Password=pPassword;
For more examples of connection strings, see official documentation.
CatalogDB Connection Params configuration
Entity name
Name of inserted or updated entity. By this Entity there are called stored procedures on connected DB server.
Example
- Customer
- User
- ...
Database schema name
A schema is a collection of logical structures of data, or schema objects.
dbo
Number of attempts
Number of attempts to process data. Server try to execute command as many times as number of attempts is set.
CatalogDB Select Params configuration
Use data pointer
When checked connector use last store data pointer value insteed of ModifiedDate property sended in input data.
Max returned rows
Max returned rows to output.
When not set, returning all rows.
Input & Output Schema
Input
Input schema is optional. When input schema is selected there must be JUST one entry contained.
Catalog Select Input (ver. 1.0.4)
| Column | Data type | Allow null | Description |
|---|---|---|---|
| Code | string | Yes | Code value for searching. |
| Code2 | string | Yes | Code2 value for searching. |
| OriginID | string | Yes | OriginID unique value of entry in DB (Guid). |
| ModifiedDate | string | Yes | ModifiedDate value for searching. |
| OnlyActive | string | Yes | OnlyActive value for searching. |
| FilterJSON | string | Yes | FilterJSON value for searching. |
| RecVersion | string | Yes | RecVersion value for searching. |
Output
Catalog Select Output (ver. 1.0.5)
| Column | Data type | Allow null | Description |
|---|---|---|---|
| DataJSON | JSON | No | JSON value of entry stored in CatalogDB. |
| CreatedDate | DateTime | Yes | DateTime when entry was created. |
| ModifiedDate | DateTime | No | Last modification DateTime. |
| RecVersion | string | Yes | RecVersion value. |
| TaskRunID | integer | Yes | ID of the currently executing TaskRun. |
Release notes
3.1.4
- Plugin binaries update as a result of included connector change.
3.1.3
- Fixed shared nuget package versions.
3.1.2
- Fixed right processing of nullable properties.