Overview
A connection defines the information required to connect to an external system.
Pipelines communicate with external systems to read and write data. Most of these external systems require sensitive information, such as user names or passwords, to access the data. When you configure pipelines and pipeline fragments, you can enter the details needed to connect to the external system, or you can select an existing connection that contains the details.
- Increased security
- When you use connections, you can limit the number of users that need to know the security credentials for external systems.
- Reusability
- You can create a connection once and then reuse that connection in multiple pipelines. Reusing connections reduces the possibility of user errors and simplifies updates to connection values.
Configuring connections requires an authoring Data Collector.
For more information on the supported connection types, see Connection Types Overview.
Connection Requirements
Before you create connections, note the following requirements:
- Use an appropriate authoring Data Collector to create connections
- You must select an available authoring Data Collector version 3.19.0 or later to create connections.
- Pipelines with the appropriate engine version can use connections
- After creating connections, you can use those connections in pipelines.
Data Collector Versions
The Data Collector version determines the connection types that you can use in Data Collector pipelines and the properties available in each connection.
Connection support was initially introduced with Data Collector 3.19.0. Later versions introduce support for additional connection types and properties.
Engine Version | New Connection Types or Properties |
---|---|
Data Collector 5.11.0 |
|
Data Collector 5.10.0 |
|
Data Collector 5.9.0 |
|
Data Collector 5.8.0 |
|
Data Collector 5.6.0 |
|
Data Collector 5.5.0 |
|
Data Collector 5.4.0 |
|
Data Collector 5.2.0 |
|
Data Collector 5.1.0 |
|
Data Collector 5.0.0 |
|
Data Collector 4.4.0 |
|
Data Collector 4.2.0 |
|
Data Collector 4.1.0 |
|
Data Collector 4.0.0 |
|
Data Collector 3.22.0 |
|
Data Collector 3.21.0 |
|
Data Collector 3.20.0 |
|
Data Collector 3.19.0 |
|
Transformer Versions
The Transformer version determines the connection types that you can use in Transformer pipelines and the properties available in each connection.
Connection support was initially introduced with Transformer 3.16.0. Later versions introduce support for additional connection types and properties.
Engine Version | New Connection Types or Properties |
---|---|
Transformer 5.7.0 |
Using this feature requires an authoring Data Collector version 5.10.0 or later. |
Transformer 5.4.0 |
Using these features requires an authoring Data Collector version 5.4.0 or later. |
Transformer 5.3.0 |
|
Transformer 4.0.0 |
|
Transformer 3.18.0 |
|
Transformer 3.16.0 |
Note: Creating these connection types requires
an authoring Data Collector version 3.19.0 or later.
|
Working with Connections
The Connections view lists all connections that you have access to.
- Create connections.
- Assign tags to connections.
- Test that configured connection values are valid.
- View connection details, including the connection type, assigned tags, and the list of pipelines and pipeline fragments that use the connection.
- Edit connection details.
- Share connections with other users and groups.
- Delete connections.
The following image shows a list of connections in the Connections view. Each connection is listed with its type, tags, and owner:
Note the following icons that display for connections when you select a connection. You'll use these icons frequently as you manage connections:
Icon | Name | Description |
---|---|---|
Add | Add a connection. | |
Refresh | Refresh the list of connections. | |
Toggle Filter Column | Toggle the display of the Filter column, where you can filter connections by connection type or tag. You can also search for connections by name or description. | |
Share | Share connections with other users and groups, as described in Permissions. | |
Edit | Edit the connection. | |
Delete | Delete the connection. |