StreamSets DataOps Platform SDK for Python uses API Credentials for authentication.
For more details, refer to the StreamSets DataOps Platform Documentation.
Creating API Credentials#
The initial API credentials needed to authenticate with the DataOps Platform via the SDK will need to be generated from within the Platform’s UI.
Once the initial API credentials have been created, it is possible to create additional API credentials directly from the SDK.
From the UI#
Using a web browser log into StreamSets DataOps Platform.
In the UI, API Credentials are presented as seen below:
Create new API credentials by referring to the StreamSets DataOps Platform Documentation.
From the SDK#
Once you have an initial set of API credentials created and can authenticate successfully with the DataOps Platform, you can also generate additional API credentials directly from the SDK.
To create a new set of API credentials and add them to the DataOps Platform, you will need to use the
streamsets.sdk.ControlHub.get_api_credential_builder() method to instantiate the builder instance.
Then, call the
streamsets.sdk.sch_models.ApiCredentialBuilder.build() method while supplying a
name value for the API credentials to be created.
Finally, take the resulting
streamsets.sdk.sch_models.ApiCredential instance and pass it to the
streamsets.sdk.ControlHub.add_api_credential() method to generate the API credentials:
api_cred_builder = sch.get_api_credential_builder() api_credential = api_cred_builder.build(name='H.E. Pennypacker API Creds') sch.add_api_credential(api_credential)
streamsets.sdk.ControlHub.add_api_credential() method will update the api_credential instance directly in-memory without needing to retrieve or refresh it.
auth_token values for a set of API credentials are private key values and should be safeguarded as sensitive passwords.
These values are not retrievable after the API credentials have been created.
If the resulting API credentials are deleted from local memory and the values are not stored, they will be lost.
For the purpose of this documentation, the
auth_token attributes of the API credentials will
be referred as <credential ID> and <token> respectively.
Connecting to Control Hub#
Connect to Control Hub by creating an instance of
streamsets.sdk.ControlHub, passing in
the API Credentials.
# Connect to the StreamSets DataOps Platform. sch = ControlHub(credential_id=<credential ID>, token=<token>)