Control Hub Cloud User Guide

Home
Getting Started

Getting Started
- Meet StreamSets Control Hub
  StreamSets Control Hub^TM is a central point of control for all of your dataflow pipelines. Control Hub allows teams to build and execute large numbers of complex dataflows at scale.
- Data Collector Communication
  StreamSets Control Hub works with Data Collector to design pipelines and to execute standalone and cluster pipelines.
- Transformer Communication
  StreamSets Control Hub works with Transformer to design pipelines and to execute Transformer pipelines on Apache Spark, an open-source cluster-computing framework.
- SDC Edge Communication
  StreamSets Control Hub works with Data Collector Edge (SDC Edge) to execute edge pipelines. SDC Edge is a lightweight agent that runs pipelines on edge devices with limited resources.
- Provisioning Agent Communication
  A Provisioning Agent is a containerized application that runs in your corporate network within a container orchestration framework, such as Kubernetes. The agent automatically provisions Data Collector containers in the Kubernetes cluster on which it runs.
- Control Hub Requirements
- Control Hub User Interface
  StreamSets Control Hub provides a web-based user interface (UI) for managing the pipeline repository and the execution components - including Data Collectors and TransformersData Collectors, Transformers, Edge Data Collectors, Provisioning Agents, and deployments. You can create connections, jobs, topologies, and Control Hub users, as well as administer your organization.
Release Notes
Tutorials
Pipeline Repository
Pipeline Design (Data Collector/Edge)
Pipeline Design (Transformer)
Connections
Jobs
Scheduler
Topologies
Reports
Subscriptions
Data Collectors
Transformers
Edge Data Collectors
Provisioned Data Collectors
Labels
Export and Import
Organization Security
Glossary

Getting Started

Meet StreamSets Control Hub
StreamSets Control Hub^TM is a central point of control for all of your dataflow pipelines. Control Hub allows teams to build and execute large numbers of complex dataflows at scale.
Data Collector Communication
StreamSets Control Hub works with Data Collector to design pipelines and to execute standalone and cluster pipelines.
Transformer Communication
StreamSets Control Hub works with Transformer to design pipelines and to execute Transformer pipelines on Apache Spark, an open-source cluster-computing framework.
SDC Edge Communication
StreamSets Control Hub works with Data Collector Edge (SDC Edge) to execute edge pipelines. SDC Edge is a lightweight agent that runs pipelines on edge devices with limited resources.
Provisioning Agent Communication
A Provisioning Agent is a containerized application that runs in your corporate network within a container orchestration framework, such as Kubernetes. The agent automatically provisions Data Collector containers in the Kubernetes cluster on which it runs.
Control Hub Requirements
Control Hub User Interface
StreamSets Control Hub provides a web-based user interface (UI) for managing the pipeline repository and the execution components - including Data Collectors and TransformersData Collectors, Transformers, Edge Data Collectors, Provisioning Agents, and deployments. You can create connections, jobs, topologies, and Control Hub users, as well as administer your organization.

© 2023 StreamSets, Inc.