Amazon EC2 Deployments

You can create an Amazon EC2 deployment for an enabled AWS environment.

When you create an EC2 deployment, you define the engine type, version, and configuration to deploy to the Amazon VPC specified in the environment. You also specify the number of engine instances to deploy. Each engine instance runs on a dedicated EC2 instance.

When you enable an EC2 deployment, Control Hub connects to the Amazon VPC specified in the environment and then creates an AWS CloudFormation stack. AWS CloudFormation provisions the group of EC2 instances in the VPC and then deploys and launches one StreamSets engine instance on each EC2 instance.

AWS CloudFormation manages the provisioning and monitoring of the EC2 instances. Control Hub simply receives the status of the deployed StreamSets engine instances and sends any updates to CloudFormation. For example, if you update the deployment to increase the number of EC2 instances, Control Hub sends the updated request to CloudFormation and then CloudFormation provisions additional EC2 instances and launches an engine instance on each.

Important: You are responsible for all costs from AWS incurred by the resources provisioned by Control Hub. StreamSets strongly advises against directly modifying the provisioned resources in AWS. Doing so may cause unexpected errors.

For more information about AWS CloudFormation, see the AWS CloudFormation documentation.

Before creating an Amazon EC2 deployment, you must complete several prerequisites.