Core Installation
Users with a StreamSets enterprise account can use the Data Collector core installation.
The core installation is a minimal installation that generally requires installing additional stage libraries to develop pipelines. The core installation allows Data Collector to use less disk space.
To use the Data Collector core installation, you can download the RPM package or the core tarball.
The core installation includes Data Collector and
the following stage libraries:
- Basic stage library
- Data formats stage library
- Development stage library
- Statistics stage library
- Windows stage library
You then use the command line interface to install additional stage libraries.
The core installation includes all development stages and the following stages:
- Origins
-
- CoAP Server
- Directory
- File Tail
- gRPC Client
- HTTP Client
- HTTP Server
- JavaScript Scripting
- MQTT Subscriber
- OPC UA Client
- REST Service
- SFTP/FTP/FTPS Client
- System Metrics
- TCP Server
- UDP Multithreaded Source
- UDP Source
- WebSocket Client
- WebSocket Server
- Windows Event Log
- Processors
-
- Base64 Field Decoder
- Base64 Field Encoder
- Data Generator
- Data Parser
- Delay
- Expression Evaluator
- Field Flattener
- Field Hasher
- Field Mapper
- Field Masker
- Field Merger
- Field Order
- Field Pivoter
- Field Remover
- Field Renamer
- Field Replacer
- Field Splitter
- Field Type Converter
- Field Zip
- Geo IP
- HTTP Client
- HTTP Router
- JavaScript Evaluator
- JSON Generator
- JSON Parser
- Log Parser
- Record Deduplicator
- Schema Generator
- Static Lookup
- Stream Selector
- Windowing Aggregator
- XML Flattener
- XML Parser
- Destinations
-
- CoAP Client
- HTTP Client
- Local FS
- MQTT Publisher
- Named Pipe
- Send Response to Origin
- SFTP/FTP/FTPS Client
- Splunk
- Syslog
- To Error
- Trash
- WebSocket Client
- Executors
-
- Databricks Job Launcher
- Pipeline Finisher
- Shell