Core Installation
Users with a StreamSets enterprise account can use the Data Collector core installation.
The core installation is a minimal installation that generally requires installing additional stage libraries to develop pipelines. The core installation allows Data Collector to use less disk space.
To use the Data Collector core installation, you can download the RPM package or the core tarball.
The core installation includes Data Collector and
the following stage libraries:
- Basic stage library
- Data formats stage library
- Development stage library
- Statistics stage library
- Windows stage library
You then use the Data Collector UI or the command line interface to install additional stage libraries.
The core installation includes all development stages and the following stages:
- Origins
-
- CoAP Server
- Directory
- File Tail
- gRPC Client
- HTTP Client
- HTTP Server
- JavaScript Scripting
- MQTT Subscriber
- NiFi HTTP Server
- OPC UA Client
- REST Service
- SDC RPC
- SFTP/FTP/FTPS Client
- System Metrics
- TCP Server
- UDP Multithreaded Source
- UDP Source
- WebSocket Client
- WebSocket Server
- Windows Event Log
- Processors
-
- Base64 Field Decoder
- Base64 Field Encoder
- Data Generator
- Data Parser
- Delay
- Expression Evaluator
- Field Flattener
- Field Hasher
- Field Mapper
- Field Masker
- Field Merger
- Field Order
- Field Pivoter
- Field Remover
- Field Renamer
- Field Replacer
- Field Splitter
- Field Type Converter
- Field Zip
- Geo IP
- HTTP Client
- HTTP Router
- JavaScript Evaluator
- JSON Generator
- JSON Parser
- Log Parser
- Record Deduplicator
- Schema Generator
- Static Lookup
- Stream Selector
- Value Replacer
- Windowing Aggregator
- XML Flattener
- XML Parser
- Destinations
-
- CoAP Client
- HTTP Client
- Local FS
- MQTT Publisher
- Named Pipe
- SDC RPC
- Send Response to Origin
- SFTP/FTP/FTPS Client
- Splunk
- Syslog
- To Error
- Trash
- WebSocket Client
- Executors
-
- Databricks Job Launcher
- Pipeline Finisher
- Shell