Data Collector Log Data

You can view and download Data Collector log data.

Log data includes information about the Data Collector, such as the build information, the time the Data Collector started, and the time the pipeline started or stopped.

The Data Collector writes log information to a log file and appends new information to the file. When the log file reaches a defined limit, it creates another file and continues writing to the file. The file name is sdc<number>.log.

The size of the file is limited by the log4j.appender.streamsets.MaxFileSize property in the file.

When you view log data, the Data Collector console displays approximately 50,000 characters of the most recent information from the log file. You can load older log information for display. The console displays progressively older information upon request, traversing different log files when necessary.