Event Generation

The Spark executor can generate events that you can use in an event stream. When you enable event generation, the executor generates events each time it starts a Spark application.

Spark executor events can be used in any logical way. For example:

With the Email executor to send a custom email after receiving an event.
For an example, see Sending Email During Pipeline Processing.
With a destination to store event information.
For an example, see Preserving an Audit Trail of Events.

Since Spark executor events include the application ID for each application that it starts, you might generate events to keep a log of the application IDs.

For more information about dataflow triggers and the event framework, see Dataflow Triggers Overview.