Scala Processor and Preprocessing Script Prerequisites

Before you use a Scala processor or preprocessing script in a pipeline, complete the following prerequisite tasks:

• Ensure that Transformer uses the version of Spark installed on your cluster.
• Set the SPARK_HOME environment variable on all nodes in the Spark cluster.