ADLS Gen2 File Metadata

The ADLS Gen2 File Metadata executor changes file metadata, creates an empty file, or removes a file or directory in Azure Data Lake Storage Gen2 each time it receives an event. To perform these tasks in Azure Data Lake Storage Gen1, use the ADLS Gen1 File Metadata executor. For information about supported versions, see Supported Systems and VersionsSupported Systems and Versions in the Data Collector documentation.

Before you use the executor, you must perform some prerequisite tasks.

An executor can perform a single task. To perform more than one task, use additional executors.

Use the ADLS Gen2 File Metadata executor as part of an event stream. For example, you might use the executor to move a file or change file permissions after it receives a file closure event from the Azure Data Lake Storage Gen2 destination.

To change metadata, configure an expression that represents the location and name of the file to process, and then specify the changes you want to make. To create an empty file, specify the output location for the file, and optionally specify the owner, permissions, and ACLs for the file. To remove a file or directory, specify the location of the file or directory.

When necessary, you can configure advanced properties to pass to the underlying Hadoop file system.

You can also use a connectionconnection to configure the executor.

You can also configure the executor to generate events for another event stream. For more information about dataflow triggers and the event framework, see Dataflow Triggers Overview.

For a solution that describes how to use a similar file metadata executor, see Managing Output Files.