Cloudera Enterprise 6.0 Beta | Other versions

Security Considerations for Cloudera Distribution of Apache Spark 2

The following sections cover any special considerations for security in the Cloudera Distribution of Apache Spark 2, or differences in security settings between Spark 1.6 and Spark 2.

Configuration Settings for Encryption

To enable encryption for the shuffle service with Cloudera Distribution of Apache Spark 2, use the following configuration setting:

spark.io.encryption.enabled=true

This is a change from Spark 1.6, where the corresponding option is spark.shuffle.encryption.enabled=true.

Page generated March 7, 2018.