Cloudera Enterprise 6.0 Beta | Other versions

Administering Cloudera Distribution of Apache Spark 2

Most administration tasks are the same whether you are using Spark 1 or Spark 2. To configure and manage Spark, follow the procedures in the .

In addition, follow these procedures that are specific to Spark 2:

Configuring Names of Spark 2 Tools

If you used the separate parcel for Cloudera Distribution of Spark 2 along with CDH 5, you might have coded the executable names pyspark2 and spark2-shell into your code. In CDH 6, because Spark 2 is the built-in version of Spark, switch back to the original executable namespyspark and spark-shell.

Page generated March 7, 2018.