Cloudera Enterprise 6.0 Beta | Other versions

Version and Packaging Information

Continue reading:

Cloudera Distribution of Apache Spark 2 Version Information

Table 1. Version Information
Version CSD Parcel
2.2 Release 1

The exact parcel name is dependent on the OS. You can find all the parcels at .
2.1 Release 1

The exact parcel name is dependent on the OS. You can find all the parcels at .
2.0 Release 2

The exact parcel name is dependent on the OS. You can find all the parcels at .
2.0 Release 1

The exact parcel name is dependent on the OS. You can find all the parcels at .

Cloudera Distribution of Apache Spark 2 Maven Artifacts

The following pom fragment shows how to access a Cloudera Distribution of Apache Spark 2 artifact from a Maven POM. For information on how to use Spark Maven artifacts, see .

<dependency>
      <groupId>org.apache.spark</groupId>
      <artifactId>spark-core_2.21</artifactId>
      <version>2.2.0.cloudera1</version>
      <scope>provided</scope>
</dependency>
Use this dependency definition to update pom.xml of the example described in . To account for changes in the Spark 2 API, before building the example, make the following updates to com.cloudera.sparkwordcount.JavaWordCount:
  • Add import java.util.Iterator;
  • Replace all instances of Iterable with Iterator.
  • Perform the following replacements:
    • return Arrays.asList(s.split(" ")); to return Arrays.asList(s.split(" ")).iterator();
    • return chars; to return chars.iterator();
  Note:

Spark 2 no longer includes an assembly JAR. This internal change is not expected to require any changes to your procedures for building and packaging applications.

Page generated March 7, 2018.