Hue can use either of the following to access HDFS data:

• WebHDFS provides high-speed data transfer with good locality because clients talk directly to the DataNodes inside the Hadoop cluster.

• HttpFS is a proxy service appropriate for integration with external systems that are not behind the cluster's firewall.

Both WebHDFS and HttpFS use the HTTP REST API so they are fully interoperable, but Hue must be configured to use one or the other. For HDFS HA deployments, you must use HttpFS.

To configure Hue to use either WebHDFS or HttpFS, do the following steps:

1. For WebHDFS only:
   1. Add the following property in hdfs-site.xml to enable WebHDFS in the NameNode and DataNodes:

      <property>
        <name>dfs.webhdfs.enabled</name>
        <value>true</value>
      </property>

   2. Restart your HDFS cluster.
2. Configure Hue as a proxy user for all other users and groups, meaning it may submit a request on behalf of any other user:

   WebHDFS: Add to core-site.xml:

   <!-- Hue WebHDFS proxy user setting -->
   <property>
     <name>hadoop.proxyuser.hue.hosts</name>
     <value>*</value>
   </property>
   <property>
     <name>hadoop.proxyuser.hue.groups</name>
     <value>*</value>
   </property>

   HttpFS: Verify that /etc/hadoop-httpfs/conf/httpfs-site.xml has the following configuration:

   <!-- Hue HttpFS proxy user setting -->
   <property>
     <name>httpfs.proxyuser.hue.hosts</name>
     <value>*</value>
   </property>
   <property>
     <name>httpfs.proxyuser.hue.groups</name>
     <value>*</value>
   </property>

   If the configuration is not present, add it to /etc/hadoop-httpfs/conf/httpfs-site.xml and restart the HttpFS daemon.
3. Verify that core-site.xml has the following configuration:

   <property>  
   <name>hadoop.proxyuser.httpfs.hosts</name>  
   <value>*</value>  
   </property>  
   <property>  
   <name>hadoop.proxyuser.httpfs.groups</name>  
   <value>*</value>  
   </property>  

   If the configuration is not present, add it to /etc/hadoop/conf/core-site.xml and restart Hadoop.
4. With root privileges, update hadoop.hdfs_clusters.default.webhdfs_url in hue.ini to point to the address of either WebHDFS or HttpFS.

   [hadoop]
   [[hdfs_clusters]]
   [[[default]]]
   # Use WebHdfs/HttpFs as the communication mechanism.

   WebHDFS:

   ...
   webhdfs_url=http://FQDN:50070/webhdfs/v1/

   HttpFS:

   ...
   webhdfs_url=http://FQDN:14000/webhdfs/v1/

     Note: If the webhdfs_url is uncommented and explicitly set to the empty value, Hue falls back to using the Thrift plugin used in Hue 1.x. This is not recommended.

To run DistCp, Streaming, Pig, Sqoop, and Hive jobs in Job Designer or the Oozie Editor/Dashboard application, see Installing the Oozie ShareLib in Hadoop HDFS for instructions.

<!-- Default proxyuser configuration for Hue -->
<property>
    <name>oozie.service.ProxyUserService.proxyuser.hue.hosts</name>
    <value>*</value>
</property>
<property>
    <name>oozie.service.ProxyUserService.proxyuser.hue.groups</name>
    <value>*</value>
</property>

See Search Configuration for details on how to configure the Search application for Hue.

The Beeswax daemon has been replaced by HiveServer2. Hue should therefore point to a running HiveServer2. This change involved the following major updates to the [beeswax] section of the Hue configuration file, hue.ini.

[beeswax]
  # Host where Hive server Thrift daemon is running.
  # If Kerberos security is enabled, use fully-qualified domain name (FQDN).
  ## hive_server_host=<FQDN of HiveServer2>

  # Port where HiveServer2 Thrift server runs on.
  ## hive_server_port=10000