Hadoop V2 - Hue Setup

In this blog I am going to discuss on how to setup Hue in your HDFS cluster.


Step 1
Download Hue on Edge Node and Extract

wget https://www.dropbox.com/s/auwpqygqgdvu1wj/hue-4.1.0.tgz?dl=0#

 tar -xzf hue-4.1.0.tgz
 
Step 2
Make Hue
 cd /tmp/hue-4.1.0
 yum install python-devel.x86_64 -y
 yum install sqlite-devel.x86_64 -y
 yum install libxml2-devel.x86_64 -y
 yum install libxslt-devel.x86_64 -y
 yum install libffi-devel.x86_64 -y
 yum install openldap-devel.x86_64 -y
 yum install mariadb-devel.x86_64 -y
 yum install gmp-devel.x86_64 -y
 make install

Step 3
Create User and change ownership
useradd -u 1014  -g hadoop hue
chown -R hue:hadoop /usr/local/hue


Step 4
Add to core-site.xml (on nn) and distribute to cluster.
Then restart both nn

<property>
    <name>hadoop.proxyuser.hue.hosts</name>
    <value>*</value>
</property>
<property>
    <name>hadoop.proxyuser.hue.groups</name>
    <value>*</value>
</property>

Step 5
Configure hue.ini. Below is what all I have configured. I always mark 'Custom' to whatever I change in order to get the changes I do to config files faster.

cd /usr/local/hue

 cat ./desktop/conf/hue.ini | grep Custom
      fs_defaultfs=hdfs://devcluster:8020 ###Custom
      webhdfs_url=http://192.168.1.71:14000/webhdfvs/v1    ###Custom
        hadoop_conf_dir=/etc/hadoop/conf   ###Custom
       resourcemanager_host=rm ###Custom
         resourcemanager_port=8032 ###Custom
       resourcemanager_api_url=http://rm:8088 ##Custom
       proxy_api_url=http://rm:8088 ##Custom
       history_server_api_url=http://rm:19888 ###Custom


Step 6
[Start hue - As hue]
/usr/local/hue/build/env/bin/supervisor


Step 7
Login to URL
http://<hostname>:8888
You will get first time user password set UI.

I generally (in test envs) set user to hue and password to hadoop