Advertisement

Tuesday, June 19, 2018

HadoopV2 - Cloudera - Install (Steps and Screenshots)

In this blog I cover quick installation of cloudera manager. 

Download Installer file 

curl http://archive.cloudera.com/cm5/installer/5.10.1/cloudera-manager-installer.bin -o cloudera-manager-installer.bin

Create repo files 

cat /etc/yum.repos.d/cloudera-cdh5.repo
[cloudera-cdh5]
# Packages for Cloudera's Distribution for Hadoop, Version 5, on RedHat    or CentOS 7 x86_64
name=Cloudera's Distribution for Hadoop, Version 5
baseurl=https://archive.cloudera.com/cdh5/redhat/7/x86_64/cdh/5/
gpgkey =https://archive.cloudera.com/cdh5/redhat/7/x86_64/cdh/RPM-GPG-KEY-cloudera   
gpgcheck = 0
 


cat /etc/yum.repos.d/centos57-updates.repo
[updates]
name=Updates
baseurl=http://vault.centos.org/5.7/updates/\$basearch/
gpgcheck=0

Refres cache for Yum repos
yum makecache

Install Execute  (as root)

 chmod u+x cloudera-manager-installer.bin

 Log Location

1. /var/log/cloudera-manager-installer
2.  and /var/log/cloud-init.log
 

If your installation fails refer to /var/log/cloudera-manager-installer directory for logs. Look for the last update log. 

Other things you should make sure to have ease of installation for next steps
1. ntp is installed  and running (either pointing to local or internet server)
NTP Enabled (sudo  systemctl enable ntpd, sudo service ntpd start )
2. /etc/hosts or DNS -  The canonical name of each host in /etc/hosts must be the FQDN (for example myhost-1.mynet.myco.com), not the unqualified hostname (for example myhost-1). The canonical name is the first entry after the IP address. (server 192.168.1.200 prefer)
Do not use aliases, either in /etc/hosts or in configuring DNS.


3. Add /etc/yum.conf the proxy configuration - in case you want yum to use proxy servers (this is for hosts addition) "proxy=http://192.168.1.200:3128/"
4. Java installed on all hosts to be managed (sudo yum install oracle-j2sdk1.7 -y)









 Login using admin/admin for the first time



Post this you can click on Home , we will add hosts individually later


Check for the services installed on the box where you installed

 chkconfig --list | grep cloudera


cloudera-scm-server     0:off   1:off   2:off   3:on    4:on    5:on    6:off
cloudera-scm-server-db  0:off   1:off   2:off   3:on    4:on    5:on    6:off
 

No comments:
Write comments