Install MapR Cluster (Red-Hat/CentOS 7.x)

                             Install MapR Cluster

Quick and dirty way to install MapR cluster within few mins with just few commands if you don't want to script this process or use GUI installer.

In this post its assumed you have a system with Red-Hat/CentOS 7.x already then below steps required to get MapR Hadoop Cluster up and running.

1) Download and install EPEL repo

[root@node106rhel72 ~]# curl -O http://mirror.nodesdirect.com/epel/7/x86_64/e/epel-release-7-9.noarch.rpm

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current

                                 Dload  Upload   Total   Spent    Left  Speed

100 14704  100 14704    0     0  58477      0 --:--:-- --:--:-- --:--:-- 58581

[root@node106rhel72 ~]# rpm -ivh epel-release-7-9.noarch.rpm

warning: epel-release-7-9.noarch.rpm: Header V3 RSA/SHA256 Signature, key ID 352c64e5: NOKEY

Preparing...                          ################################# [100%]

Updating / installing...

   1:epel-release-7-9                 ################################# [100%]

2) Since MapR packages are signed install the MapR package key (maprgpg.key)

rpm --import http://package.mapr.com/releases/pub/maprgpg.key

3) Add user mapr within group mapr

groupadd -g 5000 mapr ; useradd -g 5000 -u 5000 mapr

4) Setup MapR repo for package installation.

[root@node106rhel72 ~]# cat /etc/yum.repos.d/maprtech.repo 

[maprtech]

name=MapR Technologies

baseurl=http://package.mapr.com/releases/v5.2.0/redhat/

enabled=1

gpgcheck=0

protect=1

[centos]

name=centos, Inc.

baseurl=http://mirror.centos.org/centos/7.3.1611/os/x86_64/

enabled=1

gpgcheck=0

5) Now creating list of disk to be given to MFS .

[root@node106rhel72 ~]# fdisk -l | awk '{print $2}' | cut -d: -f1 | grep dev | egrep -v "mapper|sda" >> /tmp/disks

6)  Install all required services with Java.

yum upgrade mapr-cldb mapr-core mapr-core-internal mapr-fileserver mapr-zookeeper mapr-zk-internal mapr-webserver -y

7) Setup "JAVA_HOME" in  /opt/mapr/conf/env.sh  file .

8) Run configure.sh for cluster to be aware of CLDB and ZK nodes.

   /opt/mapr/server/configure.sh -C Nodes -Z Nodes -N Cluster-Name


9) Now use disk setup to set up storage pools and get the disks formatted ready to be used for storage by MFS .

   /opt/mapr/server/disksetup -F /tmp/disks
   
10) Re-run configure.sh for autostart of ZK service and followed by warden.

[root@node106rhel72 logs]#  /opt/mapr/server/configure.sh -C 10.10.70.106 -Z 10.10.70.106 -N Container-cluster

Configuring Hadoop-2.7.0 at /opt/mapr/hadoop/hadoop-2.7.0

Done configuring Hadoop

CLDB node list: 10.10.70.106:7222

Zookeeper node list: 10.10.70.106:5181

Node setup configuration:  cldb fileserver webserver zookeeper

Log can be found at:  /opt/mapr/logs/configure.log

Zookeeper found on this node, and it is not running. Starting Zookeeper

Warning: mapr-zookeeper.service changed on disk. Run 'systemctl daemon-reload' to reload units.

Warden is not running. Starting mapr-warden. Warden will then start all other configured services on this node

... Starting cldb

... Starting fileserver

... Starting webserver

To further manage the system, use "maprcli", or connect browser to https://node106rhel72:8443/

To stop and start this node, use "systemctl start/stop mapr-warden "

11) Check MCS to Apply License and monitor the cluster.

Connect browser to https://{webserver host name}:8443