This is an old revision of the document!
Ubuntu HortonWorks
Install the Ubuntu OS as normal. HortonWorks supports 12.04 and 14.04.
When partitioning the drives, do not create any swap.
Install some packages required by HDP:
aptitude -y install unzip ntp nscd
Increase the file descriptor and processor limits. In /etc/security/limits.conf
:
* - nofile 32768 * - nproc 65536
Disable IPv6 completely in /etc/sysctl.conf
. HortonWorks also recommends disabling swapping completely, and increasing max user instances:
net.ipv6.conf.all.disable_ipv6 = 1 net.ipv6.conf.default.disable_ipv6 = 1 net.ipv6.conf.lo.disable_ipv6 = 1 vm.swappiness = 0 fs.epoll.max_user_instances = 2048
Disable it directly as well:
sysctl -w net.ipv6.conf.all.disable_ipv6=1 sysctl -w net.ipv6.conf.default.disable_ipv6=1 sysctl -w net.ipv6.conf.lo.disable_ipv6=1 sysctl -w vm.swappiness=0 sysctl -w fs.epoll.max_user_instances=2048
HortonWorks recommends disabling transparent hugepages as well. Add to /etc/rc.local
:
echo never > /sys/kernel/mm/transparent_hugepage/enabled echo never > /sys/kernel/mm/transparent_hugepage/defrag
On the primary node, add the HDP Ubuntu repos:
wget -nv http://public-repo-1.hortonworks.com/ambari/ubuntu14/2.x/updates/2.2.0.0/ambari.list -O /etc/apt/sources.list.d/ambari.list apt-key adv --recv-keys --keyserver keyserver.ubuntu.com B9733A7A07513CAD aptitude update
Install the Ambari package:
ambari-server