====== Ubuntu HortonWorks ====== * [[Ubuntu]] * [[Hadoop]] Install the Ubuntu OS as normal. HortonWorks supports 12.04 and 14.04. When partitioning the drives, do not create any swap. Install some packages required by HDP: aptitude -y install unzip ntp nscd Increase the file descriptor and processor limits. In ''/etc/security/limits.conf'': * - nofile 32768 * - nproc 65536 Disable IPv6 completely in ''/etc/sysctl.conf''. HortonWorks also recommends disabling swapping completely, and increasing max user instances: net.ipv6.conf.all.disable_ipv6 = 1 net.ipv6.conf.default.disable_ipv6 = 1 net.ipv6.conf.lo.disable_ipv6 = 1 vm.swappiness = 0 Apply the changes: sysctl -p HortonWorks recommends disabling transparent hugepages as well. Add to ''/etc/rc.local'': echo never > /sys/kernel/mm/transparent_hugepage/enabled echo never > /sys/kernel/mm/transparent_hugepage/defrag On the primary node, add the HDP Ubuntu repos: wget -nv http://public-repo-1.hortonworks.com/ambari/ubuntu14/2.x/updates/2.2.0.0/ambari.list -O /etc/apt/sources.list.d/ambari.list apt-key adv --recv-keys --keyserver keyserver.ubuntu.com B9733A7A07513CAD aptitude update Install the Ambari package: aptitude -y install ambari-server