ubuntu_hortonworks - nx.beandog.org

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.

====== Ubuntu HortonWorks ======

  * [[Ubuntu]]
  * [[Hadoop]]

Install the Ubuntu OS as normal. HortonWorks supports 12.04 and 14.04.

When partitioning the drives, do not create any swap.

Install some packages required by HDP:

<code>
aptitude -y install unzip ntp nscd
</code>

Increase the file descriptor and processor limits. In ''/etc/security/limits.conf'':

<code>
* - nofile 32768
* - nproc 65536
</code>

Disable IPv6 completely in ''/etc/sysctl.conf''. HortonWorks also recommends disabling swapping completely, and increasing max user instances:

<code>
net.ipv6.conf.all.disable_ipv6 = 1
net.ipv6.conf.default.disable_ipv6 = 1
net.ipv6.conf.lo.disable_ipv6 = 1
vm.swappiness = 0
</code>

Apply the changes:

<code>
sysctl -p
</code>

HortonWorks recommends disabling transparent hugepages as well. Add to ''/etc/rc.local'':

<code>
echo never > /sys/kernel/mm/transparent_hugepage/enabled
echo never > /sys/kernel/mm/transparent_hugepage/defrag
</code>

On the primary node, add the HDP Ubuntu repos:

<code>
wget -nv http://public-repo-1.hortonworks.com/ambari/ubuntu14/2.x/updates/2.2.0.0/ambari.list -O /etc/apt/sources.list.d/ambari.list
apt-key adv --recv-keys --keyserver keyserver.ubuntu.com B9733A7A07513CAD
aptitude update
</code>

Install the Ambari package:

<code>
aptitude -y install ambari-server
</code>

Trace: • load_balancing • mail_servers • php_suhosin • less • openbsd_dhcp_server • createdb • acl • high_availability • dcron • openbsd_liveusb

Navigation

Search

Toolbox

QR Code