Initial Install of Hadoop at the Tier 1

Hardware setup

• Disk Servers

These were going to be of the form of vitrual disksservers ( vds*.esc.rl.ac.uk) but were not used in the end. In the future either these are real disk server could be used.

• Head Nodes

There are three virtual xen machines (SL5 64 bit) which can be used.

Software installed

• Hadoop in a box
  • Hadoop in a box was succesfully installed after following instructions at:
    • http://hadoop.apache.org/common/docs/current/quickstart.html
  • Release was 0.20.0
  • Downloaded from hadoop page
    • http://hadoop.apache.org/hdfs/releases.html
  • Did have issues trying to get the JAVA_HOME term set correctly (from the quick start instructions)

• Pseudo-Distributed Operation
  • Working on ssh needs.
• Fully-Distributed Operation
  • Software downloaded, configuration needed.
• Updating Linux
  • Linux has not yet been updated.