Skip to content

Latest commit

 

History

History
26 lines (19 loc) · 1.56 KB

README.md

File metadata and controls

26 lines (19 loc) · 1.56 KB
Raw

OS X Installer for the Cloudera Distribution for Hadoop

This allows for creating an installer for Hadoop for Mac OS X that attempts to integrate Hadoop in a typical manner with the OS:

  • Most files are put in /Library/Cloudera.
  • launchd will be used for stopping and starting the various daemons.
  • Paths are added to PATH by way of /etc/paths.d.

Issues

  • Daemons don't correctly start up for Hadoop and I haven't done anything yet for ZooKeeper.
  • I haven't put HBase, Hive, Flume or Hue in here yet.
  • Permissions are not quite right yet for various files. This is pretty frustrating.
  • It would be nice to automate setting JAVA_HOME for those things that need it. (This is just a matter of setting JAVA_HOME to the output of /usr/libexec/java_home.)
  • I haven't done anything to deal with updating to newer versions yet.

Notes

  • To build the installer, you download the various .tar.gz files from Cloudera, unpack them and put them in the right places under dist such as dist/Hadoop/Library/Cloudera/hadoop-0.20.2+737.
  • There are symlinks without version numbers (and capitalized) that all go into /Library/Cloudera on the target system. If the version being installed changes, then the symlink must also be updated.
  • I will have another script added at some point that handles setting up the permissions correctly once I figure out what all is needed there.
  • I run the CDH3.pmdoc/*.xml files through xmllint to format them nicer for diffs with the prettyxml.sh script.