com.nhncorp.neptune.parallel.hadoop
Class NeptuneMapReduceUtil

java.lang.Object
  com.nhncorp.neptune.parallel.hadoop.NeptuneMapReduceUtil

public class NeptuneMapReduceUtil
extends java.lang.Object

Author:

jindolk

Constructor Summary

NeptuneMapReduceUtil()

Method Summary

static void	clearMapReduce(java.lang.String jarPath) Clear temporary library directory.
static java.lang.String	initMapReduce(org.apache.hadoop.mapred.JobConf jobConf, java.lang.String neptuneHomeDir) Configure classpath to run MapReduce job which uses Neptune 1.
static void	main(java.lang.String[] args)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

NeptuneMapReduceUtil

public NeptuneMapReduceUtil()

Method Detail

initMapReduce

public static java.lang.String initMapReduce(org.apache.hadoop.mapred.JobConf jobConf,
                                             java.lang.String neptuneHomeDir)
                                      throws java.io.IOException

Configure classpath to run MapReduce job which uses Neptune
1. Uploads neptune library to HDFS: neptune-xxx-core.jar, pleiades-xxx-core.jar, jgroups-all.jar
2. make neptune-configure.jar includes neptune-site.xml, pleiades-site.xml and uploads to HDFS
3. run DistributedCache.addArchiveToClassPath() for each file
Must call clearMapReduce() after running job.

Parameters:

jobConf -

neptuneHomeDir -

Returns:

temporary directory for linrary in HDFS. When calling clearMapReduce(), use this value.

Throws:

java.io.IOException

clearMapReduce

public static void clearMapReduce(java.lang.String jarPath)
                           throws java.io.IOException

Clear temporary library directory.

Parameters:

jarPath -

Throws:

java.io.IOException

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

Throws:

java.lang.Exception