org.openimaj.hadoop.mapreduce

Class StageRunner

java.lang.Object

org.apache.hadoop.conf.Configured

org.openimaj.hadoop.mapreduce.StageRunner

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

Direct Known Subclasses:

HadoopTwitterPreprocessingTool, SingleStagedJob

public abstract class StageRunner
extends org.apache.hadoop.conf.Configured
implements org.apache.hadoop.util.Tool

A StageRunner provides the various components to run an individual stage. StageRunners get given the the arguments of tools and must provide the inputs of jobs, the job output location and the actual stage which will provide the job.

Author:

Sina Samangooei (ss@ecs.soton.ac.uk)

Constructor Summary

Constructors

Constructor and Description
StageRunner()

Method Summary

Modifier and Type	Method and Description
abstract void	args(String[] args)
abstract org.apache.hadoop.fs.Path[]	inputs()
abstract org.apache.hadoop.fs.Path	output()
int	run(String[] args)
void	runMain(String[] args)
boolean	shouldWait()
abstract Stage<?,?,?,?,?,?,?,?>	stage()

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Constructor Detail

StageRunner

public StageRunner()

Method Detail

run

public int run(String[] args)
        throws Exception

Specified by:

run in interface org.apache.hadoop.util.Tool

Throws:

Exception

shouldWait

public boolean shouldWait()

Returns:

Whether this stage runner should wait for the stage to complete

stage

public abstract Stage<?,?,?,?,?,?,?,?> stage()

Returns:

the stage which should be ran

output

public abstract org.apache.hadoop.fs.Path output()

Returns:

the output fed to the stage

inputs

public abstract org.apache.hadoop.fs.Path[] inputs()
                                            throws Exception

Returns:

the inputs fed to the stage

Throws:

Exception

args

public abstract void args(String[] args)
                   throws Exception

Parameters:

args - arguments handed to the Tool.run(String[]). Given before outputs, inputs or stages are asked for.

Throws:

Exception

runMain

public void runMain(String[] args)
             throws Exception

Parameters:

args - should be used as a direct proxy for a main method

Throws:

Exception