org.openimaj.hadoop.tools.twitter

Class HadoopTwitterPreprocessingToolOptions

java.lang.Object

org.openimaj.tools.InOutToolOptions

org.openimaj.tools.twitter.options.AbstractTwitterPreprocessingToolOptions

org.openimaj.hadoop.tools.twitter.HadoopTwitterPreprocessingToolOptions

public class HadoopTwitterPreprocessingToolOptions
extends AbstractTwitterPreprocessingToolOptions

Hadoop specific options for twitter preprocessing

Author:

Sina Samangooei (ss@ecs.soton.ac.uk)

Field Summary

Fields inherited from class org.openimaj.tools.twitter.options.AbstractTwitterPreprocessingToolOptions

modeOptionsOp, outputStatusType, postFilterOptionsOp, preFilterOptionsOp, statusType

Fields inherited from class org.openimaj.tools.InOutToolOptions

output

Constructor Summary

Constructors

Constructor and Description
HadoopTwitterPreprocessingToolOptions(String[] args) The hadoop options, assume these are the options before mapping
HadoopTwitterPreprocessingToolOptions(String[] args, boolean beforeMaps) The hadoop twitter preprocessing options

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.fs.Path[]	getInputPaths()
org.apache.hadoop.fs.Path	getOutputPath()
boolean	validate()

Methods inherited from class org.openimaj.tools.twitter.options.AbstractTwitterPreprocessingToolOptions

convertToOutputFormat, getEncoding, getInputClass, getOutputClass, getTimeBeforeSkip, ouputMode, postProcessesSkip, prepare, preProcessesSkip, preprocessingMode, progress, veryLoud

Methods inherited from class org.openimaj.tools.InOutToolOptions

getAllInputs, getInput, getInputFile, getOutput, isContinue, isForce, overwriteOutput, prepareMultivaluedArgument, setInput, setInputFile, setOutput

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HadoopTwitterPreprocessingToolOptions

public HadoopTwitterPreprocessingToolOptions(String[] args)
                                      throws org.kohsuke.args4j.CmdLineException

The hadoop options, assume these are the options before mapping

Parameters:

args -

Throws:

org.kohsuke.args4j.CmdLineException

HadoopTwitterPreprocessingToolOptions

public HadoopTwitterPreprocessingToolOptions(String[] args,
                                             boolean beforeMaps)
                                      throws org.kohsuke.args4j.CmdLineException

The hadoop twitter preprocessing options

Parameters:

args - command line optios

beforeMaps - if true, the output location is removed if the option to do so is set

Throws:

org.kohsuke.args4j.CmdLineException

Method Detail

validate

public boolean validate()
                 throws org.kohsuke.args4j.CmdLineException

Specified by:

validate in class AbstractTwitterPreprocessingToolOptions

Returns:

whether the options provided make sense

Throws:

org.kohsuke.args4j.CmdLineException

getInputPaths

public org.apache.hadoop.fs.Path[] getInputPaths()
                                          throws IOException

Returns:

the list of input files

Throws:

IOException

getOutputPath

public org.apache.hadoop.fs.Path getOutputPath()

Returns:

the output path