org.openimaj.hadoop.tools.twitter.token.outputmode.sparsecsv

Class Values

java.lang.Object

org.openimaj.hadoop.mapreduce.stage.StageProvider

org.openimaj.hadoop.tools.twitter.token.outputmode.sparsecsv.Values

public class Values
extends StageProvider

Output the word/time values for each word

Author:

Sina Samangooei (ss@ecs.soton.ac.uk)

Field Summary

Fields

Modifier and Type	Field and Description
static String	ARGS_KEY The index location config option
static String	MATLAB_OUT

Constructor Summary

Constructors

Constructor and Description
Values(String outputPath, int valueReduceSplit, boolean sortValueByTime, boolean matlabOutput) Assign the output path for the stage

Method Summary

Modifier and Type	Method and Description
static LinkedHashMap<String,WordDFIDFTimeSeries>	readWordDFIDF(String path, LinkedHashMap<Long,IndependentPair<Long,Long>> timeIndex, LinkedHashMap<String,IndependentPair<Long,Long>> wordIndex) Construct a time series per word
SequenceFileTextStage<?,?,?,?,?,?>	stage()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

ARGS_KEY

public static final String ARGS_KEY

The index location config option

See Also:

Constant Field Values

MATLAB_OUT

public static final String MATLAB_OUT

See Also:

Constant Field Values

Constructor Detail

Values

public Values(String outputPath,
              int valueReduceSplit,
              boolean sortValueByTime,
              boolean matlabOutput)

Assign the output path for the stage

Parameters:

outputPath -

valueReduceSplit -

sortValueByTime -

matlabOutput -

Method Detail

stage

public SequenceFileTextStage<?,?,?,?,?,?> stage()

Specified by:

stage in class StageProvider

Returns:

a job stage

readWordDFIDF

public static LinkedHashMap<String,WordDFIDFTimeSeries> readWordDFIDF(String path,
                                                                      LinkedHashMap<Long,IndependentPair<Long,Long>> timeIndex,
                                                                      LinkedHashMap<String,IndependentPair<Long,Long>> wordIndex)
                                                               throws IOException

Construct a time series per word

Parameters:

path -

timeIndex -

wordIndex -

Returns:

hashmap containing a WordDFIDFTimeSeries instance per word

Throws:

IOException