org.openimaj.hadoop.mapreduce.stage.helper

Class SequenceFileTextStage<INPUT_KEY,INPUT_VALUE,MAP_OUTPUT_KEY,MAP_OUTPUT_VALUE,OUTPUT_KEY,OUTPUT_VALUE>

java.lang.Object

org.openimaj.hadoop.mapreduce.stage.Stage<org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat<INPUT_KEY,INPUT_VALUE>,org.apache.hadoop.mapreduce.lib.output.TextOutputFormat<OUTPUT_KEY,OUTPUT_VALUE>,INPUT_KEY,INPUT_VALUE,MAP_OUTPUT_KEY,MAP_OUTPUT_VALUE,OUTPUT_KEY,OUTPUT_VALUE>

org.openimaj.hadoop.mapreduce.stage.helper.SequenceFileTextStage<INPUT_KEY,INPUT_VALUE,MAP_OUTPUT_KEY,MAP_OUTPUT_VALUE,OUTPUT_KEY,OUTPUT_VALUE>

Type Parameters:

INPUT_KEY - The key format of the input to the map task

INPUT_VALUE - The value format of the input to the map task

MAP_OUTPUT_KEY - The key format of the output of the map task (and therefore the input of the reduce)

MAP_OUTPUT_VALUE - The value format of the output of the map task (and therefore the input of the reduce)

OUTPUT_KEY - The key format of the output of the reduce task

OUTPUT_VALUE - The valueformat of the output of the reduce task

Direct Known Subclasses:

CorrelateWordTimeSeries, PMIPairSort, SimpleSequenceFileTextStage, TimeWordJacardIndex

public abstract class SequenceFileTextStage<INPUT_KEY,INPUT_VALUE,MAP_OUTPUT_KEY,MAP_OUTPUT_VALUE,OUTPUT_KEY,OUTPUT_VALUE>
extends Stage<org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat<INPUT_KEY,INPUT_VALUE>,org.apache.hadoop.mapreduce.lib.output.TextOutputFormat<OUTPUT_KEY,OUTPUT_VALUE>,INPUT_KEY,INPUT_VALUE,MAP_OUTPUT_KEY,MAP_OUTPUT_VALUE,OUTPUT_KEY,OUTPUT_VALUE>

A helper class for a common stage type. In this case, a stage that goes from a sequence file to a sequence file with types

Author:

Sina Samangooei (ss@ecs.soton.ac.uk)

Constructor Summary

Constructors

Constructor and Description
SequenceFileTextStage()

Method Summary

Methods inherited from class org.openimaj.hadoop.mapreduce.stage.Stage

combiner, finished, lzoCompress, mapper, outname, reducer, setCombinerClass, setMapperClass, setReducerClass, setup, stage

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SequenceFileTextStage

public SequenceFileTextStage()