org.openimaj.hadoop.tools.twitter.token.outputmode.sparsecsv

Class TimeIndex

java.lang.Object

org.openimaj.hadoop.mapreduce.stage.StageProvider

org.openimaj.hadoop.tools.twitter.token.outputmode.sparsecsv.TimeIndex

public class TimeIndex
extends StageProvider

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TimeIndex.Map Emits each word with the total number of times the word was seen
static class	TimeIndex.Reduce Writes each word,count

Constructor Summary

Constructors

Constructor and Description
TimeIndex()

Method Summary

Modifier and Type	Method and Description
static LinkedHashMap<Long,IndependentPair<Long,Long>>	readTimeCountLines(String path) from a report output path get the words
SequenceFileTextStage<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>	stage()
static void	writeToMatlab(String path) Write a CSV timeIndex to a MLCell writen to a .mat data file

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TimeIndex

public TimeIndex()

Method Detail

readTimeCountLines

public static LinkedHashMap<Long,IndependentPair<Long,Long>> readTimeCountLines(String path)
                                                                         throws IOException

from a report output path get the words

Parameters:

path - report output path

Returns:

map of time to an a pair containing

Throws:

IOException

stage

public SequenceFileTextStage<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text> stage()

Specified by:

stage in class StageProvider

Returns:

a job stage

writeToMatlab

public static void writeToMatlab(String path)
                          throws IOException

Write a CSV timeIndex to a MLCell writen to a .mat data file

Parameters:

path -

Throws:

IOException