org.openimaj.hadoop.tools.twitter.token.outputmode.jacard

Class CumulativeTimeWord

java.lang.Object

org.openimaj.hadoop.mapreduce.stage.StageAppender

org.openimaj.hadoop.tools.twitter.token.outputmode.jacard.CumulativeTimeWord

public class CumulativeTimeWord
extends StageAppender

Count word instances (not occurences) across times. Allows for investigation of how the vocabulary has changed over time.

Author:

Sina Samangooei (ss@ecs.soton.ac.uk)

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CumulativeTimeWord.IntersectionUnionMap For every word occurrence, emit for its time period, and for every time period from timePeriod + delta until eldestTime.
static class	CumulativeTimeWord.IntersectionUnionReduce Recieve every word-time either from the current time period or from past time periods.
static class	CumulativeTimeWord.JacardReduce

Field Summary

Fields

Modifier and Type	Field and Description
protected static String	TIME_DELTA
protected static String	TIME_ELDEST

Constructor Summary

Constructors

Constructor and Description
CumulativeTimeWord(long timeDelta, long timeEldest)

Method Summary

Modifier and Type	Method and Description
static LinkedHashMap<Long,JacardIndex>	readTimeCountLines(String path) from a report output path get the words
void	stage(MultiStagedJob stages)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

TIME_DELTA

protected static final String TIME_DELTA

See Also:

Constant Field Values

TIME_ELDEST

protected static final String TIME_ELDEST

See Also:

Constant Field Values

Constructor Detail

CumulativeTimeWord

public CumulativeTimeWord(long timeDelta,
                          long timeEldest)

Parameters:

timeDelta - the delta between times

timeEldest - the eldest time

Method Detail

stage

public void stage(MultiStagedJob stages)

Overrides:

stage in class StageAppender

Parameters:

stages - what should i add myself to?

readTimeCountLines

public static LinkedHashMap<Long,JacardIndex> readTimeCountLines(String path)
                                                          throws IOException

from a report output path get the words

Parameters:

path - report output path

Returns:

map of time to an a pair containing

Throws:

IOException