org.openimaj.hadoop.tools.twitter.token.outputmode.jacard

Class CumulativeTimeWord.IntersectionUnionReduce

java.lang.Object

org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BooleanWritable,org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.BytesWritable>

org.openimaj.hadoop.tools.twitter.token.outputmode.jacard.CumulativeTimeWord.IntersectionUnionReduce

Enclosing class:

CumulativeTimeWord

public static class CumulativeTimeWord.IntersectionUnionReduce
extends org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BooleanWritable,org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.BytesWritable>

Recieve every word-time either from the current time period or from past time periods. Has this word appeared either in the past and now? intersection == 1 Has this word appeared both in the past and now? union == 1 emit the time period with the length of the union set, the length of the intersection set and the ratio of these two (The Jacard Index)

Author:

Sina Samangooei (ss@ecs.soton.ac.uk)

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Reducer

org.apache.hadoop.mapreduce.Reducer.Context

Constructor Summary

Constructors

Constructor and Description
IntersectionUnionReduce()

Method Summary

Modifier and Type	Method and Description
protected void	reduce(org.apache.hadoop.io.BytesWritable wordtimeb, Iterable<org.apache.hadoop.io.BooleanWritable> wordBools, org.apache.hadoop.mapreduce.Reducer.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Reducer

cleanup, run, setup

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

IntersectionUnionReduce

public IntersectionUnionReduce()

Method Detail

reduce

protected void reduce(org.apache.hadoop.io.BytesWritable wordtimeb,
                      Iterable<org.apache.hadoop.io.BooleanWritable> wordBools,
                      org.apache.hadoop.mapreduce.Reducer.Context context)
               throws IOException,
                      InterruptedException

Overrides:

reduce in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BooleanWritable,org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.BytesWritable>

Throws:

IOException

InterruptedException