org.openimaj.hadoop.tools.twitter.token.outputmode.jacard

Class CumulativeJacardReducer

java.lang.Object

org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>

org.openimaj.hadoop.tools.twitter.token.outputmode.jacard.CumulativeJacardReducer

public class CumulativeJacardReducer
extends org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>

A cumulative jacard reducer designed to work as a single reducer. This reducer recieves the timeperiods in order and holds a set of words seen. Using this set the intersection and union with the current time's words can be calculated

Author:

Sina Samangooei (ss@ecs.soton.ac.uk)

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Reducer

org.apache.hadoop.mapreduce.Reducer.Context

Constructor Summary

Constructors

Constructor and Description
CumulativeJacardReducer()

Method Summary

Modifier and Type	Method and Description
protected void	reduce(org.apache.hadoop.io.LongWritable time, Iterable<org.apache.hadoop.io.Text> words, org.apache.hadoop.mapreduce.Reducer.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Reducer

cleanup, run, setup

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CumulativeJacardReducer

public CumulativeJacardReducer()

Method Detail

reduce

protected void reduce(org.apache.hadoop.io.LongWritable time,
                      Iterable<org.apache.hadoop.io.Text> words,
                      org.apache.hadoop.mapreduce.Reducer.Context context)
               throws IOException,
                      InterruptedException

Overrides:

reduce in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>

Throws:

IOException

InterruptedException