org.openimaj.hadoop.tools.twitter.token.mode.pointwisemi.count

Class PairEmitCounter

java.lang.Object

org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>

org.openimaj.hadoop.tools.twitter.token.mode.pointwisemi.count.PairEmitCounter

public class PairEmitCounter
extends org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>

The input to this reducer is ordered firstly by unary/pairs then within these sets by word Given a particular time period, first read all unary counts and combine for each word Then for all pairs, combine pair instances for a given pair then emit onces a new pair or the end is reached Once the first non unary word is found, start counting for a particular word

Author:

Sina Samangooei (ss@ecs.soton.ac.uk)

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Reducer

org.apache.hadoop.mapreduce.Reducer.Context

Constructor Summary

Constructors

Constructor and Description
PairEmitCounter()

Method Summary

Modifier and Type	Method and Description
protected void	reduce(org.apache.hadoop.io.BytesWritable timeB, Iterable<org.apache.hadoop.io.BytesWritable> paircounts, org.apache.hadoop.mapreduce.Reducer.Context context)
protected void	setup(org.apache.hadoop.mapreduce.Reducer.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Reducer

cleanup, run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PairEmitCounter

public PairEmitCounter()

Method Detail

setup

protected void setup(org.apache.hadoop.mapreduce.Reducer.Context context)
              throws IOException,
                     InterruptedException

Overrides:

setup in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>

Throws:

IOException

InterruptedException

reduce

protected void reduce(org.apache.hadoop.io.BytesWritable timeB,
                      Iterable<org.apache.hadoop.io.BytesWritable> paircounts,
                      org.apache.hadoop.mapreduce.Reducer.Context context)
               throws IOException,
                      InterruptedException

Overrides:

reduce in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>

Throws:

IOException

InterruptedException