org.openimaj.hadoop.tools.twitter.token.mode.pointwisemi.count

Class PairEmitCombiner

java.lang.Object

org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>

org.openimaj.hadoop.tools.twitter.token.mode.pointwisemi.count.PairEmitCombiner

public class PairEmitCombiner
extends org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>

Assumes each key is a timeperiod split set of words ordered by single/pair words then by word order. The key is only used to get time. Using this time the values are combined and used to construct new keys Emit for the given time a combined version of the word's count. The word might be a pair or a unary count.

Author:

Sina Samangooei (ss@ecs.soton.ac.uk)

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Reducer

org.apache.hadoop.mapreduce.Reducer.Context

Constructor Summary

Constructors

Constructor and Description
PairEmitCombiner()

Method Summary

Modifier and Type	Method and Description
protected void	reduce(org.apache.hadoop.io.BytesWritable timeword, Iterable<org.apache.hadoop.io.BytesWritable> paircounts, org.apache.hadoop.mapreduce.Reducer.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Reducer

cleanup, run, setup

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PairEmitCombiner

public PairEmitCombiner()

Method Detail

reduce

protected void reduce(org.apache.hadoop.io.BytesWritable timeword,
                      Iterable<org.apache.hadoop.io.BytesWritable> paircounts,
                      org.apache.hadoop.mapreduce.Reducer.Context context)
               throws IOException,
                      InterruptedException

Overrides:

reduce in class org.apache.hadoop.mapreduce.Reducer<org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable,org.apache.hadoop.io.BytesWritable>

Throws:

IOException

InterruptedException