org.openimaj.hadoop.tools.twitter.token.mode.dfidf

Class CountTweetsInTimeperiod.Map

java.lang.Object

org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.BytesWritable>

org.openimaj.hadoop.tools.twitter.token.mode.dfidf.CountTweetsInTimeperiod.Map

Enclosing class:

CountTweetsInTimeperiod

public static class CountTweetsInTimeperiod.Map
extends org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.BytesWritable>

map input: tweetstatus # json twitter status with JSONPath to words map output: , -1: >

Author:

Jonathon Hare (jsh2@ecs.soton.ac.uk), Sina Samangooei

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper

org.apache.hadoop.mapreduce.Mapper.Context

Field Summary

Fields

Modifier and Type	Field and Description
static org.apache.hadoop.io.LongWritable	END_TIME The time used to signify the end, used to count total numbers of times a given word appears
static org.apache.hadoop.io.LongWritable	TOTAL_TIME A total of the number of tweets, must be ignored!

Constructor Summary

Constructors

Constructor and Description
Map() Mapper don't care, mapper don't give a fuck

Method Summary

Modifier and Type	Method and Description
protected void	cleanup(org.apache.hadoop.mapreduce.Mapper.Context context)
protected void	loadOptions(org.apache.hadoop.mapreduce.Mapper.Context context)
protected void	map(org.apache.hadoop.io.LongWritable key, org.apache.hadoop.io.Text value, org.apache.hadoop.mapreduce.Mapper.Context context)
protected void	setup(org.apache.hadoop.mapreduce.Mapper.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Mapper

run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

END_TIME

public static final org.apache.hadoop.io.LongWritable END_TIME

The time used to signify the end, used to count total numbers of times a given word appears

TOTAL_TIME

public static final org.apache.hadoop.io.LongWritable TOTAL_TIME

A total of the number of tweets, must be ignored!

Constructor Detail

Map

public Map()

Mapper don't care, mapper don't give a fuck

Method Detail

loadOptions

protected void loadOptions(org.apache.hadoop.mapreduce.Mapper.Context context)
                    throws IOException

Throws:

IOException

setup

protected void setup(org.apache.hadoop.mapreduce.Mapper.Context context)
              throws IOException,
                     InterruptedException

Overrides:

setup in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.BytesWritable>

Throws:

IOException

InterruptedException

map

protected void map(org.apache.hadoop.io.LongWritable key,
                   org.apache.hadoop.io.Text value,
                   org.apache.hadoop.mapreduce.Mapper.Context context)
            throws IOException,
                   InterruptedException

Overrides:

map in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.BytesWritable>

Throws:

IOException

InterruptedException

cleanup

protected void cleanup(org.apache.hadoop.mapreduce.Mapper.Context context)
                throws IOException,
                       InterruptedException

Overrides:

cleanup in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.BytesWritable>

Throws:

IOException

InterruptedException