org.openimaj.hadoop.tools.twitter

Class TwitterPreprocessingMapper

java.lang.Object

org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>

org.openimaj.hadoop.tools.twitter.TwitterPreprocessingMapper

public class TwitterPreprocessingMapper
extends org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>

This mapper loads arguments for the AbstractTwitterPreprocessingToolOptions from the HadoopTwitterPreprocessingTool.ARGS_KEY variable (once per in memory mapper) and uses these to preprocess tweets.

Author:

Sina Samangooei (ss@ecs.soton.ac.uk)

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper

org.apache.hadoop.mapreduce.Mapper.Context

Constructor Summary

Constructors

Constructor and Description
TwitterPreprocessingMapper()

Method Summary

Modifier and Type	Method and Description
protected static void	loadOptions(org.apache.hadoop.mapreduce.Mapper.Context context)
protected void	map(org.apache.hadoop.io.LongWritable key, org.apache.hadoop.io.Text value, org.apache.hadoop.mapreduce.Mapper.Context context)
protected void	setup(org.apache.hadoop.mapreduce.Mapper.Context context)

Methods inherited from class org.apache.hadoop.mapreduce.Mapper

cleanup, run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

TwitterPreprocessingMapper

public TwitterPreprocessingMapper()

Method Detail

loadOptions

protected static void loadOptions(org.apache.hadoop.mapreduce.Mapper.Context context)
                           throws IOException

Throws:

IOException

setup

protected void setup(org.apache.hadoop.mapreduce.Mapper.Context context)
              throws IOException,
                     InterruptedException

Overrides:

setup in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>

Throws:

IOException

InterruptedException

map

protected void map(org.apache.hadoop.io.LongWritable key,
                   org.apache.hadoop.io.Text value,
                   org.apache.hadoop.mapreduce.Mapper.Context context)
            throws IOException,
                   InterruptedException

Overrides:

map in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text,org.apache.hadoop.io.NullWritable,org.apache.hadoop.io.Text>

Throws:

IOException

InterruptedException