INPUT_FORMAT
- INPUT_KEY
- INPUT_VALUE
- MAP_OUTPUT_KEY
- MAP_OUTPUT_VALUE
- OUTPUT_KEY
- OUTPUT_VALUE
- public abstract class MultipleOutputStage<INPUT_FORMAT extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<INPUT_KEY,INPUT_VALUE>,INPUT_KEY,INPUT_VALUE,MAP_OUTPUT_KEY,MAP_OUTPUT_VALUE,OUTPUT_KEY,OUTPUT_VALUE> extends Stage<INPUT_FORMAT,org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<OUTPUT_KEY,OUTPUT_VALUE>,INPUT_KEY,INPUT_VALUE,MAP_OUTPUT_KEY,MAP_OUTPUT_VALUE,OUTPUT_KEY,OUTPUT_VALUE>
Constructor and Description |
---|
MultipleOutputStage() |
Modifier and Type | Method and Description |
---|---|
abstract Class<? extends MultipleOutputReducer<MAP_OUTPUT_KEY,MAP_OUTPUT_VALUE,OUTPUT_KEY,OUTPUT_VALUE>> |
reducer()
By default this method returns the
IdentityReducer class. |
org.apache.hadoop.mapreduce.Job |
stage(org.apache.hadoop.fs.Path[] inputs,
org.apache.hadoop.fs.Path output,
org.apache.hadoop.conf.Configuration conf) |
combiner, finished, lzoCompress, mapper, outname, setCombinerClass, setMapperClass, setReducerClass, setup
public MultipleOutputStage()
public abstract Class<? extends MultipleOutputReducer<MAP_OUTPUT_KEY,MAP_OUTPUT_VALUE,OUTPUT_KEY,OUTPUT_VALUE>> reducer()
Stage
IdentityReducer
class. This
reducer outputs the values handed as they are.reducer
in class Stage<INPUT_FORMAT extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<INPUT_KEY,INPUT_VALUE>,org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<OUTPUT_KEY,OUTPUT_VALUE>,INPUT_KEY,INPUT_VALUE,MAP_OUTPUT_KEY,MAP_OUTPUT_VALUE,OUTPUT_KEY,OUTPUT_VALUE>
public org.apache.hadoop.mapreduce.Job stage(org.apache.hadoop.fs.Path[] inputs, org.apache.hadoop.fs.Path output, org.apache.hadoop.conf.Configuration conf) throws Exception
stage
in class Stage<INPUT_FORMAT extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<INPUT_KEY,INPUT_VALUE>,org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<OUTPUT_KEY,OUTPUT_VALUE>,INPUT_KEY,INPUT_VALUE,MAP_OUTPUT_KEY,MAP_OUTPUT_VALUE,OUTPUT_KEY,OUTPUT_VALUE>
inputs
- the input paths to be expectedoutput
- the output locationconf
- the job configurationException
IOException