org.openimaj.hadoop.sequencefile

Class MetadataSequenceFileOutputFormat<K,V>

java.lang.Object

org.apache.hadoop.mapreduce.OutputFormat<K,V>

org.apache.hadoop.mapreduce.lib.output.FileOutputFormat<K,V>

org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat<K,V>

org.openimaj.hadoop.sequencefile.MetadataSequenceFileOutputFormat<K,V>

Type Parameters:

K - Key type of SequenceFile

V - Value type of SequenceFile

public class MetadataSequenceFileOutputFormat<K,V>
extends org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat<K,V>

Output format for a extended SequenceFile that includes additional metadata in the file header. The metadata is provided though a MetadataConfiguration object which is constructed using information stored in the Hadoop Configuration.

Author:

Jonathon Hare (jsh2@ecs.soton.ac.uk)

Field Summary

Fields inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat

BASE_OUTPUT_NAME, PART

Constructor Summary

Constructors

Constructor and Description
MetadataSequenceFileOutputFormat()

Method Summary

Modifier and Type	Method and Description
org.apache.hadoop.mapreduce.RecordWriter<K,V>	getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)

Methods inherited from class org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat

getOutputCompressionType, setOutputCompressionType

Methods inherited from class org.apache.hadoop.mapreduce.lib.output.FileOutputFormat

checkOutputSpecs, getCompressOutput, getDefaultWorkFile, getOutputCommitter, getOutputCompressorClass, getOutputName, getOutputPath, getPathForWorkFile, getUniqueFile, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputName, setOutputPath

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MetadataSequenceFileOutputFormat

public MetadataSequenceFileOutputFormat()

Method Detail

getRecordWriter

public org.apache.hadoop.mapreduce.RecordWriter<K,V> getRecordWriter(org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                              throws IOException,
                                                                     InterruptedException

Overrides:

getRecordWriter in class org.apache.hadoop.mapreduce.lib.output.SequenceFileOutputFormat<K,V>

Throws:

IOException

InterruptedException