com.twitter.elephantbird.mapreduce.input
Class RCFileBaseInputFormat

java.lang.Object
  org.apache.hadoop.mapreduce.InputFormat<K,V>
      com.twitter.elephantbird.mapreduce.input.MapReduceInputFormatWrapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Writable>
          com.twitter.elephantbird.mapreduce.input.RCFileBaseInputFormat

Direct Known Subclasses:

RCFileProtobufInputFormat, RCFileThriftInputFormat

public abstract class RCFileBaseInputFormat
extends MapReduceInputFormatWrapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Writable>

Base input format for Thrift and Protobuf RCFile input formats.
contains a few common common utility methods.

Field Summary

Fields inherited from class com.twitter.elephantbird.mapreduce.input.MapReduceInputFormatWrapper

CLASS_CONF_KEY, realInputFormat

Constructor Summary

RCFileBaseInputFormat()
internal, for MR use only.

Method Summary

protected org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Writable>

createUnwrappedRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext taskAttempt) returns super.createRecordReader(split, taskAttempt).

Methods inherited from class com.twitter.elephantbird.mapreduce.input.MapReduceInputFormatWrapper

createRecordReader, getSplits, setInputFormat, setWrappedInputFormat

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RCFileBaseInputFormat

public RCFileBaseInputFormat()

internal, for MR use only.

Method Detail

createUnwrappedRecordReader

protected final org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Writable> createUnwrappedRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                                                                      org.apache.hadoop.mapreduce.TaskAttemptContext taskAttempt)
                                                                                                                                               throws IOException,
                                                                                                                                                      InterruptedException

returns super.createRecordReader(split, taskAttempt). This is useful when a sub class has its own their own wrapper over the base recordreader.

Throws:

IOException

InterruptedException