com.twitter.elephantbird.mapreduce.input
Class RCFileProtobufTupleInputFormat

java.lang.Object
  org.apache.hadoop.mapreduce.InputFormat<K,V>
      com.twitter.elephantbird.mapreduce.input.MapReduceInputFormatWrapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Writable>
          com.twitter.elephantbird.mapreduce.input.RCFileBaseInputFormat
              com.twitter.elephantbird.mapreduce.input.RCFileProtobufInputFormat
                  com.twitter.elephantbird.mapreduce.input.RCFileProtobufTupleInputFormat

public class RCFileProtobufTupleInputFormat
extends RCFileProtobufInputFormat

This is a wrapper over RCFileProtobufInputFormat and provides a method to create a Tuple directly from RCFile bytes, skipping building a protobuf first.

Nested Class Summary

class

RCFileProtobufTupleInputFormat.TupleReader

Nested classes/interfaces inherited from class com.twitter.elephantbird.mapreduce.input.RCFileProtobufInputFormat

RCFileProtobufInputFormat.ProtobufReader

Field Summary

Fields inherited from class com.twitter.elephantbird.mapreduce.input.MapReduceInputFormatWrapper

CLASS_CONF_KEY, realInputFormat

Constructor Summary

RCFileProtobufTupleInputFormat()

RCFileProtobufTupleInputFormat(TypeRef<com.google.protobuf.Message> typeRef)

Method Summary

org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Writable>

createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext taskAttempt)

Methods inherited from class com.twitter.elephantbird.mapreduce.input.RCFileProtobufInputFormat

setClassConf

Methods inherited from class com.twitter.elephantbird.mapreduce.input.RCFileBaseInputFormat

createUnwrappedRecordReader

Methods inherited from class com.twitter.elephantbird.mapreduce.input.MapReduceInputFormatWrapper

getSplits, setInputFormat, setWrappedInputFormat

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RCFileProtobufTupleInputFormat

public RCFileProtobufTupleInputFormat()

RCFileProtobufTupleInputFormat

public RCFileProtobufTupleInputFormat(TypeRef<com.google.protobuf.Message> typeRef)

Method Detail

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Writable> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                                                    org.apache.hadoop.mapreduce.TaskAttemptContext taskAttempt)
                                                                                                                             throws IOException,
                                                                                                                                    InterruptedException

Overrides:

createRecordReader in class RCFileProtobufInputFormat

Throws:

IOException

InterruptedException