com.twitter.elephantbird.mapreduce.input
Class RCFileThriftTupleInputFormat

java.lang.Object
  org.apache.hadoop.mapreduce.InputFormat<K,V>
      com.twitter.elephantbird.mapreduce.input.MapReduceInputFormatWrapper<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Writable>
          com.twitter.elephantbird.mapreduce.input.RCFileBaseInputFormat
              com.twitter.elephantbird.mapreduce.input.RCFileThriftInputFormat
                  com.twitter.elephantbird.mapreduce.input.RCFileThriftTupleInputFormat

public class RCFileThriftTupleInputFormat
extends RCFileThriftInputFormat

This is a wrapper over RCFileThriftInputFormat and provides a method to create a Tuple directly from RCFile bytes, skipping building a Thrift object.

Nested Class Summary

class

RCFileThriftTupleInputFormat.TupleReader

Nested classes/interfaces inherited from class com.twitter.elephantbird.mapreduce.input.RCFileThriftInputFormat

RCFileThriftInputFormat.ThriftReader

Field Summary

Fields inherited from class com.twitter.elephantbird.mapreduce.input.MapReduceInputFormatWrapper

CLASS_CONF_KEY, realInputFormat

Constructor Summary

RCFileThriftTupleInputFormat()

RCFileThriftTupleInputFormat(TypeRef<org.apache.thrift.TBase<?,?>> typeRef)

Method Summary

org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Writable>

createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext taskAttempt)

Methods inherited from class com.twitter.elephantbird.mapreduce.input.RCFileThriftInputFormat

setClassConf

Methods inherited from class com.twitter.elephantbird.mapreduce.input.RCFileBaseInputFormat

createUnwrappedRecordReader

Methods inherited from class com.twitter.elephantbird.mapreduce.input.MapReduceInputFormatWrapper

getSplits, setInputFormat, setWrappedInputFormat

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RCFileThriftTupleInputFormat

public RCFileThriftTupleInputFormat()

RCFileThriftTupleInputFormat

public RCFileThriftTupleInputFormat(TypeRef<org.apache.thrift.TBase<?,?>> typeRef)

Method Detail

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Writable> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                                                    org.apache.hadoop.mapreduce.TaskAttemptContext taskAttempt)
                                                                                                                             throws IOException,
                                                                                                                                    InterruptedException

Overrides:

createRecordReader in class RCFileThriftInputFormat

Throws:

IOException

InterruptedException