com.twitter.elephantbird.pig.load
Class RCFileThriftPigLoader

java.lang.Object
  org.apache.pig.LoadFunc
      com.twitter.elephantbird.pig.load.LzoBaseLoadFunc
          com.twitter.elephantbird.pig.load.ThriftPigLoader<org.apache.thrift.TBase<?,?>>
              com.twitter.elephantbird.pig.load.RCFileThriftPigLoader

All Implemented Interfaces:

org.apache.pig.LoadMetadata, org.apache.pig.LoadPushDown

public class RCFileThriftPigLoader
extends ThriftPigLoader<org.apache.thrift.TBase<?,?>>

Pig loader for Thrift object stored in RCFiles.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.pig.LoadPushDown

org.apache.pig.LoadPushDown.OperatorSet, org.apache.pig.LoadPushDown.RequiredField, org.apache.pig.LoadPushDown.RequiredFieldList, org.apache.pig.LoadPushDown.RequiredFieldResponse

Field Summary

Fields inherited from class com.twitter.elephantbird.pig.load.ThriftPigLoader

typeRef

Fields inherited from class com.twitter.elephantbird.pig.load.LzoBaseLoadFunc

contextSignature, jobConf, projectionKey, reader, requiredFieldList

Constructor Summary

RCFileThriftPigLoader(String thriftClassName)

Method Summary

org.apache.hadoop.mapreduce.InputFormat	getInputFormat()
org.apache.pig.data.Tuple	getNext()
void	prepareToRead(org.apache.hadoop.mapreduce.RecordReader reader, org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigSplit split)
void	setLocation(String location, org.apache.hadoop.mapreduce.Job job)

Methods inherited from class com.twitter.elephantbird.pig.load.ThriftPigLoader

getSchema, pushProjection

Methods inherited from class com.twitter.elephantbird.pig.load.LzoBaseLoadFunc

getFeatures, getNextBinaryValue, getPartitionKeys, getStatistics, getUDFProperties, incrCounter, incrCounter, incrCounter, pushProjectionHelper, setPartitionFilter, setUDFContextSignature

Methods inherited from class org.apache.pig.LoadFunc

getAbsolutePath, getLoadCaster, getPathStrings, join, relativeToAbsolutePath, warn

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RCFileThriftPigLoader

public RCFileThriftPigLoader(String thriftClassName)

Parameters:

thriftClassName - fully qualified name of the thrift class

Method Detail

getInputFormat

public org.apache.hadoop.mapreduce.InputFormat getInputFormat()
                                                       throws IOException

Overrides:

getInputFormat in class ThriftPigLoader<org.apache.thrift.TBase<?,?>>

Throws:

IOException

getNext

public org.apache.pig.data.Tuple getNext()
                                  throws IOException

Overrides:

getNext in class ThriftPigLoader<org.apache.thrift.TBase<?,?>>

Throws:

IOException

prepareToRead

public void prepareToRead(org.apache.hadoop.mapreduce.RecordReader reader,
                          org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigSplit split)

Overrides:

prepareToRead in class LzoBaseLoadFunc

setLocation

public void setLocation(String location,
                        org.apache.hadoop.mapreduce.Job job)
                 throws IOException

Overrides:

setLocation in class ThriftPigLoader<org.apache.thrift.TBase<?,?>>

Throws:

IOException