com.facebook.hive.orc

Class InStream

java.lang.Object

java.io.InputStream

com.facebook.hive.orc.InStream

All Implemented Interfaces:

Closeable, AutoCloseable

public abstract class InStream
extends InputStream

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	InStream(boolean useVInts)

Method Summary

Modifier and Type	Method and Description
static InStream	create(String name, ByteBuffer input, com.facebook.hive.orc.CompressionCodec codec, int bufferSize) This should only be used if the data happens to already be in memory, e.g.
static InStream	create(String name, ByteBuffer input, com.facebook.hive.orc.CompressionCodec codec, int bufferSize, boolean useVInts) This should only be used if the data happens to already be in memory, e.g.
static InStream	create(String name, org.apache.hadoop.fs.FSDataInputStream file, long streamOffset, int streamLength, com.facebook.hive.orc.CompressionCodec codec, int bufferSize) This should be used for creating streams to read file metadata, e.g.
static InStream	create(String name, org.apache.hadoop.fs.FSDataInputStream file, long streamOffset, int streamLength, com.facebook.hive.orc.CompressionCodec codec, int bufferSize, boolean useVInts, int readStrides)
abstract int	loadIndeces(List<OrcProto.RowIndexEntry> rowIndexEntries, int startIndex) Read in any indeces for the stream from the rowIndexEntries, startIndex is the index of the first value to read from each rowIndexEntry.
static void	read(org.apache.hadoop.fs.FSDataInputStream file, long fileOffset, byte[] array, int arrayOffset, int length)
abstract void	seek(int index)
boolean	useVInts()

Methods inherited from class java.io.InputStream

available, close, mark, markSupported, read, read, read, reset, skip

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

InStream

protected InStream(boolean useVInts)

Method Detail

loadIndeces

public abstract int loadIndeces(List<OrcProto.RowIndexEntry> rowIndexEntries,
                                int startIndex)

Read in any indeces for the stream from the rowIndexEntries, startIndex is the index of the first value to read from each rowIndexEntry. Should return the updated startIndex for the next stream.

seek

public abstract void seek(int index)
                   throws IOException

Throws:

IOException

create

public static InStream create(String name,
                              org.apache.hadoop.fs.FSDataInputStream file,
                              long streamOffset,
                              int streamLength,
                              com.facebook.hive.orc.CompressionCodec codec,
                              int bufferSize)
                       throws IOException

This should be used for creating streams to read file metadata, e.g. the footer, not for data in columns.

Throws:

IOException

create

public static InStream create(String name,
                              org.apache.hadoop.fs.FSDataInputStream file,
                              long streamOffset,
                              int streamLength,
                              com.facebook.hive.orc.CompressionCodec codec,
                              int bufferSize,
                              boolean useVInts,
                              int readStrides)
                       throws IOException

Throws:

IOException

create

public static InStream create(String name,
                              ByteBuffer input,
                              com.facebook.hive.orc.CompressionCodec codec,
                              int bufferSize)
                       throws IOException

This should only be used if the data happens to already be in memory, e.g. for tests

Throws:

IOException

create

public static InStream create(String name,
                              ByteBuffer input,
                              com.facebook.hive.orc.CompressionCodec codec,
                              int bufferSize,
                              boolean useVInts)
                       throws IOException

This should only be used if the data happens to already be in memory, e.g. for tests

Throws:

IOException

useVInts

public boolean useVInts()

read

public static void read(org.apache.hadoop.fs.FSDataInputStream file,
                        long fileOffset,
                        byte[] array,
                        int arrayOffset,
                        int length)
                 throws IOException

Throws:

IOException