Package com.facebook.hive.orc

The Optimized Row Columnar (ORC) File Format.

See: Description

Interface Summary

Interface	Description
BooleanColumnStatistics	Statistics for boolean columns.
ColumnStatistics	Statistics that are available for all types of columns.
DoubleColumnStatistics	Statistics for float and double columns.
IntegerColumnStatistics	Statistics for all of the integer columns, such as byte, short, int, and long.
OrcProto.BucketStatisticsOrBuilder
OrcProto.ColumnEncodingOrBuilder
OrcProto.ColumnStatisticsOrBuilder
OrcProto.DoubleStatisticsOrBuilder
OrcProto.FooterOrBuilder
OrcProto.IntegerStatisticsOrBuilder
OrcProto.PostScriptOrBuilder
OrcProto.RowIndexEntryOrBuilder
OrcProto.RowIndexOrBuilder
OrcProto.StreamOrBuilder
OrcProto.StringStatisticsOrBuilder
OrcProto.StripeFooterOrBuilder
OrcProto.StripeInformationOrBuilder
OrcProto.TypeOrBuilder
OrcProto.UserMetadataItemOrBuilder
PositionProvider	An interface used for seeking to a row index.
Reader	The interface for reading ORC files.
RecordReader	A row-by-row iterator for ORC files.
StringColumnStatistics	Statistics for string columns.
StripeInformation	Information about the stripes in an ORC file that is provided by the Reader.
Writer	The interface for writing ORC files.

Class Summary

Class	Description
BitFieldReader
ColumnStatisticsImpl
DynamicByteArray	A class that is a growable array of bytes.
FileDump	A tool for printing out the file structure of ORC files.
InStream
OrcConf
OrcFile	Contains factory methods to read or write ORC files.
OrcFile.KeyWrapper
OrcFile.ValueWrapper
OrcInputFormat	A MapReduce/Hive input format for ORC files.
OrcOutputFormat	A Hive OutputFormat for ORC files.
OrcProto
OrcProto.BucketStatistics
OrcProto.BucketStatistics.Builder
OrcProto.ColumnEncoding
OrcProto.ColumnEncoding.Builder
OrcProto.ColumnStatistics
OrcProto.ColumnStatistics.Builder
OrcProto.DoubleStatistics
OrcProto.DoubleStatistics.Builder
OrcProto.Footer
OrcProto.Footer.Builder
OrcProto.IntegerStatistics
OrcProto.IntegerStatistics.Builder
OrcProto.PostScript
OrcProto.PostScript.Builder
OrcProto.RowIndex
OrcProto.RowIndex.Builder
OrcProto.RowIndexEntry
OrcProto.RowIndexEntry.Builder
OrcProto.Stream
OrcProto.Stream.Builder
OrcProto.StringStatistics
OrcProto.StringStatistics.Builder
OrcProto.StripeFooter
OrcProto.StripeFooter.Builder
OrcProto.StripeInformation
OrcProto.StripeInformation.Builder
OrcProto.Type
OrcProto.Type.Builder
OrcProto.UserMetadataItem
OrcProto.UserMetadataItem.Builder
OrcSerde	A serde class for ORC.
OrcStruct
OrcStruct.Field
OrcStruct.OrcListObjectInspector
OrcStruct.OrcMapObjectInspector
OrcStruct.OrcStructInspector
OrcUnion	An in-memory representation of a union type.
OrcUnion.OrcUnionObjectInspector
PositionProviderImpl
RawDatasizeConst	A class that defines the constant strings used by the raw datasize calculation.
ReaderImpl
RunLengthByteReader	A reader that reads a sequence of bytes.
RunLengthIntegerReader	A reader that reads a sequence of integers.
SerializationUtils
StreamName	The name of a stream within a stripe.
StripeReader
WriterImpl	An ORC file writer.

Enum Summary

Enum	Description
CompressionKind	An enumeration that lists the generic compression algorithms that can be applied to ORC files.
OrcConf.ConfVars
OrcProto.ColumnEncoding.Kind
OrcProto.CompressionKind
OrcProto.Stream.Kind
OrcProto.Type.Kind
StreamName.Area

Package com.facebook.hive.orc Description

The Optimized Row Columnar (ORC) File Format. This format:

• Decomposes complex column types into primitives
• Uses type-specific encoders for each column
  • Dictionary encodings for low cardinality columns
  • Run length encoding of data
  • variable length encoding of integers
• Divides file into large stripes
• Each stripe includes light-weight indexes that enable the reader to skip large sets of rows that don't satisfy the filter condition
• A file footer that contains meta-information about file
  • Precise byte range for each stripe
  • Type information for the file
  • Any user meta-information
• Seek to row number is implemented to support secondary indexes
• Support for additional generic compression: LZO, SNAPPY, ZLIB.

Format:

 
 HEADER (3 bytes) "ORC"
 STRIPE (0 or more stripes)
 FILE-FOOTER
 POST SCRIPT
 PS LENGTH (1 byte)
 
 

Stripe:

 
 INDEX-STREAM (0 or more)
 DATA-STREAM (0 or more)
 STRIPE-FOOTER