org.apache.flink.formats.parquet.vector

类 ParquetSplitReaderUtil

java.lang.Object

org.apache.flink.formats.parquet.vector.ParquetSplitReaderUtil

public class ParquetSplitReaderUtil
extends Object

Util for generating ParquetColumnarRowSplitReader.

构造器概要

构造器

构造器和说明
ParquetSplitReaderUtil()

方法概要

限定符和类型	方法和说明
static ColumnReader	createColumnReader(boolean utcTimestamp, org.apache.flink.table.types.logical.LogicalType fieldType, org.apache.parquet.column.ColumnDescriptor descriptor, org.apache.parquet.column.page.PageReader pageReader)
static org.apache.flink.table.data.vector.ColumnVector	createVectorFromConstant(org.apache.flink.table.types.logical.LogicalType type, Object value, int batchSize)
static org.apache.flink.table.data.vector.writable.WritableColumnVector	createWritableColumnVector(int batchSize, org.apache.flink.table.types.logical.LogicalType fieldType, org.apache.parquet.schema.PrimitiveType primitiveType)
static ParquetColumnarRowSplitReader	genPartColumnarRowReader(boolean utcTimestamp, boolean caseSensitive, org.apache.hadoop.conf.Configuration conf, String[] fullFieldNames, org.apache.flink.table.types.DataType[] fullFieldTypes, Map<String,Object> partitionSpec, int[] selectedFields, int batchSize, org.apache.flink.core.fs.Path path, long splitStart, long splitLength) Util for generating partitioned ParquetColumnarRowSplitReader.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

ParquetSplitReaderUtil

public ParquetSplitReaderUtil()

方法详细资料

genPartColumnarRowReader

public static ParquetColumnarRowSplitReader genPartColumnarRowReader(boolean utcTimestamp,
                                                                     boolean caseSensitive,
                                                                     org.apache.hadoop.conf.Configuration conf,
                                                                     String[] fullFieldNames,
                                                                     org.apache.flink.table.types.DataType[] fullFieldTypes,
                                                                     Map<String,Object> partitionSpec,
                                                                     int[] selectedFields,
                                                                     int batchSize,
                                                                     org.apache.flink.core.fs.Path path,
                                                                     long splitStart,
                                                                     long splitLength)
                                                              throws IOException

Util for generating partitioned ParquetColumnarRowSplitReader.

抛出:

IOException

createVectorFromConstant

public static org.apache.flink.table.data.vector.ColumnVector createVectorFromConstant(org.apache.flink.table.types.logical.LogicalType type,
                                                                                       Object value,
                                                                                       int batchSize)

createColumnReader

public static ColumnReader createColumnReader(boolean utcTimestamp,
                                              org.apache.flink.table.types.logical.LogicalType fieldType,
                                              org.apache.parquet.column.ColumnDescriptor descriptor,
                                              org.apache.parquet.column.page.PageReader pageReader)
                                       throws IOException

抛出:

IOException

createWritableColumnVector

public static org.apache.flink.table.data.vector.writable.WritableColumnVector createWritableColumnVector(int batchSize,
                                                                                                          org.apache.flink.table.types.logical.LogicalType fieldType,
                                                                                                          org.apache.parquet.schema.PrimitiveType primitiveType)