org.apache.flink.formats.parquet

类 ParquetVectorizedInputFormat<T,SplitT extends org.apache.flink.connector.file.src.FileSourceSplit>

java.lang.Object

org.apache.flink.formats.parquet.ParquetVectorizedInputFormat<T,SplitT>

所有已实现的接口:

Serializable, org.apache.flink.api.java.typeutils.ResultTypeQueryable<T>, org.apache.flink.connector.file.src.reader.BulkFormat<T,SplitT>

直接已知子类:

ParquetColumnarRowInputFormat

public abstract class ParquetVectorizedInputFormat<T,SplitT extends org.apache.flink.connector.file.src.FileSourceSplit>
extends Object
implements org.apache.flink.connector.file.src.reader.BulkFormat<T,SplitT>

Parquet BulkFormat that reads data from the file to VectorizedColumnBatch in vectorized mode.

另请参阅:

序列化表格

嵌套类概要

嵌套类

限定符和类型	类和说明
protected static class	ParquetVectorizedInputFormat.ParquetReaderBatch<T> Reader batch that provides writing and reading capabilities.

从接口继承的嵌套类/接口 org.apache.flink.connector.file.src.reader.BulkFormat

org.apache.flink.connector.file.src.reader.BulkFormat.Reader<T>, org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator<T>

构造器概要

构造器

构造器和说明
ParquetVectorizedInputFormat(SerializableConfiguration hadoopConfig, org.apache.flink.table.types.logical.RowType projectedType, ColumnBatchFactory<SplitT> batchFactory, int batchSize, boolean isUtcTimestamp, boolean isCaseSensitive)

方法概要

限定符和类型	方法和说明
org.apache.flink.formats.parquet.ParquetVectorizedInputFormat.ParquetReader	createReader(org.apache.flink.configuration.Configuration config, SplitT split)
protected abstract ParquetVectorizedInputFormat.ParquetReaderBatch<T>	createReaderBatch(org.apache.flink.table.data.vector.writable.WritableColumnVector[] writableVectors, org.apache.flink.table.data.vector.VectorizedColumnBatch columnarBatch, org.apache.flink.connector.file.src.util.Pool.Recycler<ParquetVectorizedInputFormat.ParquetReaderBatch<T>> recycler)
boolean	isSplittable()
protected int	numBatchesToCirculate(org.apache.flink.configuration.Configuration config)
org.apache.flink.formats.parquet.ParquetVectorizedInputFormat.ParquetReader	restoreReader(org.apache.flink.configuration.Configuration config, SplitT split)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.connector.file.src.reader.BulkFormat

getProducedType

构造器详细资料

ParquetVectorizedInputFormat

public ParquetVectorizedInputFormat(SerializableConfiguration hadoopConfig,
                                    org.apache.flink.table.types.logical.RowType projectedType,
                                    ColumnBatchFactory<SplitT> batchFactory,
                                    int batchSize,
                                    boolean isUtcTimestamp,
                                    boolean isCaseSensitive)

方法详细资料

createReader

public org.apache.flink.formats.parquet.ParquetVectorizedInputFormat.ParquetReader createReader(org.apache.flink.configuration.Configuration config,
                                                                                                SplitT split)
                                                                                         throws IOException

指定者:

createReader 在接口中 org.apache.flink.connector.file.src.reader.BulkFormat<T,SplitT extends org.apache.flink.connector.file.src.FileSourceSplit>

抛出:

IOException

numBatchesToCirculate

protected int numBatchesToCirculate(org.apache.flink.configuration.Configuration config)

restoreReader

public org.apache.flink.formats.parquet.ParquetVectorizedInputFormat.ParquetReader restoreReader(org.apache.flink.configuration.Configuration config,
                                                                                                 SplitT split)
                                                                                          throws IOException

指定者:

restoreReader 在接口中 org.apache.flink.connector.file.src.reader.BulkFormat<T,SplitT extends org.apache.flink.connector.file.src.FileSourceSplit>

抛出:

IOException

isSplittable

public boolean isSplittable()

指定者:

isSplittable 在接口中 org.apache.flink.connector.file.src.reader.BulkFormat<T,SplitT extends org.apache.flink.connector.file.src.FileSourceSplit>

createReaderBatch

protected abstract ParquetVectorizedInputFormat.ParquetReaderBatch<T> createReaderBatch(org.apache.flink.table.data.vector.writable.WritableColumnVector[] writableVectors,
                                                                                        org.apache.flink.table.data.vector.VectorizedColumnBatch columnarBatch,
                                                                                        org.apache.flink.connector.file.src.util.Pool.Recycler<ParquetVectorizedInputFormat.ParquetReaderBatch<T>> recycler)

参数:

writableVectors - vectors to be write

columnarBatch - vectors to be read

recycler - batch recycler