org.apache.flink.formats.parquet.utils

Class ParquetSchemaConverter

java.lang.Object

org.apache.flink.formats.parquet.utils.ParquetSchemaConverter

public class ParquetSchemaConverter
extends Object

Schema converter converts Parquet schema to and from Flink internal types.

Field Summary

Fields

Modifier and Type	Field and Description
static String	LIST_ARRAY_TYPE
static String	LIST_ELEMENT
static String	LIST_GROUP_NAME
static String	MAP_VALUE
static String	MESSAGE_ROOT

Constructor Summary

Constructors

Constructor and Description
ParquetSchemaConverter()

Method Summary

Modifier and Type	Method and Description
static int	computeMinBytesForDecimalPrecision(int precision)
static org.apache.flink.api.common.typeinfo.TypeInformation<?>	convertFields(List<org.apache.parquet.schema.Type> parquetFields)
static org.apache.flink.api.common.typeinfo.TypeInformation<?>	convertParquetTypeToTypeInfo(org.apache.parquet.schema.Type fieldType)
static org.apache.parquet.schema.MessageType	convertToParquetMessageType(String name, org.apache.flink.table.types.logical.RowType rowType)
static org.apache.flink.api.common.typeinfo.TypeInformation<?>	fromParquetType(org.apache.parquet.schema.MessageType type) Converts Parquet schema to Flink Internal Type.
static org.apache.parquet.schema.MessageType	toParquetType(org.apache.flink.api.common.typeinfo.TypeInformation<?> typeInformation, boolean legacyMode) Converts Flink Internal Type to Parquet schema.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

MAP_VALUE

public static final String MAP_VALUE

See Also:

Constant Field Values

LIST_ARRAY_TYPE

public static final String LIST_ARRAY_TYPE

See Also:

Constant Field Values

LIST_ELEMENT

public static final String LIST_ELEMENT

See Also:

Constant Field Values

LIST_GROUP_NAME

public static final String LIST_GROUP_NAME

See Also:

Constant Field Values

MESSAGE_ROOT

public static final String MESSAGE_ROOT

See Also:

Constant Field Values

Constructor Detail

ParquetSchemaConverter

public ParquetSchemaConverter()

Method Detail

fromParquetType

public static org.apache.flink.api.common.typeinfo.TypeInformation<?> fromParquetType(org.apache.parquet.schema.MessageType type)

Converts Parquet schema to Flink Internal Type.

Parameters:

type - Parquet schema

Returns:

Flink type information

toParquetType

public static org.apache.parquet.schema.MessageType toParquetType(org.apache.flink.api.common.typeinfo.TypeInformation<?> typeInformation,
                                                                  boolean legacyMode)

Converts Flink Internal Type to Parquet schema.

Parameters:

typeInformation - Flink type information

legacyMode - is standard LIST and MAP schema or back-compatible schema

Returns:

Parquet schema

convertFields

public static org.apache.flink.api.common.typeinfo.TypeInformation<?> convertFields(List<org.apache.parquet.schema.Type> parquetFields)

convertParquetTypeToTypeInfo

public static org.apache.flink.api.common.typeinfo.TypeInformation<?> convertParquetTypeToTypeInfo(org.apache.parquet.schema.Type fieldType)

convertToParquetMessageType

public static org.apache.parquet.schema.MessageType convertToParquetMessageType(String name,
                                                                                org.apache.flink.table.types.logical.RowType rowType)

computeMinBytesForDecimalPrecision

public static int computeMinBytesForDecimalPrecision(int precision)