org.apache.flink.formats.parquet

Class ParquetTableSource

java.lang.Object

org.apache.flink.formats.parquet.ParquetTableSource

All Implemented Interfaces:

org.apache.flink.table.sources.BatchTableSource<org.apache.flink.types.Row>, org.apache.flink.table.sources.FilterableTableSource<org.apache.flink.types.Row>, org.apache.flink.table.sources.ProjectableTableSource<org.apache.flink.types.Row>, org.apache.flink.table.sources.TableSource<org.apache.flink.types.Row>

public class ParquetTableSource
extends Object
implements org.apache.flink.table.sources.BatchTableSource<org.apache.flink.types.Row>, org.apache.flink.table.sources.FilterableTableSource<org.apache.flink.types.Row>, org.apache.flink.table.sources.ProjectableTableSource<org.apache.flink.types.Row>

A TableSource to read Parquet files.

The ParquetTableSource supports projection and filter push-down.

An ParquetTableSource is used as shown in the example below.

 ParquetTableSource parquetSrc = ParquetTableSource.builder()
   .path("file:///my/data/file.parquet")
   .schema(messageType)
   .build();

 tEnv.registerTableSourceInternal("parquetTable", parquetSrc);
 Table res = tableEnv.sqlQuery("SELECT * FROM parquetTable");
 

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ParquetTableSource.Builder Constructs an ParquetTableSource.

Method Summary

Modifier and Type	Method and Description
org.apache.flink.table.sources.TableSource<org.apache.flink.types.Row>	applyPredicate(List<org.apache.flink.table.expressions.Expression> predicates)
static ParquetTableSource.Builder	builder()
String	explainSource()
org.apache.flink.api.java.DataSet<org.apache.flink.types.Row>	getDataSet(org.apache.flink.api.java.ExecutionEnvironment executionEnvironment)
org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.types.Row>	getReturnType()
org.apache.flink.table.api.TableSchema	getTableSchema()
boolean	isFilterPushedDown()
org.apache.flink.table.sources.TableSource<org.apache.flink.types.Row>	projectFields(int[] fields)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.table.sources.TableSource

getProducedDataType

Method Detail

projectFields

public org.apache.flink.table.sources.TableSource<org.apache.flink.types.Row> projectFields(int[] fields)

Specified by:

projectFields in interface org.apache.flink.table.sources.ProjectableTableSource<org.apache.flink.types.Row>

getDataSet

public org.apache.flink.api.java.DataSet<org.apache.flink.types.Row> getDataSet(org.apache.flink.api.java.ExecutionEnvironment executionEnvironment)

Specified by:

getDataSet in interface org.apache.flink.table.sources.BatchTableSource<org.apache.flink.types.Row>

applyPredicate

public org.apache.flink.table.sources.TableSource<org.apache.flink.types.Row> applyPredicate(List<org.apache.flink.table.expressions.Expression> predicates)

Specified by:

applyPredicate in interface org.apache.flink.table.sources.FilterableTableSource<org.apache.flink.types.Row>

isFilterPushedDown

public boolean isFilterPushedDown()

Specified by:

isFilterPushedDown in interface org.apache.flink.table.sources.FilterableTableSource<org.apache.flink.types.Row>

getReturnType

public org.apache.flink.api.common.typeinfo.TypeInformation<org.apache.flink.types.Row> getReturnType()

Specified by:

getReturnType in interface org.apache.flink.table.sources.TableSource<org.apache.flink.types.Row>

getTableSchema

public org.apache.flink.table.api.TableSchema getTableSchema()

Specified by:

getTableSchema in interface org.apache.flink.table.sources.TableSource<org.apache.flink.types.Row>

explainSource

public String explainSource()

Specified by:

explainSource in interface org.apache.flink.table.sources.TableSource<org.apache.flink.types.Row>

builder

public static ParquetTableSource.Builder builder()