A B C D E G I O S T U V W

A

abort() - Method in class org.apache.hudi.internal.BulkInsertDataInternalWriterHelper

abort() - Method in class org.apache.hudi.internal.DataSourceInternalWriterHelper

B

BaseDefaultSource - Class in org.apache.hudi.internal

Base class for DefaultSource used by Spark datasource v2.

BaseDefaultSource() - Constructor for class org.apache.hudi.internal.BaseDefaultSource

BaseWriterCommitMessage - Class in org.apache.hudi.internal

Base class for HoodieWriterCommitMessage used by Spark datasource v2.

BaseWriterCommitMessage(List<HoodieInternalWriteStatus>) - Constructor for class org.apache.hudi.internal.BaseWriterCommitMessage

BulkInsertDataInternalWriterHelper - Class in org.apache.hudi.internal

Helper class for HoodieBulkInsertDataInternalWriter used by Spark datasource v2.

BulkInsertDataInternalWriterHelper(HoodieTable, HoodieWriteConfig, String, int, long, long, StructType, boolean, boolean) - Constructor for class org.apache.hudi.internal.BulkInsertDataInternalWriterHelper

C

checkRequiredProperties(TypedProperties, List<String>) - Static method in class org.apache.hudi.DataSourceUtils

close() - Method in class org.apache.hudi.internal.BulkInsertDataInternalWriterHelper

commit(List<HoodieWriteStat>) - Method in class org.apache.hudi.internal.DataSourceInternalWriterHelper

configuration - Variable in class org.apache.hudi.internal.BaseDefaultSource

createClusteringClient(BaseHoodieWriteClient) - Method in class org.apache.hudi.async.SparkStreamingAsyncClusteringService

createCompactor(BaseHoodieWriteClient) - Method in class org.apache.hudi.async.SparkStreamingAsyncCompactService

createHoodieClient(JavaSparkContext, String, String, String, Map<String, String>) - Static method in class org.apache.hudi.DataSourceUtils

createHoodieConfig(String, String, String, Map<String, String>) - Static method in class org.apache.hudi.DataSourceUtils

createHoodieRecord(GenericRecord, Comparable, HoodieKey, String) - Static method in class org.apache.hudi.DataSourceUtils

createHoodieRecord(GenericRecord, HoodieKey, String) - Static method in class org.apache.hudi.DataSourceUtils

createInflightCommit() - Method in class org.apache.hudi.internal.DataSourceInternalWriterHelper

createPayload(String, GenericRecord, Comparable) - Static method in class org.apache.hudi.DataSourceUtils

Create a payload class via reflection, passing in an ordering/precombine value.

createPayload(String, GenericRecord) - Static method in class org.apache.hudi.DataSourceUtils

Create a payload class via reflection, do not ordering/precombine value.

createUserDefinedBulkInsertPartitionerWithRows(HoodieWriteConfig) - Static method in class org.apache.hudi.DataSourceUtils

Create a UserDefinedBulkInsertPartitionerRows class via reflection,
if the class name of UserDefinedBulkInsertPartitioner is configured through the HoodieWriteConfig.

D

DataSourceInternalWriterHelper - Class in org.apache.hudi.internal

Helper class for HoodieDataSourceInternalWriter used by Spark datasource v2.

DataSourceInternalWriterHelper(String, HoodieWriteConfig, StructType, SparkSession, Configuration, Map<String, String>) - Constructor for class org.apache.hudi.internal.DataSourceInternalWriterHelper

DataSourceUtils - Class in org.apache.hudi

Utilities used throughout the data source.

DataSourceUtils() - Constructor for class org.apache.hudi.DataSourceUtils

doDeleteOperation(SparkRDDWriteClient, JavaRDD<HoodieKey>, String) - Static method in class org.apache.hudi.DataSourceUtils

doDeletePartitionsOperation(SparkRDDWriteClient, List<String>, String) - Static method in class org.apache.hudi.DataSourceUtils

doWriteOperation(SparkRDDWriteClient, JavaRDD<HoodieRecord>, String, WriteOperationType) - Static method in class org.apache.hudi.DataSourceUtils

dropDuplicates(JavaSparkContext, JavaRDD<HoodieRecord>, HoodieWriteConfig) - Static method in class org.apache.hudi.DataSourceUtils

Drop records already present in the dataset.

dropDuplicates(JavaSparkContext, JavaRDD<HoodieRecord>, Map<String, String>) - Static method in class org.apache.hudi.DataSourceUtils

E

eval(IndexedRecord) - Method in interface org.apache.hudi.sql.IExpressionEvaluator

Evaluate the result of the expressions based on the record.

G

getCode() - Method in interface org.apache.hudi.sql.IExpressionEvaluator

Get the code of the expressions.

getConfiguration() - Method in class org.apache.hudi.internal.BaseDefaultSource

getExtraMetadata(Map<String, String>) - Static method in class org.apache.hudi.DataSourceUtils

getHoodieTable() - Method in class org.apache.hudi.internal.DataSourceInternalWriterHelper

getSparkSession() - Method in class org.apache.hudi.internal.BaseDefaultSource

getTablePath(FileSystem, Path[]) - Static method in class org.apache.hudi.DataSourceUtils

getWriteOperationType() - Method in class org.apache.hudi.internal.DataSourceInternalWriterHelper

getWriteStatuses() - Method in class org.apache.hudi.internal.BaseWriterCommitMessage

getWriteStatuses() - Method in class org.apache.hudi.internal.BulkInsertDataInternalWriterHelper

I

IExpressionEvaluator - Interface in org.apache.hudi.sql

A interface for CodeGen to execute expressions on the record.

InsertMode - Enum in org.apache.hudi.sql

Insert mode for insert into pk-table.

INSTANT_TIME_OPT_KEY - Static variable in class org.apache.hudi.internal.DataSourceInternalWriterHelper

O

of(String) - Static method in enum org.apache.hudi.sql.InsertMode

onDataWriterCommit(String) - Method in class org.apache.hudi.internal.DataSourceInternalWriterHelper

org.apache.hudi - package org.apache.hudi

org.apache.hudi.async - package org.apache.hudi.async

org.apache.hudi.internal - package org.apache.hudi.internal

org.apache.hudi.sql - package org.apache.hudi.sql

S

sparkSession - Variable in class org.apache.hudi.internal.BaseDefaultSource

SparkStreamingAsyncClusteringService - Class in org.apache.hudi.async

Async clustering service for Spark structured streaming.

SparkStreamingAsyncClusteringService(HoodieEngineContext, BaseHoodieWriteClient) - Constructor for class org.apache.hudi.async.SparkStreamingAsyncClusteringService

SparkStreamingAsyncCompactService - Class in org.apache.hudi.async

Async Compaction Service used by Structured Streaming.

SparkStreamingAsyncCompactService(HoodieEngineContext, BaseHoodieWriteClient) - Constructor for class org.apache.hudi.async.SparkStreamingAsyncCompactService

T

toString() - Method in class org.apache.hudi.internal.BaseWriterCommitMessage

tryOverrideParquetWriteLegacyFormatProperty(Map<String, String>, StructType) - Static method in class org.apache.hudi.DataSourceUtils

Checks whether default value (false) of "hoodie.parquet.writelegacyformat.enabled" should be overridden in case: Property has not been explicitly set by the writer Data schema contains DecimalType that would be affected by it If both of the aforementioned conditions are true, will override the default value of the config (by essentially setting the value) to make sure that the produced Parquet data files could be read by AvroParquetReader

U

useCommitCoordinator() - Method in class org.apache.hudi.internal.DataSourceInternalWriterHelper

V

value() - Method in enum org.apache.hudi.sql.InsertMode

valueOf(String) - Static method in enum org.apache.hudi.sql.InsertMode

Returns the enum constant of this type with the specified name.

values() - Static method in enum org.apache.hudi.sql.InsertMode

Returns an array containing the constants of this enum type, in the order they are declared.

W

write(InternalRow) - Method in class org.apache.hudi.internal.BulkInsertDataInternalWriterHelper

A B C D E G I O S T U V W