org.apache.hudi.async

Class SparkStreamingAsyncClusteringService

java.lang.Object

org.apache.hudi.async.HoodieAsyncService

org.apache.hudi.async.HoodieAsyncTableService

org.apache.hudi.async.AsyncClusteringService

org.apache.hudi.async.SparkStreamingAsyncClusteringService

All Implemented Interfaces:

Serializable, RunsTableService

public class SparkStreamingAsyncClusteringService
extends AsyncClusteringService

Async clustering service for Spark structured streaming. Here, async clustering is run in daemon mode to prevent blocking shutting down the Spark application.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.hudi.async.AsyncClusteringService

CLUSTERING_POOL_NAME, context

Fields inherited from class org.apache.hudi.async.HoodieAsyncTableService

writeConfig

Fields inherited from class org.apache.hudi.async.HoodieAsyncService

hasError

Constructor Summary

Constructors

Constructor and Description
SparkStreamingAsyncClusteringService(HoodieEngineContext context, BaseHoodieWriteClient writeClient)

Method Summary

Modifier and Type	Method and Description
protected BaseClusterer	createClusteringClient(BaseHoodieWriteClient client)

Methods inherited from class org.apache.hudi.async.AsyncClusteringService

startService, updateWriteClient

Methods inherited from class org.apache.hudi.async.HoodieAsyncTableService

start

Methods inherited from class org.apache.hudi.async.HoodieAsyncService

enqueuePendingAsyncServiceInstant, hasError, isRunInDaemonMode, isShutdown, isShutdownRequested, isStarted, shutdown, waitForShutdown, waitTillPendingAsyncServiceInstantsReducesTo

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hudi.client.RunsTableService

shouldDelegateToTableServiceManager, tableServicesEnabled

Constructor Detail

SparkStreamingAsyncClusteringService

public SparkStreamingAsyncClusteringService(HoodieEngineContext context,
                                            BaseHoodieWriteClient writeClient)

Method Detail

createClusteringClient

protected BaseClusterer createClusteringClient(BaseHoodieWriteClient client)

Specified by:

createClusteringClient in class AsyncClusteringService