org.apache.hudi.async

Class SparkStreamingAsyncCompactService

java.lang.Object

org.apache.hudi.async.HoodieAsyncService

org.apache.hudi.async.HoodieAsyncTableService

org.apache.hudi.async.AsyncCompactService

org.apache.hudi.async.SparkStreamingAsyncCompactService

All Implemented Interfaces:

Serializable, RunsTableService

public class SparkStreamingAsyncCompactService
extends AsyncCompactService

Async Compaction Service used by Structured Streaming. Here, async compaction is run in daemon mode to prevent blocking shutting down the Spark application.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.hudi.async.AsyncCompactService

COMPACT_POOL_NAME, context

Fields inherited from class org.apache.hudi.async.HoodieAsyncTableService

writeConfig

Fields inherited from class org.apache.hudi.async.HoodieAsyncService

hasError

Constructor Summary

Constructors

Constructor and Description
SparkStreamingAsyncCompactService(HoodieEngineContext context, BaseHoodieWriteClient client)

Method Summary

Modifier and Type	Method and Description
protected BaseCompactor	createCompactor(BaseHoodieWriteClient client)

Methods inherited from class org.apache.hudi.async.AsyncCompactService

shouldStopCompactor, startService, updateWriteClient

Methods inherited from class org.apache.hudi.async.HoodieAsyncTableService

start

Methods inherited from class org.apache.hudi.async.HoodieAsyncService

enqueuePendingAsyncServiceInstant, hasError, isRunInDaemonMode, isShutdown, isShutdownRequested, isStarted, shutdown, waitForShutdown, waitTillPendingAsyncServiceInstantsReducesTo

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hudi.client.RunsTableService

tableServicesEnabled

Constructor Detail

SparkStreamingAsyncCompactService

public SparkStreamingAsyncCompactService(HoodieEngineContext context,
                                         BaseHoodieWriteClient client)

Method Detail

createCompactor

protected BaseCompactor createCompactor(BaseHoodieWriteClient client)

Specified by:

createCompactor in class AsyncCompactService