org.apache.flink.runtime.io.network.partition.hybrid

类 HsFullSpillingStrategy

java.lang.Object

org.apache.flink.runtime.io.network.partition.hybrid.HsFullSpillingStrategy

所有已实现的接口:

HsSpillingStrategy

public class HsFullSpillingStrategy
extends Object
implements HsSpillingStrategy

A special implementation of HsSpillingStrategy that spilled all buffers to disk.

嵌套类概要

从接口继承的嵌套类/接口 org.apache.flink.runtime.io.network.partition.hybrid.HsSpillingStrategy

HsSpillingStrategy.Decision

构造器概要

构造器

构造器和说明
HsFullSpillingStrategy(HybridShuffleConfiguration hybridShuffleConfiguration)

方法概要

限定符和类型	方法和说明
HsSpillingStrategy.Decision	decideActionWithGlobalInfo(HsSpillingInfoProvider spillingInfoProvider) Make a decision based on global information.
Optional<HsSpillingStrategy.Decision>	onBufferConsumed(BufferIndexAndChannel consumedBuffer) Make a decision when a buffer is consumed.
Optional<HsSpillingStrategy.Decision>	onBufferFinished(int numTotalUnSpillBuffers, int currentPoolSize) Make a decision when a buffer becomes finished.
Optional<HsSpillingStrategy.Decision>	onMemoryUsageChanged(int numTotalRequestedBuffers, int currentPoolSize) Make a decision when memory usage is changed.
HsSpillingStrategy.Decision	onResultPartitionClosed(HsSpillingInfoProvider spillingInfoProvider) Make a decision when result partition is closed.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

HsFullSpillingStrategy

public HsFullSpillingStrategy(HybridShuffleConfiguration hybridShuffleConfiguration)

方法详细资料

onBufferFinished

public Optional<HsSpillingStrategy.Decision> onBufferFinished(int numTotalUnSpillBuffers,
                                                              int currentPoolSize)

从接口复制的说明: HsSpillingStrategy

Make a decision when a buffer becomes finished.

指定者:

onBufferFinished 在接口中 HsSpillingStrategy

参数:

numTotalUnSpillBuffers - total number of buffers not spill.

返回:

A HsSpillingStrategy.Decision based on the provided information, or Optional.empty() if the decision cannot be made, which indicates global information is needed.

onBufferConsumed

public Optional<HsSpillingStrategy.Decision> onBufferConsumed(BufferIndexAndChannel consumedBuffer)

从接口复制的说明: HsSpillingStrategy

Make a decision when a buffer is consumed.

指定者:

onBufferConsumed 在接口中 HsSpillingStrategy

参数:

consumedBuffer - the buffer that is consumed.

返回:

A HsSpillingStrategy.Decision based on the provided information, or Optional.empty() if the decision cannot be made, which indicates global information is needed.

onMemoryUsageChanged

public Optional<HsSpillingStrategy.Decision> onMemoryUsageChanged(int numTotalRequestedBuffers,
                                                                  int currentPoolSize)

从接口复制的说明: HsSpillingStrategy

Make a decision when memory usage is changed.

指定者:

onMemoryUsageChanged 在接口中 HsSpillingStrategy

参数:

numTotalRequestedBuffers - total number of buffers requested.

currentPoolSize - current value of buffer pool size.

返回:

A HsSpillingStrategy.Decision based on the provided information, or Optional.empty() if the decision cannot be made, which indicates global information is needed.

decideActionWithGlobalInfo

public HsSpillingStrategy.Decision decideActionWithGlobalInfo(HsSpillingInfoProvider spillingInfoProvider)

从接口复制的说明: HsSpillingStrategy

Make a decision based on global information. Because this method will directly touch the HsSpillingInfoProvider, the caller should take care of the thread safety.

指定者:

decideActionWithGlobalInfo 在接口中 HsSpillingStrategy

参数:

spillingInfoProvider - that provides information about the current status.

返回:

A HsSpillingStrategy.Decision based on the global information.

onResultPartitionClosed

public HsSpillingStrategy.Decision onResultPartitionClosed(HsSpillingInfoProvider spillingInfoProvider)

从接口复制的说明: HsSpillingStrategy

Make a decision when result partition is closed. Because this method will directly touch the HsSpillingInfoProvider, the caller should take care of the thread safety.

指定者:

onResultPartitionClosed 在接口中 HsSpillingStrategy

参数:

spillingInfoProvider - that provides information about the current status.

返回:

A HsSpillingStrategy.Decision based on the global information.