org.apache.flink.runtime.io.network.partition.hybrid

类 HsSubpartitionMemoryDataManager

java.lang.Object

org.apache.flink.runtime.io.network.partition.hybrid.HsSubpartitionMemoryDataManager

所有已实现的接口:

HsDataView

public class HsSubpartitionMemoryDataManager
extends Object
implements HsDataView

This class is responsible for managing the data in a single subpartition. One HsMemoryDataManager will hold multiple HsSubpartitionMemoryDataManager.

方法概要

限定符和类型	方法和说明
void	append(ByteBuffer record, Buffer.DataType dataType) Append record to HsSubpartitionMemoryDataManager.
Optional<ResultSubpartition.BufferAndBacklog>	consumeBuffer(int toConsumeIndex) Check whether the head of unConsumedBuffers is the buffer to be consumed.
int	getBacklog() Get the number of buffers backlog.
Deque<BufferIndexAndChannel>	getBuffersSatisfyStatus(HsSpillingInfoProvider.SpillStatus spillStatus, HsSpillingInfoProvider.ConsumeStatus consumeStatus) Get buffers in allBuffers that satisfy expected HsSpillingInfoProvider.SpillStatus and HsSpillingInfoProvider.ConsumeStatus.
Buffer.DataType	peekNextToConsumeDataType(int nextToConsumeIndex) Check whether the head of unConsumedBuffers is the buffer to be consumed next time.
void	releaseDataView() Release this HsDataView when related subpartition view is releasing.
void	releaseSubpartitionBuffers(List<BufferIndexAndChannel> toRelease) Release this subpartition's buffers in a decision.
void	setOutputMetrics(HsOutputMetrics outputMetrics)
List<BufferWithIdentity>	spillSubpartitionBuffers(List<BufferIndexAndChannel> toSpill, CompletableFuture<Void> spillDoneFuture) Spill this subpartition's buffers in a decision.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

方法详细资料

peekNextToConsumeDataType

public Buffer.DataType peekNextToConsumeDataType(int nextToConsumeIndex)

Check whether the head of unConsumedBuffers is the buffer to be consumed next time. If so, return the next buffer's data type.

指定者:

peekNextToConsumeDataType 在接口中 HsDataView

参数:

nextToConsumeIndex - index of the buffer to be consumed next time.

返回:

If the head of unConsumedBuffers is target, return the buffer's data type. Otherwise, return Buffer.DataType.NONE.

consumeBuffer

public Optional<ResultSubpartition.BufferAndBacklog> consumeBuffer(int toConsumeIndex)

Check whether the head of unConsumedBuffers is the buffer to be consumed. If so, return the buffer and backlog.

指定者:

consumeBuffer 在接口中 HsDataView

参数:

toConsumeIndex - index of buffer to be consumed.

返回:

If the head of unConsumedBuffers is target, return optional of the buffer and backlog. Otherwise, return Optional.empty().

getBacklog

public int getBacklog()

从接口复制的说明: HsDataView

Get the number of buffers backlog.

指定者:

getBacklog 在接口中 HsDataView

返回:

backlog of this view's corresponding subpartition.

releaseDataView

public void releaseDataView()

从接口复制的说明: HsDataView

Release this HsDataView when related subpartition view is releasing.

指定者:

releaseDataView 在接口中 HsDataView

append

public void append(ByteBuffer record,
                   Buffer.DataType dataType)
            throws InterruptedException

Append record to HsSubpartitionMemoryDataManager.

参数:

record - to be managed by this class.

dataType - the type of this record. In other words, is it data or event.

抛出:

InterruptedException

getBuffersSatisfyStatus

public Deque<BufferIndexAndChannel> getBuffersSatisfyStatus(HsSpillingInfoProvider.SpillStatus spillStatus,
                                                            HsSpillingInfoProvider.ConsumeStatus consumeStatus)

Get buffers in allBuffers that satisfy expected HsSpillingInfoProvider.SpillStatus and HsSpillingInfoProvider.ConsumeStatus.

参数:

spillStatus - the status of spilling expected.

consumeStatus - the status of consuming expected.

返回:

buffers satisfy expected status in order.

spillSubpartitionBuffers

public List<BufferWithIdentity> spillSubpartitionBuffers(List<BufferIndexAndChannel> toSpill,
                                                         CompletableFuture<Void> spillDoneFuture)

Spill this subpartition's buffers in a decision.

参数:

toSpill - All buffers that need to be spilled belong to this subpartition in a decision.

spillDoneFuture - completed when spill is finished.

返回:

BufferWithIdentitys about these spill buffers.

releaseSubpartitionBuffers

public void releaseSubpartitionBuffers(List<BufferIndexAndChannel> toRelease)

Release this subpartition's buffers in a decision.

参数:

toRelease - All buffers that need to be released belong to this subpartition in a decision.

setOutputMetrics

public void setOutputMetrics(HsOutputMetrics outputMetrics)