org.apache.flink.runtime.io.network.partition.hybrid

接口 HsFileDataIndex

所有已知实现类:

HsFileDataIndexImpl

public interface HsFileDataIndex

Index of spilled data. For each spilled data buffer, this maintains the subpartition it belongs to, the buffer index within the subpartition, the offset in file it begin with, and its readability.

Note: Buffers added to this index should not be read until being explicitly marked READABLE.

嵌套类概要

嵌套类

限定符和类型	接口和说明
static class	HsFileDataIndex.ReadableRegion Represents a series of physically continuous buffers in the file, which are readable, from the same subpartition, and has sequential buffer index.
static class	HsFileDataIndex.SpilledBuffer Represents a spilled buffer.

方法概要

限定符和类型	方法和说明
void	addBuffers(List<HsFileDataIndex.SpilledBuffer> spilledBuffers) Add buffers to the index.
void	close() Close this file data index.
Optional<HsFileDataIndex.ReadableRegion>	getReadableRegion(int subpartitionId, int bufferIndex, int consumingOffset) Get a HsFileDataIndex.ReadableRegion for the given subpartition that starts with the given buffer index, if existed.
void	markBufferReleased(int subpartitionId, int bufferIndex) Mark a buffer as RELEASED.

方法详细资料

getReadableRegion

Optional<HsFileDataIndex.ReadableRegion> getReadableRegion(int subpartitionId,
                                                           int bufferIndex,
                                                           int consumingOffset)

Get a HsFileDataIndex.ReadableRegion for the given subpartition that starts with the given buffer index, if existed.

Note: Depending on the implementation, this method does not guarantee to always return the longest possible readable region.

参数:

subpartitionId - that the readable region belongs to

bufferIndex - that the readable region starts with

consumingOffset - of the downstream

返回:

a HsFileDataIndex.ReadableRegion for the given subpartition that starts with the given buffer index, if exist; otherwise, Optional.empty().

addBuffers

void addBuffers(List<HsFileDataIndex.SpilledBuffer> spilledBuffers)

Add buffers to the index.

Attention: this method only called by spilling thread.

参数:

spilledBuffers - to be added. The buffers in the list are expected in the same order as in the spilled file.

markBufferReleased

void markBufferReleased(int subpartitionId,
                        int bufferIndex)

Mark a buffer as RELEASED.

参数:

subpartitionId - that the buffer belongs to

bufferIndex - of the buffer within the subpartition

close

void close()

Close this file data index.