org.apache.flink.runtime.operators.hash

Class ReOpenableHashPartition<BT,PT>

java.lang.Object

org.apache.flink.runtime.memorymanager.AbstractPagedInputView

org.apache.flink.runtime.operators.hash.HashPartition<BT,PT>

org.apache.flink.runtime.operators.hash.ReOpenableHashPartition<BT,PT>

All Implemented Interfaces:

DataInput, DataInputView, SeekableDataInputView

public class ReOpenableHashPartition<BT,PT>
extends HashPartition<BT,PT>

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.runtime.operators.hash.HashPartition

HashPartition.BuildSideBuffer<BT>

Field Summary

Fields

Modifier and Type	Field and Description
protected int	initialPartitionBuffersCount

Fields inherited from class org.apache.flink.runtime.operators.hash.HashPartition

furtherPartitioning, nextOverflowBucket, numOverflowSegments, overflowSegments, partitionBuffers, probeSideBuffer, probeSideChannel, probeSideRecordCounter, recursionLevel

Fields inherited from class org.apache.flink.runtime.memorymanager.AbstractPagedInputView

headerLength

Method Summary

Methods

Modifier and Type	Method and Description
void	clearAllMemory(List<MemorySegment> target)
int	finalizeProbePhase(List<MemorySegment> freeMemory, List<HashPartition<BT,PT>> spilledPartitions) This method is used if the HashTable is setup for multiple probe phases.

Methods inherited from class org.apache.flink.runtime.operators.hash.HashPartition

finalizeBuildPhase, getBuildSideBlockCount, getBuildSideChannel, getBuildSideRecordCount, getLimitForSegment, getPartitionNumber, getProbeSideBlockCount, getProbeSideChannel, getProbeSideRecordCount, getRecursionLevel, insertIntoBuildBuffer, insertIntoProbeBuffer, isInMemory, nextSegment, prepareProbePhase, setFurtherPatitioning, setReadPosition, spillPartition

Methods inherited from class org.apache.flink.runtime.memorymanager.AbstractPagedInputView

advance, clear, getCurrentPositionInSegment, getCurrentSegment, getCurrentSegmentLimit, read, read, readBoolean, readByte, readChar, readDouble, readFloat, readFully, readFully, readInt, readLine, readLong, readShort, readUnsignedByte, readUnsignedShort, readUTF, seekInput, skipBytes, skipBytesToRead

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.core.memory.DataInputView

read, read, skipBytesToRead

Methods inherited from interface java.io.DataInput

readBoolean, readByte, readChar, readDouble, readFloat, readFully, readFully, readInt, readLine, readLong, readShort, readUnsignedByte, readUnsignedShort, readUTF, skipBytes

Field Detail

initialPartitionBuffersCount

protected int initialPartitionBuffersCount

Method Detail

finalizeProbePhase

public int finalizeProbePhase(List<MemorySegment> freeMemory,
                     List<HashPartition<BT,PT>> spilledPartitions)
                       throws IOException

This method is used if the HashTable is setup for multiple probe phases. We can drop probe related files but not build files (or memory)

Overrides:

finalizeProbePhase in class HashPartition<BT,PT>

Parameters:

furtherPartitioning - Set to true if additional partitioning steps are required -> release as much memory as possible! (Memory contents are stored on disk)

Returns:

The number of write-behind buffers reclaimable after this method call.

Throws:

IOException

clearAllMemory

public void clearAllMemory(List<MemorySegment> target)

Overrides:

clearAllMemory in class HashPartition<BT,PT>