org.apache.flink.runtime.source.coordinator

类 SplitAssignmentTracker<SplitT extends org.apache.flink.api.connector.source.SourceSplit>

java.lang.Object

org.apache.flink.runtime.source.coordinator.SplitAssignmentTracker<SplitT>

@Internal
public class SplitAssignmentTracker<SplitT extends org.apache.flink.api.connector.source.SourceSplit>
extends Object

A class that is responsible for tracking the past split assignments made by SplitEnumerator.

构造器概要

构造器

构造器和说明
SplitAssignmentTracker()

方法概要

限定符和类型	方法和说明
List<SplitT>	getAndRemoveUncheckpointedAssignment(int subtaskId, long restoredCheckpointId) This method is invoked when a source reader fails over.
void	onCheckpoint(long checkpointId) Behavior of SplitAssignmentTracker on checkpoint.
void	onCheckpointComplete(long checkpointId) when a checkpoint has been successfully made, this method is invoked to clean up the assignment history before this successful checkpoint.
void	recordSplitAssignment(org.apache.flink.api.connector.source.SplitsAssignment<SplitT> splitsAssignment) Record a new split assignment.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

SplitAssignmentTracker

public SplitAssignmentTracker()

方法详细资料

onCheckpoint

public void onCheckpoint(long checkpointId)
                  throws Exception

Behavior of SplitAssignmentTracker on checkpoint. Tracker will mark uncheckpointed assignment as checkpointed with current checkpoint ID.

参数:

checkpointId - the id of the ongoing checkpoint

抛出:

Exception

onCheckpointComplete

public void onCheckpointComplete(long checkpointId)

when a checkpoint has been successfully made, this method is invoked to clean up the assignment history before this successful checkpoint.

参数:

checkpointId - the id of the successful checkpoint.

recordSplitAssignment

public void recordSplitAssignment(org.apache.flink.api.connector.source.SplitsAssignment<SplitT> splitsAssignment)

Record a new split assignment.

参数:

splitsAssignment - the new split assignment.

getAndRemoveUncheckpointedAssignment

public List<SplitT> getAndRemoveUncheckpointedAssignment(int subtaskId,
                                                         long restoredCheckpointId)

This method is invoked when a source reader fails over. In this case, the source reader will restore its split assignment to the last successful checkpoint. Any split assignment to that source reader after the last successful checkpoint will be lost on the source reader side as if those splits were never assigned. To handle this case, the coordinator needs to find those splits and return them back to the SplitEnumerator for re-assignment.

参数:

subtaskId - the subtask id of the reader that failed over.

restoredCheckpointId - the ID of the checkpoint that the reader was restored to.

返回:

A list of splits that needs to be added back to the SplitEnumerator.