org.apache.flink.runtime.taskexecutor

类 TaskExecutor

java.lang.Object

org.apache.flink.runtime.rpc.RpcEndpoint

org.apache.flink.runtime.taskexecutor.TaskExecutor

所有已实现的接口:

AutoCloseable, org.apache.flink.runtime.rpc.RpcGateway, TaskExecutorGateway, TaskExecutorOperatorEventGateway, TaskExecutorThreadInfoGateway, org.apache.flink.util.AutoCloseableAsync

public class TaskExecutor
extends org.apache.flink.runtime.rpc.RpcEndpoint
implements TaskExecutorGateway

TaskExecutor implementation. The task executor is responsible for the execution of multiple Task.

嵌套类概要

从类继承的嵌套类/接口 org.apache.flink.runtime.rpc.RpcEndpoint

org.apache.flink.runtime.rpc.RpcEndpoint.MainThreadExecutor

字段概要

字段

限定符和类型	字段和说明
static String	TASK_MANAGER_NAME

从类继承的字段 org.apache.flink.runtime.rpc.RpcEndpoint

log, rpcServer

构造器概要

构造器

构造器和说明

TaskExecutor(org.apache.flink.runtime.rpc.RpcService rpcService, TaskManagerConfiguration taskManagerConfiguration, HighAvailabilityServices haServices, TaskManagerServices taskExecutorServices, ExternalResourceInfoProvider externalResourceInfoProvider, HeartbeatServices heartbeatServices, TaskManagerMetricGroup taskManagerMetricGroup, String metricQueryServiceAddress, TaskExecutorBlobService taskExecutorBlobService, org.apache.flink.runtime.rpc.FatalErrorHandler fatalErrorHandler, TaskExecutorPartitionTracker partitionTracker)

方法概要

限定符和类型	方法和说明
CompletableFuture<Acknowledge>	abortCheckpoint(ExecutionAttemptID executionAttemptID, long checkpointId, long latestCompletedCheckpointId, long checkpointTimestamp) Abort a checkpoint for the given task.
CompletableFuture<Boolean>	canBeReleased() Checks whether the task executor can be released.
CompletableFuture<Acknowledge>	cancelTask(ExecutionAttemptID executionAttemptID, org.apache.flink.api.common.time.Time timeout) Cancel the given task.
CompletableFuture<Acknowledge>	confirmCheckpoint(ExecutionAttemptID executionAttemptID, long completedCheckpointId, long completedCheckpointTimestamp, long lastSubsumedCheckpointId) Confirm a checkpoint for the given task.
void	disconnectJobManager(org.apache.flink.api.common.JobID jobId, Exception cause) Disconnects the given JobManager from the TaskManager.
void	disconnectResourceManager(Exception cause) Disconnects the ResourceManager from the TaskManager.
void	freeInactiveSlots(org.apache.flink.api.common.JobID jobId, org.apache.flink.api.common.time.Time timeout) Frees all currently inactive slot allocated for the given job.
CompletableFuture<Acknowledge>	freeSlot(AllocationID allocationId, Throwable cause, org.apache.flink.api.common.time.Time timeout) Frees the slot with the given allocation ID.
ResourceID	getResourceID()
CompletableFuture<Void>	heartbeatFromJobManager(ResourceID resourceID, AllocatedSlotReport allocatedSlotReport) Heartbeat request from the job manager.
CompletableFuture<Void>	heartbeatFromResourceManager(ResourceID resourceID) Heartbeat request from the resource manager.
void	onStart()
CompletableFuture<Void>	onStop() Called to shut down the TaskManager.
CompletableFuture<Acknowledge>	releaseClusterPartitions(Collection<IntermediateDataSetID> dataSetsToRelease, org.apache.flink.api.common.time.Time timeout) Releases all cluster partitions belong to any of the given data sets.
void	releaseOrPromotePartitions(org.apache.flink.api.common.JobID jobId, Set<ResultPartitionID> partitionToRelease, Set<ResultPartitionID> partitionsToPromote) Batch release/promote intermediate result partitions.
CompletableFuture<TransientBlobKey>	requestFileUploadByName(String fileName, org.apache.flink.api.common.time.Time timeout) Requests the file upload of the specified name to the cluster's BlobServer.
CompletableFuture<TransientBlobKey>	requestFileUploadByType(FileType fileType, org.apache.flink.api.common.time.Time timeout) Requests the file upload of the specified type to the cluster's BlobServer.
CompletableFuture<Collection<LogInfo>>	requestLogList(org.apache.flink.api.common.time.Time timeout) Requests for the historical log file names on the TaskManager.
CompletableFuture<org.apache.flink.types.SerializableOptional<String>>	requestMetricQueryServiceAddress(org.apache.flink.api.common.time.Time timeout) Returns the gateway of Metric Query Service on the TaskManager.
CompletableFuture<Acknowledge>	requestSlot(SlotID slotId, org.apache.flink.api.common.JobID jobId, AllocationID allocationId, ResourceProfile resourceProfile, String targetAddress, ResourceManagerId resourceManagerId, org.apache.flink.api.common.time.Time timeout) Requests a slot from the TaskManager.
CompletableFuture<ThreadDumpInfo>	requestThreadDump(org.apache.flink.api.common.time.Time timeout) Requests the thread dump from this TaskManager.
CompletableFuture<TaskThreadInfoResponse>	requestThreadInfoSamples(ExecutionAttemptID taskExecutionAttemptId, ThreadInfoSamplesRequest requestParams, org.apache.flink.api.common.time.Time timeout) Request a thread info sample from the given task.
CompletableFuture<Acknowledge>	sendOperatorEventToTask(ExecutionAttemptID executionAttemptID, OperatorID operatorId, org.apache.flink.util.SerializedValue<OperatorEvent> evt) Sends an operator event to an operator in a task executed by the Task Manager (Task Executor).
CompletableFuture<Acknowledge>	submitTask(TaskDeploymentDescriptor tdd, JobMasterId jobMasterId, org.apache.flink.api.common.time.Time timeout) Submit a Task to the TaskExecutor.
CompletableFuture<Acknowledge>	triggerCheckpoint(ExecutionAttemptID executionAttemptID, long checkpointId, long checkpointTimestamp, CheckpointOptions checkpointOptions) Trigger the checkpoint for the given task.
CompletableFuture<Acknowledge>	updatePartitions(ExecutionAttemptID executionAttemptID, Iterable<PartitionInfo> partitionInfos, org.apache.flink.api.common.time.Time timeout) Update the task where the given partitions can be found.

从类继承的方法 org.apache.flink.runtime.rpc.RpcEndpoint

callAsync, closeAsync, getAddress, getEndpointId, getHostname, getMainThreadExecutor, getRpcService, getSelfGateway, getTerminationFuture, internalCallOnStart, internalCallOnStop, isRunning, runAsync, scheduleRunAsync, scheduleRunAsync, start, stop, validateRunsInMainThread

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.runtime.rpc.RpcGateway

getAddress, getHostname

从接口继承的方法 org.apache.flink.util.AutoCloseableAsync

close

字段详细资料

TASK_MANAGER_NAME

public static final String TASK_MANAGER_NAME

另请参阅:

常量字段值

构造器详细资料

TaskExecutor

public TaskExecutor(org.apache.flink.runtime.rpc.RpcService rpcService,
                    TaskManagerConfiguration taskManagerConfiguration,
                    HighAvailabilityServices haServices,
                    TaskManagerServices taskExecutorServices,
                    ExternalResourceInfoProvider externalResourceInfoProvider,
                    HeartbeatServices heartbeatServices,
                    TaskManagerMetricGroup taskManagerMetricGroup,
                    @Nullable
                    String metricQueryServiceAddress,
                    TaskExecutorBlobService taskExecutorBlobService,
                    org.apache.flink.runtime.rpc.FatalErrorHandler fatalErrorHandler,
                    TaskExecutorPartitionTracker partitionTracker)

方法详细资料

canBeReleased

public CompletableFuture<Boolean> canBeReleased()

从接口复制的说明: TaskExecutorGateway

Checks whether the task executor can be released. It cannot be released if there're unconsumed result partitions.

指定者:

canBeReleased 在接口中 TaskExecutorGateway

返回:

Future flag indicating whether the task executor can be released.

requestLogList

public CompletableFuture<Collection<LogInfo>> requestLogList(org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: TaskExecutorGateway

Requests for the historical log file names on the TaskManager.

指定者:

requestLogList 在接口中 TaskExecutorGateway

返回:

A Tuple2 Array with all log file names with its length.

onStart

public void onStart()
             throws Exception

覆盖:

onStart 在类中 org.apache.flink.runtime.rpc.RpcEndpoint

抛出:

Exception

onStop

public CompletableFuture<Void> onStop()

Called to shut down the TaskManager. The method closes all TaskManager services.

覆盖:

onStop 在类中 org.apache.flink.runtime.rpc.RpcEndpoint

requestThreadInfoSamples

public CompletableFuture<TaskThreadInfoResponse> requestThreadInfoSamples(ExecutionAttemptID taskExecutionAttemptId,
                                                                          ThreadInfoSamplesRequest requestParams,
                                                                          org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: TaskExecutorThreadInfoGateway

Request a thread info sample from the given task.

指定者:

requestThreadInfoSamples 在接口中 TaskExecutorThreadInfoGateway

参数:

taskExecutionAttemptId - identifying the task to sample

requestParams - parameters of the request

timeout - of the request

返回:

Future of stack trace sample response

submitTask

public CompletableFuture<Acknowledge> submitTask(TaskDeploymentDescriptor tdd,
                                                 JobMasterId jobMasterId,
                                                 org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: TaskExecutorGateway

Submit a Task to the TaskExecutor.

指定者:

submitTask 在接口中 TaskExecutorGateway

参数:

tdd - describing the task to submit

jobMasterId - identifying the submitting JobMaster

timeout - of the submit operation

返回:

Future acknowledge of the successful operation

cancelTask

public CompletableFuture<Acknowledge> cancelTask(ExecutionAttemptID executionAttemptID,
                                                 org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: TaskExecutorGateway

Cancel the given task.

指定者:

cancelTask 在接口中 TaskExecutorGateway

参数:

executionAttemptID - identifying the task

timeout - for the cancel operation

返回:

Future acknowledge if the task is successfully canceled

updatePartitions

public CompletableFuture<Acknowledge> updatePartitions(ExecutionAttemptID executionAttemptID,
                                                       Iterable<PartitionInfo> partitionInfos,
                                                       org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: TaskExecutorGateway

Update the task where the given partitions can be found.

指定者:

updatePartitions 在接口中 TaskExecutorGateway

参数:

executionAttemptID - identifying the task

partitionInfos - telling where the partition can be retrieved from

timeout - for the update partitions operation

返回:

Future acknowledge if the partitions have been successfully updated

releaseOrPromotePartitions

public void releaseOrPromotePartitions(org.apache.flink.api.common.JobID jobId,
                                       Set<ResultPartitionID> partitionToRelease,
                                       Set<ResultPartitionID> partitionsToPromote)

从接口复制的说明: TaskExecutorGateway

Batch release/promote intermediate result partitions.

指定者:

releaseOrPromotePartitions 在接口中 TaskExecutorGateway

参数:

jobId - id of the job that the partitions belong to

partitionToRelease - partition ids to release

partitionsToPromote - partitions ids to promote

releaseClusterPartitions

public CompletableFuture<Acknowledge> releaseClusterPartitions(Collection<IntermediateDataSetID> dataSetsToRelease,
                                                               org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: TaskExecutorGateway

Releases all cluster partitions belong to any of the given data sets.

指定者:

releaseClusterPartitions 在接口中 TaskExecutorGateway

参数:

dataSetsToRelease - data sets for which all cluster partitions should be released

timeout - for the partitions release operation

返回:

Future acknowledge that the request was received

heartbeatFromJobManager

public CompletableFuture<Void> heartbeatFromJobManager(ResourceID resourceID,
                                                       AllocatedSlotReport allocatedSlotReport)

从接口复制的说明: TaskExecutorGateway

Heartbeat request from the job manager.

指定者:

heartbeatFromJobManager 在接口中 TaskExecutorGateway

参数:

resourceID - unique id of the job manager

返回:

future which is completed exceptionally if the operation fails

heartbeatFromResourceManager

public CompletableFuture<Void> heartbeatFromResourceManager(ResourceID resourceID)

从接口复制的说明: TaskExecutorGateway

Heartbeat request from the resource manager.

指定者:

heartbeatFromResourceManager 在接口中 TaskExecutorGateway

参数:

resourceID - unique id of the resource manager

返回:

future which is completed exceptionally if the operation fails

triggerCheckpoint

public CompletableFuture<Acknowledge> triggerCheckpoint(ExecutionAttemptID executionAttemptID,
                                                        long checkpointId,
                                                        long checkpointTimestamp,
                                                        CheckpointOptions checkpointOptions)

从接口复制的说明: TaskExecutorGateway

Trigger the checkpoint for the given task. The checkpoint is identified by the checkpoint ID and the checkpoint timestamp.

指定者:

triggerCheckpoint 在接口中 TaskExecutorGateway

参数:

executionAttemptID - identifying the task

checkpointId - unique id for the checkpoint

checkpointTimestamp - is the timestamp when the checkpoint has been initiated

checkpointOptions - for performing the checkpoint

返回:

Future acknowledge if the checkpoint has been successfully triggered

confirmCheckpoint

public CompletableFuture<Acknowledge> confirmCheckpoint(ExecutionAttemptID executionAttemptID,
                                                        long completedCheckpointId,
                                                        long completedCheckpointTimestamp,
                                                        long lastSubsumedCheckpointId)

从接口复制的说明: TaskExecutorGateway

Confirm a checkpoint for the given task. The checkpoint is identified by the checkpoint ID and the checkpoint timestamp.

指定者:

confirmCheckpoint 在接口中 TaskExecutorGateway

参数:

executionAttemptID - identifying the task

completedCheckpointId - unique id for the completed checkpoint

completedCheckpointTimestamp - is the timestamp when the checkpoint has been initiated

lastSubsumedCheckpointId - unique id for the checkpoint to be subsumed

返回:

Future acknowledge if the checkpoint has been successfully confirmed

abortCheckpoint

public CompletableFuture<Acknowledge> abortCheckpoint(ExecutionAttemptID executionAttemptID,
                                                      long checkpointId,
                                                      long latestCompletedCheckpointId,
                                                      long checkpointTimestamp)

从接口复制的说明: TaskExecutorGateway

Abort a checkpoint for the given task. The checkpoint is identified by the checkpoint ID and the checkpoint timestamp.

指定者:

abortCheckpoint 在接口中 TaskExecutorGateway

参数:

executionAttemptID - identifying the task

checkpointId - unique id for the checkpoint

latestCompletedCheckpointId - the id of the latest completed checkpoint

checkpointTimestamp - is the timestamp when the checkpoint has been initiated

返回:

Future acknowledge if the checkpoint has been successfully confirmed

requestSlot

public CompletableFuture<Acknowledge> requestSlot(SlotID slotId,
                                                  org.apache.flink.api.common.JobID jobId,
                                                  AllocationID allocationId,
                                                  ResourceProfile resourceProfile,
                                                  String targetAddress,
                                                  ResourceManagerId resourceManagerId,
                                                  org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: TaskExecutorGateway

Requests a slot from the TaskManager.

指定者:

requestSlot 在接口中 TaskExecutorGateway

参数:

slotId - slot id for the request

jobId - for which to request a slot

allocationId - id for the request

resourceProfile - of requested slot, used only for dynamic slot allocation and will be ignored otherwise

targetAddress - to which to offer the requested slots

resourceManagerId - current leader id of the ResourceManager

timeout - for the operation

返回:

answer to the slot request

freeSlot

public CompletableFuture<Acknowledge> freeSlot(AllocationID allocationId,
                                               Throwable cause,
                                               org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: TaskExecutorGateway

Frees the slot with the given allocation ID.

指定者:

freeSlot 在接口中 TaskExecutorGateway

参数:

allocationId - identifying the slot to free

cause - of the freeing operation

timeout - for the operation

返回:

Future acknowledge which is returned once the slot has been freed

freeInactiveSlots

public void freeInactiveSlots(org.apache.flink.api.common.JobID jobId,
                              org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: TaskExecutorGateway

Frees all currently inactive slot allocated for the given job.

指定者:

freeInactiveSlots 在接口中 TaskExecutorGateway

参数:

jobId - job for which all inactive slots should be released

timeout - for the operation

requestFileUploadByType

public CompletableFuture<TransientBlobKey> requestFileUploadByType(FileType fileType,
                                                                   org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: TaskExecutorGateway

Requests the file upload of the specified type to the cluster's BlobServer.

指定者:

requestFileUploadByType 在接口中 TaskExecutorGateway

参数:

fileType - to upload

timeout - for the asynchronous operation

返回:

Future which is completed with the TransientBlobKey of the uploaded file.

requestFileUploadByName

public CompletableFuture<TransientBlobKey> requestFileUploadByName(String fileName,
                                                                   org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: TaskExecutorGateway

Requests the file upload of the specified name to the cluster's BlobServer.

指定者:

requestFileUploadByName 在接口中 TaskExecutorGateway

参数:

fileName - to upload

timeout - for the asynchronous operation

返回:

Future which is completed with the TransientBlobKey of the uploaded file.

requestMetricQueryServiceAddress

public CompletableFuture<org.apache.flink.types.SerializableOptional<String>> requestMetricQueryServiceAddress(org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: TaskExecutorGateway

Returns the gateway of Metric Query Service on the TaskManager.

指定者:

requestMetricQueryServiceAddress 在接口中 TaskExecutorGateway

返回:

Future gateway of Metric Query Service on the TaskManager.

disconnectJobManager

public void disconnectJobManager(org.apache.flink.api.common.JobID jobId,
                                 Exception cause)

从接口复制的说明: TaskExecutorGateway

Disconnects the given JobManager from the TaskManager.

指定者:

disconnectJobManager 在接口中 TaskExecutorGateway

参数:

jobId - JobID for which the JobManager was the leader

cause - for the disconnection from the JobManager

disconnectResourceManager

public void disconnectResourceManager(Exception cause)

从接口复制的说明: TaskExecutorGateway

Disconnects the ResourceManager from the TaskManager.

指定者:

disconnectResourceManager 在接口中 TaskExecutorGateway

参数:

cause - for the disconnection from the ResourceManager

sendOperatorEventToTask

public CompletableFuture<Acknowledge> sendOperatorEventToTask(ExecutionAttemptID executionAttemptID,
                                                              OperatorID operatorId,
                                                              org.apache.flink.util.SerializedValue<OperatorEvent> evt)

从接口复制的说明: TaskExecutorOperatorEventGateway

Sends an operator event to an operator in a task executed by the Task Manager (Task Executor).

The reception is acknowledged (future is completed) when the event has been dispatched to the AbstractInvokable.dispatchOperatorEvent(OperatorID, SerializedValue) method. It is not guaranteed that the event is processed successfully within the implementation. These cases are up to the task and event sender to handle (for example with an explicit response message upon success, or by triggering failure/recovery upon exception).

指定者:

sendOperatorEventToTask 在接口中 TaskExecutorGateway

指定者:

sendOperatorEventToTask 在接口中 TaskExecutorOperatorEventGateway

requestThreadDump

public CompletableFuture<ThreadDumpInfo> requestThreadDump(org.apache.flink.api.common.time.Time timeout)

从接口复制的说明: TaskExecutorGateway

Requests the thread dump from this TaskManager.

指定者:

requestThreadDump 在接口中 TaskExecutorGateway

参数:

timeout - timeout for the asynchronous operation

返回:

the ThreadDumpInfo for this TaskManager.

getResourceID

public ResourceID getResourceID()