org.apache.flink.runtime.resourcemanager.active

类 ActiveResourceManager<WorkerType extends ResourceIDRetrievable>

java.lang.Object

org.apache.flink.runtime.rpc.RpcEndpoint

org.apache.flink.runtime.rpc.FencedRpcEndpoint<ResourceManagerId>

org.apache.flink.runtime.resourcemanager.ResourceManager<WorkerType>

org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager<WorkerType>

所有已实现的接口:

AutoCloseable, ClusterPartitionManager, ResourceEventHandler<WorkerType>, ResourceManagerGateway, org.apache.flink.runtime.rpc.FencedRpcGateway<ResourceManagerId>, org.apache.flink.runtime.rpc.RpcGateway, org.apache.flink.util.AutoCloseableAsync

public class ActiveResourceManager<WorkerType extends ResourceIDRetrievable>
extends ResourceManager<WorkerType>
implements ResourceEventHandler<WorkerType>

An active implementation of ResourceManager.

This resource manager actively requests and releases resources from/to the external resource management frameworks. With different ResourceManagerDriver provided, this resource manager can work with various frameworks.

嵌套类概要

从类继承的嵌套类/接口 org.apache.flink.runtime.rpc.RpcEndpoint

org.apache.flink.runtime.rpc.RpcEndpoint.MainThreadExecutor

字段概要

字段

限定符和类型	字段和说明
protected org.apache.flink.configuration.Configuration	flinkConfig

从类继承的字段 org.apache.flink.runtime.resourcemanager.ResourceManager

ioExecutor, RESOURCE_MANAGER_NAME, resourceManagerMetricGroup

从类继承的字段 org.apache.flink.runtime.rpc.RpcEndpoint

log, rpcServer

构造器概要

构造器

构造器和说明

ActiveResourceManager(ResourceManagerDriver<WorkerType> resourceManagerDriver, org.apache.flink.configuration.Configuration flinkConfig, org.apache.flink.runtime.rpc.RpcService rpcService, UUID leaderSessionId, ResourceID resourceId, HeartbeatServices heartbeatServices, SlotManager slotManager, ResourceManagerPartitionTrackerFactory clusterPartitionTrackerFactory, JobLeaderIdService jobLeaderIdService, ClusterInformation clusterInformation, org.apache.flink.runtime.rpc.FatalErrorHandler fatalErrorHandler, ResourceManagerMetricGroup resourceManagerMetricGroup, ThresholdMeter startWorkerFailureRater, java.time.Duration retryInterval, java.time.Duration workerRegistrationTimeout, Executor ioExecutor)

方法概要

限定符和类型	方法和说明
protected void	initialize() Initializes the framework specific components.
protected void	internalDeregisterApplication(ApplicationStatus finalStatus, String optionalDiagnostics) The framework specific code to deregister the application.
void	onError(Throwable exception) Notifies that an error has occurred that the process cannot proceed.
void	onPreviousAttemptWorkersRecovered(Collection<WorkerType> recoveredWorkers) Notifies that workers of previous attempt have been recovered from the external resource manager.
protected void	onWorkerRegistered(WorkerType worker)
void	onWorkerTerminated(ResourceID resourceId, String diagnostics) Notifies that the worker has been terminated.
protected void	registerMetrics()
boolean	startNewWorker(WorkerResourceSpec workerResourceSpec) Allocates a resource using the worker resource specification.
boolean	stopWorker(WorkerType worker) Stops the given worker.
protected void	terminate() Terminates the framework specific components.
protected WorkerType	workerStarted(ResourceID resourceID) Callback when a worker was started.

从类继承的方法 org.apache.flink.runtime.resourcemanager.ResourceManager

closeJobManagerConnection, closeTaskManagerConnection, declareRequiredResources, deregisterApplication, disconnectJobManager, disconnectTaskManager, getNumberOfRegisteredTaskManagers, getRequiredResources, getStartedFuture, heartbeatFromJobManager, heartbeatFromTaskManager, jobLeaderLostLeadership, listDataSets, notifySlotAvailable, onFatalError, onStart, onStop, registerJobMaster, registerTaskExecutor, releaseClusterPartitions, releaseResource, removeJob, requestResourceOverview, requestTaskExecutorThreadInfoGateway, requestTaskManagerDetailsInfo, requestTaskManagerFileUploadByName, requestTaskManagerFileUploadByType, requestTaskManagerInfo, requestTaskManagerLogList, requestTaskManagerMetricQueryServiceAddresses, requestThreadDump, sendSlotReport, setFailUnfulfillableRequest

从类继承的方法 org.apache.flink.runtime.rpc.FencedRpcEndpoint

callAsyncWithoutFencing, getFencingToken, getMainThreadExecutor, getUnfencedMainThreadExecutor, runAsyncWithoutFencing, setFencingToken

从类继承的方法 org.apache.flink.runtime.rpc.RpcEndpoint

callAsync, closeAsync, getAddress, getEndpointId, getHostname, getRpcService, getSelfGateway, getTerminationFuture, internalCallOnStart, internalCallOnStop, isRunning, runAsync, scheduleRunAsync, scheduleRunAsync, start, stop, validateRunsInMainThread

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.runtime.rpc.FencedRpcGateway

getFencingToken

从接口继承的方法 org.apache.flink.runtime.rpc.RpcGateway

getAddress, getHostname

从接口继承的方法 org.apache.flink.util.AutoCloseableAsync

close

字段详细资料

flinkConfig

protected final org.apache.flink.configuration.Configuration flinkConfig

构造器详细资料

ActiveResourceManager

public ActiveResourceManager(ResourceManagerDriver<WorkerType> resourceManagerDriver,
                             org.apache.flink.configuration.Configuration flinkConfig,
                             org.apache.flink.runtime.rpc.RpcService rpcService,
                             UUID leaderSessionId,
                             ResourceID resourceId,
                             HeartbeatServices heartbeatServices,
                             SlotManager slotManager,
                             ResourceManagerPartitionTrackerFactory clusterPartitionTrackerFactory,
                             JobLeaderIdService jobLeaderIdService,
                             ClusterInformation clusterInformation,
                             org.apache.flink.runtime.rpc.FatalErrorHandler fatalErrorHandler,
                             ResourceManagerMetricGroup resourceManagerMetricGroup,
                             ThresholdMeter startWorkerFailureRater,
                             java.time.Duration retryInterval,
                             java.time.Duration workerRegistrationTimeout,
                             Executor ioExecutor)

方法详细资料

initialize

protected void initialize()
                   throws ResourceManagerException

从类复制的说明: ResourceManager

Initializes the framework specific components.

指定者:

initialize 在类中 ResourceManager<WorkerType extends ResourceIDRetrievable>

抛出:

ResourceManagerException - which occurs during initialization and causes the resource manager to fail.

terminate

protected void terminate()
                  throws ResourceManagerException

从类复制的说明: ResourceManager

Terminates the framework specific components.

指定者:

terminate 在类中 ResourceManager<WorkerType extends ResourceIDRetrievable>

抛出:

ResourceManagerException

internalDeregisterApplication

protected void internalDeregisterApplication(ApplicationStatus finalStatus,
                                             @Nullable
                                             String optionalDiagnostics)
                                      throws ResourceManagerException

从类复制的说明: ResourceManager

The framework specific code to deregister the application. This should report the application's final status and shut down the resource manager cleanly.

This method also needs to make sure all pending containers that are not registered yet are returned.

指定者:

internalDeregisterApplication 在类中 ResourceManager<WorkerType extends ResourceIDRetrievable>

参数:

finalStatus - The application status to report.

optionalDiagnostics - A diagnostics message or null.

抛出:

ResourceManagerException - if the application could not be shut down.

startNewWorker

public boolean startNewWorker(WorkerResourceSpec workerResourceSpec)

从类复制的说明: ResourceManager

Allocates a resource using the worker resource specification.

指定者:

startNewWorker 在类中 ResourceManager<WorkerType extends ResourceIDRetrievable>

参数:

workerResourceSpec - workerResourceSpec specifies the size of the to be allocated resource

返回:

whether the resource can be allocated

workerStarted

protected WorkerType workerStarted(ResourceID resourceID)

从类复制的说明: ResourceManager

Callback when a worker was started.

指定者:

workerStarted 在类中 ResourceManager<WorkerType extends ResourceIDRetrievable>

参数:

resourceID - The worker resource id

stopWorker

public boolean stopWorker(WorkerType worker)

从类复制的说明: ResourceManager

Stops the given worker.

指定者:

stopWorker 在类中 ResourceManager<WorkerType extends ResourceIDRetrievable>

参数:

worker - The worker.

返回:

True if the worker was stopped, otherwise false

onWorkerRegistered

protected void onWorkerRegistered(WorkerType worker)

覆盖:

onWorkerRegistered 在类中 ResourceManager<WorkerType extends ResourceIDRetrievable>

registerMetrics

protected void registerMetrics()

覆盖:

registerMetrics 在类中 ResourceManager<WorkerType extends ResourceIDRetrievable>

onPreviousAttemptWorkersRecovered

public void onPreviousAttemptWorkersRecovered(Collection<WorkerType> recoveredWorkers)

从接口复制的说明: ResourceEventHandler

Notifies that workers of previous attempt have been recovered from the external resource manager.

指定者:

onPreviousAttemptWorkersRecovered 在接口中 ResourceEventHandler<WorkerType extends ResourceIDRetrievable>

参数:

recoveredWorkers - Collection of worker nodes, in the deployment specific type.

onWorkerTerminated

public void onWorkerTerminated(ResourceID resourceId,
                               String diagnostics)

从接口复制的说明: ResourceEventHandler

Notifies that the worker has been terminated.

See also ResourceManagerDriver.requestResource(org.apache.flink.runtime.clusterframework.TaskExecutorProcessSpec).

指定者:

onWorkerTerminated 在接口中 ResourceEventHandler<WorkerType extends ResourceIDRetrievable>

参数:

resourceId - Identifier of the terminated worker.

diagnostics - Diagnostic message about the worker termination.

onError

public void onError(Throwable exception)

从接口复制的说明: ResourceEventHandler

Notifies that an error has occurred that the process cannot proceed.

指定者:

onError 在接口中 ResourceEventHandler<WorkerType extends ResourceIDRetrievable>

参数:

exception - Exception that describes the error.