org.apache.flink.runtime.taskmanager

Class TaskManager

java.lang.Object

org.apache.flink.runtime.taskmanager.TaskManager

All Implemented Interfaces:

VersionedProtocol, TaskOperationProtocol

public class TaskManager
extends Object
implements TaskOperationProtocol

A task manager receives tasks from the job manager and executes them. After having executed them (or in case of an execution error) it reports the execution result back to the job manager. Task managers are able to automatically discover the job manager and receive its configuration from it as long as the job manager is running on the same local network

Field Summary

Fields

Modifier and Type	Field and Description
static String	ARG_CONF_DIR

Constructor Summary

Constructors

Constructor and Description
TaskManager(ExecutionMode executionMode) All parameters are obtained from the GlobalConfiguration, which must be loaded prior to instantiating the task manager.

Method Summary

Methods

Modifier and Type	Method and Description
TaskCancelResult	cancelTask(ExecutionVertexID id) Advises the task manager to cancel the task with the given ID.
void	executionStateChanged(JobID jobID, ExecutionVertexID id, ExecutionState newExecutionState, String optionalDescription)
LibraryCacheProfileResponse	getLibraryCacheProfile(LibraryCacheProfileRequest request) Queries the task manager about the cache status of the libraries stated in the LibraryCacheProfileRequest object.
void	invalidateLookupCacheEntries(Set<ChannelID> channelIDs) Invalidates the entries identified by the given channel IDs from the task manager's receiver lookup cache.
boolean	isShutDown() Checks whether the task manager has already been shut down.
TaskKillResult	killTask(ExecutionVertexID id) Advises the task manager to kill the task with the given ID.
void	killTaskManager() Kills the task manager.
void	logBufferUtilization() Triggers the task manager write the current utilization of its read and write buffers to its logs.
static void	main(String[] args) Entry point for the program.
void	shutdown() Shuts the task manager down.
List<TaskSubmissionResult>	submitTasks(List<TaskDeploymentDescriptor> tasks) Submits a list of tasks to the task manager.
static boolean	tryToConnect(InetAddress fromAddress, SocketAddress toSocket, int timeout)
void	updateLibraryCache(LibraryCacheUpdate update) Updates the task manager's library cache.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

ARG_CONF_DIR

public static final String ARG_CONF_DIR

See Also:

Constant Field Values

Constructor Detail

TaskManager

public TaskManager(ExecutionMode executionMode)
            throws Exception

All parameters are obtained from the GlobalConfiguration, which must be loaded prior to instantiating the task manager.

Throws:

Exception

Method Detail

main

public static void main(String[] args)
                 throws IOException

Entry point for the program.

Parameters:

args - arguments from the command line

Throws:

IOException

tryToConnect

public static boolean tryToConnect(InetAddress fromAddress,
                   SocketAddress toSocket,
                   int timeout)
                            throws IOException

Throws:

IOException

cancelTask

public TaskCancelResult cancelTask(ExecutionVertexID id)
                            throws IOException

Description copied from interface: TaskOperationProtocol

Advises the task manager to cancel the task with the given ID.

Specified by:

cancelTask in interface TaskOperationProtocol

Parameters:

id - the ID of the task to cancel

Returns:

the result of the task cancel attempt

Throws:

IOException - thrown if an error occurs during this remote procedure call

killTask

public TaskKillResult killTask(ExecutionVertexID id)
                        throws IOException

Description copied from interface: TaskOperationProtocol

Advises the task manager to kill the task with the given ID.

Specified by:

killTask in interface TaskOperationProtocol

Parameters:

id - the ID of the task to kill

Returns:

the result of the task kill attempt

Throws:

IOException - thrown if an error occurs during this remote procedure call

submitTasks

public List<TaskSubmissionResult> submitTasks(List<TaskDeploymentDescriptor> tasks)
                                       throws IOException

Description copied from interface: TaskOperationProtocol

Submits a list of tasks to the task manager.

Specified by:

submitTasks in interface TaskOperationProtocol

Parameters:

tasks - the tasks to be submitted

Returns:

the result of the task submission

Throws:

IOException - thrown if an error occurs during this remote procedure call

getLibraryCacheProfile

public LibraryCacheProfileResponse getLibraryCacheProfile(LibraryCacheProfileRequest request)
                                                   throws IOException

Description copied from interface: TaskOperationProtocol

Queries the task manager about the cache status of the libraries stated in the LibraryCacheProfileRequest object.

Specified by:

getLibraryCacheProfile in interface TaskOperationProtocol

Parameters:

request - a LibraryCacheProfileRequest containing a list of libraries whose cache status is to be determined

Returns:

a LibraryCacheProfileResponse containing the cache status for each library included in the request

Throws:

IOException - thrown if an error occurs during this remote procedure call

updateLibraryCache

public void updateLibraryCache(LibraryCacheUpdate update)
                        throws IOException

Description copied from interface: TaskOperationProtocol

Updates the task manager's library cache.

Specified by:

updateLibraryCache in interface TaskOperationProtocol

Parameters:

update - a LibraryCacheUpdate object used to transmit the library data

Throws:

IOException - thrown if an error occurs during this remote procedure call

executionStateChanged

public void executionStateChanged(JobID jobID,
                         ExecutionVertexID id,
                         ExecutionState newExecutionState,
                         String optionalDescription)

shutdown

public void shutdown()

Shuts the task manager down.

isShutDown

public boolean isShutDown()

Checks whether the task manager has already been shut down.

Returns:

true if the task manager has already been shut down, false otherwise

logBufferUtilization

public void logBufferUtilization()

Description copied from interface: TaskOperationProtocol

Triggers the task manager write the current utilization of its read and write buffers to its logs. This method is primarily for debugging purposes.

Specified by:

logBufferUtilization in interface TaskOperationProtocol

killTaskManager

public void killTaskManager()
                     throws IOException

Description copied from interface: TaskOperationProtocol

Kills the task manager. This method is mainly intended to test and debug Nephele's fault tolerance mechanisms.

Specified by:

killTaskManager in interface TaskOperationProtocol

Throws:

IOException - thrown if an error occurs during this remote procedure call

invalidateLookupCacheEntries

public void invalidateLookupCacheEntries(Set<ChannelID> channelIDs)
                                  throws IOException

Description copied from interface: TaskOperationProtocol

Invalidates the entries identified by the given channel IDs from the task manager's receiver lookup cache.

Specified by:

invalidateLookupCacheEntries in interface TaskOperationProtocol

Parameters:

channelIDs - the channel IDs identifying the cache entries to invalidate

Throws:

IOException - thrown if an error occurs during this remote procedure call