org.apache.tez.dag.app.dag.impl

Class TaskImpl

java.lang.Object

org.apache.tez.dag.app.dag.impl.TaskImpl

All Implemented Interfaces:

org.apache.hadoop.yarn.event.EventHandler<TaskEvent>, Task, DAGIDAware, TaskIDAware, VertexIDAware

public class TaskImpl
extends Object
implements Task, org.apache.hadoop.yarn.event.EventHandler<TaskEvent>

Implementation of Task interface.

Field Summary

Fields

Modifier and Type	Field and Description
protected AppContext	appContext
protected org.apache.hadoop.yarn.util.Clock	clock
protected org.apache.hadoop.conf.Configuration	conf
protected org.apache.hadoop.yarn.event.EventHandler	eventHandler
protected int	maxAttempts
protected int	maxFailedAttempts
protected TaskCommunicatorManagerInterface	taskCommunicatorManagerInterface
protected TaskHeartbeatHandler	taskHeartbeatHandler

Constructor Summary

Constructors

Constructor and Description

TaskImpl(TezVertexID vertexId, int taskIndex, org.apache.hadoop.yarn.event.EventHandler eventHandler, org.apache.hadoop.conf.Configuration conf, TaskCommunicatorManagerInterface taskCommunicatorManagerInterface, org.apache.hadoop.yarn.util.Clock clock, TaskHeartbeatHandler thh, AppContext appContext, boolean leafVertex, org.apache.hadoop.yarn.api.records.Resource resource, ContainerContext containerContext, StateChangeNotifier stateChangeNotifier, Vertex vertex)

Method Summary

Modifier and Type	Method and Description
boolean	canCommit(TezTaskAttemptID taskAttemptID) Can the output of the taskAttempt be committed.
TaskAttempt	getAttempt(TezTaskAttemptID attemptID)
Map<TezTaskAttemptID,TaskAttempt>	getAttempts()
TaskSpec	getBaseTaskSpec()
TezCounters	getCounters()
List<String>	getDiagnostics()
long	getFinishTime()
long	getFirstAttemptStartTime()
TaskStateInternal	getInternalState()
Set<org.apache.hadoop.yarn.api.records.NodeId>	getNodesWithRunningAttempts()
float	getProgress()
TaskReport	getReport()
protected String	getSplitsAsString()
TaskState	getState()
TaskAttempt	getSuccessfulAttempt()
ArrayList<TezEvent>	getTaskAttemptTezEvents(TezTaskAttemptID attemptID, int fromEventId, int maxEvents)
TezTaskID	getTaskID()
TaskLocationHint	getTaskLocationHint()
Vertex	getVertex()
void	handle(TaskEvent event)
protected void	internalError(TaskEventType type)
protected void	internalErrorUncaughtException(TaskEventType type, Exception e)
boolean	isFinished() Has Task reached the final state or not.
protected void	logJobHistoryTaskFailedEvent(TaskState finalState)
protected void	logJobHistoryTaskFinishedEvent()
protected void	logJobHistoryTaskStartedEvent()
void	registerTezEvent(TezEvent tezEvent)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.tez.dag.records.TaskIDAware

getVertexID

Methods inherited from interface org.apache.tez.dag.records.VertexIDAware

getDAGID

Methods inherited from interface org.apache.tez.dag.records.DAGIDAware

getApplicationId

Field Detail

conf

protected final org.apache.hadoop.conf.Configuration conf

taskCommunicatorManagerInterface

protected final TaskCommunicatorManagerInterface taskCommunicatorManagerInterface

taskHeartbeatHandler

protected final TaskHeartbeatHandler taskHeartbeatHandler

eventHandler

protected final org.apache.hadoop.yarn.event.EventHandler eventHandler

maxFailedAttempts

protected final int maxFailedAttempts

maxAttempts

protected final int maxAttempts

clock

protected final org.apache.hadoop.yarn.util.Clock clock

appContext

protected final AppContext appContext

Constructor Detail

TaskImpl

public TaskImpl(TezVertexID vertexId,
                int taskIndex,
                org.apache.hadoop.yarn.event.EventHandler eventHandler,
                org.apache.hadoop.conf.Configuration conf,
                TaskCommunicatorManagerInterface taskCommunicatorManagerInterface,
                org.apache.hadoop.yarn.util.Clock clock,
                TaskHeartbeatHandler thh,
                AppContext appContext,
                boolean leafVertex,
                org.apache.hadoop.yarn.api.records.Resource resource,
                ContainerContext containerContext,
                StateChangeNotifier stateChangeNotifier,
                Vertex vertex)

Method Detail

getState

public TaskState getState()

Specified by:

getState in interface Task

getAttempts

public Map<TezTaskAttemptID,TaskAttempt> getAttempts()

Specified by:

getAttempts in interface Task

getAttempt

public TaskAttempt getAttempt(TezTaskAttemptID attemptID)

Specified by:

getAttempt in interface Task

getVertex

public Vertex getVertex()

Specified by:

getVertex in interface Task

getTaskID

public TezTaskID getTaskID()

Specified by:

getTaskID in interface TaskIDAware

isFinished

public boolean isFinished()

Description copied from interface: Task

Has Task reached the final state or not.

Specified by:

isFinished in interface Task

getReport

public TaskReport getReport()

Specified by:

getReport in interface Task

getCounters

public TezCounters getCounters()

Specified by:

getCounters in interface Task

getProgress

public float getProgress()

Specified by:

getProgress in interface Task

getTaskAttemptTezEvents

public ArrayList<TezEvent> getTaskAttemptTezEvents(TezTaskAttemptID attemptID,
                                                   int fromEventId,
                                                   int maxEvents)

Specified by:

getTaskAttemptTezEvents in interface Task

getBaseTaskSpec

public TaskSpec getBaseTaskSpec()

Specified by:

getBaseTaskSpec in interface Task

getTaskLocationHint

public TaskLocationHint getTaskLocationHint()

Specified by:

getTaskLocationHint in interface Task

getDiagnostics

public List<String> getDiagnostics()

Specified by:

getDiagnostics in interface Task

getFinishTime

public long getFinishTime()

Specified by:

getFinishTime in interface Task

getNodesWithRunningAttempts

public Set<org.apache.hadoop.yarn.api.records.NodeId> getNodesWithRunningAttempts()

Specified by:

getNodesWithRunningAttempts in interface Task

Returns:

set of nodes on which previous attempts were running on, at the time of latest attempt being scheduled.

getInternalState

public TaskStateInternal getInternalState()

canCommit

public boolean canCommit(TezTaskAttemptID taskAttemptID)

Description copied from interface: Task

Can the output of the taskAttempt be committed. Note that once the task gives a go for a commit, further canCommit requests from any other attempts should return false.

Specified by:

canCommit in interface Task

Returns:

whether the attempt's output can be committed or not.

getSuccessfulAttempt

public TaskAttempt getSuccessfulAttempt()

Specified by:

getSuccessfulAttempt in interface Task

handle

public void handle(TaskEvent event)

Specified by:

handle in interface org.apache.hadoop.yarn.event.EventHandler<TaskEvent>

internalError

protected void internalError(TaskEventType type)

internalErrorUncaughtException

protected void internalErrorUncaughtException(TaskEventType type,
                                              Exception e)

getSplitsAsString

protected String getSplitsAsString()

Returns:

a String representation of the splits. Subclasses can override this method to provide their own representations of splits (if any).

logJobHistoryTaskStartedEvent

protected void logJobHistoryTaskStartedEvent()

logJobHistoryTaskFinishedEvent

protected void logJobHistoryTaskFinishedEvent()

logJobHistoryTaskFailedEvent

protected void logJobHistoryTaskFailedEvent(TaskState finalState)

registerTezEvent

public void registerTezEvent(TezEvent tezEvent)

Specified by:

registerTezEvent in interface Task

getFirstAttemptStartTime

public long getFirstAttemptStartTime()

Specified by:

getFirstAttemptStartTime in interface Task