| Modifier and Type | Method and Description |
|---|---|
JobID |
AccumulatorEvent.getJobID() |
| Constructor and Description |
|---|
AccumulatorEvent(JobID jobID,
Map<String,Accumulator<?,?>> accumulators) |
| Modifier and Type | Method and Description |
|---|---|
JobID |
TaskDeploymentDescriptor.getJobID()
Returns the ID of the job the tasks belongs to.
|
| Constructor and Description |
|---|
TaskDeploymentDescriptor(JobID jobID,
ExecutionVertexID vertexID,
String taskName,
int indexInSubtaskGroup,
int currentNumberOfSubtasks,
Configuration jobConfiguration,
Configuration taskConfiguration,
Class<? extends AbstractInvokable> invokableClass,
SerializableArrayList<GateDeploymentDescriptor> outputGates,
SerializableArrayList<GateDeploymentDescriptor> inputGates)
Constructs a task deployment descriptor.
|
| Modifier and Type | Method and Description |
|---|---|
JobID |
RecentJobEvent.getJobID()
Returns the ID of the new job.
|
| Constructor and Description |
|---|
RecentJobEvent(JobID jobID,
String jobName,
JobStatus jobStatus,
boolean isProfilingEnabled,
long submissionTimestamp,
long timestamp)
Constructs a new event.
|
| Modifier and Type | Method and Description |
|---|---|
JobID |
Environment.getJobID()
Returns the ID of the job from the original job graph.
|
JobID |
RuntimeEnvironment.getJobID() |
| Modifier and Type | Method and Description |
|---|---|
void |
ExecutionListener.executionStateChanged(JobID jobID,
ExecutionVertexID vertexID,
ExecutionState newExecutionState,
String optionalMessage)
Called when the execution state of the associated task has changed.
|
void |
ExecutionListener.userThreadFinished(JobID jobID,
ExecutionVertexID vertexID,
Thread userThread)
Called when a thread spawn by a user task has finished.
|
void |
ExecutionListener.userThreadStarted(JobID jobID,
ExecutionVertexID vertexID,
Thread userThread)
Called when the user task has started a new thread.
|
| Modifier and Type | Method and Description |
|---|---|
static void |
LibraryCacheManager.addLibrary(JobID jobID,
Path name,
long size,
DataInput in)
Reads a library from the given input stream and adds it to the local library cache.
|
static ClassLoader |
LibraryCacheManager.getClassLoader(JobID id)
Returns the class loader to the specified vertex.
|
static String[] |
LibraryCacheManager.getRequiredJarFiles(JobID id)
Returns the names of the required libraries of the specified job.
|
static void |
LibraryCacheManager.register(JobID id,
Path[] clientPaths)
Registers a job ID with a set of library paths that are required to run the job.
|
static void |
LibraryCacheManager.register(JobID id,
String[] requiredJarFiles)
Registers a job ID with a set of library paths that are required to run the job.
|
static void |
LibraryCacheManager.unregister(JobID id)
Unregisters a job ID and releases the resources associated with it.
|
| Modifier and Type | Method and Description |
|---|---|
JobID |
ExecutionGraph.getJobID()
Returns the job ID of the job configuration this execution graph was originally constructed from.
|
| Modifier and Type | Method and Description |
|---|---|
static ExecutionSignature |
ExecutionSignature.createSignature(Class<? extends AbstractInvokable> invokableClass,
JobID jobID)
Calculates the execution signature from the given class name and job ID.
|
void |
ExecutionGraph.executionStateChanged(JobID jobID,
ExecutionVertexID vertexID,
ExecutionState newExecutionState,
String optionalMessage) |
void |
ExecutionStageListener.nextExecutionStageEntered(JobID jobID,
ExecutionStage executionStage)
This method is called to indicate that the job with the given
JobID has finished its previous
ExecutionStage and has entered the next ExecutionStage. |
void |
ExecutionGraph.userThreadFinished(JobID jobID,
ExecutionVertexID vertexID,
Thread userThread) |
void |
ExecutionGraph.userThreadStarted(JobID jobID,
ExecutionVertexID vertexID,
Thread userThread) |
| Modifier and Type | Method and Description |
|---|---|
FutureTask<Path> |
FileCache.createTmpFile(String name,
DistributedCache.DistributedCacheEntry entry,
JobID jobID)
If the file doesn't exists locally, it will copy the file to the temp directory.
|
void |
FileCache.deleteTmpFile(String name,
DistributedCache.DistributedCacheEntry entry,
JobID jobID)
Deletes the local file after a 5 second delay.
|
Path |
FileCache.getTempDir(JobID jobID,
String childPath) |
| Modifier and Type | Method and Description |
|---|---|
JobID |
AllocatedSlot.getJobID()
Returns the ID of the job this allocated slice belongs to.
|
| Modifier and Type | Method and Description |
|---|---|
void |
InstanceListener.allocatedResourcesDied(JobID jobID,
List<AllocatedResource> allocatedResource)
Called if one or more allocated resources assigned to at least one job have died unexpectedly.
|
AllocatedResource |
Instance.allocateSlot(JobID jobID) |
void |
Instance.checkLibraryAvailability(JobID jobID)
Checks if all the libraries required to run the job with the given
job ID are available on this instance.
|
NetworkTopology |
InstanceManager.getNetworkTopology(JobID jobID) |
NetworkTopology |
DefaultInstanceManager.getNetworkTopology(JobID jobID) |
void |
InstanceManager.requestInstance(JobID jobID,
Configuration conf,
int requiredSlots) |
void |
DefaultInstanceManager.requestInstance(JobID jobID,
Configuration conf,
int requiredSlots) |
void |
InstanceListener.resourcesAllocated(JobID jobID,
List<AllocatedResource> allocatedResources)
Called if one or more requested resources have become available.
|
| Constructor and Description |
|---|
AllocatedSlot(JobID jobID)
Creates a new allocated slice on the given hosting instance.
|
InstanceNotifier(InstanceListener instanceListener,
JobID jobID,
List<AllocatedResource> allocatedResources)
Constructs a new instance notifier object.
|
| Modifier and Type | Method and Description |
|---|---|
JobID |
Envelope.getJobID() |
| Modifier and Type | Method and Description |
|---|---|
BufferProvider |
ChannelManager.getBufferProvider(JobID jobID,
ChannelID sourceChannelID) |
| Constructor and Description |
|---|
Envelope(int sequenceNumber,
JobID jobID,
ChannelID source) |
| Modifier and Type | Method and Description |
|---|---|
BufferProvider |
BufferProviderBroker.getBufferProvider(JobID jobID,
ChannelID sourceChannelID) |
| Modifier and Type | Method and Description |
|---|---|
JobID |
OutputChannel.getJobID() |
JobID |
InputChannel.getJobID() |
abstract JobID |
Channel.getJobID() |
| Modifier and Type | Method and Description |
|---|---|
JobID |
Gate.getJobID() |
| Constructor and Description |
|---|
Gate(JobID jobID,
GateID gateID,
int index)
Constructs a new abstract gate
|
InputGate(JobID jobID,
GateID gateID,
int index)
Constructs a new runtime input gate.
|
OutputGate(JobID jobId,
GateID gateId,
int index)
Constructs a new output gate.
|
| Modifier and Type | Method and Description |
|---|---|
static JobID |
JobID.fromByteArray(byte[] bytes) |
static JobID |
JobID.fromByteBuffer(ByteBuffer buf) |
static JobID |
JobID.fromByteBuffer(ByteBuffer buf,
int offset) |
static JobID |
JobID.fromHexString(String hexString) |
static JobID |
JobID.generate() |
JobID |
JobGraph.getJobID()
Returns the ID of the job.
|
| Modifier and Type | Method and Description |
|---|---|
JobCancelResult |
JobManager.cancelJob(JobID jobID) |
void |
DeploymentManager.deploy(JobID jobID,
Instance instance,
List<ExecutionVertex> verticesToBeDeployed)
Deploys the list of vertices on the given
Instance. |
void |
JobManager.deploy(JobID jobID,
Instance instance,
List<ExecutionVertex> verticesToBeDeployed) |
AccumulatorEvent |
JobManager.getAccumulatorResults(JobID jobID) |
Map<String,Accumulator<?,?>> |
JobManager.getAccumulators(JobID jobID) |
List<AbstractEvent> |
JobManager.getEvents(JobID jobID) |
void |
EventCollector.getEventsForJob(JobID jobID,
List<AbstractEvent> eventList,
boolean includeManagementEvents)
Retrieves and adds the collected events for the job with the given job ID to the provided list.
|
JobProgressResult |
JobManager.getJobProgress(JobID jobID) |
ManagementGraph |
JobManager.getManagementGraph(JobID jobID)
Returns current ManagementGraph from eventCollector and, if not current, from archive
Retrieves the management graph for the job
with the given ID.
|
ManagementGraph |
EventCollector.getManagementGraph(JobID jobID)
Returns the
ManagementGraph object for the job with the given ID from the map of recently created
management graphs. |
NetworkTopology |
JobManager.getNetworkTopology(JobID jobID) |
void |
JobManager.killTask(JobID jobID,
ManagementVertexID id) |
void |
JobManager.logBufferUtilization(JobID jobID) |
ConnectionInfoLookupResponse |
JobManager.lookupConnectionInfo(InstanceConnectionInfo caller,
JobID jobID,
ChannelID sourceChannelID) |
InputSplitWrapper |
JobManager.requestNextInputSplit(JobID jobID,
ExecutionVertexID vertexID,
IntegerRecord sequenceNumber) |
| Modifier and Type | Method and Description |
|---|---|
Map<String,Accumulator<?,?>> |
AccumulatorManager.getJobAccumulators(JobID jobID)
Returns all collected accumulators for the job.
|
void |
AccumulatorManager.processIncomingAccumulators(JobID jobID,
Map<String,Accumulator<?,?>> newAccumulators)
Merges the new accumulators with the existing accumulators collected for
the job.
|
| Modifier and Type | Method and Description |
|---|---|
void |
ArchiveListener.archiveEvent(JobID jobId,
AbstractEvent event)
Stores event in archive
|
void |
MemoryArchivist.archiveEvent(JobID jobId,
AbstractEvent event) |
void |
ArchiveListener.archiveJobevent(JobID jobId,
RecentJobEvent event)
Stores old job in archive
|
void |
MemoryArchivist.archiveJobevent(JobID jobId,
RecentJobEvent event) |
void |
ArchiveListener.archiveManagementGraph(JobID jobId,
ManagementGraph graph)
Stores old ManagementGraph in archive
|
void |
MemoryArchivist.archiveManagementGraph(JobID jobId,
ManagementGraph graph) |
void |
ArchiveListener.archiveNetworkTopology(JobID jobId,
NetworkTopology topology)
Stores old NetworkTopology in Archive
|
void |
MemoryArchivist.archiveNetworkTopology(JobID jobId,
NetworkTopology topology) |
List<AbstractEvent> |
ArchiveListener.getEvents(JobID jobID)
Get all archived Events for a job
|
List<AbstractEvent> |
MemoryArchivist.getEvents(JobID jobID) |
RecentJobEvent |
ArchiveListener.getJob(JobID JobId)
Return archived job
|
RecentJobEvent |
MemoryArchivist.getJob(JobID jobId) |
long |
ArchiveListener.getJobTime(JobID jobID,
JobStatus jobStatus)
Returns the time when the status of the given job changed to jobStatus
|
long |
MemoryArchivist.getJobTime(JobID jobID,
JobStatus jobStatus) |
ManagementGraph |
ArchiveListener.getManagementGraph(JobID jobID)
Get archived ManagementGraph for a job
|
ManagementGraph |
MemoryArchivist.getManagementGraph(JobID jobID) |
long |
ArchiveListener.getVertexTime(JobID jobID,
ManagementVertexID jobVertexID,
ExecutionState executionState)
returns the time, when the status of the given vertex changed to executionState
|
long |
MemoryArchivist.getVertexTime(JobID jobID,
ManagementVertexID jobVertexID,
ExecutionState executionState) |
| Modifier and Type | Method and Description |
|---|---|
void |
DefaultScheduler.allocatedResourcesDied(JobID jobID,
List<AllocatedResource> allocatedResources) |
void |
DefaultExecutionListener.executionStateChanged(JobID jobID,
ExecutionVertexID vertexID,
ExecutionState newExecutionState,
String optionalMessage) |
ExecutionGraph |
DefaultScheduler.getExecutionGraphByID(JobID jobID)
Returns the execution graph which is associated with the given job ID.
|
void |
DefaultScheduler.nextExecutionStageEntered(JobID jobID,
ExecutionStage executionStage) |
void |
DefaultScheduler.resourcesAllocated(JobID jobID,
List<AllocatedResource> allocatedResources) |
void |
DefaultExecutionListener.userThreadFinished(JobID jobID,
ExecutionVertexID vertexID,
Thread userThread) |
void |
DefaultExecutionListener.userThreadStarted(JobID jobID,
ExecutionVertexID vertexID,
Thread userThread) |
| Constructor and Description |
|---|
InputSplitWrapper(JobID jobID,
InputSplit inputSplit)
Constructs a new input split wrapper.
|
| Modifier and Type | Method and Description |
|---|---|
JobID |
ManagementGraph.getJobID()
Returns the ID of the job this graph describes.
|
| Constructor and Description |
|---|
ManagementGraph(JobID jobID)
Constructs a new management graph with the given job ID.
|
| Modifier and Type | Method and Description |
|---|---|
void |
JobManagerProfiler.registerForProfilingData(JobID jobID,
ProfilingListener profilingListener)
Registers the given
ProfilingListener object to receive
profiling data for the job with the given job ID. |
void |
JobManagerProfiler.unregisterFromProfilingData(JobID jobID,
ProfilingListener profilingListener)
Unregisters the given
ProfilingListener object from receiving
profiling data issued by the job manager's profiling component. |
| Modifier and Type | Method and Description |
|---|---|
InternalExecutionVertexThreadProfilingData |
EnvironmentThreadSet.captureCPUUtilization(JobID jobID,
ThreadMXBean tmx,
long timestamp) |
void |
EnvironmentListenerImpl.executionStateChanged(JobID jobID,
ExecutionVertexID vertexID,
ExecutionState newExecutionState,
String optionalMessage) |
void |
JobManagerProfilerImpl.registerForProfilingData(JobID jobID,
ProfilingListener profilingListener) |
void |
JobManagerProfilerImpl.unregisterFromProfilingData(JobID jobID,
ProfilingListener profilingListener) |
void |
EnvironmentListenerImpl.userThreadFinished(JobID jobID,
ExecutionVertexID vertexID,
Thread userThread) |
void |
EnvironmentListenerImpl.userThreadStarted(JobID jobID,
ExecutionVertexID vertexID,
Thread userThread) |
| Modifier and Type | Method and Description |
|---|---|
JobID |
InternalOutputGateProfilingData.getJobID() |
JobID |
InternalInputGateProfilingData.getJobID() |
JobID |
InternalExecutionVertexProfilingData.getJobID() |
| Constructor and Description |
|---|
InternalExecutionVertexProfilingData(JobID jobID,
ExecutionVertexID executionVertexID) |
InternalExecutionVertexThreadProfilingData(JobID jobID,
ExecutionVertexID executionVertexID,
int profilingInterval,
int userTime,
int systemTime,
int blockedTime,
int waitedTime) |
InternalInputGateProfilingData(JobID jobID,
ExecutionVertexID executionVertexID,
int gateIndex,
int profilingInterval,
int noRecordsAvailableCounter) |
InternalOutputGateProfilingData(JobID jobID,
ExecutionVertexID executionVertexID,
int gateIndex,
int profilingInterval,
int channelCapacityExhaustedCounter) |
| Modifier and Type | Method and Description |
|---|---|
JobID |
ProfilingEvent.getJobID()
Returns the ID of the job this profiling information belongs to.
|
| Constructor and Description |
|---|
InputGateProfilingEvent(int gateIndex,
int noRecordsAvailableCounter,
ManagementVertexID vertexID,
int profilingInterval,
JobID jobID,
long timestamp,
long profilingTimestamp)
Constructs a new input gate profiling event.
|
InstanceProfilingEvent(int profilingInterval,
int ioWaitCPU,
int idleCPU,
int userCPU,
int systemCPU,
int hardIrqCPU,
int softIrqCPU,
long totalMemory,
long freeMemory,
long bufferedMemory,
long cachedMemory,
long cachedSwapMemory,
long receivedBytes,
long transmittedBytes,
JobID jobID,
long timestamp,
long profilingTimestamp)
Constructs a new instance profiling event.
|
InstanceSummaryProfilingEvent(int profilingInterval,
int ioWaitCPU,
int idleCPU,
int userCPU,
int systemCPU,
int hardIrqCPU,
int softIrqCPU,
long totalMemory,
long freeMemory,
long bufferedMemory,
long cachedMemory,
long cachedSwapMemory,
long receivedBytes,
long transmittedBytes,
JobID jobID,
long timestamp,
long profilingTimestamp)
Constructs a new instance summary profiling event.
|
OutputGateProfilingEvent(int gateIndex,
int channelCapacityExhausted,
ManagementVertexID vertexID,
int profilingInterval,
JobID jobID,
long timestamp,
long profilingTimestamp)
Constructs a new output gate profiling event.
|
ProfilingEvent(JobID jobID,
long timestamp,
long profilingTimestamp)
Constructs a new profiling event.
|
SingleInstanceProfilingEvent(int profilingInterval,
int ioWaitCPU,
int idleCPU,
int userCPU,
int systemCPU,
int hardIrqCPU,
int softIrqCPU,
long totalMemory,
long freeMemory,
long bufferedMemory,
long cachedMemory,
long cachedSwapMemory,
long receivedBytes,
long transmittedBytes,
JobID jobID,
long timestamp,
long profilingTimestamp,
String instanceName)
Constructs a new instance profiling event.
|
ThreadProfilingEvent(int userTime,
int systemTime,
int blockedTime,
int waitedTime,
ManagementVertexID vertexID,
int profilingInterval,
JobID jobID,
long timestamp,
long profilingTimestamp) |
VertexProfilingEvent(ManagementVertexID vertexID,
int profilingInterval,
JobID jobID,
long timestamp,
long profilingTimestamp) |
| Modifier and Type | Method and Description |
|---|---|
JobCancelResult |
JobManagementProtocol.cancelJob(JobID jobID)
Requests to cancel the job specified by the given ID.
|
AccumulatorEvent |
AccumulatorProtocol.getAccumulatorResults(JobID jobID)
Get the final accumulator results.
|
List<AbstractEvent> |
ExtendedManagementProtocol.getEvents(JobID jobID)
Retrieves the collected events for the job with the given job ID.
|
JobProgressResult |
JobManagementProtocol.getJobProgress(JobID jobID)
Retrieves the current status of the job specified by the given ID.
|
ManagementGraph |
ExtendedManagementProtocol.getManagementGraph(JobID jobID)
Retrieves the management graph for the job
with the given ID.
|
NetworkTopology |
ExtendedManagementProtocol.getNetworkTopology(JobID jobID)
Retrieves the current network topology for the job with
the given ID.
|
void |
ExtendedManagementProtocol.killTask(JobID jobID,
ManagementVertexID id)
Kills the task with the given vertex ID.
|
void |
ExtendedManagementProtocol.logBufferUtilization(JobID jobID)
Triggers all task managers involved in processing the job with the given job ID to write the utilization of
their read and write buffers to their log files.
|
ConnectionInfoLookupResponse |
ChannelLookupProtocol.lookupConnectionInfo(InstanceConnectionInfo caller,
JobID jobID,
ChannelID sourceChannelID)
Retrieves all recipients of a data for the given
sourceChannelID. |
InputSplitWrapper |
InputSplitProviderProtocol.requestNextInputSplit(JobID jobID,
ExecutionVertexID vertexID,
IntegerRecord sequenceNumber)
Requests the next split to be consumed by the task with the given execution vertex ID.
|
| Modifier and Type | Method and Description |
|---|---|
JobID |
TaskExecutionState.getJobID()
The ID of the job the task belongs to
|
JobID |
Task.getJobID()
Returns the ID of the job this task belongs to.
|
| Modifier and Type | Method and Description |
|---|---|
void |
TaskManager.executionStateChanged(JobID jobID,
ExecutionVertexID id,
ExecutionState newExecutionState,
String optionalDescription) |
| Constructor and Description |
|---|
TaskExecutionState(JobID jobID,
ExecutionVertexID id,
ExecutionState executionState,
String description)
Creates a new task execution state.
|
Copyright © 2014 The Apache Software Foundation. All rights reserved.