| Modifier and Type | Method and Description |
|---|---|
JobID |
AccumulatorEvent.getJobID() |
| Constructor and Description |
|---|
AccumulatorEvent(JobID jobID,
Map<String,Accumulator<?,?>> accumulators) |
| Modifier and Type | Method and Description |
|---|---|
void |
BlobClient.delete(JobID jobId,
String key)
Deletes the BLOB identified by the given job ID and key from the BLOB server.
|
void |
BlobClient.deleteAll(JobID jobId)
Deletes all BLOBs belonging to the job with the given ID from the BLOB server
|
void |
BlobServer.deleteJobDirectory(JobID jobID)
Method which deletes all files associated with the given jobID.
|
InputStream |
BlobClient.get(JobID jobID,
String key)
Downloads the BLOB identified by the given job ID and key from the BLOB server.
|
File |
BlobServer.getStorageLocation(JobID jobID,
String key)
Returns a file handle to the file identified by the given jobID and key.
|
void |
BlobClient.put(JobID jobId,
String key,
byte[] value)
Uploads the data of the given byte array to the BLOB server and stores it under the given job ID and key.
|
void |
BlobClient.put(JobID jobId,
String key,
byte[] value,
int offset,
int len)
Uploads data from the given byte array to the BLOB server and stores it under the given job ID and key.
|
void |
BlobClient.put(JobID jobId,
String key,
InputStream inputStream)
Uploads data from the given input stream to the BLOB server and stores it under the given job ID and key.
|
| Modifier and Type | Method and Description |
|---|---|
JobID |
TaskDeploymentDescriptor.getJobID()
Returns the ID of the job the tasks belongs to.
|
| Constructor and Description |
|---|
TaskDeploymentDescriptor(JobID jobID,
JobVertexID vertexID,
ExecutionAttemptID execuionId,
String taskName,
int indexInSubtaskGroup,
int currentNumberOfSubtasks,
Configuration jobConfiguration,
Configuration taskConfiguration,
String invokableClassName,
List<GateDeploymentDescriptor> outputGates,
List<GateDeploymentDescriptor> inputGates,
List<BlobKey> requiredJarFiles,
int targetSlotNumber)
Constructs a task deployment descriptor.
|
| Modifier and Type | Method and Description |
|---|---|
JobID |
RecentJobEvent.getJobID()
Returns the ID of the new job.
|
| Constructor and Description |
|---|
RecentJobEvent(JobID jobID,
String jobName,
JobStatus jobStatus,
boolean isProfilingEnabled,
long submissionTimestamp,
long timestamp)
Constructs a new event.
|
| Modifier and Type | Method and Description |
|---|---|
JobID |
RuntimeEnvironment.getJobID() |
JobID |
Environment.getJobID()
Returns the ID of the job from the original job graph.
|
| Modifier and Type | Method and Description |
|---|---|
void |
ExecutionListener.executionStateChanged(JobID jobID,
JobVertexID vertexId,
int subtask,
ExecutionAttemptID executionId,
ExecutionState newExecutionState,
String optionalMessage) |
| Modifier and Type | Method and Description |
|---|---|
ClassLoader |
FallbackLibraryCacheManager.getClassLoader(JobID id) |
ClassLoader |
LibraryCacheManager.getClassLoader(JobID id)
Returns the user code class loader associated with id.
|
ClassLoader |
BlobLibraryCacheManager.getClassLoader(JobID id) |
int |
BlobLibraryCacheManager.getNumberOfReferenceHolders(JobID jobId) |
void |
FallbackLibraryCacheManager.registerJob(JobID id,
Collection<BlobKey> requiredJarFiles) |
void |
LibraryCacheManager.registerJob(JobID id,
Collection<BlobKey> requiredJarFiles)
Registers a job with its required jar files.
|
void |
BlobLibraryCacheManager.registerJob(JobID id,
Collection<BlobKey> requiredJarFiles) |
void |
FallbackLibraryCacheManager.registerTask(JobID id,
ExecutionAttemptID execution,
Collection<BlobKey> requiredJarFiles) |
void |
LibraryCacheManager.registerTask(JobID id,
ExecutionAttemptID execution,
Collection<BlobKey> requiredJarFiles)
Registers a job task execution with its required jar files.
|
void |
BlobLibraryCacheManager.registerTask(JobID jobId,
ExecutionAttemptID task,
Collection<BlobKey> requiredJarFiles) |
void |
FallbackLibraryCacheManager.unregisterJob(JobID id) |
void |
LibraryCacheManager.unregisterJob(JobID id)
Unregisters a job from the library cache manager.
|
void |
BlobLibraryCacheManager.unregisterJob(JobID id) |
void |
FallbackLibraryCacheManager.unregisterTask(JobID id,
ExecutionAttemptID execution) |
void |
LibraryCacheManager.unregisterTask(JobID id,
ExecutionAttemptID execution)
Unregisters a job from the library cache manager.
|
void |
BlobLibraryCacheManager.unregisterTask(JobID jobId,
ExecutionAttemptID task) |
| Modifier and Type | Method and Description |
|---|---|
JobID |
ExecutionVertex.getJobId() |
JobID |
ExecutionJobVertex.getJobId() |
JobID |
ExecutionGraph.getJobID() |
| Constructor and Description |
|---|
ExecutionGraph(JobID jobId,
String jobName,
Configuration jobConfig) |
ExecutionGraph(JobID jobId,
String jobName,
Configuration jobConfig,
List<BlobKey> requiredJarFiles,
ClassLoader userClassLoader,
ExecutorService executor) |
ExecutionGraph(JobID jobId,
String jobName,
Configuration jobConfig,
List<BlobKey> requiredJarFiles,
ExecutorService executor) |
| Modifier and Type | Method and Description |
|---|---|
FutureTask<Path> |
FileCache.createTmpFile(String name,
DistributedCache.DistributedCacheEntry entry,
JobID jobID)
If the file doesn't exists locally, it will copy the file to the temp directory.
|
void |
FileCache.deleteTmpFile(String name,
DistributedCache.DistributedCacheEntry entry,
JobID jobID)
Deletes the local file after a 5 second delay.
|
Path |
FileCache.getTempDir(JobID jobID,
String childPath) |
| Modifier and Type | Method and Description |
|---|---|
JobID |
AllocatedSlot.getJobID()
Returns the ID of the job this allocated slot belongs to.
|
| Modifier and Type | Method and Description |
|---|---|
AllocatedSlot |
Instance.allocateSlot(JobID jobID) |
| Constructor and Description |
|---|
AllocatedSlot(JobID jobID,
Instance instance,
int slotNumber) |
| Modifier and Type | Method and Description |
|---|---|
JobID |
Envelope.getJobID() |
| Modifier and Type | Method and Description |
|---|---|
BufferProvider |
ChannelManager.getBufferProvider(JobID jobID,
ChannelID sourceChannelID) |
| Constructor and Description |
|---|
Envelope(int sequenceNumber,
JobID jobID,
ChannelID source) |
| Modifier and Type | Method and Description |
|---|---|
BufferProvider |
BufferProviderBroker.getBufferProvider(JobID jobID,
ChannelID sourceChannelID) |
| Modifier and Type | Method and Description |
|---|---|
JobID |
InputChannel.getJobID() |
abstract JobID |
Channel.getJobID() |
JobID |
OutputChannel.getJobID() |
| Modifier and Type | Method and Description |
|---|---|
JobID |
Gate.getJobID() |
| Constructor and Description |
|---|
Gate(JobID jobID,
GateID gateID,
int index)
Constructs a new abstract gate
|
InputGate(JobID jobID,
GateID gateID,
int index)
Constructs a new runtime input gate.
|
OutputGate(JobID jobId,
GateID gateId,
int index)
Constructs a new output gate.
|
| Modifier and Type | Method and Description |
|---|---|
static JobID |
JobID.fromByteArray(byte[] bytes) |
static JobID |
JobID.fromByteBuffer(ByteBuffer buf) |
static JobID |
JobID.fromByteBuffer(ByteBuffer buf,
int offset) |
static JobID |
JobID.fromHexString(String hexString) |
static JobID |
JobID.generate() |
JobID |
JobGraph.getJobID()
Returns the ID of the job.
|
| Constructor and Description |
|---|
JobGraph(JobID jobId,
String jobName)
Constructs a new job graph with the given name and a random job ID.
|
JobGraph(JobID jobId,
String jobName,
AbstractJobVertex... vertices)
Constructs a new job graph with the given name and a random job ID.
|
| Modifier and Type | Method and Description |
|---|---|
Map<JobID,ExecutionGraph> |
JobManager.getCurrentJobs() |
| Modifier and Type | Method and Description |
|---|---|
JobCancelResult |
JobManager.cancelJob(JobID jobID) |
AccumulatorEvent |
JobManager.getAccumulatorResults(JobID jobID) |
Map<String,Accumulator<?,?>> |
JobManager.getAccumulators(JobID jobID) |
List<AbstractEvent> |
JobManager.getEvents(JobID jobID) |
void |
EventCollector.getEventsForJob(JobID jobID,
List<AbstractEvent> eventList,
boolean includeManagementEvents)
Retrieves and adds the collected events for the job with the given job ID to the provided list.
|
JobProgressResult |
JobManager.getJobProgress(JobID jobID) |
ExecutionGraph |
EventCollector.getManagementGraph(JobID jobID)
Returns the execution graph object for the job with the given ID from the map of recently added graphs.
|
ExecutionGraph |
JobManager.getRecentExecutionGraph(JobID jobID) |
ConnectionInfoLookupResponse |
JobManager.lookupConnectionInfo(InstanceConnectionInfo caller,
JobID jobID,
ChannelID sourceChannelID) |
InputSplit |
JobManager.requestNextInputSplit(JobID jobID,
JobVertexID vertexId,
ExecutionAttemptID executionAttempt) |
| Modifier and Type | Method and Description |
|---|---|
Map<String,Accumulator<?,?>> |
AccumulatorManager.getJobAccumulators(JobID jobID)
Returns all collected accumulators for the job.
|
void |
AccumulatorManager.processIncomingAccumulators(JobID jobID,
Map<String,Accumulator<?,?>> newAccumulators)
Merges the new accumulators with the existing accumulators collected for
the job.
|
| Modifier and Type | Method and Description |
|---|---|
void |
ArchiveListener.archiveEvent(JobID jobId,
AbstractEvent event)
Stores event in archive
|
void |
MemoryArchivist.archiveEvent(JobID jobId,
AbstractEvent event) |
void |
ArchiveListener.archiveExecutionGraph(JobID jobId,
ExecutionGraph graph) |
void |
MemoryArchivist.archiveExecutionGraph(JobID jobId,
ExecutionGraph graph) |
void |
ArchiveListener.archiveJobevent(JobID jobId,
RecentJobEvent event)
Stores old job in archive
|
void |
MemoryArchivist.archiveJobevent(JobID jobId,
RecentJobEvent event) |
List<AbstractEvent> |
ArchiveListener.getEvents(JobID jobID)
Get all archived Events for a job
|
List<AbstractEvent> |
MemoryArchivist.getEvents(JobID jobID) |
ExecutionGraph |
ArchiveListener.getExecutionGraph(JobID jid) |
ExecutionGraph |
MemoryArchivist.getExecutionGraph(JobID jid) |
RecentJobEvent |
ArchiveListener.getJob(JobID JobId)
Return archived job
|
RecentJobEvent |
MemoryArchivist.getJob(JobID jobId) |
| Modifier and Type | Method and Description |
|---|---|
void |
JobManagerProfiler.registerForProfilingData(JobID jobID,
ProfilingListener profilingListener)
Registers the given
ProfilingListener object to receive
profiling data for the job with the given job ID. |
void |
JobManagerProfiler.unregisterFromProfilingData(JobID jobID,
ProfilingListener profilingListener)
Unregisters the given
ProfilingListener object from receiving
profiling data issued by the job manager's profiling component. |
| Modifier and Type | Method and Description |
|---|---|
InternalExecutionVertexThreadProfilingData |
EnvironmentThreadSet.captureCPUUtilization(JobID jobID,
ThreadMXBean tmx,
long timestamp) |
void |
EnvironmentListenerImpl.executionStateChanged(JobID jobID,
JobVertexID vertexId,
int subtaskIndex,
ExecutionAttemptID executionId,
ExecutionState newExecutionState,
String optionalMessage) |
void |
JobManagerProfilerImpl.registerForProfilingData(JobID jobID,
ProfilingListener profilingListener) |
void |
JobManagerProfilerImpl.unregisterFromProfilingData(JobID jobID,
ProfilingListener profilingListener) |
| Modifier and Type | Method and Description |
|---|---|
JobID |
InternalExecutionVertexProfilingData.getJobID() |
| Constructor and Description |
|---|
InternalExecutionVertexProfilingData(JobID jobId,
JobVertexID vertexId,
int subtask,
ExecutionAttemptID executionId) |
InternalExecutionVertexThreadProfilingData(JobID jobID,
JobVertexID vertexId,
int subtask,
ExecutionAttemptID executionId,
int profilingInterval,
int userTime,
int systemTime,
int blockedTime,
int waitedTime) |
| Modifier and Type | Method and Description |
|---|---|
JobID |
ProfilingEvent.getJobID()
Returns the ID of the job this profiling information belongs to.
|
| Constructor and Description |
|---|
InstanceProfilingEvent(int profilingInterval,
int ioWaitCPU,
int idleCPU,
int userCPU,
int systemCPU,
int hardIrqCPU,
int softIrqCPU,
long totalMemory,
long freeMemory,
long bufferedMemory,
long cachedMemory,
long cachedSwapMemory,
long receivedBytes,
long transmittedBytes,
JobID jobID,
long timestamp,
long profilingTimestamp)
Constructs a new instance profiling event.
|
InstanceSummaryProfilingEvent(int profilingInterval,
int ioWaitCPU,
int idleCPU,
int userCPU,
int systemCPU,
int hardIrqCPU,
int softIrqCPU,
long totalMemory,
long freeMemory,
long bufferedMemory,
long cachedMemory,
long cachedSwapMemory,
long receivedBytes,
long transmittedBytes,
JobID jobID,
long timestamp,
long profilingTimestamp)
Constructs a new instance summary profiling event.
|
ProfilingEvent(JobID jobID,
long timestamp,
long profilingTimestamp)
Constructs a new profiling event.
|
SingleInstanceProfilingEvent(int profilingInterval,
int ioWaitCPU,
int idleCPU,
int userCPU,
int systemCPU,
int hardIrqCPU,
int softIrqCPU,
long totalMemory,
long freeMemory,
long bufferedMemory,
long cachedMemory,
long cachedSwapMemory,
long receivedBytes,
long transmittedBytes,
JobID jobID,
long timestamp,
long profilingTimestamp,
String instanceName)
Constructs a new instance profiling event.
|
ThreadProfilingEvent(int userTime,
int systemTime,
int blockedTime,
int waitedTime,
JobVertexID vertexId,
int subtask,
ExecutionAttemptID executionId,
int profilingInterval,
JobID jobID,
long timestamp,
long profilingTimestamp) |
VertexProfilingEvent(JobVertexID vertexId,
int subtask,
ExecutionAttemptID executionId,
int profilingInterval,
JobID jobID,
long timestamp,
long profilingTimestamp) |
| Modifier and Type | Method and Description |
|---|---|
JobCancelResult |
JobManagementProtocol.cancelJob(JobID jobID)
Requests to cancel the job specified by the given ID.
|
AccumulatorEvent |
AccumulatorProtocol.getAccumulatorResults(JobID jobID)
Get the final accumulator results.
|
List<AbstractEvent> |
ExtendedManagementProtocol.getEvents(JobID jobID)
Retrieves the collected events for the job with the given job ID.
|
JobProgressResult |
JobManagementProtocol.getJobProgress(JobID jobID)
Retrieves the current status of the job specified by the given ID.
|
ConnectionInfoLookupResponse |
ChannelLookupProtocol.lookupConnectionInfo(InstanceConnectionInfo caller,
JobID jobID,
ChannelID sourceChannelID)
Retrieves all recipients of a data for the given
sourceChannelID. |
InputSplit |
InputSplitProviderProtocol.requestNextInputSplit(JobID jobID,
JobVertexID vertex,
ExecutionAttemptID executionAttempt) |
| Modifier and Type | Method and Description |
|---|---|
JobID |
Task.getJobID()
Returns the ID of the job this task belongs to.
|
JobID |
TaskExecutionState.getJobID()
The ID of the job the task belongs to
|
| Modifier and Type | Method and Description |
|---|---|
void |
TaskManager.notifyExecutionStateChange(JobID jobID,
ExecutionAttemptID executionId,
ExecutionState newExecutionState,
Throwable optionalError) |
| Constructor and Description |
|---|
Task(JobID jobId,
JobVertexID vertexId,
int taskIndex,
int parallelism,
ExecutionAttemptID executionId,
String taskName,
TaskManager taskManager) |
TaskExecutionState(JobID jobID,
ExecutionAttemptID executionId,
ExecutionState executionState) |
TaskExecutionState(JobID jobID,
ExecutionAttemptID executionId,
ExecutionState executionState,
Throwable error)
Creates a new task execution state.
|
TaskInputSplitProvider(InputSplitProviderProtocol protocol,
JobID jobId,
JobVertexID vertexId,
ExecutionAttemptID executionAttempt) |
Copyright © 2015 The Apache Software Foundation. All rights reserved.