org.apache.flink.client.program

Class ClusterClient<T>

java.lang.Object

org.apache.flink.client.program.ClusterClient<T>

Type Parameters:

T - type of the cluster id

Direct Known Subclasses:

MiniClusterClient, RestClusterClient, StandaloneClusterClient

public abstract class ClusterClient<T>
extends Object

Encapsulates the functionality necessary to submit a program to a remote cluster.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	ClusterClient.LazyActorSystemLoader Utility class to lazily instantiate an ActorSystem.

Field Summary

Fields

Modifier and Type	Field and Description
protected ActorSystemLoader	actorSystemLoader The actor system used to communicate with the JobManager.
protected org.apache.flink.configuration.Configuration	flinkConfig Configuration of the client.
protected org.apache.flink.runtime.highavailability.HighAvailabilityServices	highAvailabilityServices Service factory for high available.
protected org.apache.flink.api.common.JobExecutionResult	lastJobExecutionResult For interactive invocations, the job results are only available after the ContextEnvironment has been run inside the user JAR.
protected org.slf4j.Logger	log
static int	MAX_SLOTS_UNKNOWN Value returned by getMaxSlots() if the number of maximum slots is unknown.
protected scala.concurrent.duration.FiniteDuration	timeout Timeout for futures.

Constructor Summary

Constructors

Constructor and Description
ClusterClient(org.apache.flink.configuration.Configuration flinkConfig) Creates a instance that submits the programs to the JobManager defined in the configuration.
ClusterClient(org.apache.flink.configuration.Configuration flinkConfig, org.apache.flink.runtime.highavailability.HighAvailabilityServices highAvailabilityServices, boolean sharedHaServices) Creates a instance that submits the programs to the JobManager defined in the configuration.
ClusterClient(org.apache.flink.configuration.Configuration flinkConfig, org.apache.flink.runtime.highavailability.HighAvailabilityServices highAvailabilityServices, boolean sharedHaServices, ActorSystemLoader actorSystemLoader)

Method Summary

Modifier and Type	Method and Description
void	cancel(org.apache.flink.api.common.JobID jobId) Cancels a job identified by the job id.
String	cancelWithSavepoint(org.apache.flink.api.common.JobID jobId, String savepointDirectory) Cancels a job identified by the job id and triggers a savepoint.
org.apache.flink.runtime.client.JobListeningContext	connectToJob(org.apache.flink.api.common.JobID jobID) Reattaches to a running job with the given job id.
CompletableFuture<org.apache.flink.runtime.messages.Acknowledge>	disposeSavepoint(String savepointPath)
void	endSession(org.apache.flink.api.common.JobID jobId) Tells the JobManager to finish the session (job) defined by the given ID.
void	endSessions(List<org.apache.flink.api.common.JobID> jobIds) Tells the JobManager to finish the sessions (jobs) defined by the given IDs.
Map<String,org.apache.flink.util.OptionalFailure<Object>>	getAccumulators(org.apache.flink.api.common.JobID jobID) Requests and returns the accumulators for the given job identifier.
Map<String,org.apache.flink.util.OptionalFailure<Object>>	getAccumulators(org.apache.flink.api.common.JobID jobID, ClassLoader loader) Requests and returns the accumulators for the given job identifier.
org.apache.flink.runtime.util.LeaderConnectionInfo	getClusterConnectionInfo() Gets the current cluster connection info (may change in case of a HA setup).
abstract T	getClusterId() Returns the cluster id identifying the cluster to which the client is connected.
abstract org.apache.flink.runtime.clusterframework.messages.GetClusterStatusResponse	getClusterStatus() Returns the latest cluster status, with number of Taskmanagers and slots.
org.apache.flink.configuration.Configuration	getFlinkConfiguration() Return the Flink configuration object.
static org.apache.flink.runtime.jobgraph.JobGraph	getJobGraph(org.apache.flink.configuration.Configuration flinkConfig, org.apache.flink.optimizer.plan.FlinkPlan optPlan, List<URL> jarFiles, List<URL> classpaths, org.apache.flink.runtime.jobgraph.SavepointRestoreSettings savepointSettings)
static org.apache.flink.runtime.jobgraph.JobGraph	getJobGraph(org.apache.flink.configuration.Configuration flinkConfig, PackagedProgram prog, org.apache.flink.optimizer.plan.FlinkPlan optPlan, org.apache.flink.runtime.jobgraph.SavepointRestoreSettings savepointSettings)
org.apache.flink.runtime.instance.ActorGateway	getJobManagerGateway() Returns the ActorGateway of the current job manager leader using the LeaderRetrievalService.
CompletableFuture<org.apache.flink.runtime.jobgraph.JobStatus>	getJobStatus(org.apache.flink.api.common.JobID jobId) Requests the JobStatus of the job with the given JobID.
abstract int	getMaxSlots() The client may define an upper limit on the number of slots to use.
abstract List<String>	getNewMessages() May return new messages from the cluster.
static org.apache.flink.optimizer.plan.FlinkPlan	getOptimizedPlan(org.apache.flink.optimizer.Optimizer compiler, PackagedProgram prog, int parallelism)
static org.apache.flink.optimizer.plan.OptimizedPlan	getOptimizedPlan(org.apache.flink.optimizer.Optimizer compiler, org.apache.flink.api.common.Plan p, int parallelism)
static String	getOptimizedPlanAsJson(org.apache.flink.optimizer.Optimizer compiler, PackagedProgram prog, int parallelism)
boolean	getPrintStatusDuringExecution()
abstract String	getWebInterfaceURL() Returns an URL (as a string) to the JobManager web interface.
abstract boolean	hasUserJarsInClassPath(List<URL> userJarFiles) Returns true if the client already has the user jar and providing it again would result in duplicate uploading of the jar.
boolean	isDetached() A flag to indicate whether this clients submits jobs detached.
CompletableFuture<Collection<org.apache.flink.runtime.client.JobStatusMessage>>	listJobs() Lists the currently running and finished jobs on the cluster.
protected void	logAndSysout(String message) Logs and prints to sysout if printing to stdout is enabled.
CompletableFuture<org.apache.flink.runtime.messages.Acknowledge>	rescaleJob(org.apache.flink.api.common.JobID jobId, int newParallelism) Rescales the specified job such that it will have the new parallelism.
org.apache.flink.api.common.JobExecutionResult	retrieveJob(org.apache.flink.api.common.JobID jobID) Reattaches to a running from the supplied job id.
org.apache.flink.api.common.JobSubmissionResult	run(org.apache.flink.optimizer.plan.FlinkPlan compiledPlan, List<URL> libraries, List<URL> classpaths, ClassLoader classLoader)
org.apache.flink.api.common.JobSubmissionResult	run(org.apache.flink.optimizer.plan.FlinkPlan compiledPlan, List<URL> libraries, List<URL> classpaths, ClassLoader classLoader, org.apache.flink.runtime.jobgraph.SavepointRestoreSettings savepointSettings)
org.apache.flink.api.common.JobExecutionResult	run(org.apache.flink.runtime.jobgraph.JobGraph jobGraph, ClassLoader classLoader) Submits a JobGraph blocking.
org.apache.flink.api.common.JobSubmissionResult	run(JobWithJars program, int parallelism)
org.apache.flink.api.common.JobSubmissionResult	run(JobWithJars jobWithJars, int parallelism, org.apache.flink.runtime.jobgraph.SavepointRestoreSettings savepointSettings) Runs a program on the Flink cluster to which this client is connected.
org.apache.flink.api.common.JobSubmissionResult	run(PackagedProgram prog, int parallelism) General purpose method to run a user jar from the CliFrontend in either blocking or detached mode, depending on whether setDetached(true) or setDetached(false).
org.apache.flink.api.common.JobSubmissionResult	runDetached(org.apache.flink.runtime.jobgraph.JobGraph jobGraph, ClassLoader classLoader) Submits a JobGraph detached.
void	setDetached(boolean isDetached) Set the mode of this client (detached or blocking job execution).
void	setPrintStatusDuringExecution(boolean print) Configures whether the client should print progress updates during the execution to System.out.
void	shutdown() Shuts down the client.
void	shutDownCluster()
void	stop(org.apache.flink.api.common.JobID jobId) Stops a program on Flink cluster whose job-manager is configured in this client's configuration.
abstract org.apache.flink.api.common.JobSubmissionResult	submitJob(org.apache.flink.runtime.jobgraph.JobGraph jobGraph, ClassLoader classLoader) Calls the subclasses' submitJob method.
CompletableFuture<String>	triggerSavepoint(org.apache.flink.api.common.JobID jobId, String savepointDirectory) Triggers a savepoint for the job identified by the job id.
abstract void	waitForClusterToBeReady() Blocks until the client has determined that the cluster is ready for Job submission.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

log

protected final org.slf4j.Logger log

actorSystemLoader

protected final ActorSystemLoader actorSystemLoader

The actor system used to communicate with the JobManager.

flinkConfig

protected final org.apache.flink.configuration.Configuration flinkConfig

Configuration of the client.

timeout

protected final scala.concurrent.duration.FiniteDuration timeout

Timeout for futures.

highAvailabilityServices

protected final org.apache.flink.runtime.highavailability.HighAvailabilityServices highAvailabilityServices

Service factory for high available.

lastJobExecutionResult

protected org.apache.flink.api.common.JobExecutionResult lastJobExecutionResult

For interactive invocations, the job results are only available after the ContextEnvironment has been run inside the user JAR. We pass the Client to every instance of the ContextEnvironment which lets us access the execution result here.

MAX_SLOTS_UNKNOWN

public static final int MAX_SLOTS_UNKNOWN

Value returned by getMaxSlots() if the number of maximum slots is unknown.

See Also:

Constant Field Values

Constructor Detail

ClusterClient

public ClusterClient(org.apache.flink.configuration.Configuration flinkConfig)
              throws Exception

Creates a instance that submits the programs to the JobManager defined in the configuration. This method will try to resolve the JobManager hostname and throw an exception if that is not possible.

Parameters:

flinkConfig - The config used to obtain the job-manager's address, and used to configure the optimizer.

Throws:

Exception - we cannot create the high availability services

ClusterClient

public ClusterClient(org.apache.flink.configuration.Configuration flinkConfig,
                     org.apache.flink.runtime.highavailability.HighAvailabilityServices highAvailabilityServices,
                     boolean sharedHaServices)

Creates a instance that submits the programs to the JobManager defined in the configuration. This method will try to resolve the JobManager hostname and throw an exception if that is not possible.

Parameters:

flinkConfig - The config used to obtain the job-manager's address, and used to configure the optimizer.

highAvailabilityServices - HighAvailabilityServices to use for leader retrieval

sharedHaServices - true if the HighAvailabilityServices are shared and must not be shut down

ClusterClient

public ClusterClient(org.apache.flink.configuration.Configuration flinkConfig,
                     org.apache.flink.runtime.highavailability.HighAvailabilityServices highAvailabilityServices,
                     boolean sharedHaServices,
                     ActorSystemLoader actorSystemLoader)

Method Detail

shutdown

public void shutdown()
              throws Exception

Shuts down the client. This stops the internal actor system and actors.

Throws:

Exception

setPrintStatusDuringExecution

public void setPrintStatusDuringExecution(boolean print)

Configures whether the client should print progress updates during the execution to System.out. All updates are logged via the SLF4J loggers regardless of this setting.

Parameters:

print - True to print updates to standard out during execution, false to not print them.

getPrintStatusDuringExecution

public boolean getPrintStatusDuringExecution()

Returns:

whether the client will print progress updates during the execution to System.out

getClusterConnectionInfo

public org.apache.flink.runtime.util.LeaderConnectionInfo getClusterConnectionInfo()
                                                                            throws org.apache.flink.runtime.leaderretrieval.LeaderRetrievalException

Gets the current cluster connection info (may change in case of a HA setup).

Returns:

The the connection info to the leader component of the cluster

Throws:

org.apache.flink.runtime.leaderretrieval.LeaderRetrievalException - if the leader could not be retrieved

getOptimizedPlanAsJson

public static String getOptimizedPlanAsJson(org.apache.flink.optimizer.Optimizer compiler,
                                            PackagedProgram prog,
                                            int parallelism)
                                     throws org.apache.flink.optimizer.CompilerException,
                                            ProgramInvocationException

Throws:

org.apache.flink.optimizer.CompilerException

ProgramInvocationException

getOptimizedPlan

public static org.apache.flink.optimizer.plan.FlinkPlan getOptimizedPlan(org.apache.flink.optimizer.Optimizer compiler,
                                                                         PackagedProgram prog,
                                                                         int parallelism)
                                                                  throws org.apache.flink.optimizer.CompilerException,
                                                                         ProgramInvocationException

Throws:

org.apache.flink.optimizer.CompilerException

ProgramInvocationException

getOptimizedPlan

public static org.apache.flink.optimizer.plan.OptimizedPlan getOptimizedPlan(org.apache.flink.optimizer.Optimizer compiler,
                                                                             org.apache.flink.api.common.Plan p,
                                                                             int parallelism)
                                                                      throws org.apache.flink.optimizer.CompilerException

Throws:

org.apache.flink.optimizer.CompilerException

run

public org.apache.flink.api.common.JobSubmissionResult run(PackagedProgram prog,
                                                           int parallelism)
                                                    throws ProgramInvocationException,
                                                           ProgramMissingJobException

General purpose method to run a user jar from the CliFrontend in either blocking or detached mode, depending on whether setDetached(true) or setDetached(false).

Parameters:

prog - the packaged program

parallelism - the parallelism to execute the contained Flink job

Returns:

The result of the execution

Throws:

ProgramMissingJobException

ProgramInvocationException

run

public org.apache.flink.api.common.JobSubmissionResult run(JobWithJars program,
                                                           int parallelism)
                                                    throws ProgramInvocationException

Throws:

ProgramInvocationException

run

public org.apache.flink.api.common.JobSubmissionResult run(JobWithJars jobWithJars,
                                                           int parallelism,
                                                           org.apache.flink.runtime.jobgraph.SavepointRestoreSettings savepointSettings)
                                                    throws org.apache.flink.optimizer.CompilerException,
                                                           ProgramInvocationException

Runs a program on the Flink cluster to which this client is connected. The call blocks until the execution is complete, and returns afterwards.

Parameters:

jobWithJars - The program to be executed.

parallelism - The default parallelism to use when running the program. The default parallelism is used when the program does not set a parallelism by itself.

Throws:

org.apache.flink.optimizer.CompilerException - Thrown, if the compiler encounters an illegal situation.

ProgramInvocationException - Thrown, if the program could not be instantiated from its jar file, or if the submission failed. That might be either due to an I/O problem, i.e. the job-manager is unreachable, or due to the fact that the parallel execution failed.

run

public org.apache.flink.api.common.JobSubmissionResult run(org.apache.flink.optimizer.plan.FlinkPlan compiledPlan,
                                                           List<URL> libraries,
                                                           List<URL> classpaths,
                                                           ClassLoader classLoader)
                                                    throws ProgramInvocationException

Throws:

ProgramInvocationException

run

public org.apache.flink.api.common.JobSubmissionResult run(org.apache.flink.optimizer.plan.FlinkPlan compiledPlan,
                                                           List<URL> libraries,
                                                           List<URL> classpaths,
                                                           ClassLoader classLoader,
                                                           org.apache.flink.runtime.jobgraph.SavepointRestoreSettings savepointSettings)
                                                    throws ProgramInvocationException

Throws:

ProgramInvocationException

run

public org.apache.flink.api.common.JobExecutionResult run(org.apache.flink.runtime.jobgraph.JobGraph jobGraph,
                                                          ClassLoader classLoader)
                                                   throws ProgramInvocationException

Submits a JobGraph blocking.

Parameters:

jobGraph - The JobGraph

classLoader - User code class loader to deserialize the results and errors (may contain custom classes).

Returns:

JobExecutionResult

Throws:

ProgramInvocationException

runDetached

public org.apache.flink.api.common.JobSubmissionResult runDetached(org.apache.flink.runtime.jobgraph.JobGraph jobGraph,
                                                                   ClassLoader classLoader)
                                                            throws ProgramInvocationException

Submits a JobGraph detached.

Parameters:

jobGraph - The JobGraph

classLoader - User code class loader to deserialize the results and errors (may contain custom classes).

Returns:

JobSubmissionResult

Throws:

ProgramInvocationException

retrieveJob

public org.apache.flink.api.common.JobExecutionResult retrieveJob(org.apache.flink.api.common.JobID jobID)
                                                           throws org.apache.flink.runtime.client.JobExecutionException

Reattaches to a running from the supplied job id.

Parameters:

jobID - The job id of the job to attach to

Returns:

The JobExecutionResult for the jobID

Throws:

org.apache.flink.runtime.client.JobExecutionException - if an error occurs during monitoring the job execution

connectToJob

public org.apache.flink.runtime.client.JobListeningContext connectToJob(org.apache.flink.api.common.JobID jobID)
                                                                 throws org.apache.flink.runtime.client.JobExecutionException

Reattaches to a running job with the given job id.

Parameters:

jobID - The job id of the job to attach to

Returns:

The JobExecutionResult for the jobID

Throws:

org.apache.flink.runtime.client.JobExecutionException - if an error occurs during monitoring the job execution

getJobStatus

public CompletableFuture<org.apache.flink.runtime.jobgraph.JobStatus> getJobStatus(org.apache.flink.api.common.JobID jobId)

Requests the JobStatus of the job with the given JobID.

cancel

public void cancel(org.apache.flink.api.common.JobID jobId)
            throws Exception

Cancels a job identified by the job id.

Parameters:

jobId - the job id

Throws:

Exception - In case an error occurred.

cancelWithSavepoint

public String cancelWithSavepoint(org.apache.flink.api.common.JobID jobId,
                                  @Nullable
                                  String savepointDirectory)
                           throws Exception

Cancels a job identified by the job id and triggers a savepoint.

Parameters:

jobId - the job id

savepointDirectory - directory the savepoint should be written to

Returns:

path where the savepoint is located

Throws:

Exception - In case an error occurred.

stop

public void stop(org.apache.flink.api.common.JobID jobId)
          throws Exception

Stops a program on Flink cluster whose job-manager is configured in this client's configuration. Stopping works only for streaming programs. Be aware, that the program might continue to run for a while after sending the stop command, because after sources stopped to emit data all operators need to finish processing.

Parameters:

jobId - the job ID of the streaming program to stop

Throws:

Exception - If the job ID is invalid (ie, is unknown or refers to a batch job) or if sending the stop signal failed. That might be due to an I/O problem, ie, the job-manager is unreachable.

triggerSavepoint

public CompletableFuture<String> triggerSavepoint(org.apache.flink.api.common.JobID jobId,
                                                  @Nullable
                                                  String savepointDirectory)
                                           throws org.apache.flink.util.FlinkException

Triggers a savepoint for the job identified by the job id. The savepoint will be written to the given savepoint directory, or CheckpointingOptions.SAVEPOINT_DIRECTORY if it is null.

Parameters:

jobId - job id

savepointDirectory - directory the savepoint should be written to

Returns:

path future where the savepoint is located

Throws:

org.apache.flink.util.FlinkException - if no connection to the cluster could be established

disposeSavepoint

public CompletableFuture<org.apache.flink.runtime.messages.Acknowledge> disposeSavepoint(String savepointPath)
                                                                                  throws org.apache.flink.util.FlinkException

Throws:

org.apache.flink.util.FlinkException

listJobs

public CompletableFuture<Collection<org.apache.flink.runtime.client.JobStatusMessage>> listJobs()
                                                                                         throws Exception

Lists the currently running and finished jobs on the cluster.

Returns:

future collection of running and finished jobs

Throws:

Exception - if no connection to the cluster could be established

getAccumulators

public Map<String,org.apache.flink.util.OptionalFailure<Object>> getAccumulators(org.apache.flink.api.common.JobID jobID)
                                                                          throws Exception

Requests and returns the accumulators for the given job identifier. Accumulators can be requested while a is running or after it has finished. The default class loader is used to deserialize the incoming accumulator results.

Parameters:

jobID - The job identifier of a job.

Returns:

A Map containing the accumulator's name and its value.

Throws:

Exception

getAccumulators

public Map<String,org.apache.flink.util.OptionalFailure<Object>> getAccumulators(org.apache.flink.api.common.JobID jobID,
                                                                                 ClassLoader loader)
                                                                          throws Exception

Requests and returns the accumulators for the given job identifier. Accumulators can be requested while a is running or after it has finished.

Parameters:

jobID - The job identifier of a job.

loader - The class loader for deserializing the accumulator results.

Returns:

A Map containing the accumulator's name and its value.

Throws:

Exception

endSession

public void endSession(org.apache.flink.api.common.JobID jobId)
                throws Exception

Tells the JobManager to finish the session (job) defined by the given ID.

Parameters:

jobId - The ID that identifies the session.

Throws:

Exception

endSessions

public void endSessions(List<org.apache.flink.api.common.JobID> jobIds)
                 throws Exception

Tells the JobManager to finish the sessions (jobs) defined by the given IDs.

Parameters:

jobIds - The IDs that identify the sessions.

Throws:

Exception

getJobGraph

public static org.apache.flink.runtime.jobgraph.JobGraph getJobGraph(org.apache.flink.configuration.Configuration flinkConfig,
                                                                     PackagedProgram prog,
                                                                     org.apache.flink.optimizer.plan.FlinkPlan optPlan,
                                                                     org.apache.flink.runtime.jobgraph.SavepointRestoreSettings savepointSettings)
                                                              throws ProgramInvocationException

Throws:

ProgramInvocationException

getJobGraph

public static org.apache.flink.runtime.jobgraph.JobGraph getJobGraph(org.apache.flink.configuration.Configuration flinkConfig,
                                                                     org.apache.flink.optimizer.plan.FlinkPlan optPlan,
                                                                     List<URL> jarFiles,
                                                                     List<URL> classpaths,
                                                                     org.apache.flink.runtime.jobgraph.SavepointRestoreSettings savepointSettings)

getJobManagerGateway

public org.apache.flink.runtime.instance.ActorGateway getJobManagerGateway()
                                                                    throws org.apache.flink.util.FlinkException

Returns the ActorGateway of the current job manager leader using the LeaderRetrievalService.

Returns:

ActorGateway of the current job manager leader

Throws:

Exception

org.apache.flink.util.FlinkException

logAndSysout

protected void logAndSysout(String message)

Logs and prints to sysout if printing to stdout is enabled.

Parameters:

message - The message to log/print

waitForClusterToBeReady

public abstract void waitForClusterToBeReady()

Blocks until the client has determined that the cluster is ready for Job submission.

This is delayed until right before job submission to report any other errors first (e.g. invalid job definitions/errors in the user jar)

getWebInterfaceURL

public abstract String getWebInterfaceURL()

Returns an URL (as a string) to the JobManager web interface.

getClusterStatus

public abstract org.apache.flink.runtime.clusterframework.messages.GetClusterStatusResponse getClusterStatus()

Returns the latest cluster status, with number of Taskmanagers and slots.

getNewMessages

public abstract List<String> getNewMessages()

May return new messages from the cluster. Messages can be for example about failed containers or container launch requests.

getClusterId

public abstract T getClusterId()

Returns the cluster id identifying the cluster to which the client is connected.

Returns:

cluster id of the connected cluster

setDetached

public void setDetached(boolean isDetached)

Set the mode of this client (detached or blocking job execution).

Parameters:

isDetached - If true, the client will submit programs detached via the run method

isDetached

public boolean isDetached()

A flag to indicate whether this clients submits jobs detached.

Returns:

True if the Client submits detached, false otherwise

getFlinkConfiguration

public org.apache.flink.configuration.Configuration getFlinkConfiguration()

Return the Flink configuration object.

Returns:

The Flink configuration object

getMaxSlots

public abstract int getMaxSlots()

The client may define an upper limit on the number of slots to use.

Returns:

-1 (MAX_SLOTS_UNKNOWN) if unknown

hasUserJarsInClassPath

public abstract boolean hasUserJarsInClassPath(List<URL> userJarFiles)

Returns true if the client already has the user jar and providing it again would result in duplicate uploading of the jar.

submitJob

public abstract org.apache.flink.api.common.JobSubmissionResult submitJob(org.apache.flink.runtime.jobgraph.JobGraph jobGraph,
                                                                          ClassLoader classLoader)
                                                                   throws ProgramInvocationException

Calls the subclasses' submitJob method. It may decide to simply call one of the run methods or it may perform some custom job submission logic.

Parameters:

jobGraph - The JobGraph to be submitted

Returns:

JobSubmissionResult

Throws:

ProgramInvocationException

rescaleJob

public CompletableFuture<org.apache.flink.runtime.messages.Acknowledge> rescaleJob(org.apache.flink.api.common.JobID jobId,
                                                                                   int newParallelism)

Rescales the specified job such that it will have the new parallelism.

Parameters:

jobId - specifying the job to modify

newParallelism - specifying the new parallelism of the rescaled job

Returns:

Future which is completed once the rescaling has been completed

shutDownCluster

public void shutDownCluster()