org.apache.flink.optimizer.dag

Class WorksetIterationNode

java.lang.Object

org.apache.flink.optimizer.dag.OptimizerNode

org.apache.flink.optimizer.dag.TwoInputNode

org.apache.flink.optimizer.dag.WorksetIterationNode

All Implemented Interfaces:

EstimateProvider, IterationNode, DumpableNode<OptimizerNode>, org.apache.flink.util.Visitable<OptimizerNode>

public class WorksetIterationNode
extends TwoInputNode
implements IterationNode

A node in the optimizer's program representation for a workset iteration.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	WorksetIterationNode.SingleRootJoiner

Nested classes/interfaces inherited from class org.apache.flink.optimizer.dag.OptimizerNode

OptimizerNode.UnclosedBranchDescriptor

Field Summary

Fields inherited from class org.apache.flink.optimizer.dag.TwoInputNode

input1, input2, keys1, keys2

Fields inherited from class org.apache.flink.optimizer.dag.OptimizerNode

cachedPlans, closedBranchingNodes, estimatedNumRecords, estimatedOutputSize, hereJoinedBranches, id, MAX_DYNAMIC_PATH_COST_WEIGHT, onDynamicPath, openBranches, uniqueFields

Constructor Summary

Constructors

Constructor and Description
WorksetIterationNode(org.apache.flink.api.common.operators.base.DeltaIterationBase<?,?> iteration) Creates a new node with a single input for the optimizer plan.

Method Summary

Modifier and Type	Method and Description
void	acceptForStepFunction(org.apache.flink.util.Visitor<OptimizerNode> visitor)
void	clearInterestingProperties()
void	computeInterestingPropertiesForInputs(CostEstimator estimator) Tells the node to compute the interesting properties for its inputs.
protected void	computeOperatorSpecificDefaultEstimates(DataStatistics statistics)
void	computeUnclosedBranchStack() This method causes the node to compute the description of open branches in its sub-plan.
int	getCostWeight()
OptimizerNode	getInitialSolutionSetPredecessorNode()
OptimizerNode	getInitialWorksetPredecessorNode()
org.apache.flink.api.common.operators.base.DeltaIterationBase<?,?>	getIterationContract()
OptimizerNode	getNextWorkset()
String	getOperatorName() Gets the name of this node, which is the name of the function/operator, or data source / data sink.
protected List<OperatorDescriptorDual>	getPossibleProperties()
org.apache.flink.api.common.operators.SemanticProperties	getSemanticProperties()
TwoInputNode	getSingleRootOfStepFunction()
OptimizerNode	getSolutionSetDelta()
org.apache.flink.api.common.operators.util.FieldList	getSolutionSetKeyFields()
SolutionSetNode	getSolutionSetNode()
WorksetNode	getWorksetNode()
protected void	instantiate(OperatorDescriptorDual operator, Channel solutionSetIn, Channel worksetIn, List<Set<? extends NamedChannel>> broadcastPlanChannels, List<PlanNode> target, CostEstimator estimator, RequestedGlobalProperties globPropsReqSolutionSet, RequestedGlobalProperties globPropsReqWorkset, RequestedLocalProperties locPropsReqSolutionSet, RequestedLocalProperties locPropsReqWorkset)
protected void	readStubAnnotations() Reads all stub annotations, i.e.
void	setNextPartialSolution(OptimizerNode solutionSetDelta, OptimizerNode nextWorkset, org.apache.flink.api.common.ExecutionMode executionMode)
void	setPartialSolution(SolutionSetNode solutionSetNode, WorksetNode worksetNode)

Methods inherited from class org.apache.flink.optimizer.dag.TwoInputNode

accept, addLocalCandidates, getAlternativePlans, getFirstIncomingConnection, getFirstPredecessorNode, getIncomingConnections, getOperator, getSecondIncomingConnection, getSecondPredecessorNode, getSemanticPropertiesForGlobalPropertyFiltering, getSemanticPropertiesForLocalPropertyFiltering, placePipelineBreakersIfNecessary, setInput

Methods inherited from class org.apache.flink.optimizer.dag.OptimizerNode

addBroadcastConnection, addClosedBranch, addClosedBranches, addOutgoingConnection, areBranchCompatible, computeOutputEstimates, computeUnclosedBranchStackForBroadcastInputs, computeUnionOfInterestingPropertiesFromSuccessors, getBranchesForParent, getBroadcastConnectionNames, getBroadcastConnections, getClosedBranchingNodes, getDumpableInputs, getEstimatedAvgWidthPerOutputRecord, getEstimatedNumRecords, getEstimatedOutputSize, getId, getInterestingProperties, getMaxDepth, getMinimalMemoryAcrossAllSubTasks, getOpenBranches, getOptimizerNode, getOutgoingConnections, getParallelism, getPlanNode, getPredecessors, getUniqueFields, hasUnclosedBranches, haveAllOutputConnectionInterestingProperties, identifyDynamicPath, initId, isBranching, isOnDynamicPath, markAllOutgoingConnectionsAsPipelineBreaking, mergeLists, prunePlanAlternatives, prunePlanAlternativesWithCommonBranching, readUniqueFieldsAnnotation, removeClosedBranches, setBroadcastInputs, setEstimatedNumRecords, setEstimatedOutputSize, setParallelism, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

WorksetIterationNode

public WorksetIterationNode(org.apache.flink.api.common.operators.base.DeltaIterationBase<?,?> iteration)

Creates a new node with a single input for the optimizer plan.

Parameters:

iteration - The iteration operator that the node represents.

Method Detail

getIterationContract

public org.apache.flink.api.common.operators.base.DeltaIterationBase<?,?> getIterationContract()

getSolutionSetNode

public SolutionSetNode getSolutionSetNode()

getWorksetNode

public WorksetNode getWorksetNode()

getNextWorkset

public OptimizerNode getNextWorkset()

getSolutionSetDelta

public OptimizerNode getSolutionSetDelta()

setPartialSolution

public void setPartialSolution(SolutionSetNode solutionSetNode,
                               WorksetNode worksetNode)

setNextPartialSolution

public void setNextPartialSolution(OptimizerNode solutionSetDelta,
                                   OptimizerNode nextWorkset,
                                   org.apache.flink.api.common.ExecutionMode executionMode)

getCostWeight

public int getCostWeight()

Overrides:

getCostWeight in class OptimizerNode

getSingleRootOfStepFunction

public TwoInputNode getSingleRootOfStepFunction()

getSolutionSetKeyFields

public org.apache.flink.api.common.operators.util.FieldList getSolutionSetKeyFields()

getInitialSolutionSetPredecessorNode

public OptimizerNode getInitialSolutionSetPredecessorNode()

getInitialWorksetPredecessorNode

public OptimizerNode getInitialWorksetPredecessorNode()

getOperatorName

public String getOperatorName()

Description copied from class: OptimizerNode

Gets the name of this node, which is the name of the function/operator, or data source / data sink.

Specified by:

getOperatorName in class OptimizerNode

Returns:

The node name.

getSemanticProperties

public org.apache.flink.api.common.operators.SemanticProperties getSemanticProperties()

Overrides:

getSemanticProperties in class TwoInputNode

readStubAnnotations

protected void readStubAnnotations()

Description copied from class: OptimizerNode

Reads all stub annotations, i.e. which fields remain constant, what cardinality bounds the functions have, which fields remain unique.

Overrides:

readStubAnnotations in class OptimizerNode

computeOperatorSpecificDefaultEstimates

protected void computeOperatorSpecificDefaultEstimates(DataStatistics statistics)

Specified by:

computeOperatorSpecificDefaultEstimates in class OptimizerNode

getPossibleProperties

protected List<OperatorDescriptorDual> getPossibleProperties()

Specified by:

getPossibleProperties in class TwoInputNode

computeInterestingPropertiesForInputs

public void computeInterestingPropertiesForInputs(CostEstimator estimator)

Description copied from class: OptimizerNode

Tells the node to compute the interesting properties for its inputs. The interesting properties for the node itself must have been computed before. The node must then see how many of interesting properties it preserves and add its own.

Overrides:

computeInterestingPropertiesForInputs in class TwoInputNode

Parameters:

estimator - The CostEstimator instance to use for plan cost estimation.

clearInterestingProperties

public void clearInterestingProperties()

Overrides:

clearInterestingProperties in class OptimizerNode

instantiate

protected void instantiate(OperatorDescriptorDual operator,
                           Channel solutionSetIn,
                           Channel worksetIn,
                           List<Set<? extends NamedChannel>> broadcastPlanChannels,
                           List<PlanNode> target,
                           CostEstimator estimator,
                           RequestedGlobalProperties globPropsReqSolutionSet,
                           RequestedGlobalProperties globPropsReqWorkset,
                           RequestedLocalProperties locPropsReqSolutionSet,
                           RequestedLocalProperties locPropsReqWorkset)

Overrides:

instantiate in class TwoInputNode

computeUnclosedBranchStack

public void computeUnclosedBranchStack()

Description copied from class: OptimizerNode

This method causes the node to compute the description of open branches in its sub-plan. An open branch describes, that a (transitive) child node had multiple outputs, which have not all been re-joined in the sub-plan. This method needs to set the openBranches field to a stack of unclosed branches, the latest one top. A branch is considered closed, if some later node sees all of the branching node's outputs, no matter if there have been more branches to different paths in the meantime.

Overrides:

computeUnclosedBranchStack in class TwoInputNode

acceptForStepFunction

public void acceptForStepFunction(org.apache.flink.util.Visitor<OptimizerNode> visitor)

Specified by:

acceptForStepFunction in interface IterationNode