org.apache.flink.runtime.io.network.partition.consumer

类 UnionInputGate

java.lang.Object

org.apache.flink.runtime.io.network.partition.consumer.InputGate

org.apache.flink.runtime.io.network.partition.consumer.UnionInputGate

所有已实现的接口:

AutoCloseable, AvailabilityProvider, ChannelStateHolder, PullingAsyncDataInput<BufferOrEvent>

public class UnionInputGate
extends InputGate

Input gate wrapper to union the input from multiple input gates.

Each input gate has input channels attached from which it reads data. At each input gate, the input channels have unique IDs from 0 (inclusive) to the number of input channels (exclusive).

 +---+---+      +---+---+---+
 | 0 | 1 |      | 0 | 1 | 2 |
 +--------------+--------------+
 | Input gate 0 | Input gate 1 |
 +--------------+--------------+
 

The union input gate maps these IDs from 0 to the *total* number of input channels across all unioned input gates, e.g. the channels of input gate 0 keep their original indexes and the channel indexes of input gate 1 are set off by 2 to 2--4.

 +---+---++---+---+---+
 | 0 | 1 || 2 | 3 | 4 |
 +--------------------+
 | Union input gate   |
 +--------------------+
 

It is NOT possible to recursively union union input gates.

嵌套类概要

从类继承的嵌套类/接口 org.apache.flink.runtime.io.network.partition.consumer.InputGate

InputGate.InputWithData<INPUT,DATA>

从接口继承的嵌套类/接口 org.apache.flink.runtime.io.PullingAsyncDataInput

PullingAsyncDataInput.EndOfDataStatus

从接口继承的嵌套类/接口 org.apache.flink.runtime.io.AvailabilityProvider

AvailabilityProvider.AvailabilityHelper

字段概要

从类继承的字段 org.apache.flink.runtime.io.network.partition.consumer.InputGate

availabilityHelper, priorityAvailabilityHelper

从接口继承的字段 org.apache.flink.runtime.io.AvailabilityProvider

AVAILABLE

构造器概要

构造器

构造器和说明
UnionInputGate(IndexedInputGate... inputGates)

方法概要

限定符和类型	方法和说明
void	acknowledgeAllRecordsProcessed(InputChannelInfo channelInfo)
void	close()
void	finishReadRecoveredState()
InputChannel	getChannel(int channelIndex) Returns the channel of this gate.
Optional<BufferOrEvent>	getNext() Blocking call waiting for next BufferOrEvent.
int	getNumberOfInputChannels() Returns the total number of input channels across all unioned input gates.
CompletableFuture<Void>	getStateConsumedFuture()
PullingAsyncDataInput.EndOfDataStatus	hasReceivedEndOfData() Tells if we consumed all available data.
boolean	isFinished()
Optional<BufferOrEvent>	pollNext() Poll the BufferOrEvent.
void	requestPartitions()
void	resumeConsumption(InputChannelInfo channelInfo)
void	sendTaskEvent(TaskEvent event)
void	setup() Setup gate, potentially heavy-weight, blocking operation comparing to just creation.
String	toString()

从类继承的方法 org.apache.flink.runtime.io.network.partition.consumer.InputGate

getAvailableFuture, getChannelInfos, getPriorityEventAvailableFuture, setChannelStateWriter

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

从接口继承的方法 org.apache.flink.runtime.io.AvailabilityProvider

and, isApproximatelyAvailable, isAvailable, or

构造器详细资料

UnionInputGate

public UnionInputGate(IndexedInputGate... inputGates)

方法详细资料

getNumberOfInputChannels

public int getNumberOfInputChannels()

Returns the total number of input channels across all unioned input gates.

指定者:

getNumberOfInputChannels 在类中 InputGate

getChannel

public InputChannel getChannel(int channelIndex)

从类复制的说明: InputGate

Returns the channel of this gate.

指定者:

getChannel 在类中 InputGate

isFinished

public boolean isFinished()

指定者:

isFinished 在接口中 PullingAsyncDataInput<BufferOrEvent>

指定者:

isFinished 在类中 InputGate

返回:

true if is finished and for example end of input was reached, false otherwise.

hasReceivedEndOfData

public PullingAsyncDataInput.EndOfDataStatus hasReceivedEndOfData()

从接口复制的说明: PullingAsyncDataInput

Tells if we consumed all available data.

Moreover it tells us the reason why there is no more data incoming. If any of the upstream subtasks finished because of the stop-with-savepoint --no-drain, we should not drain the input. See also StopMode.

getNext

public Optional<BufferOrEvent> getNext()
                                throws IOException,
                                       InterruptedException

从类复制的说明: InputGate

Blocking call waiting for next BufferOrEvent.

Note: It should be guaranteed that the previous returned buffer has been recycled before getting next one.

指定者:

getNext 在类中 InputGate

返回:

Optional.empty() if InputGate.isFinished() returns true.

抛出:

IOException

InterruptedException

pollNext

public Optional<BufferOrEvent> pollNext()
                                 throws IOException,
                                        InterruptedException

从类复制的说明: InputGate

Poll the BufferOrEvent.

Note: It should be guaranteed that the previous returned buffer has been recycled before polling next one.

指定者:

pollNext 在接口中 PullingAsyncDataInput<BufferOrEvent>

指定者:

pollNext 在类中 InputGate

返回:

Optional.empty() if there is no data to return or if InputGate.isFinished() returns true.

抛出:

IOException

InterruptedException

sendTaskEvent

public void sendTaskEvent(TaskEvent event)
                   throws IOException

指定者:

sendTaskEvent 在类中 InputGate

抛出:

IOException

resumeConsumption

public void resumeConsumption(InputChannelInfo channelInfo)
                       throws IOException

指定者:

resumeConsumption 在类中 InputGate

抛出:

IOException

acknowledgeAllRecordsProcessed

public void acknowledgeAllRecordsProcessed(InputChannelInfo channelInfo)
                                    throws IOException

指定者:

acknowledgeAllRecordsProcessed 在类中 InputGate

抛出:

IOException

setup

public void setup()

从类复制的说明: InputGate

Setup gate, potentially heavy-weight, blocking operation comparing to just creation.

指定者:

setup 在类中 InputGate

getStateConsumedFuture

public CompletableFuture<Void> getStateConsumedFuture()

指定者:

getStateConsumedFuture 在类中 InputGate

requestPartitions

public void requestPartitions()
                       throws IOException

指定者:

requestPartitions 在类中 InputGate

抛出:

IOException

close

public void close()
           throws IOException

抛出:

IOException

toString

public String toString()

覆盖:

toString 在类中 Object

finishReadRecoveredState

public void finishReadRecoveredState()
                              throws IOException

指定者:

finishReadRecoveredState 在类中 InputGate

抛出:

IOException