object consumer
- Alphabetic
- By Inheritance
- consumer
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def checkpointRecords[F[_]](checkpointSettings: KinesisCheckpointSettings = KinesisCheckpointSettings.defaultInstance, parallelism: Int = 10)(implicit arg0: ConcurrentEffect[F], arg1: Timer[F]): Pipe[F, CommittableRecord, KinesisClientRecord]
Pipe to checkpoint records in Kinesis, marking them as processed Groups records by shard id, so that each shard is subject to its own clustering of records After accumulating maxBatchSize or reaching maxBatchWait for a respective shard, the latest record is checkpointed By design, all records prior to the checkpointed record are also checkpointed in Kinesis
Pipe to checkpoint records in Kinesis, marking them as processed Groups records by shard id, so that each shard is subject to its own clustering of records After accumulating maxBatchSize or reaching maxBatchWait for a respective shard, the latest record is checkpointed By design, all records prior to the checkpointed record are also checkpointed in Kinesis
- F
effect type of the fs2 stream
- checkpointSettings
configure maxBatchSize and maxBatchWait time before triggering a checkpoint
- returns
a stream of Record types representing checkpointed messages
- def checkpointRecords_[F[_]](checkpointSettings: KinesisCheckpointSettings = KinesisCheckpointSettings.defaultInstance)(implicit F: ConcurrentEffect[F], timer: Timer[F]): Pipe[F, CommittableRecord, Unit]
Sink to checkpoint records in Kinesis, marking them as processed Groups records by shard id, so that each shard is subject to its own clustering of records After accumulating maxBatchSize or reaching maxBatchWait for a respective shard, the latest record is checkpointed By design, all records prior to the checkpointed record are also checkpointed in Kinesis
Sink to checkpoint records in Kinesis, marking them as processed Groups records by shard id, so that each shard is subject to its own clustering of records After accumulating maxBatchSize or reaching maxBatchWait for a respective shard, the latest record is checkpointed By design, all records prior to the checkpointed record are also checkpointed in Kinesis
- F
effect type of the fs2 stream
- checkpointSettings
configure maxBatchSize and maxBatchWait time before triggering a checkpoint
- returns
a Sink that accepts a stream of CommittableRecords
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native() @HotSpotIntrinsicCandidate()
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native() @HotSpotIntrinsicCandidate()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native() @HotSpotIntrinsicCandidate()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- def mkDefaultKinesisClient(settings: KinesisConsumerSettings): KinesisAsyncClient
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native() @HotSpotIntrinsicCandidate()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native() @HotSpotIntrinsicCandidate()
- def readChunkedFromKinesisStream[F[_]](consumerConfig: KinesisConsumerSettings, kinesisClient: KinesisAsyncClient)(implicit arg0: ConcurrentEffect[F], arg1: ContextShift[F]): Stream[F, Chunk[CommittableRecord]]
Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown
Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown
- F
effect type of the fs2 stream
- consumerConfig
configuration parameters for the KCL
- kinesisClient
preconfigured kineiss klient, usefull when you need STS access
- returns
an infinite fs2 Stream that emits Kinesis Records Chunks
- def readChunkedFromKinesisStream[F[_]](consumerConfig: KinesisConsumerSettings)(implicit arg0: ConcurrentEffect[F], arg1: ContextShift[F]): Stream[F, Chunk[CommittableRecord]]
Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown
Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown
- F
effect type of the fs2 stream
- consumerConfig
configuration parameters for the KCL
- returns
an infinite fs2 Stream that emits Kinesis Records Chunks
- def readFromKinesisStream[F[_]](consumerConfig: KinesisConsumerSettings, kinesisClient: KinesisAsyncClient)(implicit arg0: ConcurrentEffect[F], arg1: ContextShift[F]): Stream[F, CommittableRecord]
Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown
Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown
- F
effect type of the fs2 stream
- consumerConfig
configuration parameters for the KCL
- kinesisClient
preconfigured kineiss klient, usefull when you need STS access
- returns
an infinite fs2 Stream that emits Kinesis Records
- def readFromKinesisStream[F[_]](appName: String, streamName: String, kinesisClient: KinesisAsyncClient)(implicit arg0: ConcurrentEffect[F], arg1: ContextShift[F], rt: RaiseThrowable[F]): Stream[F, CommittableRecord]
Intialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown
Intialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown
- F
effect type of the fs2 stream
- appName
name of the Kinesis application. Used by KCL when resharding
- streamName
name of the Kinesis stream to consume from
- kinesisClient
preconfigured kineiss klient, usefull when you need STS access
- returns
an infinite fs2 Stream that emits Kinesis Records
- def readFromKinesisStream[F[_]](consumerConfig: KinesisConsumerSettings)(implicit arg0: ConcurrentEffect[F], arg1: ContextShift[F]): Stream[F, CommittableRecord]
Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown
Initialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown
- F
effect type of the fs2 stream
- consumerConfig
configuration parameters for the KCL
- returns
an infinite fs2 Stream that emits Kinesis Records
- def readFromKinesisStream[F[_]](appName: String, streamName: String)(implicit arg0: ConcurrentEffect[F], arg1: ContextShift[F], rt: RaiseThrowable[F]): Stream[F, CommittableRecord]
Intialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown
Intialize a worker and start streaming records from a Kinesis stream On stream finish (due to error or other), worker will be shutdown
- F
effect type of the fs2 stream
- appName
name of the Kinesis application. Used by KCL when resharding
- streamName
name of the Kinesis stream to consume from
- returns
an infinite fs2 Stream that emits Kinesis Records
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
Deprecated Value Members
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable]) @Deprecated
- Deprecated