Object ObjectDataset
-
- All Implemented Interfaces:
public class ObjectDatasetRow datasets as manifest-committed object parts (HEL-236 scenarios 1–3): bounded encoded parts under a run-scoped prefix, published atomically via StagingArea — the manifest is the ONLY thing a reader trusts, so a mid-export failure never yields a readable half-dataset. Reading streams parts back into RowBatches with per-part checksum + row-count verification; corruption fails visibly and typed.
Pairs with pkgrovekit-jdbc/transfer naturally: a
JdbcReader's batches feed export; DatasetHandle.batches feeds aJdbcBatchWriter— that is the database → object storage → database path proven end-to-end inintegration-tests(StorageDatasetRoundTripIT).
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description public final classObjectDataset.ExportOptionspublic final classObjectDataset.ExportResultpublic final classObjectDataset.ReadOptions
-
Field Summary
Fields Modifier and Type Field Description public final static ObjectDatasetINSTANCE
-
Method Summary
Modifier and Type Method Description final static ObjectDataset.ExportResultexport(ObjectStore store, String prefix, String runId, Schema schema, Sequence<RowBatch> batches, ObjectDataset.ExportOptions options)Stream batches into <prefix>/<runId>/part-*.…+ a committed manifest.final static DatasetHandleopen(ObjectStore store, ObjectKey manifestKey, ObjectDataset.ReadOptions options)Open a published dataset by its manifest key. -
-
Method Detail
-
export
final static ObjectDataset.ExportResult export(ObjectStore store, String prefix, String runId, Schema schema, Sequence<RowBatch> batches, ObjectDataset.ExportOptions options)
Stream batches into
<prefix>/<runId>/part-*.…+ a committed manifest. Bounded: at most ONE encoded part (ExportOptions.maxPartBytes) is held. On any failure the staging area is discarded and nothing was published.
-
open
final static DatasetHandle open(ObjectStore store, ObjectKey manifestKey, ObjectDataset.ReadOptions options)
Open a published dataset by its manifest key.
-
-
-
-