Package com.pkgrove.pkgrovekit.storage
Interface RowPartFormat
-
- All Implemented Interfaces:
public interface RowPartFormatHow rows become object-part bytes and back (HEL-236 scenarios 1–2). The format is a SEAM: PkgroveKit ships the dependency-free JsonLinesRowFormat; columnar formats (Parquet) are deliberately delegated to engines that already own them — DuckDB reads/writes Parquet on S3 natively (
docs/storage.mdshows that path) — because a faithful Parquet writer would drag the Hadoop dependency tree into a module whose contract is "lightweight".
-
-
Method Summary
Modifier and Type Method Description abstract Longwrite(Schema schema, Iterable<Row> rows, OutputStream out)Encode rows to out; returns the row count written. abstract Sequence<RowBatch>read(Schema schema, InputStream input, Integer batchRows)Decode a part back into batches of at most batchRows rows. abstract StringgetId()Stable identifier recorded in manifests (a reader must match it). abstract StringgetFileExtension()Suggested key suffix, e.g. -
-
Method Detail
-
write
abstract Long write(Schema schema, Iterable<Row> rows, OutputStream out)
-
read
abstract Sequence<RowBatch> read(Schema schema, InputStream input, Integer batchRows)
Decode a part back into batches of at most batchRows rows. Streaming.
-
getFileExtension
abstract String getFileExtension()
Suggested key suffix, e.g.
jsonl.
-
-
-
-