zephon.build_index¶

Build an index.json for a dataset directory (fast O(1) shard discovery).

CLI: python -m zephon.build_index <format> <dataset_dir>.

build_index(format_name, dataset_dir, *, output_path=None, progress=True)[source]¶

Build an index.json for dataset_dir (formats: parquet, vortex).

Writes to dataset_dir/index.json unless output_path is given, printing per-file progress when progress is true. Returns the written index path.