Contents Menu Expand Light mode Dark mode Auto light/dark, in light mode Auto light/dark, in dark mode Skip to content
Zephon
Light Logo Dark Logo

User Guide

  • Basic Concepts
  • Why Zephon?
  • Working with Datasets
    • JSONL
    • Parquet
    • Binary Shard Formats
      • litData
      • Mosaic (MDS)
      • Vortex
    • Storage Backends and Shard Cache
  • WorkSources: The Training Curriculum
    • Mixing Datasets
    • Shuffling and Repeating Samples
  • Pipelines: From a Curriculum to Training Batches
    • How Pipelines Run
    • Preparing Samples
    • Shuffling and Maintaining Mixtures
    • Packing
    • Building Training Batches
    • Inspecting and Tuning Pipelines
    • Distributed Training
    • Checkpointing and Resuming Pipelines
    • User-Defined Operators
  • Training Integrations

API Reference

  • Pipeline & top-level API
  • zephon.io
  • zephon.work
  • zephon.ops
  • zephon.types
  • zephon.observability
  • zephon.build_index
Back to top
Copyright © 2026, DatologyAI
Made with Sphinx and @pradyunsg's Furo