Provenance

​

What provenance contains

{
  "tenant_id": "acme",
  "dataset_id": "app-logs",
  "source": "app-logs",
  "source_key": "2024/06/01/app-0001.jsonl.gz",
  "source_etag": "\"9b2cf5...\"",
  "line": 4821,
  "transform_version": "v3"
}

​

Why it matters

• Traceability. From any result you can find the exact source object and line, which makes debugging and auditing concrete rather than approximate.
• Reproducibility. source_etag and transform_version pin a result to a specific revision of the data and the code that parsed it.
• Isolation. tenant_id on every record means tenant isolation holds at the data layer, not only at the query layer.