Skip to main content
Interactive 3D/Dataset Lineage & Data Provenance
Dataset Lineage DAG
Click a node to see its upstream dependencies highlighted. Track data provenance end-to-end.
Raw EventsS3 / Kafka840 GB2h agoRaw LabelsPostgreSQL1.2 GB6h agoIngestion LayerSpark job v3.1840 GB2h agoPreprocessingPySpark pipeline620 GB2h agoFeature StoreFeast v0.3218 GB1h agoTraining DatasetDVC v1.4.24.2 GB45m agofraud-detector v3MLflow run#482210 MB20m ago
Training Dataset
System
DVC v1.4.2
Size
4.2 GB
Last Updated
45m ago
Upstream Deps
5 nodes
Trace Dataset
Display Options
Key Insight
Lineage tracking answers: "Which raw data produced this model?" Full provenance is required for debugging data issues and regulatory compliance.

Dataset Lineage & Data Provenance - Interactive Visualization

Dataset lineage answers the critical question: which raw data produced this model? A full lineage DAG tracks data from its raw sources through ingestion jobs, preprocessing pipelines, feature stores, and versioned training datasets into the final model artifact. Tools like DVC, Delta Lake, and Apache Atlas provide lineage tracking. Without lineage, debugging a model degradation is nearly impossible - you cannot tell if the issue is a code change or a data change.

  • Click any node to highlight its complete upstream dependency chain
  • Each node shows the data system, size, and time since last update
  • Trace the path from Raw Events through Spark ingestion, PySpark preprocessing, Feast feature store to the training dataset
  • Full lineage enables rollback: if a model degrades, you can re-train on the previous data version

Part of the EngineersOfAI Interactive 3D - free interactive visualizations covering every major concept in machine learning and AI engineering. Hover any element for a plain-English explanation. No code required.