EasyDeepLearn

How does DVC work?

medium

Answer

  • Data Version Control: git-like for large files.
  • Stores metadata (.dvc files) in git; actual data in remote storage (S3, GCS, Azure). dvc add data.csv → creates data.csv.dvc with hash + points to remote. git commit metadata + dvc push data.
  • Others: git pull + dvc pull restores exact snapshot.
  • Pipeline definition in dvc.yaml with stages + deps + outputs → dvc repro runs only changed stages.
  • Similar tools: LakeFS (branch-based), Delta Lake.
Check yourself — multiple choice
  • Random
  • Git-like for large files: metadata (.dvc) in git, actual data in remote (S3/GCS); dvc add + git commit + dvc push; pipeline dvc.yaml stages + reproduce only changed; alt LakeFS/Delta
  • Same as git
  • Not real

DVC: metadata in git + data in remote; pipeline reproduces changed stages.

#reproducibility

Practise MLOps & Data Quality

215 interview questions in this topic.

Related questions