EasyDeepLearn

What is lakeFS?

medium

Answer

  • Git-like versioning for object storage (S3, GCS, Azure Blob).
  • Full branch / commit / merge for data lakes.
  • Every ingest creates a branch; validated; merged to main.
  • Rollback = revert commit.
  • Zero-copy branches (no data duplication).
  • Compatible with Spark, Iceberg, Delta, Hive.
  • Advantage over DVC: works on already-existing data lake without moving files; ACID over object storage.
  • Standard for data-lake reproducibility.
Check yourself — multiple choice
  • Random
  • Git-like for object storage (S3/GCS/Azure); branch/commit/merge full data-lake; every ingest → branch → validate → merge; zero-copy branches; ACID over object; compat Spark/Iceberg/Delta
  • Same as DVC
  • Not real

lakeFS: git for object storage; zero-copy branch/merge; ACID over data lake.

#reproducibility

Practise MLOps & Data Quality

215 interview questions in this topic.

Related questions