Sync Delta Tables Stored in DBFS (Managed or External) To Unity Catalog

Databricks recommends for these use cases to recreate the tables in unity catalog and copy the data using a deep clone. But if you are a person who’s not a fan of copying/moving data, you can follow my humble demo. I’ll show you how I get to work around.

The second type of delta tables cloning is called shallow clonewhich is way more cheaper to create because it does not copy the data files. However shallow cloning delta tables directly to unity catalog is not yet supported.

Bypassing this limitation means doing the shallow clone to a bridge external location and after synchronizing the result of the last shallow clone to the unity catalog.

Visit Now

Tags: Catalog Unity