Migrate External Hive Streaming tables to Unity in an Azure Workspace
<p>If you use external tables for your Delta lake, and want to migrate to Unity, this is a simple guide for accomplishing this. The differences between how to do this with a streaming table and a non streaming table are very minor, with the major difference being you must stop your stream, make your needed changes and then restart your stream vs simply waiting for a batch process to run a modified notebook. The examples I’ll be showing will be in Azure, but after the specifics of the external storage, these steps should work with Workspaces in all three clouds where Unity is available.</p>
<p>Prerequisites:</p>
<ol>
<li>You must have Unity enabled for your workspace. For quick guide on how to do this check out my post <a href="https://medium.com/@jason.drew/quickly-enable-unity-on-your-azure-workspace-4243dff4bb14" rel="noopener">Quickly Enable Unity on your Azure Workspace</a>.</li>
<li>Your external mounts (Azure specific) for your external hive tables must be using <strong>abfss</strong> not <strong>wasbs</strong> format. To check, issue the python command <strong>dbutils.fs.mounts()</strong> and look at the source of your mount.</li>
<li>You have an external location set to the same container as your external table <strong>abfss mount</strong>.</li>
</ol>
<p>Streaming External Hive Table Example:</p>
<p><a href="https://medium.com/@jason.drew/migrate-external-hive-streaming-tables-to-unity-in-an-azure-workspace-6bc05a80832f"><strong>Visit Now</strong></a></p>