The 2023 Data + AI Summit held during JUNE 26–29, revolved around “Generation AI,” a theme exploring LLMs, lakehouse architectures and all the latest innovations in data and AI. During this week multiple announcements were made to support the modern data engineering and data streaming solution supporting Delta Lake, improving Unity Catalog, the Databricks Lakehouse Platform and lot more.
The Databricks Lakehouse is an integral tool for data engineering ,across batch and streaming data using Delta Live Tables and Databricks Workflows.
Lakehouse — Integration of Data Warehouses and Data Lakes
If you are a data engineers, data scientists, or a business analysts who is looking for a unified workspace, that…
One such cutting-edge announcement was public preview of System Tables. It is an advancement in Unity Catalog for auditing, lineage and billing in Unity Catalog. In this article we will discuss more precisely about what are System tables, how to enable the same, where are they located and many more.