Tag: MSK

Quick Blog: Databricks DLT consuming from AWS MSK Kafka Topics

This quick blog shows an example architecture of Databricks deployed using Customer Managed VPC, with private MSK cluster in the same VPC. By providing your own VPC to host Databricks and MSK, you can customize networking objects and keep MSK traffic private. After building this platf...

Simplifying Kafka Cluster Deployment: Step-by-Step Guide with Amazon MSK and Terraform

This is the second article of the series “Building a managed streaming data pipeline”. If you haven’t read the first one, I leave the link here for you to have a look: Unleash the Spark: Create an Amazon EMR Serverless Cluster with Terraform and run PySpark jobs Ignite Your D...