SOLID Principles for Spark Applications

Spark is a framework for processing large volumes of data distributed across multiple machines at the same time. It is originally written in Scala, a programming language that supports object-oriented programming (OOP) and functional programming (FP). Spark mainly deals with immutable data types like RDDs and DataFrames. If a data type is immutable, this means that once it is created, it cannot be modified. The only way to change them is to create an entirely new structure that includes the desired changes. <a href="https://medium.com/data-engineer-things/solid-principles-for-spark-applications-e604577837b">Read More</a>