Exploring Spark Declarative Pipelines (SDP) with Apache Iceberg

I recently built a modern financial lakehouse project using Spark Declarative Pipelines (SDP), Apache Iceberg, Medallion architecture, and streaming/batch concepts.

The article covers:

\- Declarative data pipelines

\- Iceberg table design

\- Bronze/Silver/Gold architecture

\- Financial analytics use cases

\- Production-style lakehouse concepts

Has anyone else experimented Spark declarative pipelines in production yet ?

Blog: https://medium.com/@pranavsadagopan/building-a-spark-declarative-pipeline-a-modern-financial-data-lakehouse-with-sdp-apache-iceberg-36ae6c6523ae