I'm using Python and Pyspark.
I inherited a pipeline that does the following:
import business_logic1, business_logic2
class main():
_init_():
self.table1 = "table1"
self.table2 = "table2"
if Boolean:
self.table3 = "table_xxx"
else:
self.table3 = "table_yyy"
...
# many many more tables
def run():
dict_business_logic1 = {
"table1" = self.table1,
"table5" = self.table5,
"table7" = self.table7,
...
}
business_logic1 = business_logic1(dict_method1)