Skip to content Skip to sidebar Skip to footer
Showing posts with the label Directed Acyclic Graphs

How To Define Operations Of An Stfp Operator On Airflow?

class SFTPOperation(object): PUT = 'put' GET = 'get' operation=SFTPOpera… Read more How To Define Operations Of An Stfp Operator On Airflow?

How To Trigger A Dag On The Success Of A Another Dag In Airflow Using Python?

I have a python DAG Parent Job and DAG Child Job. The tasks in the Child Job should be triggered on… Read more How To Trigger A Dag On The Success Of A Another Dag In Airflow Using Python?

How To Use Apache Airflow In A Virtual Environment?

I am quite new to using apache airflow. I use pycharm as my IDE. I create a project (anaconda envir… Read more How To Use Apache Airflow In A Virtual Environment?

Spark Dag Differs With 'withcolumn' Vs 'select'

Context In a recent SO-post, I discovered that using withColumn may improve the DAG when dealing wi… Read more Spark Dag Differs With 'withcolumn' Vs 'select'

Combinatorics In Python

I have a sort of a one level tree structure as: Where p are parent nodes, c are child nodes and b … Read more Combinatorics In Python

Combinatorics In Python

I have a sort of a one level tree structure as: Where p are parent nodes, c are child nodes and b … Read more Combinatorics In Python