Notes on apache airflow
with DAG( dag_id = ) as dag :
- Operators in Airflow - default python , bash the default ones which come with it
- https://airflow.apache.org/docs/apache-airflow/stable/_api/airflow/operators/index.html
- When interactin with any third party provides we install those providors
- Example AWS , Snowflake , Databricks
- Sensors -
- Task group - Airflow utils has task group ids which can be used for grouping
No comments:
Post a Comment