Skip to content

Split the graph - DAG

Dr0ptp4kt requested to merge dr0ptp4kt/airflow-dags:dag-scholarly-article-partition into main

Bug: T347989

This adds the following:

  • An additional HDFS table for a split graph, which would require a manual run
  • The DAG that does the split, that can be triggered with configuration on-demand and toggled off when done

It requires r/969229 and its eventual deploy.

Merge request reports