Skip to content

Migrate refine webrequest job to Airflow

Aqu requested to merge T327073_migrate_refine_webrequest_to_airflow into main

Linked with: https://gerrit.wikimedia.org/r/c/analytics/refinery/+/894661/

2 steps on deployment:

  • make sure the artifact cache is warm
sudo -u analytics kerberos-run-command analytics /usr/lib/airflow/bin/artifact-cache warm  airflow-dags/wmf_airflow_common/config/artifact_config.yaml airflow-dags/analytics_test/
  • drop+create+repair wmf.webrequest

Bug: T327073

Edited by Aqu

Merge request reports