Skip to content

Automoderator potential vandalism reverted DAG

Bug: T376456

Generates aggregate potential vandalism reverted by Automoderator, along with other user types.

Steps:

  • waits for mediawiki_history snapshot to be released.
  • fetches and processes aggregate metrics for potential vandalism reverted by Automoderator.
  • each snapshot is appended to wmf_product.automoderator_potential_vandalism_reverted.
  • a latest snapshot is published as TSV to https://analytics.wikimedia.org/published/datasets/
  • snapshots older than 3 months are purged from the destination table.

Testing results (dev instance)

Screenshot from 2024-10-09 22-56-48.pngVerified the data at kcvelaga.automoderator_potential_vandalism_reverted and output TSV is present at /tmp/kcvelaga/automoderator/potential_vandalism_reverted_proportion.tsv.bz2


Note: Marking this as draft as the queries are under review ( repos/product-analytics/data-pipelines!26 (merged)), but the rest of the code can be reviewed.

Edited by KCVelaga

Merge request reports