Automoderator potential vandalism reverted DAG
Bug: T376456
Generates aggregate potential vandalism reverted by Automoderator, along with other user types.
Steps:
- waits for mediawiki_history snapshot to be released.
- fetches and processes aggregate metrics for potential vandalism reverted by Automoderator.
- each snapshot is appended to wmf_product.automoderator_potential_vandalism_reverted.
- a latest snapshot is published as TSV to https://analytics.wikimedia.org/published/datasets/
- snapshots older than 3 months are purged from the destination table.
Testing results (dev instance)
Verified the data at kcvelaga.automoderator_potential_vandalism_reverted
and output TSV is present at /tmp/kcvelaga/automoderator/potential_vandalism_reverted_proportion.tsv.bz2
Note: Marking this as draft as the queries are under review ( repos/product-analytics/data-pipelines!26 (merged)), but the rest of the code can be reviewed.