Workaround for Spark 2
This is a temporary fix that should be reverted as soon as https://phabricator.wikimedia.org/T322366 is resolved.
- pass
spark2-submit
path and Spark 2 configuration directory to every Airflow task but the sensors - improve comments