Based on the documentation, you can set the scheduler preset to None (Don’t schedule, use for exclusively “externally triggered” DAGs). Also, you can set it to @once if schedule once and only once.
Tasks getting stuck is, most likely, a bug. At the moment (<= 1.9.0alpha1) it can happen when a task cannot even start up on the (remote) worker. This happens for example in the case of an overloaded worker or missing dependencies. This patch should resolve that issue. It is worth investigating why your tasks do … Read more
Here is how we manage it for our team. First in terms of naming convention, each of our DAG file name matches the DAG Id from the content of the DAG itself (including the DAG version). This is useful because ultimately it’s the DAG Id that you see in the Airflow UI so you will … Read more
Airflow can be a bit tricky to setup. Do you have the airflow scheduler running? Do you have the airflow webserver running? Have you checked that all DAGs you want to run are set to On in the web ui? Do all the DAGs you want to run have a start date which is in … Read more