Empty Log w/ Failed Tasks #50853
Unanswered
marshalljacobs12
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Airflow Version: 3.0.1
When triggering ~50 dag runs from the REST API (
/api/v2/dags/{dag_id}/dagRuns
called ~50 times), the first ~35 tasks queue and run successfully (in my airflow.cfg,parallelism=32
). However, as the Airflow server continues to make its way through the tasks in all the dag runs, tasks start failing with empty logs. Additionally, my DAG definition hasdefault_args={"retries": 1, "trigger_rule": "all_success"},
On the tasks that leave no log file (second attempt), I also have no data about the first attempt.
All the failures happen with ECSRunTaskOperator tasks
Has anyone encountered anything similar?
Beta Was this translation helpful? Give feedback.
All reactions