Replies: 1 comment
-
Solved... |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Good day, I'm trying to get 150 processes to launch at the same time. I tried changing the parameters:
[core]
parallelism = 150
dag_concurrency = 150
max_active_runs_per_dag = 150
Increased the number of workers
celery -A airflow.executors.celery_executor.app worker --autoscale=10,3
Pool size 150 slots
Please tell me where else to tweak?
Beta Was this translation helpful? Give feedback.
All reactions