Is there any ways/tools to get memory consumptions by dag/task? #32794
Unanswered
maksiplus19
asked this question in
Q&A
Replies: 1 comment
-
Just the normal memory monitoring tools for python apps. Airflow is no different than any other python app. I've heard good stories of memray https://github.com/bloomberg/memray |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
We have two applications that share airflow. One have 7 constant dags, other build dags dynamicly. Some users complaint about workers use all memory and restart with OOM. How can we analyse memory usage?
Also can we get memory usage by dag parser?
Now we cant understand, is it normal memory usage and we need increase limits or some dags use too much memory
Beta Was this translation helpful? Give feedback.
All reactions