You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
What happened?
We are using the internal grafana alert manager and are seeing the memory usage constantly increase (container_memory_usage_bytes). I suspect the alert states are being persisted forever in internal memory.
We have roughly 30 alerts running on 1 instance.
What did you expect to happen?
We would expect the memory usage to go down at some point.
Did this work before?
Without having any alerts we see that it is stable and does not increase continuously.
Environment (with versions):
Grafana helm chart: 6.52.1 (9.4.3)
We upgraded to grafana version 11.1.1 but are still seeing the memory increase continuously
Some thoughts I had:
I suspect that garbage collection is not occuring, and we are getting this constantly increasing memory usage as a result. I am trying to set GOMEMLIMIT to see if that helps.
The text was updated successfully, but these errors were encountered:
What happened?
We are using the internal grafana alert manager and are seeing the memory usage constantly increase (
container_memory_usage_bytes
). I suspect the alert states are being persisted forever in internal memory.We have roughly 30 alerts running on 1 instance.
What did you expect to happen?
We would expect the memory usage to go down at some point.
Did this work before?
Without having any alerts we see that it is stable and does not increase continuously.
Environment (with versions):
Grafana helm chart: 6.52.1 (9.4.3)
We upgraded to grafana version
11.1.1
but are still seeing the memory increase continuouslyThe values we are using are as follows:
And then we override some grafana.ini values as follows:
Attached 2 pprof files
Archive.zip
Some thoughts I had:
I suspect that garbage collection is not occuring, and we are getting this constantly increasing memory usage as a result. I am trying to set
GOMEMLIMIT
to see if that helps.The text was updated successfully, but these errors were encountered: