Prometheus sum by rate give crazily high spike

32 views Asked by At

Using PromQL, I can draw two charts, using different time interval.
sum (rate (some_metrics[1s]))
sum (rate (some_metrics[1h]))
However, for the second chart: sum (rate (some_metrics[1h])) It sometimes gives a crazily steady high spike
where the sum (rate (some_metrics[1s])) behaves normally
Any help is appreciated.

Even weirder, those only happen for roughly an hour. After an hour, then this bizzare spike disappear and it behaves normally again.

0

There are 0 answers