Discrepancy between Mimir and the actual data #5603
Replies: 3 comments 15 replies
-
@pstibrany @pracucci @DylanGuedes I would appreciate your assistance. |
Beta Was this translation helpful? Give feedback.
-
Is it possible that you are scraping the same targets multiple times? you can check which targets are being scraped by checking the prometheus UI on the prometheis. One way this could be happening is that There are multiple Prometheus custom resources that are configured to scrape the same Service/PodMonitors |
Beta Was this translation helpful? Give feedback.
-
Hi @girishms-sentient , Even I had the same issue, we have 3 prometheus instances in prod, so made the below changes as suggested in your above solution. But it failed with below error can you please guide me in what mistake i have made in my below yam file below |
Beta Was this translation helpful? Give feedback.
-
The Mimir is configured and running, but the data I'm seeing in the Mimir Grafana dashboard does not match the actual Grafana for the cluster. Sometimes the displayed data is twice/thrice as accurate.
Actual Grafana dashboard:
Mimir Grafana:
Here's the mimir config:
Prometheus remote write:
Is there anything I'm missing or is there a way to solve this issue?
Beta Was this translation helpful? Give feedback.
All reactions