Hi folks!
While reviewing the Grizzly dashboards I noticed that sometimes the SLO/SLI graphs show big "holes" in visualization, and I tracked them down to (what appears to be) missing datapoints in the recording rules themselves:
The above graphs are related to the Lift Wing Ores Legacy's dashboard.
From https://w.wiki/8PJd it seems that the original istio metric for total requests (counter) is populated, meanwhile the recording rule tiself shows a big gap of days.
The performance of the recording rules seems good, so it shouldn't be a matter of the titan hosts lagging (in theory): https://thanos.wikimedia.org/rules#istio_slos
Any idea?