Add support for result paging

[amotl]

To reach beyond the 5000 results limit employed by Grafana on the dashboard search API, grafana-wtf should apply appropriate paging, see also https://grafana.com/docs/http_api/folder_dashboard_search/.

This request originated at #2, thanks @jangaraj.

[amotl]

@jangaraj: As I learned from your reports, you are operating Grafana setups with more than 1000 dashboards but you have not yet crossed the 5000 dashboard mark, right?

Please let me know if this turns out to be true at some time, then we will add appropriate paging mechanisms to the code.

Cheers!

[jangaraj]

Yes, my Grafana instance has only 1.3k dashboards.

[madhav-prabhu]

@amotl before I ask my ques just wanted to say grafana-wtf has been a lifesaver and a solid tool! 💯

Do you have any plans to introduce paging to go beyond the 5000 dashboard limit? I use grafana-wtf as a part of a larger workflow that analyzes metrics utilization across various datasources, the grafana instance has about 6k dashboards and counting, giving incomplete results

[amotl]

Dear @madhav-prabhu,

thanks a stack for writing in, for your kind words, and for outlining that you have a need that this limit needs to be raised. Would you be able to come up with a corresponding patch, or don't you have the capacities for that?

With kind regards,
Andreas.

[amotl]

grafana-client needs to implement the page parameter in search_dashboards().

• https://grafana.com/docs/grafana/latest/developers/http_api/folder_dashboard_search/

[amotl]

@vbichov just contributed that missing feature at grafana-client. Thanks a stack!

• "Search" endpoint lacks page parameter grafana-client#187
• adding page support for search api grafana-client#188

So, we can finally think about adding that missing feature at grafana-wtf as well, probably around that spot:

grafana-wtf/grafana_wtf/core.py

Line 205 in 25dd79a

self.data.dashboard_list = self.grafana.search.search_dashboards(limit=5000)