Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adjust the duration threshold for the alerts dependent on disk latency #19

Open
sokada1221 opened this issue Oct 31, 2019 · 0 comments
Open

Comments

@sokada1221
Copy link

sokada1221 commented Oct 31, 2019

Alerts that depend on disk latency are too sensitive for public cloud resources, and keeps triggering for each disk latency fluctuation. The following is the list of alerts that should be adjusted:

  • TiKV_async_request_write_duration_seconds
  • TiKV_scheduler_command_duration_seconds
  • TiKV_scheduler_latch_wait_duration_seconds

As per discussion with @tennix, we'll adjust the "for" clause from 1m to 5m for these alerts to prevent excessive false alarms in public cloud environment.

@sokada1221 sokada1221 changed the title Adjust the duration threshold for TiKV_scheduler_command_duration_seconds and TiKV_async_request_write_duration_seconds Adjust the duration threshold for the alerts dependent on disk latency Nov 9, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant