Skip to content

Commit

Permalink
Merge branch 'main' into bumping-version
Browse files Browse the repository at this point in the history
  • Loading branch information
fulmicoton authored Nov 13, 2023
2 parents 9ca3f11 + 71ef797 commit 91ed198
Show file tree
Hide file tree
Showing 122 changed files with 3,983 additions and 1,396 deletions.
5 changes: 4 additions & 1 deletion docs/configuration/source-config.md
Original file line number Diff line number Diff line change
Expand Up @@ -64,11 +64,14 @@ The Kafka source consumes a `topic` using the client library [librdkafka](https:
- `bootstrap.servers`
Comma-separated list of host and port pairs that are the addresses of a subset of the Kafka brokers in the Kafka cluster.

- `auto.offset.reset`
Defines the behavior of the source when consuming a partition for which there is no initial offset saved in the checkpoint. `earliest` consumes from the beginning of the partition, whereas `latest` (default) consumes from the end.

- `enable.auto.commit`
The Kafka source manages commit offsets manually using the [checkpoint API](../overview/concepts/indexing.md#checkpoint) and disables auto-commit.

- `group.id`
Kafka-based distributed indexing relies on consumer groups. Unless overridden in the client parameters, the default group ID assigned to each consumer managed by the source is `quickwit-{index_uid}-{source_id}`
Kafka-based distributed indexing relies on consumer groups. Unless overridden in the client parameters, the default group ID assigned to each consumer managed by the source is `quickwit-{index_uid}-{source_id}`.

- `max.poll.interval.ms`
Short max poll interval durations may cause a source to crash when back pressure from the indexer occurs. Therefore, Quickwit recommends using the default value of `300000` (5 minutes).
Expand Down
6 changes: 3 additions & 3 deletions docs/operating/monitoring.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,12 +5,12 @@ sidebar_position: 2

You can monitor your Quickwit cluster with Grafana.

We provide two Grafana dashboards to help you monitor:
We provide three Grafana dashboards to help you monitor:
- [indexers performance](https://github.com/quickwit-oss/quickwit/blob/main/monitoring/grafana/dashboards/indexers.json)
- [indexers performance](https://github.com/quickwit-oss/quickwit/blob/main/monitoring/grafana/dashboards/searchers.json)
- [searchers performance](https://github.com/quickwit-oss/quickwit/blob/main/monitoring/grafana/dashboards/searchers.json)
- [metastore queries](https://github.com/quickwit-oss/quickwit/blob/main/monitoring/grafana/dashboards/metastore.json)

Both dashboards relies on a prometheus datasource fed with [Quickwit metrics](../reference/metrics.md).
Dashboards rely on a prometheus datasource fed with [Quickwit metrics](../reference/metrics.md).

## Screenshots

Expand Down
Loading

0 comments on commit 91ed198

Please sign in to comment.