Skip to content

Commit

Permalink
[pre-commit.ci] auto fixes from pre-commit.com hooks
Browse files Browse the repository at this point in the history
for more information, see https://pre-commit.ci
  • Loading branch information
pre-commit-ci[bot] committed Nov 25, 2024
1 parent ac0be01 commit e4e807e
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions helm-charts/monitoring.md
Original file line number Diff line number Diff line change
Expand Up @@ -78,12 +78,14 @@ $ curl --no-progress-meter $prom_url/metrics | grep scrape_pool_targets.*$chart
Then check that Prometheus metrics from a relevant LLM inferencing service are available.

For vLLM:

```console
$ curl --no-progress-meter $prom_url/api/v1/query? \
--data-urlencode 'query=vllm:cache_config_info{service="'$chart'-vllm"}' | jq
```

Or TGI:

```console
$ curl --no-progress-meter $prom_url/api/v1/query? \
--data-urlencode 'query=tgi_queue_size{service="'$chart'-tgi"}' | jq
Expand Down

0 comments on commit e4e807e

Please sign in to comment.