Skip to content

Commit

Permalink
minor change to the routing page for multiple boundaries
Browse files Browse the repository at this point in the history
  • Loading branch information
vedpatwardhan committed Sep 19, 2024
1 parent 13d2faa commit 83b0519
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion routing/routing_syntax.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -92,7 +92,7 @@ in the *input*, not be more expensive than `$0.6` per million tokens in the *out
have an inter token latency faster than `20ms`, but not faster than `1ms`:

```shell
llama-3.1-70b-chat@quality|input-cost<=0.8|output-cost<=0.6|1<itl<20
llama-3.1-70b-chat@quality|input-cost<=0.8|output-cost<=0.8|itl>1|itl<20
```

As explained above, any of the aliases defined above can be used interchangeably,
Expand Down

0 comments on commit 83b0519

Please sign in to comment.