Add batched_next_token() and batched_sample()
#1326
| Job | Run time |
|---|---|
| 14s | |
| 14s |
batched_next_token() and batched_sample()
#1326
| Job | Run time |
|---|---|
| 14s | |
| 14s |