Add batched_next_token()
and batched_sample()
(#1693)
#1328
Job | Run time |
---|---|
18s | |
18s |
batched_next_token()
and batched_sample()
(#1693)
#1328
Job | Run time |
---|---|
18s | |
18s |