Add batched_next_token()
and batched_sample()
#1326
Job | Run time |
---|---|
14s | |
14s |
batched_next_token()
and batched_sample()
#1326
Job | Run time |
---|---|
14s | |
14s |