Skip to content

Commit

Permalink
improve doc
Browse files Browse the repository at this point in the history
  • Loading branch information
JingyaHuang committed Oct 22, 2024
1 parent 03bff53 commit 8e61eeb
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion optimum/neuron/modeling_seq2seq.py
Original file line number Diff line number Diff line change
Expand Up @@ -429,7 +429,7 @@ def _combine_encoder_decoder_config(self, encoder_config: "PretrainedConfig", de
from transformers import {processor_class}
from optimum.neuron import {model_class}
# 1. compile
if __name__ == "__main__": # compulsory for parallel tracing since the API will spawn multiple processes
if __name__ == "__main__": # compulsory for parallel tracing since the API will spawn multiple processes.
neuron_model = {model_class}.from_pretrained(
{checkpoint_tp}, export=True, tensor_parallel_size=8, dynamic_batch_size=False, batch_size=1, sequence_length=128, num_beams=4,
)
Expand Down

0 comments on commit 8e61eeb

Please sign in to comment.