Skip to content

Commit

Permalink
add missing mixed init
Browse files Browse the repository at this point in the history
  • Loading branch information
dakinggg committed Aug 18, 2023
1 parent 1a99f09 commit 5cdfb20
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions mcli/mcli-llama2-finetune.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -33,6 +33,7 @@ parameters:
# Model
model:
name: hf_causal_lm
init_device: mixed
pretrained_model_name_or_path: meta-llama/Llama-2-7b-hf
pretrained: true
# Note: you must have set the HUGGING_FACE_HUB_TOKEN environment variable and have access to the llama2 models
Expand Down

0 comments on commit 5cdfb20

Please sign in to comment.