Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

just fixing two configs #152

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

just fixing two configs #152

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 21 additions & 0 deletions pax/conf/experiment/ipd/gs_v_ppo_mem.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45,6 +45,27 @@ ppo1:
with_cnn: False
hidden_size: 16

# PPO agent parameters
ppo2:
num_minibatches: 4
num_epochs: 2
gamma: 0.96
gae_lambda: 0.95
ppo_clipping_epsilon: 0.2
value_coeff: 0.5
clip_value: True
max_gradient_norm: 0.5
anneal_entropy: False
entropy_coeff_start: 0.02
entropy_coeff_horizon: 2000000
entropy_coeff_end: 0.001
lr_scheduling: False
learning_rate: 1
adam_epsilon: 1e-5
with_memory: False
with_cnn: False
hidden_size: 16



# ES parameters
Expand Down
1 change: 1 addition & 0 deletions pax/conf/experiment/ipd/shaper_v_ppo_mem.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,7 @@ num_outer_steps: 100
num_inner_steps: 100
num_generations: 5000
total_timesteps: 1e11
num_devices: 1

# PPO agent parameters
ppo1:
Expand Down