Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Notebooks docs #8

Merged
merged 56 commits into from
Feb 26, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
56 commits
Select commit Hold shift + click to select a range
cda7416
added .gitignore and .github/workflows
felimomo Feb 20, 2024
34b1714
:Merge branch 'main' of https://github.com/boettiger-lab/rl4greencrab
felimomo Feb 20, 2024
cc924e0
hyperpars
felimomo Feb 20, 2024
3f27ead
erased broken time-series model
felimomo Feb 20, 2024
9100c3c
training metaenvs (such as time-series envs) from yaml files
felimomo Feb 21, 2024
3845b5c
testing N_mem=2 in yaml files
felimomo Feb 21, 2024
967e120
added systematic exploration of training script
felimomo Feb 21, 2024
8a0d04f
Update README.md
felimomo Feb 21, 2024
1ccd0a4
Update README.md
felimomo Feb 21, 2024
f58b6ac
Merge branch 'main' into training-playing
felimomo Feb 21, 2024
4574b1d
relative paths
felimomo Feb 21, 2024
85db298
benchmarking stochasticity. progress bar optional
felimomo Feb 21, 2024
7e52e68
more benchmarks
felimomo Feb 21, 2024
203cffd
yaml
felimomo Feb 21, 2024
7b21c8f
benchmarks script
felimomo Feb 22, 2024
2f5b1d9
naming, defaulting
felimomo Feb 23, 2024
159d12d
GreenCrab.__init__
felimomo Feb 23, 2024
48f22bb
GreenCrab mini
felimomo Feb 23, 2024
0acb2d4
GreenCrabSimplifiedEnv
felimomo Feb 23, 2024
17a27d8
tests
felimomo Feb 23, 2024
e6e8164
indentation
felimomo Feb 23, 2024
e234a0c
typo
felimomo Feb 23, 2024
5650e73
output type
felimomo Feb 25, 2024
7df8449
mini
felimomo Feb 25, 2024
63ec421
float32
felimomo Feb 25, 2024
17b6da8
envs dir, float32 obs
felimomo Feb 25, 2024
fc0f339
imports
felimomo Feb 25, 2024
1dbddf1
imports
felimomo Feb 25, 2024
91c6133
var rename
felimomo Feb 25, 2024
9844a8a
time-series env obs shape
felimomo Feb 25, 2024
bc1357c
agent imports
felimomo Feb 25, 2024
9937bc3
added agents
felimomo Feb 25, 2024
5a5a7af
typo
felimomo Feb 25, 2024
ada7881
utils folder with contents
felimomo Feb 25, 2024
5c545af
typo
felimomo Feb 25, 2024
4ca3b74
added intro notebook
felimomo Feb 25, 2024
ec376ad
more intro
felimomo Feb 25, 2024
abb8b86
envs/__init__
felimomo Feb 25, 2024
de781d7
notebook, typo in __init__
felimomo Feb 25, 2024
71bb995
intro notebook
felimomo Feb 25, 2024
20cd10a
patches on agents, action_reward_scale, intro notebook
felimomo Feb 25, 2024
3ffb914
revamped intro notebook
felimomo Feb 25, 2024
e0829f7
Merge branch 'main' into notebooks-docs
felimomo Feb 25, 2024
9f99dc5
deleted outdated notebooks
felimomo Feb 26, 2024
9dcf227
intro_pt1, intro_pt2
felimomo Feb 26, 2024
089303c
Merge branch 'notebooks-docs' of https://github.com/boettiger-lab/rl4…
felimomo Feb 26, 2024
0032750
intro_pt2
felimomo Feb 26, 2024
a24c12e
deleted outdated yaml
felimomo Feb 26, 2024
68ccce0
new yaml configs
felimomo Feb 26, 2024
eef8740
added boilerplate yaml
felimomo Feb 26, 2024
6a4acf6
sb3_train allows kwargs to extend yaml input
felimomo Feb 26, 2024
5c08c59
removed outdated train scripts
felimomo Feb 26, 2024
72e2cf8
train_algos bash script, train_gcse_manual python script, yaml configs
felimomo Feb 26, 2024
668586d
debugging scripts, deleted old env files
felimomo Feb 26, 2024
5df6bed
registration entry points, multi algo script
felimomo Feb 26, 2024
c006934
HER deprecated
felimomo Feb 26, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 9 additions & 0 deletions hyperpars/gcse-boilerplate.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# stable-baselines3 configuration.

env_id: "gcsenv"
config: {}
tensorboard: "/home/rstudio/logs"
use_sde: True
id: "1"
repo: "cboettig/rl-ecology"
save_path: "/home/rstudio/rl4greencrab/saved_agents"
15 changes: 15 additions & 0 deletions hyperpars/ppo-gcse.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
# stable-baselines3 configuration template.
#
# env_id strings are found at src/rl4greencrab/__init__.py
# config is passed as an input to the env initialization.

algo: "PPO"
env_id: "gcsenv"
n_envs: 12
tensorboard: "/home/rstudio/logs"
total_timesteps: 1000000
config: {}
use_sde: True
id: "1"
repo: "cboettig/rl-ecology"
save_path: "/home/rstudio/rl4greencrab/saved_agents"
14 changes: 0 additions & 14 deletions hyperpars/ppo-greencrab-ts-v2-1.yml

This file was deleted.

12 changes: 0 additions & 12 deletions hyperpars/ppo-greencrab-v0-1.yml

This file was deleted.

13 changes: 0 additions & 13 deletions hyperpars/systematic-benchmarks/TQC-Nmem_1/1-tqc_nmem-1_bmk.yml

This file was deleted.

13 changes: 0 additions & 13 deletions hyperpars/systematic-benchmarks/TQC-Nmem_1/2-tqc_nmem-1_bmk.yml

This file was deleted.

13 changes: 0 additions & 13 deletions hyperpars/systematic-benchmarks/TQC-Nmem_1/3-tqc_nmem-1_bmk.yml

This file was deleted.

13 changes: 0 additions & 13 deletions hyperpars/systematic-benchmarks/TQC-Nmem_1/4-tqc_nmem-1_bmk.yml

This file was deleted.

13 changes: 0 additions & 13 deletions hyperpars/systematic-benchmarks/TQC-Nmem_1/5-tqc_nmem-1_bmk.yml

This file was deleted.

13 changes: 0 additions & 13 deletions hyperpars/systematic-benchmarks/TQC-Nmem_1/6-tqc_nmem-1_bmk.yml

This file was deleted.

13 changes: 0 additions & 13 deletions hyperpars/systematic-benchmarks/TQC-Nmem_1/7-tqc_nmem-1_bmk.yml

This file was deleted.

13 changes: 0 additions & 13 deletions hyperpars/systematic-benchmarks/TQC-Nmem_1/8-tqc_nmem-1_bmk.yml

This file was deleted.

13 changes: 0 additions & 13 deletions hyperpars/systematic-benchmarks/TQC-Nmem_1/9-tqc_nmem-1_bmk.yml

This file was deleted.

12 changes: 12 additions & 0 deletions hyperpars/td3-gcse.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
# stable-baselines3 configuration.

algo: "TD3"
env_id: "gcsenv"
n_envs: 12
tensorboard: "/home/rstudio/logs"
total_timesteps: 1000000
config: {}
use_sde: True
id: "1"
repo: "cboettig/rl-ecology"
save_path: "/home/rstudio/rl4greencrab/saved_agents"
12 changes: 12 additions & 0 deletions hyperpars/tqc-gcse.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
# stable-baselines3 configuration.

algo: "TQC"
env_id: "gcsenv"
n_envs: 12
tensorboard: "/home/rstudio/logs"
total_timesteps: 1000000
config: {}
use_sde: True
id: "1"
repo: "cboettig/rl-ecology"
save_path: "/home/rstudio/rl4greencrab/saved_agents"
14 changes: 0 additions & 14 deletions hyperpars/tqc-greencrab-ts-v2-1.yml

This file was deleted.

12 changes: 0 additions & 12 deletions hyperpars/tqc-greencrab-v0-1.yml

This file was deleted.

Loading
Loading