[go: nahoru, domu]

Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Gymnasium support #1327

Merged
merged 257 commits into from
Apr 14, 2023
Merged
Changes from 1 commit
Commits
Show all changes
257 commits
Select commit Hold shift + click to select a range
435f5fb
Fix failing set_env test
carlosluis Feb 28, 2022
f64346a
Fix test failiing due to deprectation of env.seed
carlosluis Mar 3, 2022
9efc37b
Merge branch 'master' into fix_tests
carlosluis Mar 7, 2022
daaa84c
Adjust mean reward threshold in failing test
carlosluis Mar 8, 2022
e62edde
Fix her test failing due to rng
carlosluis Mar 8, 2022
9a41c51
Change seed and revert reward threshold to 90
carlosluis Mar 8, 2022
41f260b
Merge branch 'master' into fix_tests
carlosluis Mar 16, 2022
9c73732
Pin gym version
carlosluis Mar 16, 2022
110be78
Make VecEnv compatible with gym seeding change
carlosluis Mar 16, 2022
dc9c645
Revert change to VecEnv reset signature
carlosluis Mar 17, 2022
e1c6e1b
Change subprocenv seed cmd to call reset instead
carlosluis Mar 17, 2022
29bd222
Fix type check
carlosluis Mar 17, 2022
b1730f4
Add backward compat
araffin Mar 17, 2022
3297091
Merge branch 'master' into fix_tests
araffin Mar 25, 2022
00e7946
Add `compat_gym_seed` helper
araffin Mar 25, 2022
ecf02ce
Merge branch 'master' into fix_tests
araffin Mar 28, 2022
f0e1ccb
Merge branch 'master' into fix_tests
carlosluis Apr 11, 2022
a116a1a
Add goal env checks in env_checker
carlosluis Apr 11, 2022
8780919
Add docs on HER requirements for envs
carlosluis Apr 11, 2022
e0db1ed
Merge branch 'master' into fix_tests
carlosluis Apr 11, 2022
ff44a2f
Merge branch 'master' into fix_tests
araffin Apr 13, 2022
c2ab5cd
Capture user warning in test with inverted box space
carlosluis Apr 13, 2022
cb50e9e
Update ale-py version
araffin Apr 18, 2022
de3f086
Fix randint
araffin Apr 19, 2022
1980db2
Allow noop_max to be zero
araffin Apr 19, 2022
85087bc
Merge branch 'master' into fix_tests
araffin Apr 19, 2022
776217a
Merge branch 'master' into fix_tests
araffin Apr 25, 2022
fa40152
Merge branch 'master' into fix_tests
araffin May 8, 2022
90adf8f
Update changelog
araffin May 8, 2022
d0300c8
Merge branch 'master' into fix_tests
araffin May 8, 2022
25136d7
Merge branch 'master' into fix_tests
araffin May 10, 2022
ec9d50f
Merge branch 'master' into fix_tests
araffin May 10, 2022
0f240fa
Update docker image
araffin May 10, 2022
a6766bd
Merge branch 'fix_tests' of github.com:carlosluis/stable-baselines3 i…
araffin May 10, 2022
3087d58
Update doc conda env and dockerfile
araffin May 13, 2022
7629016
Custom envs should not have any warnings
araffin May 13, 2022
7bb643b
Fix test for numpy >= 1.21
araffin May 13, 2022
706f072
Add check for vectorized compute reward
araffin May 13, 2022
af8e51b
Merge branch 'master' into fix_tests
araffin May 29, 2022
77d188f
Bump to gym 0.24
araffin May 29, 2022
68cec40
Fix gym default step docstring
araffin May 29, 2022
0072b77
Test downgrading gym
araffin May 29, 2022
07a85b8
Revert "Test downgrading gym"
araffin May 29, 2022
d755cc6
Fix protobuf error
araffin May 29, 2022
99b91eb
Fix in dependencies
araffin May 29, 2022
1d7da08
Fix protobuf dep
araffin May 29, 2022
f205865
Merge branch 'master' into fix_tests
araffin May 29, 2022
cf7e438
Use newest version of cartpole
araffin May 29, 2022
3d6f28a
Merge branch 'master' into fix_tests
araffin May 31, 2022
626db1d
Update gym
araffin Jun 10, 2022
f864501
Fix warning
araffin Jun 14, 2022
3af1488
Merge branch 'master' into fix_tests
araffin Jun 23, 2022
5fa3cd9
Loosen required scipy version
araffin Jun 23, 2022
e79148b
Scipy no longer needed
araffin Jun 23, 2022
ebf73d6
Merge branch 'master' into fix_tests
araffin Jul 18, 2022
1ad5f78
Try gym 0.25
araffin Jul 18, 2022
3f0b531
Silence warnings from gym
araffin Jul 25, 2022
2fc09f7
Merge branch 'master' into fix_tests
araffin Jul 25, 2022
b27e555
Filter warnings during tests
araffin Jul 25, 2022
c1e01c9
Merge branch 'master' into fix_tests
araffin Jul 30, 2022
78ef1e4
Merge branch 'master' into fix_tests
araffin Aug 22, 2022
c4bf066
Merge branch 'master' into fix_tests
araffin Aug 22, 2022
ed0f79e
Merge branch 'master' into fix_tests
araffin Aug 25, 2022
ee52936
Merge branch 'master' into fix_tests
araffin Sep 7, 2022
5d3b07f
Merge branch 'master' into fix_tests
araffin Sep 16, 2022
99d2155
Merge branch 'master' into fix_tests
araffin Sep 26, 2022
a0d5c79
Merge branch 'master' into fix_tests
qgallouedec Sep 28, 2022
75fd27e
Merge branch 'master' into fix_tests
araffin Sep 30, 2022
8c65748
Update doc
araffin Oct 1, 2022
0874da1
Update requirements
araffin Oct 1, 2022
26ceefc
Add gym 26 compat in vec env
araffin Oct 1, 2022
a8c579a
Fixes in envs and tests for gym 0.26+
araffin Oct 1, 2022
6ed3079
Enforce gym 0.26 api
araffin Oct 1, 2022
0851440
Merge pull request #1 from carlosluis/fix_tests
tlpss Oct 2, 2022
95bb4d6
format
tlpss Oct 2, 2022
c4517f2
Fix formatting
araffin Oct 2, 2022
9ac7592
Fix dependencies
araffin Oct 2, 2022
d2e6873
Fix syntax
araffin Oct 2, 2022
969c1cf
Cleanup doc and warnings
araffin Oct 2, 2022
2fcd072
Faster tests
araffin Oct 2, 2022
dd67a20
Higher budget for HER perf test (revert prev change)
araffin Oct 2, 2022
ae04b20
Merge branch 'master' into fix_tests
araffin Oct 3, 2022
9ae6fa2
Fixes and update doc
araffin Oct 5, 2022
056454b
Fix doc build
araffin Oct 5, 2022
f9bbb29
Merge branch 'master' into fix_tests
araffin Oct 6, 2022
29dffed
Merge branch 'master' into fix_tests
araffin Oct 10, 2022
cf565d9
Merge branch 'master' into fix_tests
araffin Oct 13, 2022
ed191b0
Merge branch 'master' of https://github.com/DLR-RM/stable-baselines3 …
qgallouedec Oct 17, 2022
04aa926
Merge branch 'master' into fix_tests
araffin Oct 24, 2022
734e19f
Merge branch 'master' into fix_tests
araffin Oct 26, 2022
9ad927b
Fix breaking change
araffin Oct 31, 2022
3ca1b73
Fixes for rendering
araffin Oct 31, 2022
0f5374f
Rename variables in monitor
araffin Oct 31, 2022
9cf2c3d
Merge pull request #2 from carlosluis/fix_tests
tlpss Nov 3, 2022
3320e78
update render method for gym 0.26 API
tlpss Nov 3, 2022
1596ea4
update tests and docs to new gym render API
tlpss Nov 3, 2022
b4b911c
Merge branch 'master' into fix_tests
araffin Nov 7, 2022
008fdce
undo removal of render modes metatadata check
tlpss Nov 7, 2022
93bd988
set rgb_array as default render mode for gym.make
tlpss Nov 7, 2022
c9a29b9
Merge branch 'master' into fix_tests
araffin Nov 15, 2022
720317f
Merge branch 'master' into fix_tests
araffin Nov 16, 2022
53da2d0
undo changes & raise warning if not 'rgb_array'
tlpss Nov 20, 2022
8675011
Merge branch 'master' into fix_tests
araffin Nov 22, 2022
db81278
Merge branch 'master' into fix_tests
araffin Nov 25, 2022
54fb37e
Fix type check
araffin Nov 28, 2022
96793b9
Merge branch 'fix_tests' into fix_tests
araffin Nov 28, 2022
e30c117
Merge branch 'master' into fix_tests
qgallouedec Nov 28, 2022
07ca271
Remove recursion and fix type checking
araffin Nov 28, 2022
acd0420
Merge branch 'master' into fix_tests
araffin Nov 29, 2022
c0a6a18
Remove hacks for protobuf and gym 0.24
araffin Nov 29, 2022
b954703
Fix type annotations
araffin Nov 29, 2022
870139c
reuse existing render_mode attribute
tlpss Dec 3, 2022
bc5335f
return tiled images for 'human' render mode
tlpss Dec 3, 2022
c718106
Merge branch 'fix_tests' of https://github.com/carlosluis/stable-base…
tlpss Dec 3, 2022
11cf07f
Allow to use opencv for human render, fix typos
araffin Dec 6, 2022
9d91ea3
Merge pull request #4 from tlpss/tlss/fix_tests
araffin Dec 6, 2022
3f75a8a
Add warning when using non-zero start with Discrete (fixes #1197)
araffin Dec 7, 2022
08a4712
Merge branch 'master' into fix_tests
araffin Dec 10, 2022
93c86f2
Merge branch 'master' into fix_tests
araffin Dec 13, 2022
d35cfad
Merge branch 'master' into fix_tests
araffin Dec 18, 2022
6251fdc
Fix type checking
araffin Dec 18, 2022
be998e8
Merge branch 'fix_tests' of github.com:carlosluis/stable-baselines3 i…
araffin Dec 18, 2022
d24d30d
Merge branch 'fix_tests' into tlpss/fix_tests
araffin Dec 18, 2022
6b80c93
Bug fixes and handle more cases
araffin Dec 18, 2022
c09fa74
Throw proper warnings
araffin Dec 18, 2022
480a793
Update test
araffin Dec 18, 2022
e03b885
Fix new metadata name
araffin Dec 18, 2022
e4248df
Ignore numpy warnings
araffin Dec 18, 2022
16bb26b
Merge branch 'fix_tests' into tlpss/fix_tests
araffin Dec 18, 2022
1f8ccbe
Fixes in vec recorder
araffin Dec 18, 2022
f4e978a
Global ignore
araffin Dec 18, 2022
408e9c2
Merge branch 'fix_tests' into tlpss/fix_tests
araffin Dec 18, 2022
f98903a
Filter local warning too
araffin Dec 18, 2022
046c12b
Merge branch 'fix_tests' into tlpss/fix_tests
araffin Dec 18, 2022
595be86
Merge branch 'master' into fix_tests
araffin Dec 19, 2022
29086a5
Monkey patch not needed for gym 26
araffin Dec 19, 2022
254107a
Merge branch 'fix_tests' into tlpss/fix_tests
araffin Dec 19, 2022
6103962
Merge branch 'master' into fix_tests
araffin Dec 20, 2022
fbaa8ac
Merge branch 'fix_tests' into tlss/fix_tests
araffin Dec 20, 2022
20faf11
Merge branch 'master' into fix_tests
araffin Dec 22, 2022
01831b6
Merge branch 'master' into fix_tests
araffin Dec 22, 2022
3780476
Merge branch 'fix_tests' into tlpss/fix_tests
araffin Dec 22, 2022
085b4c8
Merge branch 'fix_tests' of github.com:tlpss/stable-baselines3 into t…
araffin Dec 22, 2022
6a3f45d
Add doc of VecEnv vs Gym API
araffin Dec 23, 2022
c645d49
Add render test
araffin Dec 23, 2022
3cf4d00
Merge pull request #3 from tlpss/fix_tests
araffin Dec 23, 2022
3f6413d
Fix return type
araffin Dec 23, 2022
ff609ad
Update VecEnv vs Gym API doc
araffin Dec 23, 2022
99589ce
Add note in the quickstart section
araffin Jan 2, 2023
cf75cdc
Merge branch 'master' into fix_tests
araffin Jan 2, 2023
3611f2c
Merge branch 'master' into fix_tests
araffin Jan 5, 2023
b428a27
Fix for custom render mode
araffin Jan 5, 2023
d98dc9e
Fix return type
araffin Jan 5, 2023
5c32861
Merge branch 'master' into fix_tests
araffin Jan 11, 2023
6eaecd2
Merge branch 'master' into fix_tests
araffin Jan 16, 2023
cd28666
Fix type checking
araffin Jan 16, 2023
4f796a0
Merge branch 'master' into fix_tests
araffin Jan 23, 2023
669ef02
Merge branch 'master' into fix_tests
araffin Jan 23, 2023
c9430ec
check test env test_buffer
qgallouedec Jan 24, 2023
546928c
skip render check
qgallouedec Jan 24, 2023
8462dbb
check env test_dict_env
qgallouedec Jan 24, 2023
205b987
test_env test_gae
qgallouedec Jan 24, 2023
1946082
check envs in remaining tests
qgallouedec Jan 24, 2023
7460782
Update tests
araffin Jan 25, 2023
0431c7a
Merge pull request #5 from DLR-RM/check_test_env
araffin Jan 25, 2023
e5575d8
Add warning for Discrete action space with non-zero (#1295)
araffin Jan 25, 2023
c951311
Merge branch 'master' into fix_tests
qgallouedec Jan 28, 2023
b787d98
Fix atari annotation
qgallouedec Jan 28, 2023
85bb0d4
ignore get_action_meanings [attr-defined]
qgallouedec Jan 28, 2023
ba5827e
Merge branch 'master' into fix_tests
araffin Feb 6, 2023
afa1c73
Fix mypy issues
araffin Feb 6, 2023
f03fd75
Merge branch 'master' into fix_tests
araffin Feb 11, 2023
e085ce1
Add patch for gym/gymnasium transition
araffin Feb 11, 2023
8fb8c89
Switch to gymnasium
araffin Feb 11, 2023
45b2042
Rely on signature instead of version
araffin Feb 11, 2023
cf1ec25
More patches
araffin Feb 11, 2023
951baee
Type ignore because of https://github.com/Farama-Foundation/Gymnasium…
araffin Feb 11, 2023
40048ba
Merge branch 'master' into fix_tests
araffin Feb 11, 2023
25e70b4
Fix doc build
araffin Feb 11, 2023
f23f43a
Fix pytype errors
araffin Feb 11, 2023
1cc406e
Fix atari requirement
araffin Feb 13, 2023
bfcb0ee
Update env checker due to change in dtype for Discrete
araffin Feb 13, 2023
360625a
Fix type hint
araffin Feb 13, 2023
f014774
Convert spaces for saved models
araffin Feb 13, 2023
fefe177
Ignore pytype
araffin Feb 13, 2023
1c5ca7b
Remove gitlab CI
araffin Feb 13, 2023
b730d22
Disable pytype for convert space
araffin Feb 13, 2023
a436891
Fix undefined info
araffin Feb 13, 2023
75217fa
Fix undefined info
araffin Feb 13, 2023
cff332c
Merge branch 'fix_tests' of github.com:carlosluis/stable-baselines3 i…
araffin Feb 13, 2023
c7e666b
Merge branch 'master' into feat/gymnasium-support
araffin Feb 19, 2023
65af7c1
Upgrade shimmy
araffin Feb 19, 2023
ad48559
Fix wrappers type annotation (need PR from Gymnasium)
araffin Feb 19, 2023
dc742fb
Fix gymnasium dependency
araffin Feb 19, 2023
ed8bcf3
Fix dependency declaration
araffin Feb 19, 2023
75c2266
Cap pygame version for python 3.7
araffin Feb 19, 2023
ce829c3
Point to master branch (v0.28.0)
araffin Feb 23, 2023
645b7ba
Fix: use main not master branch
araffin Feb 23, 2023
6da9b39
Merge branch 'master' into fix_tests
araffin Feb 25, 2023
06ad5a8
Rename done to terminated
araffin Feb 25, 2023
96c4565
Merge branch 'fix_tests' into feat/gymnasium-support
araffin Feb 25, 2023
93c10cf
Fix pygame dependency for python 3.7
araffin Feb 25, 2023
c5a5d73
Merge branch 'master' into fix_tests
araffin Feb 27, 2023
b0affcc
Merge branch 'fix_tests' into feat/gymnasium-support
araffin Feb 27, 2023
29201a7
Rename gym to gymnasium
araffin Feb 27, 2023
51ffad2
Merge branch 'master' into fix_tests
araffin Mar 3, 2023
ac97978
Merge branch 'fix_tests' into feat/gymnasium-support
araffin Mar 3, 2023
ae92d23
Update Gymnasium
araffin Mar 3, 2023
6296699
Fix test
araffin Mar 3, 2023
a2a03c5
Fix tests
araffin Mar 7, 2023
00b9bbb
Merge branch 'master' into fix_tests
araffin Mar 11, 2023
8a149f4
Merge branch 'fix_tests' of github.com:carlosluis/stable-baselines3 i…
araffin Mar 11, 2023
9fe7e6e
Merge branch 'fix_tests' into feat/gymnasium-support
araffin Mar 11, 2023
b82cacd
Forks don't have access to private variables
araffin Mar 11, 2023
07d2171
Merge branch 'master' into fix_tests
araffin Mar 12, 2023
d0f5e8a
Fix linter warnings
araffin Mar 12, 2023
baca99f
Merge branch 'fix_tests' into feat/gymnasium-support
araffin Mar 12, 2023
d5c79b0
[ci skip] Merge branch 'master' into fix_tests
araffin Mar 14, 2023
b9cfba1
Merge branch 'fix_tests' into feat/gymnasium-support
araffin Mar 14, 2023
5328921
Update read the doc env
araffin Mar 14, 2023
e91b436
Merge branch 'master' into fix_tests
araffin Mar 20, 2023
5ec7e39
Merge branch 'fix_tests' of github.com:carlosluis/stable-baselines3 i…
araffin Mar 20, 2023
524d0bb
Merge branch 'fix_tests' into feat/gymnasium-support
araffin Mar 20, 2023
986e6c0
Fix env checker for GoalEnv
araffin Mar 20, 2023
3dadca4
Merge branch 'fix_tests' into feat/gymnasium-support
araffin Mar 20, 2023
e5a1e9e
Fix import
araffin Mar 20, 2023
2be728d
Merge branch 'master' into fix_tests
araffin Mar 29, 2023
331853a
Update env checker (more info) and fix dtype
araffin Mar 29, 2023
68861b6
Use micromamab for Docker
araffin Mar 29, 2023
9f0d5d8
Update dependencies
araffin Mar 29, 2023
6617e6e
Clarify VecEnv doc
araffin Mar 29, 2023
82e3128
Merge branch 'fix_tests' into feat/gymnasium-support
araffin Mar 29, 2023
39eae4e
Fix Gymnasium version
araffin Mar 29, 2023
b853bc6
Copy file only after mamba install
araffin Mar 29, 2023
621f64f
[ci skip] Update docker doc
araffin Mar 29, 2023
5e1f507
Polish code
araffin Mar 29, 2023
aa1a64c
Merge branch 'master' into feat/gymnasium-support
araffin Apr 3, 2023
e77937f
Reformat
araffin Apr 3, 2023
91822e6
Merge branch 'master' into feat/gymnasium-support
araffin Apr 5, 2023
1390567
Remove deprecated features
araffin Apr 5, 2023
0e1e50d
Ignore warning
araffin Apr 5, 2023
77b0950
Merge branch 'master' into feat/gymnasium-support
araffin Apr 8, 2023
63307d4
Merge branch 'master' into feat/gymnasium-support
araffin Apr 12, 2023
9e57237
Update doc
araffin Apr 13, 2023
3bc8918
Update examples and changelog
araffin Apr 13, 2023
923bd46
Fix type annotation bundle (SAC, TD3, A2C, PPO, base class) (#1436)
araffin Apr 13, 2023
7f4ded5
Disable mypy for python 3.7
araffin Apr 13, 2023
eafd84c
Rename Gym26StepReturn
araffin Apr 13, 2023
e613373
Update continuous critic type annotation
araffin Apr 13, 2023
33cd8db
Fix pytype complain
araffin Apr 13, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Adjust mean reward threshold in failing test
  • Loading branch information
carlosluis committed Mar 8, 2022
commit daaa84c41e3b99968e34f96f241998a91e735013
2 changes: 1 addition & 1 deletion tests/test_identity.py
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ def test_discrete(model_class, env):

model = model_class("MlpPolicy", env_, gamma=0.4, seed=1, **kwargs).learn(n_steps)

evaluate_policy(model, env_, n_eval_episodes=20, reward_threshold=90, warn=False)
evaluate_policy(model, env_, n_eval_episodes=20, reward_threshold=86, warn=False)
obs = env.reset()

assert np.shape(model.predict(obs)[0]) == np.shape(obs)
Expand Down