0.0.2a
Pre-release
Pre-release
What's Changed
- [BugFix] Fixed compose which ignored inv_transforms of child by @nicolas-dufour in #328
- [BugFix] functorch installation in CircleCI by @vmoens in #336
- [Refactor] VecNorm inference API by @vmoens in #337
- TransformedEnv sets added Transforms into eval mode by @alexanderlobov in #331
- [Refactor] make to_tensordict() create a copy of the content by @nicolas-dufour in #334
- [CircleCI] Fix dm_control rendering by @vmoens in #339
- [BugFix]: joining processes when they're done by @vmoens in #311
- [Test] pass the OS error in case the file isn't closed by @tongbaojia in #344
- [Feature] Make default rollout tensordict contiguous by @vmoens in #343
- [BugFix] Clone memmap tensors on regular tensors and other replay buffer improvements by @vmoens in #340
- [CI] Using latest gym by @vmoens in #346
- [Doc] Coding your first DDPG tutorial by @vmoens in #345
- [Doc] Minor: typos in DDPG by @vmoens in #354
- [Feature] Register lambda and gamma in buffers by @vmoens in #353
- [Feature] Implement eq for TensorSpec by @omikad in #358
- [Doc] Multi-tasking tutorial by @vmoens in #352
- [Feature] Env refactoring for model based RL by @nicolas-dufour in #315
- [Feature]: Added support for TensorDictSequence module subsampling by @nicolas-dufour in #332
- [BugFix] Add lock to vec norm transform by @jaschmid-fb in #356
- [Perf]: Improve PPO training performance by @vmoens in #297
- [BugFix] Functorch-Tensordict bug fixes by @vmoens in #361
- Revert "[BugFix] Functorch-Tensordict bug fixes" by @vmoens in #362
- [BugFix] Functorch-Tensordict bug fixes by @vmoens in #363
- [Feature] CSVLogger (ABBANDONED) by @vmoens in #371
- [Feature] Support tensor-based decay in TD-lambda by @tcbegley in #360
- [Feature] CSVLogger by @vmoens in #372
- [BugFix] Fewer env instantiations for better mujoco rendering by @vmoens in #378
- [Feature] change imports of environment libraries (gym and dm_control) at lower levels by @guabao in #379
- [BugFix] Representation of indexed nested tensordict by @vmoens in #370
- [BugFix] In-place
__setitem__
for SubTensorDict by @vmoens in #369 - [Feature] Add
ProbabilisticTensorDictModule
dist key mapping support by @nicolas-dufour in #376 - [Feature]: R3M integration by @vmoens in #321
- [Feature] static_seed flag for envs, vectorized envs and collectors by @vmoens in #385
- [Feature] AdditiveGaussian exploration strategy by @vmoens in #388
- [Feature] Multi-images R3M by @vmoens in #389
- [Feature] Flatten multi-images in R3M by @vmoens in #391
- [Quality] Code cleanup for fbsync by @vmoens in #392
- [Feature] In-house functional modules for TorchRL using TensorDict by @vmoens in #387
- [Quality] Code cleanup for fbsync by @vmoens in #397
- [Doc] Add charts to examples by @nicolas-dufour in #374
- [Feature] Vectorized GAE by @vmoens in #365
- [BugFix] Temporarily fix gym to 0.25.1 to fix CI by @vmoens in #411
- [Feature] Create a Squeeze transform and update Unsqueeze transform by @reachsumit in #408
- [Naming] Recurse kwarg to match pytorch by @matt-fff in #410
- [Feature] Add all implemented loggers to the init of loggers by @flinder in #402
- [BugFix] Fix gym 0.26 compatibility by @vmoens in #403
- [BugFix] Remove submodules by @vmoens in #414
- [Feature] lock tensordict when calling
share_memory_()
by @fdabek1 in #412 - [BugFix] Updated TensorDict.expand to work as Tensor.expand by @AnshulSehgal in #409
- [BugFix] Looser check for test_recorder assertion by @vmoens in #415
- [Feature] Allow spec to be passed directly to exploration wrappers by @vmoens in #418
- [BugFix] Collector revert to default exploration mode if empty string is passed by @vmoens in #421
- [Naming] Rename _TargetNetUpdate to TargetNetUpdater, making it public by @yushiyangk in #422
- [Doc] Re-run tutorials by @vmoens in #381
- Revert "[Doc] Re-run tutorials" (colab links broken) by @vmoens in #423
- [Feature] Switch back to latest gym by @vmoens in #425
- [Feature] TensorDict without device by @tcbegley in #413
- Updated the README.md file by @bashnick in #427
- [Feature] Adding support for initialising TensorDicts from nested dicts by @zeenolife in #404
- [Features] Make image_size a cfg param by @nicolas-dufour in #430
- Make TensorDict.expand accept Sequence arguments by @nicolasgriffiths in #424
- [Doc] Readme revamp for efficiency/modularity display by @vmoens in #382
- [Feature] New
biased_softplus
semantic to allow for minimum scale setting by @nicolas-dufour in #428 - [Tutorial] Re-run tutos by @vmoens in #434
- [BugFix] mixed device_safe vs device by @vmoens in #429
- [BugFix] Explicit params and buffers by @agrotov in #436
- [BugFix] Fixed Additive noise by @nicolas-dufour in #441
- [Tests] Test loggers video saving by @bashnick in #439
- Revert "[BugFix] Fixed Additive noise" by @vmoens in #442
- [Refactor] Rename TensorDictSequence to TensorDictSequential by @ronert in #440
- [Refactor] Refactoring
set*()
methods forTensorDictBase
class by @zeenolife in #438 - [Cleanup] Removing gym-retro interface by @vmoens in #444
- [BugFix]: Fix additive noise by @nicolas-dufour in #447
- [BugFix] CatTensors: Prepended
next_
to the out_key by @ggimler3 in #449 - [BugFix] Fix AdditiveGaussian exploration tests by @vmoens in #450
- [BugFix] Wrong call to
device_safe
in replay buffer code by @vmoens in #454 - [BugFix] Add transform_observation_spec _R3MNet by @ymwdalex in #443
- [Doc] Add a knowledge base by @shagunsodhani in #375
- [Feature] Allow for actions and rewards to be in the reset tensordict by @vmoens in #458
- [Doc] Readme for knowledge base by @vmoens in #459
- [Feature] Added
batch_lock
attribute in EnvBase by @nicolas-dufour in #399 - [BugFix] deepcopy specs before transforming by @vmoens in #461
- [BugFix]: Fixed dm_control action type casting by @nicolas-dufour in #463
- [Versioning] Version 0.0.2a0 by @vmoens in #465
New Contributors
- @alexanderlobov made their first contribution in #331
- @tongbaojia made their first contribution in #344
- @omikad made their first contribution in #358
- @jaschmid-fb made their first contribution in #356
- @tcbegley made their first contribution in #360
- @guabao made their first contribution in #379
- @reachsumit made their first contribution in #408
- @matt-fff made their first contribution in #410
- @flinder made their first contribution in #402
- @fdabek1 made their first contribution in #412
- @AnshulSehgal made their first contribution in #409
- @yushiyangk made their first contribution in #422
- @bashnick made their first contribution in #427
- @zeenolife made their first contribution in #404
- @nicolasgriffiths made their first contribution in #424
- @agrotov made their first contribution in #436
- @ronert made their first contribution in #440
- @ggimler3 made their first contribution in #449
- @ymwdalex made their first contribution in #443
Full Changelog: v0.0.1c...v0.0.2a