Skip to content

Issues: pytorch/rl

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

163 Open 478 Closed
163 Open 478 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[BUG] Transform._call is not called from reset bug Something isn't working
#2595 opened Nov 22, 2024 by codingWhale13
@vmoens
[BUG] torchrl.objectives.SACLoss internal objective does not mask out terminated states bug Something isn't working
#2590 opened Nov 20, 2024 by fmeirinhos
3 tasks done
@vmoens
[BUG] torchrl.objectives.SACLoss is broken when there is more than one qvalue_network bug Something isn't working
#2589 opened Nov 20, 2024 by fmeirinhos
3 tasks done
@vmoens
[BUG] SliceSampler should return unique IDs when sampling multiple times from the same trajectory bug Something isn't working
#2588 opened Nov 20, 2024 by dmelcer9
3 tasks done
@vmoens
3
[Feature Request] Transform that stacks data for agents with identical specs enhancement New feature or request
#2566 opened Nov 14, 2024 by kurtamohler
1 task done
1
@kurtamohler
8
[Feature Request] Use context managers to toggle the recurrent mode of RNN modules? enhancement New feature or request
#2562 opened Nov 14, 2024 by thomasbbrunner
1 task done
@vmoens
7
[BUG] Vmap call in value estimate not compatible with torch_geometric radius graph bug Something isn't working
#2537 opened Nov 5, 2024 by matteobettini
@vmoens
[Feature Request] Include group-level done fields in the VMAS environment enhancement New feature or request
#2536 opened Nov 5, 2024 by thomasbbrunner
1 task done
@vmoens
9
[Feature Request] TorchRL for Python 3.13t enhancement New feature or request
#2535 opened Nov 4, 2024 by patchmeifyoucan
@vmoens
2
[BUG] SyncDataCollector Crashes when init_random_frames=0 bug Something isn't working
#2534 opened Nov 4, 2024 by AlexandreBrown
3 tasks done
@vmoens
1
[BUG] RuntimeError: Setting 'advantage' via the constructor is deprecated, use .set_keys(<key>='some_key') instead . bug Something isn't working
#2528 opened Oct 30, 2024 by jianzhnie
@vmoens
[BUG] target_value_network_params initialization bug in convert_to_functional() bug Something isn't working
#2523 opened Oct 28, 2024 by matinmoezzi
3 tasks done
@vmoens
[BUG] info['_weight'] device for Importance Sampling in PER bug Something isn't working
#2518 opened Oct 26, 2024 by EladSharony
3 tasks done
@vmoens
3
[Feature Request] Loss make_value_estimator takes a ValueEstimatorBase class as argument enhancement New feature or request
#2503 opened Oct 18, 2024 by louisfaury
1 task done
@vmoens
[Feature Request] Support compiling ReplayBuffer.extend/sample without recompile enhancement New feature or request
#2501 opened Oct 18, 2024 by kurtamohler
1 task done
@kurtamohler
5
[BUG] Tutorial #4, gym compat bug Something isn't working
#2495 opened Oct 15, 2024 by MaximilienLC
@vmoens
1
[BUG]ClipPPOLoss encounters an bug when calculating the loss in a composite action space scenario, failing to produce the correct result. bug Something isn't working
#2487 opened Oct 10, 2024 by Sui-Xing
@vmoens
3
[BUG] Problems with multidimensional nvec in MultiCategorical bug Something isn't working
#2486 opened Oct 10, 2024 by matteobettini
@vmoens
[Bug] Assert CompositeSpec order guarantees
#2482 opened Oct 10, 2024 by vmoens
[BUG] MaskedCategorical missing mode and deterministic_sample properties. bug Something isn't working
#2479 opened Oct 9, 2024 by MorganeAyle
@vmoens
[BUG] GAE parameters (gamma, lmbda) seemed to get changed by ClipPPOLoss, advantage module does not calculate loss_critic bug Something isn't working
#2462 opened Oct 3, 2024 by therealjoker4u
@vmoens
1
[BUG]UserWarning: deterministic_sample wasn't found when queried in <class 'torch.distributions.categorical.Categorical'>. CompositeDistribution is falling back on mode instead. For better code quality and efficiency, make sure to either provide a distribution with a deterministic_sample attribute or to change the InteractionMode to the desired value. bug Something isn't working
#2458 opened Sep 27, 2024 by Sui-Xing
@vmoens
[BUG] RenameTransform of ParallelEnv is not the same as ParallelEnv of transformed environment bug Something isn't working
#2445 opened Sep 19, 2024 by thomasbbrunner
3 tasks done
@vmoens
GAE does not support LSTM-based value network. enhancement New feature or request
#2444 opened Sep 19, 2024 by levelrin
1 task done
@vmoens
2
Document the TensorDict structure of the return of the _step() function for a multi agent environment enhancement New feature or request
#2425 opened Sep 8, 2024 by zoetsekas
1 task done
@vmoens
2
ProTip! Exclude everything labeled bug with -label:bug.