[Refactor] Use <spec>_unbatched in VMAS

[vmoens]

Stack from ghstack (oldest at bottom):

• -> [Refactor] Use <spec>_unbatched in VMAS #2593
• [BugFix] action_spec_unbatched whenever necessary #2592

@matteobettini LMK if that works

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2593

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• [DomainsOnly] Jobs fail with GLIBC version not found

❌ 3 New Failures, 1 Cancelled Job, 15 Unrelated Failures

As of commit ed4493d with merge base a47b32c ():

NEW FAILURES - The following jobs have failed:

• Continuous Benchmark (PR) / CPU Pytest benchmark (gh)
  FAILED ../../../../../../tmp/test_objectives_benchmarks.py::test_iql_speed[True-None] - torch._dynamo.exc.Unsupported: Graph break under GenericContextWrappingVariable
• Continuous Benchmark (PR) / GPU Pytest benchmark (gh)
  FAILED ../../../../tmp/test_objectives_benchmarks.py::test_iql_speed[True-None] - torch._dynamo.exc.Unsupported: Graph break under GenericContextWrappingVariable
• SOTA Tests on Linux / tests (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 3d3f5592e0015be23bb5bbcf2b7631c59baa7149456d81383bebb9d346b6c242 /exec failed with exit code 1

CANCELLED JOB - The following job was cancelled. Please retry:

• Generate documentation / build-docs (3.10, 12.1) / linux-job (gh)
  ##[error]The operation was canceled.

FLAKY - The following job failed but was likely due to flakiness present on trunk:

• Unit-tests on Linux / tests-cpu-oldget (3.12) / linux-job (gh) (similar failure)
  test/test_trainer.py::TestRecorder::test_recorder

BROKEN TRUNK - The following jobs failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Build Linux Wheels / pytorch/rl (pytorch/rl, test/smoke_test.py, torchrl) / upload / manywheel-py3_9-rocm6_1 (gh) (trunk failure)
  ##[error]Unable to find an artifact with the name: pytorch_rl__3.9_rocm6.1_x86_64
• Build Linux Wheels / pytorch/rl (pytorch/rl, test/smoke_test.py, torchrl) / upload / manywheel-py3_9-rocm6_2 (gh) (trunk failure)
  ##[error]Unable to find an artifact with the name: pytorch_rl__3.9_rocm6.2_x86_64
• Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cpu (gh) (trunk failure)
  ##[error]Unable to find any artifacts for the associated workflow
• Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cuda11_8 (gh) (trunk failure)
  ##[error]Unable to find any artifacts for the associated workflow
• Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cuda12_4 (gh) (trunk failure)
  ##[error]Unable to find any artifacts for the associated workflow
• Habitat Tests on Linux / tests (3.9, 12.1) / linux-job (gh) (trunk failure)
  AttributeError: _ARRAY_API not found
• Libs Tests on Linux / unittests-jumanji (3.9, 12.1) / linux-job (gh) (trunk failure)
  test/test_libs.py::TestJumanji::test_jumanji_rendering[batch_size1-RubiksCube-v0]
• Unit-tests on Linux / tests-cpu (3.10) / linux-job (gh) (trunk failure)
  test/test_trainer.py::TestRecorder::test_recorder
• Unit-tests on Linux / tests-cpu (3.11) / linux-job (gh) (trunk failure)
  test/test_trainer.py::TestRecorder::test_recorder
• Unit-tests on Linux / tests-cpu (3.12) / linux-job (gh) (trunk failure)
  test/test_trainer.py::TestRecorder::test_recorder
• Unit-tests on Linux / tests-cpu (3.9) / linux-job (gh) (trunk failure)
  test/test_trainer.py::TestRecorder::test_recorder
• Unit-tests on Linux / tests-gpu (3.11, 12.1) / linux-job (gh) (trunk failure)
  test/test_trainer.py::TestRecorder::test_recorder
• Unit-tests on Linux / tests-stable-gpu (3.10, 11.8) / linux-job (gh) (trunk failure)
  test/test_trainer.py::TestRecorder::test_recorder
• Unit-tests on Windows / unittests-cpu / windows-job (gh) (trunk failure)
  ##[error]Process completed with exit code 1.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[matteobettini]

Cool! So the batched versions are built automatically?

[vmoens]

yep I wrote a setter for them