Skip to content

Tutorials/Sim2Real Blogs: Add MuJoCo and MJWarp robot lessons. - #279

Merged
jnbntz merged 4 commits into
NVIDIA:mainfrom
johnnynunez:codex/blog2-mujoco-warp
Oct 5, 2026
Merged

jnbntz merged 4 commits into
NVIDIA:mainfrom
johnnynunez:codex/blog2-mujoco-warp

Conversation

@johnnynunez

@johnnynunez johnnynunez commented Sep 23, 2026 •

Copy link
Copy Markdown
Contributor

Add tutorials/sim2real-blogs/ with three companion lessons for How to Use NVIDIA Warp and MJWarp: MuJoCo fundamentals, CPU pick and place, and batched MuJoCo Warp physics.

The SO-101 and Seeed reBot DevArm can run the original stacking task or an optional receiving-box task. With --task box, each robot grasps, lifts, carries and releases both cubes into the box. Measured checks require opposing loaded jaw contacts, airborne transport, whole-cube containment, detached settling and gripper withdrawal. The notebook cells explicitly select reference or student implementations. The default stack exercise, capacity checks and synchronized fixed-control benchmarks are preserved.

The tutorial includes completed solutions, pinned MuJoCo 3.12 / Warp 1.17 dependencies, asset attribution, a dedicated Docker/Brev environment and a test entrypoint. Robot meshes download from pinned upstream revisions. The existing tutorials/warp/ tree matches the PR base.

Validation

  • Both robots passed the stack and box tasks on CPU and separately on each of two RTX PRO 6000 Blackwell GPUs: 12 task checks. Final GPU box runs used 2,000 frames / 40 simulated seconds and passed independent raw-observation audits without capacity overflow.
  • The Docker image built on the workstation. Its test entrypoint passed 27 tests and 5 subtests, zero skips, including the CUDA task, captured benchmark and real constraint-overflow rejection. Both box references also passed inside the image on GPU.
  • All three published notebooks pass canonical formatting; the existing 18 code cells in the two task notebooks remain unchanged, with one optional box cell added to each. Syntax, 26 local links, Compose configuration and diff checks pass.

See the validation record for versions, capacities, settling criteria and tested scope. The demonstrations disclose actuator overrides and precision differences; benchmark timings measure physics stepping, not completed robot tasks or training speed.

Live Brev/Compose deployment, interactive viewers and Colab were not tested. Colab links target upstream main and become available after merge. Fork CI still requires the maintainers' normal review process.

Add Blog 2 companion notebooks, exercises, solutions, reproducible dependencies, and task/throughput validation. Preserve source and asset attribution.

Signed-off-by: Johnny <johnnynuca14@gmail.com>
@copy-pr-bot

copy-pr-bot Bot commented Sep 23, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@github-actions

Copy link
Copy Markdown
Contributor

👋 Thank you for your contribution!

This pull request is from a forked repository so GitHub Actions will not be able to run CI. A maintainer will review your changes shortly and manually trigger the CI.

@maintainers Please review this PR when you have a chance and follow the instructions in the CONTRIBUTING.md file to trigger the CI.

Explain that the scripted IK uses command-derived scratch state, while copied GPU state supports rendering and task inspection.

Signed-off-by: Johnny <johnnynuca14@gmail.com>
Restore the original Warp tutorial and move the SO-101 lessons, tests, and Brev environment into tutorials/sim2real-blogs. Update notebook numbering, setup paths, navigation, and the tutorial index.

Validation: 8 tests passed, 3 CUDA tests skipped; notebook format, relative links, local setup paths, Compose configuration, Linux dependency resolution, and diff checks passed.

Signed-off-by: Johnny <johnnynuca14@gmail.com>
@johnnynunez johnnynunez changed the title Tutorials/Warp: Add SO-101 MuJoCo Warp simulation lessons Tutorials/Sim2Real Blogs: Add independent SO-101 simulation lessons Sep 23, 2026
@johnnynunez
johnnynunez marked this pull request as ready for review October 2, 2026 19:34
…bots.

Add an optional two-cube receiving-box task to the CPU and GPU lessons, with measured grasp, lift, carry, release and settling checks for SO-101 and reBot. Keep the default stack exercises and CUDA benchmark guards intact. Add opt-in notebook cells, regression tests and updated validation instructions.

Signed-off-by: Johnny <johnnync13@gmail.com>
@johnnynunez johnnynunez changed the title Tutorials/Sim2Real Blogs: Add independent SO-101 simulation lessons Tutorials/Sim2Real Blogs: Add MuJoCo and MJWarp robot lessons. Oct 4, 2026
@jnbntz jnbntz assigned jnbntz and unassigned jnbntz Oct 5, 2026
@jnbntz
jnbntz self-requested a review October 5, 2026 21:17
@jnbntz
jnbntz merged commit 7c4dff0 into NVIDIA:main Oct 5, 2026
johnnynunez added a commit to johnnynunez/accelerated-computing-hub that referenced this pull request Oct 10, 2026
Refresh the MuJoCo/MJWarp lessons with the physically validated two-cube receiving-box task, matched CPU/GPU benchmark, finite viewer lifecycle, reproducible environments and unchanged raw evidence.

Follow-up to NVIDIA#279.

Signed-off-by: Johnny <johnnync13@gmail.com>
jnbntz pushed a commit that referenced this pull request Oct 14, 2026
Refresh the MuJoCo/MJWarp lessons with the physically validated two-cube receiving-box task, matched CPU/GPU benchmark, finite viewer lifecycle, reproducible environments and unchanged raw evidence.

Follow-up to #279.

Signed-off-by: Johnny <johnnync13@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants