diff --git a/README.md b/README.md
index 659ea94..67270f5 100644
--- a/README.md
+++ b/README.md
@@ -26,6 +26,14 @@ All four covers are **AI-generated editorial illustrations**, not footage, measu
## Latest studies
+[From a conversation to compatible robot skills](reports/Chat%20to%20compatible%20robot%20skills.md)
+connects a photo and desired outcome to scene review, compatible skill retrieval,
+verified installation and inspectable simulation through a proposed chat workflow.
+Real local object detection and one native LIBERO reset are verified; OpenVLA
+weights remain incomplete, and no learned or steered robot actions have run.
+[Inspect the runtime receipt](topics/physical-grounding/runs/2026-10-27-robot-lab/README.md)
+and [Hugging Face concept card](https://huggingface.co/spaces/Dvidia/robot-simulation-lab/blob/main/docs/robot-chat-v01/concept.md).
+
[Live PiPER shoe workstation v0.1](reports/Live%20PiPER%20shoe%20workstation%20v01.md)
lets readers drag a tool target, adjust the gripper and nudge a free rigid shoe
diff --git a/docs/downloads/reports/Chat to compatible robot skills.md b/docs/downloads/reports/Chat to compatible robot skills.md
new file mode 100644
index 0000000..a8a8556
--- /dev/null
+++ b/docs/downloads/reports/Chat to compatible robot skills.md
@@ -0,0 +1,233 @@
+# Chat to compatible robot skills
+
+DVIDIA research · 27 October 2026 · Product architecture and local runtime note
+
+Original writing: [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/). Referenced models, code and assets retain their own terms.
+
+The intended interface is a conversation: attach a photo, describe a desired
+outcome, and let DVIDIA find an executable skill for the available robot. The
+conversation should carry the workflow from observation through installation,
+simulation and review. A user should not need to assemble those tools manually.
+
+The current prototype connects photo analysis and conservative skill retrieval
+to a separate local worker for ten LIBERO-10 task descriptions sharing one
+revision-pinned OpenVLA checkpoint. **Real local object detection and one native
+simulator reset are verified. OpenVLA model inference, learned robot actions and
+activation-steered robot actions have not been executed.** The checkpoint
+transfer stopped after an 8 MiB partial download; this is not an installation or
+a successful task. The [runtime receipt](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/runtime-receipt.json)
+and [evidence notes](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/README.md)
+preserve that boundary. A companion [Hugging Face concept card](https://huggingface.co/spaces/Dvidia/robot-simulation-lab/blob/main/docs/robot-chat-v01/concept.md)
+tracks the same documentation scope; it does not host OpenVLA inference.
+
+## Implementation follow-up — 28 October 2026
+
+The local prototype now implements the photo/outcome composer and conversation
+cards. A unique compatible unblocked task starts verified installation and real
+scene preparation; the user sees the simulator camera before choosing Run in
+simulation. Connection settings, object corrections and action/neuron inspection
+are expandable. This is a typed tool workflow with conservative lexical
+retrieval; the conversation does not add a general language planner.
+
+Nineteen focused chat/client/planner tests and 42 worker tests pass. New
+regressions reject reversed spatial destinations and wrong target colors.
+Installation cancellation races and explicit stop-tracking recovery are handled.
+Browser control initially timed out, then recovered in a fresh tab. Development
+and built desktop previews verified real photo detection, an unsupported
+dishwashing reply, actual task-5 camera capture, unique compatible retrieval and
+live installation progress. Browser error logs were empty. Phone-sized layout
+acceptance remains pending. The repaired downloader has resumed the real
+checkpoint transfer, but no completed installation, learned action or steering
+result is established. The 26 October receipt below remains unchanged.
+
+
+
+The screenshot shows installation progress, not robot execution.
+
+## One conversation carries the task
+
+A useful request is “Put the book in the back compartment of the caddy,” with a
+photo attached. DVIDIA needs to identify the intended object and destination,
+look for a compatible behavior, check its prerequisites and expose any missing
+evidence. The product should present these as progress in one conversation:
+
+| Conversation event | What it represents |
+| --- | --- |
+| Photo and desired outcome | User input, including explicit corrections |
+| “I found a book; please identify its destination” | A grounded question when the evidence is insufficient |
+| Skill card with prerequisites and compatibility | A candidate, with reasons it can or cannot run |
+| Download progress and verified installation | Actual artifact state, including interruption and retry |
+| Simulator preview and run progress | A real task reset followed by actual policy actions when available |
+| Outcome and inspectable trace | Success, failure or cancellation with actions and observations |
+| “Try this intervention” | An experimental rerun with the same initial simulator state |
+
+This is the conversational simplification implemented in the local prototype.
+Detailed connection settings, manifests, action vectors and channel controls can
+live in expandable cards. The conversation remains an interface to typed tools;
+assistant prose cannot mark an artifact installed or a task completed.
+
+“Tidy this room” expresses a valid desired outcome but leaves important
+decisions unresolved: where toys belong, which clothes are dirty, whether a
+container is reachable and whether the robot has the required behaviors. A photo
+does not answer all of these questions. The first version should ask for missing
+destinations or state evidence and report unsupported tasks. General household
+task decomposition and automatic selection of multi-skill sequences are future
+work. No dishwashing, laundry or toy-sorting competence is established by this
+prototype.
+
+## Retrieve by intended change, then check compatibility
+
+The architecture connects five distinct decisions:
+
+```text
+Photo + desired outcome
+ -> observations with source and uncertainty
+ -> candidate skills with prerequisites and effects
+ -> compatible artifact + verified installation
+ -> actual simulator state + policy execution
+ -> measured outcome + inspectable trace
+```
+
+An object name is a useful search clue, but the intended change determines
+whether a skill is relevant. A mug-placement task does not satisfy a request to
+wash a mug. A drawer task that closes the drawer adds an unwanted effect if the
+user asked for it to remain open. The current browser planner uses bounded
+lexical matching and aliases; it checks object identities, destinations,
+relations, state changes and negation, then rejects incompatible profiles. It is
+not a learned affordance estimator or a general language planner.
+
+This separation is motivated by [SayCan](https://say-can.github.io/), which
+combines language-based skill relevance with state-dependent affordances. Our
+current rule-based filter does not reproduce SayCan's learned value functions
+or its reported performance. The design implication is to keep goal relevance,
+observed prerequisites and runtime compatibility independently inspectable.
+
+Every executable candidate currently carries a skill ID, instruction, required
+objects, effects, prerequisites, profile ID, checkpoint repository, immutable
+revision and benchmark task ID. The present profile is
+`libero-panda-openvla-v1`: a Franka Panda simulation using seven-dimensional OSC
+pose actions. Its checkpoint is
+[`openvla/openvla-7b-finetuned-libero-10`](https://huggingface.co/openvla/openvla-7b-finetuned-libero-10/tree/80970322773f81baa2e22fe495d0487b93a05cfa).
+The ten task entries share the same checkpoint; downloading each task does not
+create ten separate learned policies.
+
+The [example v1 manifest](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/skill-manifest.example.json)
+is documentation only and contains no installed artifact.
+
+A broader skill registry will also need versioned observation and action
+schemas, units, control rate, gripper convention, tested operating envelope,
+required sensors, adapter versions and task-specific evaluation receipts.
+Hardware compatibility would require its own tested adapter and qualification.
+Those extended registry fields are a proposed contract, not an implemented
+universal skill package.
+
+## Execution belongs to the local worker
+
+The browser communicates with an isolated loopback worker using the typed
+`dvidia.robot-lab.v1` protocol and an in-memory capability. The worker performs
+real detector calls, artifact verification, native resets, model loading and
+bounded runs. It contains no physical robot driver. Checkpoint size, revision
+and digests are verified before atomic activation; partial files never count as
+an installed skill. The runtime loads explicit classes from pinned OpenVLA
+source rather than executing a checkpoint's remote class mapping.
+
+An arbitrary household photo is planning input. It is not an executable LIBERO
+state. Before a run, the user must select a supported benchmark task and capture
+its real simulator camera and initial state. Task metadata is marked as
+simulator evidence, distinct from image detections and user corrections. A run
+is bound to that task, scene, seed and installed checkpoint. Completion must
+come from the simulator's task-success signal.
+
+[OpenVLA](https://github.com/openvla/openvla) supplies a language-conditioned
+robot action policy. The selected [checkpoint card](https://huggingface.co/openvla/openvla-7b-finetuned-libero-10)
+describes a LIBERO-10 fine-tune; it is a concrete starting point for this
+benchmark-specific experiment, not a generally installable housekeeping model.
+The runtime uses `predict_action` with the `libero_10` normalization statistics.
+Code, checkpoint and underlying model terms need separate review; the upstream
+MIT labels do not replace the applicable Llama 2 terms or third-party asset
+licenses.
+
+## What has actually run
+
+The retained receipt was recorded on 26 October 2026 and is published here as a
+historical engineering result. It is not a fresh benchmark of this note's date.
+
+| Component | Recorded evidence | Limit |
+| --- | --- | --- |
+| Local runtime | Python 3.12.9, Torch 2.6.0 and MPS detected on an Apple Silicon Mac | Full OpenVLA memory fit and latency unverified |
+| Real photo inference | Verified TorchVision SSDlite checkpoint; cup 0.9957, person 0.8254 and dining table 0.4730 on one editorial image | Confidence scores are detector outputs, not measured accuracy; no dirt, color, ownership or task-state judgment |
+| Native task reset | LIBERO-10 task 5, seed 7, book/caddy camera image and flattened-state digest | Zero policy actions; ten no-op settling steps only |
+| Reset repeatability | Worker-thread and independent main-thread reset digests match | Matching initial state does not establish deterministic inference or rollouts |
+| Artifact installation | Interrupted transfer retained 8 MiB of a roughly 15.1 GB checkpoint | No activated checkpoint |
+| Policy and steering | Transport and hook fixtures tested | No learned rollout, task result or behavioral steering measurement |
+
+The reset digest is
+`b133849e34e709aaecf9f42e1a281d9dc53dfeeebf01d5e41077914b8d12893e`.
+The macOS worker uses MuJoCo's official offscreen CGL context to avoid initializing
+GLFW/AppKit from an HTTP worker thread. This changes context selection, not the
+physics or observed state. Only the task-5 asset closure was provisioned for the
+recorded runtime check; other task assets remain locally unverified.
+
+
+
+The photograph used for detector testing was an editorial illustration from the
+app, not a physical robot camera capture. The simulator image above is an actual
+rendered reset. Neither is evidence that a robot performed the requested action.
+
+## Neuron exploration is a separate measured intervention
+
+[Lyra's neuron explorer](https://github.com/lyramakesmusic/neuron-explorer)
+inspired the interaction: inspect model units, change a unit's activation and
+retain the resulting behavior. Its text-model experiments do not by themselves
+establish a robot control method. The directly relevant robotics precedent is
+[Mechanistic Interpretability for Steering Vision Language Action Models](https://vla-mech-interp.github.io/),
+which studies semantic activation directions and interventions in OpenVLA and
+π₀. Its [research code](https://github.com/Physical-AI-Safety-Institute/mechanistic-steering-vlas)
+is a methodological reference; the DVIDIA worker uses an original hook and does
+not vendor that toolkit.
+
+The implemented hook observes a zero-based intermediate Llama MLP channel at the
+input to `down_proj`. It records the last token's value on each autoregressive
+forward pass and can add a bounded raw dose to that channel. The displayed
+per-action value averages the pre-intervention values across generation passes.
+This is **a raw channel intervention**, not an identified “careful,” “fast” or
+“move left” neuron. It is also not an implementation-equivalent reproduction of
+the paper's semantic cluster interventions. Hook cleanup and cancellation have
+unit coverage; their effects on a loaded robot policy remain unmeasured.
+
+Before behavioral claims, compare an unsteered baseline and intervention on the
+same checkpoint, task, seed, preprocessing and exact reset digest. Record all
+action dimensions, end-effector motion, activation summaries, cameras,
+completion and failures. Current portable Pillow preprocessing is explicitly a
+numerical variant of upstream's TensorFlow path, so published OpenVLA benchmark
+scores are not a performance reference for this Mac configuration.
+
+## Staged evaluation and release gates
+
+1. **Conversation and retrieval:** freeze a small set of supported and
+ unsupported requests, including ambiguous destinations, negation and desired
+ state changes. Independently label compatible candidates. Report retrieval
+ precision and recall, unsupported-task handling and clarification behavior.
+ An interaction that looks correct is not evidence of execution.
+2. **Installation and one-action diagnostic:** finish the revision-pinned
+ transfer, verify every artifact, load the full model and execute one real
+ action on the recorded task-5 reset. Record peak memory, load/inference time,
+ actual action vector and failure status. Stop if memory or rendering is
+ insufficient; a substitute controller does not satisfy this gate.
+3. **Baseline simulation:** run bounded unsteered episodes on a frozen set of
+ seeds. Retain every attempt and the actual LIBERO success signal. Report
+ strict completion, step counts, latency and invalid attempts separately.
+4. **Causal channel study:** choose units and doses using development scenes,
+ then freeze them. Compare paired baseline, sham-hook, positive/negative-dose
+ and randomly selected channel controls on held-out seeds. Measure task
+ completion alongside motion changes; do not select only successful videos.
+5. **Skill sequencing and household transfer:** introduce separately qualified
+ skills, evidence refresh after each action, explicit recovery and destination
+ rules. Hardware execution needs independent adapter, sensing and task
+ qualification. This stage is not implemented or run.
+
+Stages 2–5 remain unrun. The first deliverable is an honest conversation that
+connects to real tools and makes missing capability understandable. The research
+question is whether that interface can select a skill whose measured behavior
+achieves the user's intended change, and whether controlled interventions alter
+that behavior reproducibly without degrading completion.
diff --git a/docs/downloads/topics/physical-grounding/README.md b/docs/downloads/topics/physical-grounding/README.md
index 7235a81..ae82743 100644
--- a/docs/downloads/topics/physical-grounding/README.md
+++ b/docs/downloads/topics/physical-grounding/README.md
@@ -1,5 +1,16 @@
# Physical grounding
+## Chat to compatible robot skills — 27 October 2026
+
+[From a conversation to compatible robot skills](../../reports/Chat%20to%20compatible%20robot%20skills.md)
+proposes one conversation from photo and desired outcome to grounded skill
+selection, installation, simulation and trace inspection. The local prototype
+records real object detection and one repeated native task-5 reset. An interrupted
+8 MiB partial checkpoint is not an installation; OpenVLA actions, steering
+measurements, general household planning and hardware execution remain unrun.
+[The runtime archive](runs/2026-10-27-robot-lab/README.md) preserves the exact
+receipt, actual reset image and a documentation-only skill manifest.
+
## Live PiPER shoe workstation — 13 October 2026
diff --git a/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/README.md b/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/README.md
new file mode 100644
index 0000000..9904fcb
--- /dev/null
+++ b/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/README.md
@@ -0,0 +1,68 @@
+# Photo, outcome and compatible robot skills
+
+Publication date: 27 October 2026. Runtime receipt: 26 October 2026.
+
+This archive supports [Chat to compatible robot skills](../../../../reports/Chat%20to%20compatible%20robot%20skills.md).
+It contains real local runtime checks and an actual simulator reset, with no
+learned policy rollout or steering result.
+
+- [Runtime receipt](runtime-receipt.json): sanitized dependency versions,
+ upstream source revisions, detector outputs, task/seed, reset digest and
+ original worker source digests.
+- [Example v1 skill manifest](skill-manifest.example.json): current catalog fields
+ for task 5, marked unavailable until an actual runtime checks compatibility.
+ It bundles no policy and is not an installation.
+- [Native task-5 reset camera](libero-task5-reset.png): 256 × 256 image rendered
+ after ten no-op settling steps, before any learned action.
+
+The receipt is copied byte-for-byte from the app's original engineering evidence.
+Its source digests describe that snapshot, not later installer or interface
+revisions. The separate test fixtures recorded in it are explicitly synthetic;
+the detector inference and simulator reset are actual runtime observations.
+No private capability, photo payload or account credential is included.
+
+## Reproduction boundary
+
+The public upstream sources are pinned as follows:
+
+| Artifact | Revision |
+| --- | --- |
+| OpenVLA source | `c8f03f48af692657d3060c19588038c7220e9af9` |
+| LIBERO source | `8f1084e3132a39270c3a13ebe37270a43ece2a01` |
+| `openvla/openvla-7b-finetuned-libero-10` | `80970322773f81baa2e22fe495d0487b93a05cfa` |
+
+The model revision identifies the intended checkpoint; its weights were not
+installed for this receipt. The interrupted transfer retained an 8 MiB partial
+file and no activation marker. Only the task-5 study/book/caddy asset closure
+was fetched. A complete standalone worker release is separate from this
+documentation archive; these two evidence files are not an installable skill.
+
+The reset uses task order index 0, LIBERO-10 task index 5 and seed 7. It performs
+ten no-op settling steps and hashes the flattened simulator state. The worker
+thread and independent main-thread run produced the same digest:
+
+```text
+b133849e34e709aaecf9f42e1a281d9dc53dfeeebf01d5e41077914b8d12893e
+```
+
+Apple MPS availability does not prove the full model fits or executes correctly.
+The camera is simulation evidence, not physical hardware evidence. All upstream
+model, simulator and asset terms remain applicable.
+
+## Hugging Face publication
+
+[Publication receipt](huggingface-publication.json) records the documentation-only
+commit, exact file hashes and anonymous readback. The update preserves all 3,771
+pre-existing files except the root card, which receives one additional concept
+section. It adds no model weights, live inference endpoint or hardware control.
+
+[Chat implementation follow-up](huggingface-followup.json) records the second
+documentation-only update. The [interface screenshot](chat-interface.png) shows
+the local built prototype with an actual simulator camera and a still-incomplete
+checkpoint transfer. Development and built desktop browser workflows were
+verified after the initial browser-control interruption; no policy action ran.
+
+[Final documentation and screenshot revision](huggingface-final.json) adds the
+verified desktop interface image and updates the implementation status. All
+three files pass anonymous readback at the recorded immutable Hub commit; all
+3,774 other existing Space files remain unchanged.
diff --git a/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/chat-interface.png b/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/chat-interface.png
new file mode 100644
index 0000000..c5bbf63
Binary files /dev/null and b/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/chat-interface.png differ
diff --git a/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/huggingface-final.json b/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/huggingface-final.json
new file mode 100644
index 0000000..b3b0533
--- /dev/null
+++ b/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/huggingface-final.json
@@ -0,0 +1,25 @@
+{
+ "repo": "Dvidia/robot-simulation-lab",
+ "parent": "f4ae2b2cdce4a4a40359fc44d4dd1c99fb954dd9",
+ "files": [
+ {
+ "path": "docs/robot-chat-v01/concept.md",
+ "bytes": 14785,
+ "sha256": "92c653b5c8aa674cf4cbd9f10e0f6d59d97a8011649ce9be4309fd5a6ed8e4a9"
+ },
+ {
+ "path": "README.md",
+ "bytes": 41682,
+ "sha256": "88672953b3bb44095c14a96d86aa698de40c2aa3df357568f115ff8c4a38d14c"
+ },
+ {
+ "path": "docs/robot-chat-v01/chat-interface.png",
+ "bytes": 92631,
+ "sha256": "4246dbb3f82cebee62ef4678e5712c3de7869e2c1a8dcf5aa54bf07de68e08a6"
+ }
+ ],
+ "commit": "a2e4b8a90fa2160e0ba0cfa51a668de5fef6233b",
+ "anonymous_readback_verified": true,
+ "unchanged_existing_files": 3774,
+ "scope": "concept, root documentation and interface screenshot only; no live inference, model weights or hardware"
+}
diff --git a/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/huggingface-followup.json b/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/huggingface-followup.json
new file mode 100644
index 0000000..18757ef
--- /dev/null
+++ b/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/huggingface-followup.json
@@ -0,0 +1,20 @@
+{
+ "repo": "Dvidia/robot-simulation-lab",
+ "parent": "9e6b5e36e96d15d5d456f4362f548972e46c3373",
+ "files": [
+ {
+ "path": "docs/robot-chat-v01/concept.md",
+ "bytes": 14369,
+ "sha256": "95b10be488051d3ae4fdaa33a577cd6517ea1ff4b912615b43feb37cb61e3e96"
+ },
+ {
+ "path": "README.md",
+ "bytes": 41628,
+ "sha256": "4d6d130bbfadeb073cbbc26dc004e6f0dadb77fa4391acd0c6fd44cd9373e1b4"
+ }
+ ],
+ "commit": "f4ae2b2cdce4a4a40359fc44d4dd1c99fb954dd9",
+ "anonymous_readback_verified": true,
+ "unchanged_existing_files": 3774,
+ "scope": "two documentation files only; no live inference, model weights or hardware"
+}
diff --git a/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/huggingface-publication.json b/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/huggingface-publication.json
new file mode 100644
index 0000000..e8158bf
--- /dev/null
+++ b/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/huggingface-publication.json
@@ -0,0 +1,40 @@
+{
+ "repo": "Dvidia/robot-simulation-lab",
+ "type": "space",
+ "parent": "9eaeeae67def2697ca664b54a754e915f0741c78",
+ "files": [
+ {
+ "path": "README.md",
+ "bytes": 41454,
+ "sha256": "2467367a33640553b528937339a3700fd9fed62f24b03e76c77799639a40f3b9"
+ },
+ {
+ "path": "docs/robot-chat-v01/concept.md",
+ "bytes": 13191,
+ "sha256": "c36d5556b7b176a3b93e0dcfc7f2ba1920806a24dc513811863e2b96de2ae5b7"
+ },
+ {
+ "path": "docs/robot-chat-v01/runtime-evidence.json",
+ "bytes": 4868,
+ "sha256": "edb0ac36726120f0f65b94770183af14a0cc9234f69f212a7d383fb231260252"
+ },
+ {
+ "path": "docs/robot-chat-v01/libero-reset.png",
+ "bytes": 62199,
+ "sha256": "c7bbaad0bfc572f01917f477ec03cf6149c0fb24993a6829ae74c4b0fa1fd95f"
+ },
+ {
+ "path": "docs/robot-chat-v01/skill-manifest.example.json",
+ "bytes": 891,
+ "sha256": "70a4800ba1bafb3198e51de0dfe5379f029025507fc14236adf09c4dcfb5b060"
+ }
+ ],
+ "preserve_existing_files": 3772,
+ "scope": "documentation only; no live inference or hardware",
+ "commit": "9e6b5e36e96d15d5d456f4362f548972e46c3373",
+ "url": "https://huggingface.co/spaces/Dvidia/robot-simulation-lab/commit/9e6b5e36e96d15d5d456f4362f548972e46c3373",
+ "anonymous_readback_verified": true,
+ "unchanged_existing_files": 3771,
+ "live_inference": false,
+ "model_weights_uploaded": false
+}
diff --git a/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/libero-task5-reset.png b/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/libero-task5-reset.png
new file mode 100644
index 0000000..4188d37
Binary files /dev/null and b/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/libero-task5-reset.png differ
diff --git a/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/runtime-receipt.json b/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/runtime-receipt.json
new file mode 100644
index 0000000..f464b45
--- /dev/null
+++ b/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/runtime-receipt.json
@@ -0,0 +1,152 @@
+{
+ "recordedAt": "2026-10-26T07:00:08.623063+00:00",
+ "scope": "Local Mac runtime verification; no OpenVLA weights or learned rollout",
+ "profileId": "libero-panda-openvla-v1",
+ "model": {
+ "checkpoint": "openvla/openvla-7b-finetuned-libero-10",
+ "revision": "80970322773f81baa2e22fe495d0487b93a05cfa",
+ "weightsInstalled": false,
+ "inferenceExecuted": false,
+ "steeredRobotActionsExecuted": false
+ },
+ "sources": {
+ "openvlaRevision": "c8f03f48af692657d3060c19588038c7220e9af9",
+ "liberoRevision": "8f1084e3132a39270c3a13ebe37270a43ece2a01",
+ "liberoAssetScope": "Only task 5 study/book/caddy asset closure was fetched; other task assets unverified"
+ },
+ "runtime": {
+ "python": "3.12.9",
+ "mpsAvailable": true,
+ "torch": "2.6.0",
+ "torchvision": "0.21.0",
+ "numpy": "1.26.4",
+ "Pillow": "13.0.0",
+ "transformers": "4.40.1",
+ "tokenizers": "0.19.1",
+ "timm": "0.9.10",
+ "accelerate": "0.30.1",
+ "huggingface-hub": "0.23.0",
+ "safetensors": "0.4.5",
+ "mujoco": "3.1.1",
+ "robosuite": "1.4.1",
+ "bddl": "1.0.1",
+ "gym": "0.25.2",
+ "cloudpickle": "2.1.0",
+ "easydict": "1.9",
+ "imageio": "2.38.1",
+ "PyYAML": "6.0.3",
+ "sentencepiece": "0.2.2",
+ "numba": "0.68.0",
+ "llvmlite": "0.50.0",
+ "scipy": "1.17.1",
+ "mpsContext": "Host graphics access; sandboxed process reports unavailable",
+ "future": "1.0.0",
+ "matplotlib": "3.10.8",
+ "contourpy": "1.3.2"
+ },
+ "sourceClasses": {
+ "verified": true,
+ "classes": [
+ "OpenVLAConfig",
+ "OpenVLAForActionPrediction",
+ "PrismaticProcessor"
+ ],
+ "modelInstantiated": false
+ },
+ "photoDetection": {
+ "verified": true,
+ "image": "public/skill-cup.jpg",
+ "imageSize": [
+ 1024,
+ 768
+ ],
+ "detector": "TorchVision SSDlite320 MobileNetV3 COCO",
+ "checkpointSha256": "a79551df90c79834bcd3bb3845ef9d966b5449a3a9b2833ae8404778ca5d65d2",
+ "elapsedSeconds": 22.981,
+ "objects": [
+ {
+ "id": "detected-0",
+ "label": "cup",
+ "confidence": 0.9956732392311096,
+ "box": [
+ 0.39903393387794495,
+ 0.47789963086446124,
+ 0.6025710105895996,
+ 0.7762130896250407
+ ],
+ "source": "detector"
+ },
+ {
+ "id": "detected-1",
+ "label": "person",
+ "confidence": 0.8253621459007263,
+ "box": [
+ 0.4701840579509735,
+ 0.1547549068927765,
+ 1,
+ 0.7927147547403971
+ ],
+ "source": "detector"
+ },
+ {
+ "id": "detected-2",
+ "label": "dining table",
+ "confidence": 0.4729897677898407,
+ "box": [
+ 0,
+ 0.5605224768320719,
+ 1,
+ 0.9700164794921875
+ ],
+ "source": "detector"
+ }
+ ],
+ "limitations": "Coarse detector hypotheses, no color/dirt/ownership/task-state inference"
+ },
+ "simulatorReset": {
+ "verified": true,
+ "taskId": 5,
+ "seed": 7,
+ "instruction": "pick up the book and place it in the back compartment of the caddy",
+ "resetHash": "b133849e34e709aaecf9f42e1a281d9dc53dfeeebf01d5e41077914b8d12893e",
+ "image": "docs/evidence/robot-lab-libero-reset-20261026.png",
+ "imageSize": [
+ 256,
+ 256
+ ],
+ "actualState": [
+ -0.29572729160672406,
+ 0.013003376967992303,
+ 1.1680005404829354,
+ 0.9995841690598055,
+ 0.0017969395174486705,
+ -0.02877830619454855,
+ 0.0002628040344518339,
+ 0.03872207014699441,
+ -0.038723508260440485
+ ],
+ "elapsedSeconds": 15.78,
+ "threaded": true,
+ "policyActionsExecuted": 0,
+ "settlingNoopSteps": 10,
+ "renderer": "Official mujoco.cgl.GLContext via original constructor adapter for robosuite1.4.1",
+ "independentMainThreadResetHash": "b133849e34e709aaecf9f42e1a281d9dc53dfeeebf01d5e41077914b8d12893e",
+ "repeatResetHashMatched": true,
+ "cameraVisuallyInspected": true,
+ "initialMacFailureResolved": "GLFW initialized AppKit off the main thread; official offscreen CGL adapter removes that path"
+ },
+ "workerTests": {
+ "command": "python -m unittest discover -s robot-lab/tests -q",
+ "python": "3.12.9",
+ "passed": 30,
+ "failed": 0,
+ "fixtureScope": "Unit/protocol/transport/hook tests include explicit synthetic fixtures; separate simulator and detector results are actual runtime measurements"
+ },
+ "workerSourceSha256": {
+ "runtime.py": "5ff4db2097335304e755a82c299a3521830b3f3e9bc545f95dbea5f1161df07f",
+ "server.py": "acc0f9e5f2ad873df47feae801094696463df66ce9d388a9fe057516a4d74e76",
+ "artifacts.py": "0567fd4c4ccf369e8fef2574e643daa7df32b6a05e0a06c2ee7941cade05ebe6",
+ "catalog.py": "dbc9916f9ec403507e1f305eb31d7c7b4f3be4e67807d85fa7aedb347e45f595",
+ "requirements.txt": "d30b0762abaedf377dcac22270a87a895f1e587c6d241bcb9705011b05d25eac"
+ }
+}
diff --git a/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/skill-manifest.example.json b/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/skill-manifest.example.json
new file mode 100644
index 0000000..4daa472
--- /dev/null
+++ b/docs/downloads/topics/physical-grounding/runs/2026-10-27-robot-lab/skill-manifest.example.json
@@ -0,0 +1,26 @@
+{
+ "id": "openvla-libero10-5",
+ "title": "Put book into caddy",
+ "description": "OpenVLA LIBERO-10 task 5; one shared learned checkpoint.",
+ "instruction": "pick up the book and place it in the back compartment of the caddy",
+ "objects": [
+ "book",
+ "caddy"
+ ],
+ "effects": [
+ "book in back compartment of caddy"
+ ],
+ "prerequisites": [
+ "LIBERO-10 matching task reset",
+ "Franka Panda simulation with 7D OSC pose actions",
+ "Reachable task objects in benchmark arrangement"
+ ],
+ "profileId": "libero-panda-openvla-v1",
+ "checkpoint": "openvla/openvla-7b-finetuned-libero-10",
+ "revision": "80970322773f81baa2e22fe495d0487b93a05cfa",
+ "license": "MIT (OpenVLA code and checkpoint); LIBERO MIT; Llama 2 terms apply",
+ "taskId": 5,
+ "installed": false,
+ "compatible": false,
+ "blocker": "Documentation example; runtime compatibility has not been checked"
+}
diff --git a/docs/feed.xml b/docs/feed.xml
index e694ae4..fc3a329 100644
--- a/docs/feed.xml
+++ b/docs/feed.xml
@@ -1,2 +1,2 @@
-DVIDIA Researchhttps://research.dvidia.org/Research footprints on demonstrations, calibrated simulation and robot skills.enLearning grip feedback with a frozen PiPER arm referencehttps://research.dvidia.org/papers/learned-piper-grip-v02/https://research.dvidia.org/papers/learned-piper-grip-v02/Tue, 27 Oct 2026 12:00:00 GMTJaw feedback 6/24 · blind 8/24 · feedforward 5/24 · teacher 24/24 · no demonstrated feedback advantage. After five seven-command residual candidates each failed all 16 development cases, a separate 25-node learned jaw adapter preserves the frozen six-axis PiPER arm references. Trained on 64 synthetic teacher episodes and 64,000 causal labels, it completes 6/24 frozen confirmation cases, versus 8/24 for its matched blind control, 5/24 feedforward, 24/24 authored teacher and 0/24 open jaws. Feedback succeeds in 0/12 interrupted cases; 14/24 terminal-only passes conceal strict task failures. All 120 confirmation attempts are valid, and an independent numeric audit reconstructs 360 retained attempts. CPU inference p95 is 0.501 ms; this establishes no live-feedback advantage, recovered grip, human-video learning or hardware qualification.Learning PiPER block placement from synthetic demonstrationshttps://research.dvidia.org/papers/learned-piper-placement-v01/https://research.dvidia.org/papers/learned-piper-placement-v01/Tue, 27 Oct 2026 12:00:00 GMTLearned 5/12 · teacher 12/12 · three controls 0/12 each · simulation only. A compact feedforward joint-and-jaw primitive trained on 32 successful synthetic demonstrations completes 5/12 frozen PiPER placement attempts from unseen starting positions. The authored teacher completes 12/12; three controls complete 0/12 each. All twelve learned terminal poses pass settling checks, while seven fail the full native contact-history gates. Complete tapes, failed development candidates, an independent audit and an installable local runner preserve the reliability gap. This is privileged-state reference distillation for a fixed rigid block and two trained goals, not human-video learning, learned feedback or physical robot qualification.Independent camera and actuator corroboration v0.4https://research.dvidia.org/papers/sensor-corroboration-v04/https://research.dvidia.org/papers/sensor-corroboration-v04/Mon, 19 Oct 2026 12:00:00 GMT272 cases · 69/112 false completions prevented · 43 remain · 73/80 true completions abstained. A fresh eight-layout PiPER simulation benchmark adds separately processed RGB and drive checks to a local physical-goal verifier. The checks prevent 69 of 112 false completion readings while leaving 43 replay, identity, orientation, support and sampling blind spots; the conservative gate abstains on 73 of 80 baseline true completions, including all 64 deliberate sensor-fault controls. The measured CPU path is 22.1 ms median and 31.5 ms p95, excluding 200 ms acquisition. All raw channels and results are preserved; this is synthetic evidence, not hardware validation.A local verifier for physical completionhttps://research.dvidia.org/papers/local-goal-verifier-v03/https://research.dvidia.org/papers/local-goal-verifier-v03/Mon, 19 Oct 2026 12:00:00 GMTNative: 16/16 true complete, 0/48 false complete · forged readings: 8/8 false complete. An offline audit traces the seven missed Jev completions without claiming an internal model cause. A local deterministic verifier then checks timestamped pose, motion, support, release and uncertainty on 200 fresh cases. It recognizes all 16 native positives and rejects all 48 native negatives; 128 evidence faults yield 120 abstentions and 8 incomplete answers. All 8 consistent forged streams produce physical false completions, exposing the remaining sensor-trust problem. CPU-only p95 is 0.318 ms, excluding the required 200 ms history and sensing. Complete native inputs, every decision, independent review and explicit failure cohorts remain public; no new Jev calls or hardware qualification.Jev image-goal verification: the measured follow-uphttps://research.dvidia.org/papers/image-goal-jev-v02/https://research.dvidia.org/papers/image-goal-jev-v02/Mon, 19 Oct 2026 12:00:00 GMT64/64 valid responses · telemetry: 0/24 false complete, 1/8 true complete. The first measured run preserves all 64 requests from the image-goal v0.1 protocol. Jev returned valid structured responses for every trial and made no false-completion declaration, but recognized only 1/8 physically complete cases with privileged native telemetry and 0/8 with images alone. All four occluded complete scenes were called incomplete in both conditions. RGB abstention matched 8/16 ambiguous references. Median online latency was 1.776 seconds, p95 3.287 seconds. The release preserves every result, the independent review and the original unrun protocol. This small synthetic diagnostic does not qualify a robot completion gate, actuator loop or learned skill.Image-goal verification: native benchmark and Jev protocolhttps://research.dvidia.org/papers/image-goal-jev-v01/https://research.dvidia.org/papers/image-goal-jev-v01/Sun, 18 Oct 2026 12:00:00 GMT32 native fixtures · 4 identical-image pairs · 64 Jev trials not run. A frozen PiPER image-goal cohort crosses eight physical conditions with four layouts. Four moving/settled pairs have byte-identical images and different completion labels, exposing when one image cannot establish task completion. Native measurements verify 32 authored fixtures; a paired 64-request Jev protocol distinguishes RGB judgments from privileged simulator telemetry. The provider evaluation has not run because credentials were unavailable: accuracy, false-completion rates and service latency remain unmeasured. Every native state, image, frozen request hash and explicit unrun result is retained. No learned policy or hardware qualification is claimed.A visual goal still needs physical feedbackhttps://research.dvidia.org/papers/goal-images-physical-feedback/https://research.dvidia.org/papers/goal-images-physical-feedback/Sun, 18 Oct 2026 12:00:00 GMT14/14 exact passive replays · 249,502 native ticks · visual models unbenchmarked. A goal image specifies a destination; physical feedback verifies whether a robot gets there. We describe a bounded decision role for TypeSafe Jev, distinguish it from action-conditioned world-model planning, and propose an independently scored reaching experiment. A separate passive audit reproduces fourteen previously inspected rigid-box arm episodes exactly and records 249,502 native ticks. Millisecond contact gaps hidden between stored observations become visible, while task outcomes remain unchanged. Complete inputs, traces, source snapshots and a verified downloader preserve every case. This is measurement work, not a new policy benchmark, PiPER shoe result or hardware qualification.Give the gripper a fair testhttps://research.dvidia.org/papers/shoe-graspability-v03/https://research.dvidia.org/papers/shoe-graspability-v03/Wed, 14 Oct 2026 12:00:00 GMT24/24 valid · 30 g: 8/12 lifts · 300 g: 0/12 · no net gain from removing rake. A frozen 24-attempt PiPER diagnostic separates three rigid shapes, 30 g and 300 g loads, and mounted versus absent rake conditions. All attempts are valid; eight of twelve lightweight controls retain a direct lift while every 300 g attempt fails, including the small block. Removing the rake gains one narrow-shoe result and loses one block result, with no net completion gain. A verified settled reference, dense contact traces, unchanged drive fingerprint and independent scoring expose limits in the modeled grasp and force response. Recorded replays and runnable CPU code retain every failure. No autonomous tool removal, retrieval, learned skill or physical hardware qualification is claimed.From reaching a shoe to keeping holdhttps://research.dvidia.org/papers/continuous-shoe-grip-v02/https://research.dvidia.org/papers/continuous-shoe-grip-v02/Tue, 13 Oct 2026 12:00:00 GMT20/20 valid · 2/10 completed under both policies · 9 contact-loss alarms verified. A frozen twenty-attempt native MuJoCo comparison adds continuous acquisition checks and bounded lowering to the mounted-rake PiPER controller. Both policies complete the same 2/10 fresh cases: no gains or losses. Nine bilateral-contact-loss alarms follow a trace-verified native origin by 20–52 ms, median 30 ms; three acquisition failures are separate. Twelve supported lowering responses produce no additional completion. A non-finger-support gap remains unmonitored. Complete recorded trajectories, independent audit and development failures are public. Authored policies, synthetic contact and privileged observations establish no learned skill or physical robot qualification.Skill prerequisites: access, reach and recoveryhttps://research.dvidia.org/papers/skill-prerequisites-v01/https://research.dvidia.org/papers/skill-prerequisites-v01/Tue, 13 Oct 2026 12:00:00 GMT16/16 valid · 2 lid contacts avoided · 3/4 retrieval checkpoints · 0/4 retained tool lifts. A frozen sixteen-attempt native MuJoCo study tests hinged shoe-box access and a mounted rake for an out-of-workspace shoe. Guarded access avoids two baseline lid collisions while task completion stays at 2/4; a transient withdrawal adds 0.70 simulated seconds without being necessary in its matched baseline. The mounted rake reaches an intermediate retrieval checkpoint in 3/4 cases, but all subsequent retained lifts fail and the short-tool case is deferred. All native traces and failures remain public. The browser replays recorded states; fresh physics runs locally. Privileged observations, synthetic contact and authored policies establish no learned skill or hardware qualification.Live PiPER shoe workstation v0.1https://research.dvidia.org/papers/live-piper-shoe-workstation-v01/https://research.dvidia.org/papers/live-piper-shoe-workstation-v01/Tue, 13 Oct 2026 12:00:00 GMTLive browser physics · 14/16 targets · strict contact parity failed · shoe lifting unqualified. A six-axis PiPER and its coupled gripper respond to user targets while MuJoCo runs locally in a browser worker. The final native run retains 20 valid attempts: 14/16 target trials pass, both high-target repeats fail, and jaw, impulse, disabled-table and 600-second hold checks pass. A ten-minute headless Chromium run reports 51.389 render calls per second and a 0.9999795 simulation/wall-time ratio on the tested Apple M5 host; simulated movement response is 61.9 ms p95 across 61 commands. Render calls do not measure GPU presentation. Native/WASM numerical and loaded-contact-count checks pass, while strict raw contact counts differ in 13/1,500 states. All fifteen development shoe-lift attempts fail. Complete development, failure and timing records remain separate. This authored rigid-shoe environment establishes no learned skill, calibrated material model or physical robot qualification.Reusable shoe asset library v0.1https://research.dvidia.org/papers/shoe-asset-library-v01/https://research.dvidia.org/papers/shoe-asset-library-v01/Mon, 12 Oct 2026 12:00:00 GMTSix shoe proxies · three arms · support 27/27, disabled table 0/27 · manipulation unqualified. Six original MIT rigid shoe proxies compose with the pinned UR5e/Robotiq, PiPER and SO-101 models through versioned scene descriptors and offline native 3D previews. A frozen 54-attempt test records 27/27 supported pairs and 0/27 support successes when table collisions are disabled; all 54 gravity checks pass without numerical warnings. No loaded non-table shoe contacts appear in the 20 ms samples, which cannot rule out shorter transients. All sampled trajectories and 27,000 native-step durations remain available. On one Apple M5 host, 54 simulated seconds take 12.3616 wall seconds including fresh model construction; the slowest attempt takes 6.7047 seconds. Geometry and physical properties are authored assumptions. Loading, gravity and passive support do not establish shoe grasping, calibrated deformation, a learned policy or hardware transfer.PiPER placement reliability v0.5https://research.dvidia.org/papers/piper-reliability-v05/https://research.dvidia.org/papers/piper-reliability-v05/Mon, 12 Oct 2026 12:00:00 GMT23/36 revised grasp · 15/36 v0.4 · 8 gained, none lost · hardware unqualified. Three frozen fresh PiPER cohorts retain 252 numerically valid attempts and 144 failed negative controls. A fixed diagonal grasp with bounded pose planning completes 23/36 placements versus 15/36 for frozen v0.4 and 18/36 with second-lift recovery alone: eight gained completions and none lost. The fifteen shared successes are 0.772 simulated seconds slower on average. Three lift-only second probes qualify and finish their tasks; the full grasp candidate needs none. Twelve low-friction acquisitions and one later retention failure remain. Every trajectory, native task outcome and raw computation duration is retained, including 1,035 windows exceeding 20 ms and a 3.082-second outlier on a loaded host. Native mechanics and scoring remain unchanged. Separate development keeps 200 earlier attempts, including discarded regressions. Authored privileged simulation establishes no learned skill, real-time guarantee or physical qualification.PiPER contact recovery v0.4https://research.dvidia.org/papers/piper-contact-recovery-v04/https://research.dvidia.org/papers/piper-contact-recovery-v04/Sun, 11 Oct 2026 12:00:00 GMTAll modes 4/12 · two resumed tasks faster · controls 0/48 · hardware unqualified. A fresh frozen 84-attempt PiPER comparison completes 4/12 placements for v0.3 history, v0.4 carry-only and v0.4 full; all 48 matched open-jaw and hold controls fail. Two completed post-hold placements finish 2.440 and 2.640 simulated seconds sooner with unchanged 220/240 ms settling holds. Four low-friction failures reach refusal 2.88–2.90 seconds sooner without becoming successes. Fresh nominal-friction 60 g layouts expose two held-but-too-low resume failures in every mode; neither reaches speed restoration. Six earlier acquisition failures are traced to insufficient support under the pinned position servo and side pinch, not the actuator force cap. All native mechanics and outcome criteria remain unchanged. Complete trajectories and 84,000 raw computation windows are retained; none exceeds 20 ms on this host. Source-snapshotted development remains separate. Privileged authored simulation establishes no learned skill, true-slip accuracy or physical qualification.PiPER contact history v0.3https://research.dvidia.org/papers/piper-contact-history-v03/https://research.dvidia.org/papers/piper-contact-history-v03/Sun, 11 Oct 2026 12:00:00 GMTHistory 6/12 · baseline and probe-only 4/12 · controls 0/48 · hardware unqualified. A frozen paired PiPER experiment retains all 84 numerically valid attempts across twelve synthetic rigid-block scenes. History completes 6/12 placements versus 4/12 for both original motion and the identical acquisition probe without carry monitoring; all 48 separately matched open-jaw and hold controls fail. The two added completions occur at nominal friction with 60 g blocks. Four tasks complete after five closed holds/resumes, but only four of five resume windows meet the independent low absolute TCP-speed criterion. All six supported acquisition retries fail. Native gains, forces and outcome rules remain unchanged; requested movement reduction is distinct from actual speed, and two slowdown windows include early holds. Seventy-five of 84,000 computation windows exceed 20 ms. Complete sealed trajectories, original model notices, source-snapshotted development and pinned offline inspection preserve both success and failure. Privileged authored simulation establishes no learned skill, true-slip detector accuracy, shoe competence or physical qualification.PiPER grip validation and recoveryhttps://research.dvidia.org/papers/piper-grip-validation-and-recovery/https://research.dvidia.org/papers/piper-grip-validation-and-recovery/Sun, 11 Oct 2026 12:00:00 GMTModerate-friction regression · baseline 4/6, guarded 2/6 · hardware unqualified. A slow test lift and bounded supported retry add recorded acquisition decisions to the pinned PiPER contact pilot, but completion regresses: at moderate friction baseline completes 2/2 and guarded completes 0/2. Both complete 2/2 normal cases; neither completes the two low-friction cases. All 30 attempts remain numerically valid, including 18 failed controls and full-duration aborts. Four qualification decisions are followed by a brief independent following window, yet two tasks still fail; no successful recovery or overall improvement is demonstrated. Actual motion continues after hold requests, and 53/30,000 computation windows exceed 20 ms. Complete compressed receipts, original model notices and pinned offline inspection preserve the evidence. Authored privileged-state simulation establishes no detector accuracy, learned shoe skill, calibrated contact or physical robot qualification.Native grasp task benchmarkhttps://research.dvidia.org/papers/native-grasp-task-benchmark/https://research.dvidia.org/papers/native-grasp-task-benchmark/Sun, 11 Oct 2026 12:00:00 GMT6/6 simulated placements · controls 0/12 · real-time and hardware unqualified. A pinned six-axis arm and coupled gripper complete 6/6 frozen synthetic rigid-block placements, while matched recorded-arm/open-jaw and hold controls complete 0/12. Native contact must produce grasp, sustained lift, retained carry, release and settled placement with tool retreat. All 18 attempts and timing traces remain in the receipt; one placement takes 29.51 wall seconds for 20 simulated seconds and misses 251 of 1,000 computation windows, so real-time operation is not established. An offline 3D mesh replay exposes the recorded motion. The authored privileged-state baseline provides a benchmark for a future compact DVIDIA action policy, not a learned footage-to-action model, validated shoe simulation or physical robot qualification.Hardware matched robot simulationhttps://research.dvidia.org/papers/hardware-matched-robot-simulation/https://research.dvidia.org/papers/hardware-matched-robot-simulation/Sun, 11 Oct 2026 12:00:00 GMTPinned CPU mechanics · PiPER contact pilot · physical fidelity unmeasured. A separate UR5e/Robotiq reference preserves pinned geometry, inertias, moving-link collision proxies and coupled gripper structure: fourteen modeled coordinates and seven commands. Eighteen deterministic unloaded motion/closure runs are numerically valid; at a 1 ms step, CPU physics throughput measures 40.80–47.29 simulated seconds per measured stepping wall second on one host, excluding loading, sensing, rendering, policy and real actuation. Adjacent timestep comparisons and a matched static overlap expose numerical sensitivity and collision participation. A pure-Python paired trace scorer measures joint, tool and jaw mismatch without automatic qualification. Left/right five-finger references are separately audited; LeRobot collection with an original DVIDIA policy is proposed. Serial calibration, physical response, shoe task learning and bimanual execution remain unmeasured. An offline 3D mesh replay now exposes the recorded arm/gripper poses without rerunning physics. PiPER and SO-101 now have pinned CPU profiles with 6/6 valid unloaded numerical attempts each and explicit native command units. PiPER also has a frozen authored rigid-block contact pilot: nominal placement 2/2, low-friction placement 0/1, open-jaw 0/3 and hold 0/3, with all nine attempts numerically valid. One of 9,000 computation windows exceeds 20 ms; hardware real-time response is unqualified. SO-101 object tasks, learned policies and physical qualification remain open. YAM, OpenArm, ARX X5 and PAROL6 remain upcoming.DVIDIA Observation Lab pilothttps://research.dvidia.org/papers/dvidia-observation-lab/https://research.dvidia.org/papers/dvidia-observation-lab/Sun, 11 Oct 2026 12:00:00 GMTLocal review release · motion and actuator source pilots · hardware unqualified. DVIDIA Observation Lab supplies local object/palm proposals, reviewed timeline revisions and separate causal image-motion forecasts; real annotation and motion accuracy remain unmeasured. A new CPU pilot learns next-20-ms joint/jaw deltas from current native state and issued commands. Twelve seeded groups retain 36 recordings with 8/2/2 train/development/test grouping; 4,553 test transitions are not independent robot trials. The 6,438-byte action model computes at 0.207 ms p95 on one host and improves RMSE, while jaw MAE/worst error regress against persistence and an initial opening is substantially overpredicted. These are privileged simulator measurements and model-only timings. A proposed shoe capture plan has no footage or executed shoe benchmark. The v0.1 release and hosted synthetic review demo remain separate; no shoe policy, physical adapter, validated shoe physics or hardware qualification is established.Robotics research pipelinehttps://research.dvidia.org/papers/robotics-research-pipeline/https://research.dvidia.org/papers/robotics-research-pipeline/Fri, 09 Oct 2026 12:00:00 GMTArchitecture proposal · current simulation alpha · hardware unqualified. An updated architecture connects immutable Skillspace recordings, reviewed task-label proposals and synchronized measured telemetry to grouped datasets, separate visual and motor learners, and a proposed local state supervisor. The implemented CPU baseline retains authored phases, gripper decisions and recovery around its learned joint-delta head. New annotation and supervisor pilots, fresh frozen confirmation, physics calibration and compatible skill-installation gates define the next milestones. Automatic labeling, learned supervision, human-video action recovery and physical arm qualification remain unestablished; this publication adds no new training or hardware result.Skillspace footage training pipelinehttps://research.dvidia.org/papers/skillspace-footage-training/https://research.dvidia.org/papers/skillspace-footage-training/Thu, 08 Oct 2026 12:00:00 GMTPublic CPU package · one native scene qualified · simulation-only. The public Dvidia-Inference/dvidia-training repository provides a standalone CPU pipeline that audits Skillspace media, freezes grouped splits and exports inspectable artifacts. Ten synthetic six-second clips train a visual predictor with a 0.5106-second median pipeline time across three repeats on one macOS host. Aligned native simulator telemetry supplies 4,029 training labels for a learned joint-delta head, evaluated on one held-out recording. Its capsule passes native placement qualification in that recording's exact scene; identical joint targets with open jaws fail. Installation and hardware guides accompany the package. Human-video action recovery, shoe organization, demonstration sufficiency, independent scene generalization and physical robot competence remain unestablished.Skill capsule acquisition and optimizationhttps://research.dvidia.org/papers/skill-capsule-acquisition/https://research.dvidia.org/papers/skill-capsule-acquisition/Wed, 07 Oct 2026 12:00:00 GMTSimulation-only · teacher/student 7/8 · no overall speedup. A compact learned CPU movement head replaces joint-target computation inside an authored placement supervisor. Teacher and student both pass 7/8 in a new frozen evaluation, while episode wall time increases from 6.273 to 6.360 seconds. A 39,845-byte JSON capsule imports into the local lab, checks its exact runtime and qualifies the current scene through native placement and a recorded-arm/open-jaw control. Scene changes require a fresh test. One known scene and repeat pass native network denial; perception, complete task learning, other embodiments and hardware remain unqualified.Skillspace arm benchmarks and evolutionhttps://research.dvidia.org/papers/skillspace-arm-benchmarks/https://research.dvidia.org/papers/skillspace-arm-benchmarks/Wed, 07 Oct 2026 12:00:00 GMTMixed held-out result · 30/32 baseline, 29/32 updated. Two controller revisions improve development completion from 14/20 to 17/20, but the frozen paired test declines from 30/32 to 29/32: both pass all 24 normal-strength cases while actuator-stress completion falls from 6/8 to 5/8. Instrumented CPU throughput also declines. We publish the regression, unchanged contact and success rules, exact controller snapshots, richer physical inputs, runtime-bound installation and a proposed staged Skillspace contract. Contact forces and penetration remain uncalibrated; learned perception and physical qualification are open.Installing a Skillspace on a simulated armhttps://research.dvidia.org/papers/skillspace-arm-installation/https://research.dvidia.org/papers/skillspace-arm-installation/Wed, 07 Oct 2026 12:00:00 GMTPublic skill link to authored adapter · 6/6 scene placements. The first link-to-arm product path installs an existing DVIDIA placement envelope, binds a local authored controller to one simulated arm, and reuses it in independently grounded scenes. Native jaw contacts carry a free box; six layouts complete, while no-motion and identical joint commands with open jaws each complete zero of six. Installed execution passes process-level offline checks. Task metadata contains no learned policy; perception, cup geometry, full arm collisions and physical qualification remain open.Offline cable training environmenthttps://research.dvidia.org/papers/offline-cable-training-environment/https://research.dvidia.org/papers/offline-cable-training-environment/Wed, 07 Oct 2026 12:00:00 GMTCPU simulation-only · Controller search and frozen evaluation executed. The first runnable product loop combines an anchored cable environment, local controller-parameter search, frozen evaluation, offline replay and a manifest-backed skill pack. The selected controller and a fixed feedback baseline both completed 10/10 held-out simulated episodes; zero-force and release controls completed 0/10. A native macOS network-denial run completed 3/3 additional episodes. Ideal endpoint attachment and privileged state bound the result; physical rope calibration, gripping, sensors and GPU throughput remain untested.Fast accurate robot training simulationhttps://research.dvidia.org/papers/fast-accurate-robot-training-simulation/https://research.dvidia.org/papers/fast-accurate-robot-training-simulation/Wed, 07 Oct 2026 12:00:00 GMT54 CPU fixture trials · GPU and physical transfer untested. A design for an offline, self-hosted training environment that turns demonstrations into calibrated practice and qualified robot skills. We examine contact, deformation, sensor feedback and the performance–accuracy tradeoff, then report 54 deterministic native MuJoCo CPU fixture trials. Fine endpoint agreement did not establish accurate contact transients, and coarse timesteps missed collisions. Minimum GPU memory, rope accuracy and physical transfer remain unmeasured.Grok robotics research on Xhttps://research.dvidia.org/papers/grok-robotics-research-on-x/https://research.dvidia.org/papers/grok-robotics-research-on-x/Wed, 07 Oct 2026 12:00:00 GMTPrimary sources checked · Experiments proposed. Three Grok 4.7 research passes surface observation-to-action, synthetic-practice and reusable-repair ideas. Independent primary-source checks compare those findings with our thesis: observation supplies goals and state, language retrieves a skill, spatial expectations guide attention, and executable feedback with evaluation establishes competence. X posts remain discovery leads. No universal demonstration count or arbitrary-robot transfer follows from the reviewed results.Spatially grounded downloadable robot skillshttps://research.dvidia.org/papers/spatially-grounded-downloadable-robot-skills/https://research.dvidia.org/papers/spatially-grounded-downloadable-robot-skills/Wed, 07 Oct 2026 12:00:00 GMTSource review · DVIDIA experiments not run. A synthesis of learning from human demonstrations, language-conditioned spatial attention, simulation expansion and robot-specific skill delivery. Spatial priors can accelerate inspection but do not determine contact state or control. The proposed downloadable skill packages a controller, initiation and termination conditions, compatible sensing and hardware, recovery behavior and measured evidence. Separate experiments would test attention, data coverage, feedback and transfer.Clef and grounded video observationshttps://research.dvidia.org/papers/clef-and-grounded-video-observations/https://research.dvidia.org/papers/clef-and-grounded-video-observations/Tue, 06 Oct 2026 12:00:00 GMTFive licensed excerpts · Accuracy evaluation outstanding. A preregistered image-API feasibility run processed five licensed three-second POV excerpts using four timestamped frames, a Gemma caption and a Clef-flash check. All five completed at a price-derived inference estimate of $0.00140634. Post-run inspection found an object error accepted by the checker and omitted state changes. API and schema compatibility were demonstrated; annotation accuracy and whole-task success were not.From Skillspace to robot skillhttps://research.dvidia.org/papers/from-skillspace-to-robot-skill/https://research.dvidia.org/papers/from-skillspace-to-robot-skill/Tue, 06 Oct 2026 12:00:00 GMTGraduation and robot training not run. An Argus review and a proposal to connect original recordings, reviewed episodes, immutable datasets, training runs, held-out evaluation and robot-tested releases. The review separates video annotation from action supervision and defines compatibility beyond a robot’s degree-of-freedom count. A proposed 40-episode annotation pilot and evidence-based graduation criteria remain unrun.Turn physical footage into testable evidencehttps://research.dvidia.org/papers/physical-skill-research-agenda/https://research.dvidia.org/papers/physical-skill-research-agenda/Tue, 06 Oct 2026 12:00:00 GMTFour baseline protocols proposed. A research agenda covering visible capture evidence, relations over time, evaluation provenance and physical grounding. Each question has a bounded protocol and a failure condition. The aim is to measure whether structure and physical signals improve a defined task before scaling collection. Strategic opinions, author-reported results and our untested proposals are kept distinct.
+DVIDIA Researchhttps://research.dvidia.org/Research footprints on demonstrations, calibrated simulation and robot skills.enFrom a conversation to compatible robot skillshttps://research.dvidia.org/papers/chat-to-robot-skills/https://research.dvidia.org/papers/chat-to-robot-skills/Tue, 27 Oct 2026 12:00:00 GMTPhoto inference and one native reset verified · OpenVLA actions and steering not run. A conversation can carry a photo and desired outcome through scene review, skill retrieval, compatible installation, simulation and inspectable action traces. The local prototype uses ten LIBERO-10 task manifests sharing a pinned OpenVLA checkpoint. Real SSDlite inference and a repeatable native task-5 reset are recorded; the checkpoint transfer stopped after an 8 MiB partial file, so learned policy actions and activation-steered behavior remain unrun. The note separates observed evidence, candidate relevance, executable compatibility and measured completion, and defines staged evaluation for the chat workflow and raw MLP channel interventions. General household planning and hardware execution remain unqualified.Learning grip feedback with a frozen PiPER arm referencehttps://research.dvidia.org/papers/learned-piper-grip-v02/https://research.dvidia.org/papers/learned-piper-grip-v02/Tue, 27 Oct 2026 12:00:00 GMTJaw feedback 6/24 · blind 8/24 · feedforward 5/24 · teacher 24/24 · no demonstrated feedback advantage. After five seven-command residual candidates each failed all 16 development cases, a separate 25-node learned jaw adapter preserves the frozen six-axis PiPER arm references. Trained on 64 synthetic teacher episodes and 64,000 causal labels, it completes 6/24 frozen confirmation cases, versus 8/24 for its matched blind control, 5/24 feedforward, 24/24 authored teacher and 0/24 open jaws. Feedback succeeds in 0/12 interrupted cases; 14/24 terminal-only passes conceal strict task failures. All 120 confirmation attempts are valid, and an independent numeric audit reconstructs 360 retained attempts. CPU inference p95 is 0.501 ms; this establishes no live-feedback advantage, recovered grip, human-video learning or hardware qualification.Learning PiPER block placement from synthetic demonstrationshttps://research.dvidia.org/papers/learned-piper-placement-v01/https://research.dvidia.org/papers/learned-piper-placement-v01/Tue, 27 Oct 2026 12:00:00 GMTLearned 5/12 · teacher 12/12 · three controls 0/12 each · simulation only. A compact feedforward joint-and-jaw primitive trained on 32 successful synthetic demonstrations completes 5/12 frozen PiPER placement attempts from unseen starting positions. The authored teacher completes 12/12; three controls complete 0/12 each. All twelve learned terminal poses pass settling checks, while seven fail the full native contact-history gates. Complete tapes, failed development candidates, an independent audit and an installable local runner preserve the reliability gap. This is privileged-state reference distillation for a fixed rigid block and two trained goals, not human-video learning, learned feedback or physical robot qualification.Independent camera and actuator corroboration v0.4https://research.dvidia.org/papers/sensor-corroboration-v04/https://research.dvidia.org/papers/sensor-corroboration-v04/Mon, 19 Oct 2026 12:00:00 GMT272 cases · 69/112 false completions prevented · 43 remain · 73/80 true completions abstained. A fresh eight-layout PiPER simulation benchmark adds separately processed RGB and drive checks to a local physical-goal verifier. The checks prevent 69 of 112 false completion readings while leaving 43 replay, identity, orientation, support and sampling blind spots; the conservative gate abstains on 73 of 80 baseline true completions, including all 64 deliberate sensor-fault controls. The measured CPU path is 22.1 ms median and 31.5 ms p95, excluding 200 ms acquisition. All raw channels and results are preserved; this is synthetic evidence, not hardware validation.A local verifier for physical completionhttps://research.dvidia.org/papers/local-goal-verifier-v03/https://research.dvidia.org/papers/local-goal-verifier-v03/Mon, 19 Oct 2026 12:00:00 GMTNative: 16/16 true complete, 0/48 false complete · forged readings: 8/8 false complete. An offline audit traces the seven missed Jev completions without claiming an internal model cause. A local deterministic verifier then checks timestamped pose, motion, support, release and uncertainty on 200 fresh cases. It recognizes all 16 native positives and rejects all 48 native negatives; 128 evidence faults yield 120 abstentions and 8 incomplete answers. All 8 consistent forged streams produce physical false completions, exposing the remaining sensor-trust problem. CPU-only p95 is 0.318 ms, excluding the required 200 ms history and sensing. Complete native inputs, every decision, independent review and explicit failure cohorts remain public; no new Jev calls or hardware qualification.Jev image-goal verification: the measured follow-uphttps://research.dvidia.org/papers/image-goal-jev-v02/https://research.dvidia.org/papers/image-goal-jev-v02/Mon, 19 Oct 2026 12:00:00 GMT64/64 valid responses · telemetry: 0/24 false complete, 1/8 true complete. The first measured run preserves all 64 requests from the image-goal v0.1 protocol. Jev returned valid structured responses for every trial and made no false-completion declaration, but recognized only 1/8 physically complete cases with privileged native telemetry and 0/8 with images alone. All four occluded complete scenes were called incomplete in both conditions. RGB abstention matched 8/16 ambiguous references. Median online latency was 1.776 seconds, p95 3.287 seconds. The release preserves every result, the independent review and the original unrun protocol. This small synthetic diagnostic does not qualify a robot completion gate, actuator loop or learned skill.Image-goal verification: native benchmark and Jev protocolhttps://research.dvidia.org/papers/image-goal-jev-v01/https://research.dvidia.org/papers/image-goal-jev-v01/Sun, 18 Oct 2026 12:00:00 GMT32 native fixtures · 4 identical-image pairs · 64 Jev trials not run. A frozen PiPER image-goal cohort crosses eight physical conditions with four layouts. Four moving/settled pairs have byte-identical images and different completion labels, exposing when one image cannot establish task completion. Native measurements verify 32 authored fixtures; a paired 64-request Jev protocol distinguishes RGB judgments from privileged simulator telemetry. The provider evaluation has not run because credentials were unavailable: accuracy, false-completion rates and service latency remain unmeasured. Every native state, image, frozen request hash and explicit unrun result is retained. No learned policy or hardware qualification is claimed.A visual goal still needs physical feedbackhttps://research.dvidia.org/papers/goal-images-physical-feedback/https://research.dvidia.org/papers/goal-images-physical-feedback/Sun, 18 Oct 2026 12:00:00 GMT14/14 exact passive replays · 249,502 native ticks · visual models unbenchmarked. A goal image specifies a destination; physical feedback verifies whether a robot gets there. We describe a bounded decision role for TypeSafe Jev, distinguish it from action-conditioned world-model planning, and propose an independently scored reaching experiment. A separate passive audit reproduces fourteen previously inspected rigid-box arm episodes exactly and records 249,502 native ticks. Millisecond contact gaps hidden between stored observations become visible, while task outcomes remain unchanged. Complete inputs, traces, source snapshots and a verified downloader preserve every case. This is measurement work, not a new policy benchmark, PiPER shoe result or hardware qualification.Give the gripper a fair testhttps://research.dvidia.org/papers/shoe-graspability-v03/https://research.dvidia.org/papers/shoe-graspability-v03/Wed, 14 Oct 2026 12:00:00 GMT24/24 valid · 30 g: 8/12 lifts · 300 g: 0/12 · no net gain from removing rake. A frozen 24-attempt PiPER diagnostic separates three rigid shapes, 30 g and 300 g loads, and mounted versus absent rake conditions. All attempts are valid; eight of twelve lightweight controls retain a direct lift while every 300 g attempt fails, including the small block. Removing the rake gains one narrow-shoe result and loses one block result, with no net completion gain. A verified settled reference, dense contact traces, unchanged drive fingerprint and independent scoring expose limits in the modeled grasp and force response. Recorded replays and runnable CPU code retain every failure. No autonomous tool removal, retrieval, learned skill or physical hardware qualification is claimed.From reaching a shoe to keeping holdhttps://research.dvidia.org/papers/continuous-shoe-grip-v02/https://research.dvidia.org/papers/continuous-shoe-grip-v02/Tue, 13 Oct 2026 12:00:00 GMT20/20 valid · 2/10 completed under both policies · 9 contact-loss alarms verified. A frozen twenty-attempt native MuJoCo comparison adds continuous acquisition checks and bounded lowering to the mounted-rake PiPER controller. Both policies complete the same 2/10 fresh cases: no gains or losses. Nine bilateral-contact-loss alarms follow a trace-verified native origin by 20–52 ms, median 30 ms; three acquisition failures are separate. Twelve supported lowering responses produce no additional completion. A non-finger-support gap remains unmonitored. Complete recorded trajectories, independent audit and development failures are public. Authored policies, synthetic contact and privileged observations establish no learned skill or physical robot qualification.Skill prerequisites: access, reach and recoveryhttps://research.dvidia.org/papers/skill-prerequisites-v01/https://research.dvidia.org/papers/skill-prerequisites-v01/Tue, 13 Oct 2026 12:00:00 GMT16/16 valid · 2 lid contacts avoided · 3/4 retrieval checkpoints · 0/4 retained tool lifts. A frozen sixteen-attempt native MuJoCo study tests hinged shoe-box access and a mounted rake for an out-of-workspace shoe. Guarded access avoids two baseline lid collisions while task completion stays at 2/4; a transient withdrawal adds 0.70 simulated seconds without being necessary in its matched baseline. The mounted rake reaches an intermediate retrieval checkpoint in 3/4 cases, but all subsequent retained lifts fail and the short-tool case is deferred. All native traces and failures remain public. The browser replays recorded states; fresh physics runs locally. Privileged observations, synthetic contact and authored policies establish no learned skill or hardware qualification.Live PiPER shoe workstation v0.1https://research.dvidia.org/papers/live-piper-shoe-workstation-v01/https://research.dvidia.org/papers/live-piper-shoe-workstation-v01/Tue, 13 Oct 2026 12:00:00 GMTLive browser physics · 14/16 targets · strict contact parity failed · shoe lifting unqualified. A six-axis PiPER and its coupled gripper respond to user targets while MuJoCo runs locally in a browser worker. The final native run retains 20 valid attempts: 14/16 target trials pass, both high-target repeats fail, and jaw, impulse, disabled-table and 600-second hold checks pass. A ten-minute headless Chromium run reports 51.389 render calls per second and a 0.9999795 simulation/wall-time ratio on the tested Apple M5 host; simulated movement response is 61.9 ms p95 across 61 commands. Render calls do not measure GPU presentation. Native/WASM numerical and loaded-contact-count checks pass, while strict raw contact counts differ in 13/1,500 states. All fifteen development shoe-lift attempts fail. Complete development, failure and timing records remain separate. This authored rigid-shoe environment establishes no learned skill, calibrated material model or physical robot qualification.Reusable shoe asset library v0.1https://research.dvidia.org/papers/shoe-asset-library-v01/https://research.dvidia.org/papers/shoe-asset-library-v01/Mon, 12 Oct 2026 12:00:00 GMTSix shoe proxies · three arms · support 27/27, disabled table 0/27 · manipulation unqualified. Six original MIT rigid shoe proxies compose with the pinned UR5e/Robotiq, PiPER and SO-101 models through versioned scene descriptors and offline native 3D previews. A frozen 54-attempt test records 27/27 supported pairs and 0/27 support successes when table collisions are disabled; all 54 gravity checks pass without numerical warnings. No loaded non-table shoe contacts appear in the 20 ms samples, which cannot rule out shorter transients. All sampled trajectories and 27,000 native-step durations remain available. On one Apple M5 host, 54 simulated seconds take 12.3616 wall seconds including fresh model construction; the slowest attempt takes 6.7047 seconds. Geometry and physical properties are authored assumptions. Loading, gravity and passive support do not establish shoe grasping, calibrated deformation, a learned policy or hardware transfer.PiPER placement reliability v0.5https://research.dvidia.org/papers/piper-reliability-v05/https://research.dvidia.org/papers/piper-reliability-v05/Mon, 12 Oct 2026 12:00:00 GMT23/36 revised grasp · 15/36 v0.4 · 8 gained, none lost · hardware unqualified. Three frozen fresh PiPER cohorts retain 252 numerically valid attempts and 144 failed negative controls. A fixed diagonal grasp with bounded pose planning completes 23/36 placements versus 15/36 for frozen v0.4 and 18/36 with second-lift recovery alone: eight gained completions and none lost. The fifteen shared successes are 0.772 simulated seconds slower on average. Three lift-only second probes qualify and finish their tasks; the full grasp candidate needs none. Twelve low-friction acquisitions and one later retention failure remain. Every trajectory, native task outcome and raw computation duration is retained, including 1,035 windows exceeding 20 ms and a 3.082-second outlier on a loaded host. Native mechanics and scoring remain unchanged. Separate development keeps 200 earlier attempts, including discarded regressions. Authored privileged simulation establishes no learned skill, real-time guarantee or physical qualification.PiPER contact recovery v0.4https://research.dvidia.org/papers/piper-contact-recovery-v04/https://research.dvidia.org/papers/piper-contact-recovery-v04/Sun, 11 Oct 2026 12:00:00 GMTAll modes 4/12 · two resumed tasks faster · controls 0/48 · hardware unqualified. A fresh frozen 84-attempt PiPER comparison completes 4/12 placements for v0.3 history, v0.4 carry-only and v0.4 full; all 48 matched open-jaw and hold controls fail. Two completed post-hold placements finish 2.440 and 2.640 simulated seconds sooner with unchanged 220/240 ms settling holds. Four low-friction failures reach refusal 2.88–2.90 seconds sooner without becoming successes. Fresh nominal-friction 60 g layouts expose two held-but-too-low resume failures in every mode; neither reaches speed restoration. Six earlier acquisition failures are traced to insufficient support under the pinned position servo and side pinch, not the actuator force cap. All native mechanics and outcome criteria remain unchanged. Complete trajectories and 84,000 raw computation windows are retained; none exceeds 20 ms on this host. Source-snapshotted development remains separate. Privileged authored simulation establishes no learned skill, true-slip accuracy or physical qualification.PiPER contact history v0.3https://research.dvidia.org/papers/piper-contact-history-v03/https://research.dvidia.org/papers/piper-contact-history-v03/Sun, 11 Oct 2026 12:00:00 GMTHistory 6/12 · baseline and probe-only 4/12 · controls 0/48 · hardware unqualified. A frozen paired PiPER experiment retains all 84 numerically valid attempts across twelve synthetic rigid-block scenes. History completes 6/12 placements versus 4/12 for both original motion and the identical acquisition probe without carry monitoring; all 48 separately matched open-jaw and hold controls fail. The two added completions occur at nominal friction with 60 g blocks. Four tasks complete after five closed holds/resumes, but only four of five resume windows meet the independent low absolute TCP-speed criterion. All six supported acquisition retries fail. Native gains, forces and outcome rules remain unchanged; requested movement reduction is distinct from actual speed, and two slowdown windows include early holds. Seventy-five of 84,000 computation windows exceed 20 ms. Complete sealed trajectories, original model notices, source-snapshotted development and pinned offline inspection preserve both success and failure. Privileged authored simulation establishes no learned skill, true-slip detector accuracy, shoe competence or physical qualification.PiPER grip validation and recoveryhttps://research.dvidia.org/papers/piper-grip-validation-and-recovery/https://research.dvidia.org/papers/piper-grip-validation-and-recovery/Sun, 11 Oct 2026 12:00:00 GMTModerate-friction regression · baseline 4/6, guarded 2/6 · hardware unqualified. A slow test lift and bounded supported retry add recorded acquisition decisions to the pinned PiPER contact pilot, but completion regresses: at moderate friction baseline completes 2/2 and guarded completes 0/2. Both complete 2/2 normal cases; neither completes the two low-friction cases. All 30 attempts remain numerically valid, including 18 failed controls and full-duration aborts. Four qualification decisions are followed by a brief independent following window, yet two tasks still fail; no successful recovery or overall improvement is demonstrated. Actual motion continues after hold requests, and 53/30,000 computation windows exceed 20 ms. Complete compressed receipts, original model notices and pinned offline inspection preserve the evidence. Authored privileged-state simulation establishes no detector accuracy, learned shoe skill, calibrated contact or physical robot qualification.Native grasp task benchmarkhttps://research.dvidia.org/papers/native-grasp-task-benchmark/https://research.dvidia.org/papers/native-grasp-task-benchmark/Sun, 11 Oct 2026 12:00:00 GMT6/6 simulated placements · controls 0/12 · real-time and hardware unqualified. A pinned six-axis arm and coupled gripper complete 6/6 frozen synthetic rigid-block placements, while matched recorded-arm/open-jaw and hold controls complete 0/12. Native contact must produce grasp, sustained lift, retained carry, release and settled placement with tool retreat. All 18 attempts and timing traces remain in the receipt; one placement takes 29.51 wall seconds for 20 simulated seconds and misses 251 of 1,000 computation windows, so real-time operation is not established. An offline 3D mesh replay exposes the recorded motion. The authored privileged-state baseline provides a benchmark for a future compact DVIDIA action policy, not a learned footage-to-action model, validated shoe simulation or physical robot qualification.Hardware matched robot simulationhttps://research.dvidia.org/papers/hardware-matched-robot-simulation/https://research.dvidia.org/papers/hardware-matched-robot-simulation/Sun, 11 Oct 2026 12:00:00 GMTPinned CPU mechanics · PiPER contact pilot · physical fidelity unmeasured. A separate UR5e/Robotiq reference preserves pinned geometry, inertias, moving-link collision proxies and coupled gripper structure: fourteen modeled coordinates and seven commands. Eighteen deterministic unloaded motion/closure runs are numerically valid; at a 1 ms step, CPU physics throughput measures 40.80–47.29 simulated seconds per measured stepping wall second on one host, excluding loading, sensing, rendering, policy and real actuation. Adjacent timestep comparisons and a matched static overlap expose numerical sensitivity and collision participation. A pure-Python paired trace scorer measures joint, tool and jaw mismatch without automatic qualification. Left/right five-finger references are separately audited; LeRobot collection with an original DVIDIA policy is proposed. Serial calibration, physical response, shoe task learning and bimanual execution remain unmeasured. An offline 3D mesh replay now exposes the recorded arm/gripper poses without rerunning physics. PiPER and SO-101 now have pinned CPU profiles with 6/6 valid unloaded numerical attempts each and explicit native command units. PiPER also has a frozen authored rigid-block contact pilot: nominal placement 2/2, low-friction placement 0/1, open-jaw 0/3 and hold 0/3, with all nine attempts numerically valid. One of 9,000 computation windows exceeds 20 ms; hardware real-time response is unqualified. SO-101 object tasks, learned policies and physical qualification remain open. YAM, OpenArm, ARX X5 and PAROL6 remain upcoming.DVIDIA Observation Lab pilothttps://research.dvidia.org/papers/dvidia-observation-lab/https://research.dvidia.org/papers/dvidia-observation-lab/Sun, 11 Oct 2026 12:00:00 GMTLocal review release · motion and actuator source pilots · hardware unqualified. DVIDIA Observation Lab supplies local object/palm proposals, reviewed timeline revisions and separate causal image-motion forecasts; real annotation and motion accuracy remain unmeasured. A new CPU pilot learns next-20-ms joint/jaw deltas from current native state and issued commands. Twelve seeded groups retain 36 recordings with 8/2/2 train/development/test grouping; 4,553 test transitions are not independent robot trials. The 6,438-byte action model computes at 0.207 ms p95 on one host and improves RMSE, while jaw MAE/worst error regress against persistence and an initial opening is substantially overpredicted. These are privileged simulator measurements and model-only timings. A proposed shoe capture plan has no footage or executed shoe benchmark. The v0.1 release and hosted synthetic review demo remain separate; no shoe policy, physical adapter, validated shoe physics or hardware qualification is established.Robotics research pipelinehttps://research.dvidia.org/papers/robotics-research-pipeline/https://research.dvidia.org/papers/robotics-research-pipeline/Fri, 09 Oct 2026 12:00:00 GMTArchitecture proposal · current simulation alpha · hardware unqualified. An updated architecture connects immutable Skillspace recordings, reviewed task-label proposals and synchronized measured telemetry to grouped datasets, separate visual and motor learners, and a proposed local state supervisor. The implemented CPU baseline retains authored phases, gripper decisions and recovery around its learned joint-delta head. New annotation and supervisor pilots, fresh frozen confirmation, physics calibration and compatible skill-installation gates define the next milestones. Automatic labeling, learned supervision, human-video action recovery and physical arm qualification remain unestablished; this publication adds no new training or hardware result.Skillspace footage training pipelinehttps://research.dvidia.org/papers/skillspace-footage-training/https://research.dvidia.org/papers/skillspace-footage-training/Thu, 08 Oct 2026 12:00:00 GMTPublic CPU package · one native scene qualified · simulation-only. The public Dvidia-Inference/dvidia-training repository provides a standalone CPU pipeline that audits Skillspace media, freezes grouped splits and exports inspectable artifacts. Ten synthetic six-second clips train a visual predictor with a 0.5106-second median pipeline time across three repeats on one macOS host. Aligned native simulator telemetry supplies 4,029 training labels for a learned joint-delta head, evaluated on one held-out recording. Its capsule passes native placement qualification in that recording's exact scene; identical joint targets with open jaws fail. Installation and hardware guides accompany the package. Human-video action recovery, shoe organization, demonstration sufficiency, independent scene generalization and physical robot competence remain unestablished.Skill capsule acquisition and optimizationhttps://research.dvidia.org/papers/skill-capsule-acquisition/https://research.dvidia.org/papers/skill-capsule-acquisition/Wed, 07 Oct 2026 12:00:00 GMTSimulation-only · teacher/student 7/8 · no overall speedup. A compact learned CPU movement head replaces joint-target computation inside an authored placement supervisor. Teacher and student both pass 7/8 in a new frozen evaluation, while episode wall time increases from 6.273 to 6.360 seconds. A 39,845-byte JSON capsule imports into the local lab, checks its exact runtime and qualifies the current scene through native placement and a recorded-arm/open-jaw control. Scene changes require a fresh test. One known scene and repeat pass native network denial; perception, complete task learning, other embodiments and hardware remain unqualified.Skillspace arm benchmarks and evolutionhttps://research.dvidia.org/papers/skillspace-arm-benchmarks/https://research.dvidia.org/papers/skillspace-arm-benchmarks/Wed, 07 Oct 2026 12:00:00 GMTMixed held-out result · 30/32 baseline, 29/32 updated. Two controller revisions improve development completion from 14/20 to 17/20, but the frozen paired test declines from 30/32 to 29/32: both pass all 24 normal-strength cases while actuator-stress completion falls from 6/8 to 5/8. Instrumented CPU throughput also declines. We publish the regression, unchanged contact and success rules, exact controller snapshots, richer physical inputs, runtime-bound installation and a proposed staged Skillspace contract. Contact forces and penetration remain uncalibrated; learned perception and physical qualification are open.Installing a Skillspace on a simulated armhttps://research.dvidia.org/papers/skillspace-arm-installation/https://research.dvidia.org/papers/skillspace-arm-installation/Wed, 07 Oct 2026 12:00:00 GMTPublic skill link to authored adapter · 6/6 scene placements. The first link-to-arm product path installs an existing DVIDIA placement envelope, binds a local authored controller to one simulated arm, and reuses it in independently grounded scenes. Native jaw contacts carry a free box; six layouts complete, while no-motion and identical joint commands with open jaws each complete zero of six. Installed execution passes process-level offline checks. Task metadata contains no learned policy; perception, cup geometry, full arm collisions and physical qualification remain open.Offline cable training environmenthttps://research.dvidia.org/papers/offline-cable-training-environment/https://research.dvidia.org/papers/offline-cable-training-environment/Wed, 07 Oct 2026 12:00:00 GMTCPU simulation-only · Controller search and frozen evaluation executed. The first runnable product loop combines an anchored cable environment, local controller-parameter search, frozen evaluation, offline replay and a manifest-backed skill pack. The selected controller and a fixed feedback baseline both completed 10/10 held-out simulated episodes; zero-force and release controls completed 0/10. A native macOS network-denial run completed 3/3 additional episodes. Ideal endpoint attachment and privileged state bound the result; physical rope calibration, gripping, sensors and GPU throughput remain untested.Fast accurate robot training simulationhttps://research.dvidia.org/papers/fast-accurate-robot-training-simulation/https://research.dvidia.org/papers/fast-accurate-robot-training-simulation/Wed, 07 Oct 2026 12:00:00 GMT54 CPU fixture trials · GPU and physical transfer untested. A design for an offline, self-hosted training environment that turns demonstrations into calibrated practice and qualified robot skills. We examine contact, deformation, sensor feedback and the performance–accuracy tradeoff, then report 54 deterministic native MuJoCo CPU fixture trials. Fine endpoint agreement did not establish accurate contact transients, and coarse timesteps missed collisions. Minimum GPU memory, rope accuracy and physical transfer remain unmeasured.Grok robotics research on Xhttps://research.dvidia.org/papers/grok-robotics-research-on-x/https://research.dvidia.org/papers/grok-robotics-research-on-x/Wed, 07 Oct 2026 12:00:00 GMTPrimary sources checked · Experiments proposed. Three Grok 4.7 research passes surface observation-to-action, synthetic-practice and reusable-repair ideas. Independent primary-source checks compare those findings with our thesis: observation supplies goals and state, language retrieves a skill, spatial expectations guide attention, and executable feedback with evaluation establishes competence. X posts remain discovery leads. No universal demonstration count or arbitrary-robot transfer follows from the reviewed results.Spatially grounded downloadable robot skillshttps://research.dvidia.org/papers/spatially-grounded-downloadable-robot-skills/https://research.dvidia.org/papers/spatially-grounded-downloadable-robot-skills/Wed, 07 Oct 2026 12:00:00 GMTSource review · DVIDIA experiments not run. A synthesis of learning from human demonstrations, language-conditioned spatial attention, simulation expansion and robot-specific skill delivery. Spatial priors can accelerate inspection but do not determine contact state or control. The proposed downloadable skill packages a controller, initiation and termination conditions, compatible sensing and hardware, recovery behavior and measured evidence. Separate experiments would test attention, data coverage, feedback and transfer.Clef and grounded video observationshttps://research.dvidia.org/papers/clef-and-grounded-video-observations/https://research.dvidia.org/papers/clef-and-grounded-video-observations/Tue, 06 Oct 2026 12:00:00 GMTFive licensed excerpts · Accuracy evaluation outstanding. A preregistered image-API feasibility run processed five licensed three-second POV excerpts using four timestamped frames, a Gemma caption and a Clef-flash check. All five completed at a price-derived inference estimate of $0.00140634. Post-run inspection found an object error accepted by the checker and omitted state changes. API and schema compatibility were demonstrated; annotation accuracy and whole-task success were not.From Skillspace to robot skillhttps://research.dvidia.org/papers/from-skillspace-to-robot-skill/https://research.dvidia.org/papers/from-skillspace-to-robot-skill/Tue, 06 Oct 2026 12:00:00 GMTGraduation and robot training not run. An Argus review and a proposal to connect original recordings, reviewed episodes, immutable datasets, training runs, held-out evaluation and robot-tested releases. The review separates video annotation from action supervision and defines compatibility beyond a robot’s degree-of-freedom count. A proposed 40-episode annotation pilot and evidence-based graduation criteria remain unrun.Turn physical footage into testable evidencehttps://research.dvidia.org/papers/physical-skill-research-agenda/https://research.dvidia.org/papers/physical-skill-research-agenda/Tue, 06 Oct 2026 12:00:00 GMTFour baseline protocols proposed. A research agenda covering visible capture evidence, relations over time, evaluation provenance and physical grounding. Each question has a bounded protocol and a failure condition. The aim is to measure whether structure and physical signals improve a defined task before scaling collection. Strategic opinions, author-reported results and our untested proposals are kept distinct.
diff --git a/docs/index.html b/docs/index.html
index 2fb0466..a797b5a 100644
--- a/docs/index.html
+++ b/docs/index.html
@@ -1,4 +1,4 @@
After five seven-command residual candidates each failed all 16 development cases, a separate 25-node learned jaw adapter preserves the frozen six-axis PiPER arm references. Trained on 64 synthetic teacher episodes and 64,000 causal labels, it completes 6/24 frozen confirmation cases, versus 8/24 for its matched blind control, 5/24 feedforward, 24/24 authored teacher and 0/24 open jaws. Feedback succeeds in 0/12 interrupted cases; 14/24 terminal-only passes conceal strict task failures. All 120 confirmation attempts are valid, and an independent numeric audit reconstructs 360 retained attempts. CPU inference p95 is 0.501 ms; this establishes no live-feedback advantage, recovered grip, human-video learning or hardware qualification.
A compact feedforward joint-and-jaw primitive trained on 32 successful synthetic demonstrations completes 5/12 frozen PiPER placement attempts from unseen starting positions. The authored teacher completes 12/12; three controls complete 0/12 each. All twelve learned terminal poses pass settling checks, while seven fail the full native contact-history gates. Complete tapes, failed development candidates, an independent audit and an installable local runner preserve the reliability gap. This is privileged-state reference distillation for a fixed rigid block and two trained goals, not human-video learning, learned feedback or physical robot qualification.
Learned 5/12 · teacher 12/12 · three controls 0/12 each · simulation only
· Paired synthetic benchmark for camera and drive evidence
A fresh eight-layout PiPER simulation benchmark adds separately processed RGB and drive checks to a local physical-goal verifier. The checks prevent 69 of 112 false completion readings while leaving 43 replay, identity, orientation, support and sampling blind spots; the conservative gate abstains on 73 of 80 baseline true completions, including all 64 deliberate sensor-fault controls. The measured CPU path is 22.1 ms median and 31.5 ms p95, excluding 200 ms acquisition. All raw channels and results are preserved; this is synthetic evidence, not hardware validation.
An offline audit traces the seven missed Jev completions without claiming an internal model cause. A local deterministic verifier then checks timestamped pose, motion, support, release and uncertainty on 200 fresh cases. It recognizes all 16 native positives and rejects all 48 native negatives; 128 evidence faults yield 120 abstentions and 8 incomplete answers. All 8 consistent forged streams produce physical false completions, exposing the remaining sensor-trust problem. CPU-only p95 is 0.318 ms, excluding the required 200 ms history and sensing. Complete native inputs, every decision, independent review and explicit failure cohorts remain public; no new Jev calls or hardware qualification.
The first measured run preserves all 64 requests from the image-goal v0.1 protocol. Jev returned valid structured responses for every trial and made no false-completion declaration, but recognized only 1/8 physically complete cases with privileged native telemetry and 0/8 with images alone. All four occluded complete scenes were called incomplete in both conditions. RGB abstention matched 8/16 ambiguous references. Median online latency was 1.776 seconds, p95 3.287 seconds. The release preserves every result, the independent review and the original unrun protocol. This small synthetic diagnostic does not qualify a robot completion gate, actuator loop or learned skill.
A frozen PiPER image-goal cohort crosses eight physical conditions with four layouts. Four moving/settled pairs have byte-identical images and different completion labels, exposing when one image cannot establish task completion. Native measurements verify 32 authored fixtures; a paired 64-request Jev protocol distinguishes RGB judgments from privileged simulator telemetry. The provider evaluation has not run because credentials were unavailable: accuracy, false-completion rates and service latency remain unmeasured. Every native state, image, frozen request hash and explicit unrun result is retained. No learned policy or hardware qualification is claimed.
32 native fixtures · 4 identical-image pairs · 64 Jev trials not run
· Research direction and passive native contact audit
A goal image specifies a destination; physical feedback verifies whether a robot gets there. We describe a bounded decision role for TypeSafe Jev, distinguish it from action-conditioned world-model planning, and propose an independently scored reaching experiment. A separate passive audit reproduces fourteen previously inspected rigid-box arm episodes exactly and records 249,502 native ticks. Millisecond contact gaps hidden between stored observations become visible, while task outcomes remain unchanged. Complete inputs, traces, source snapshots and a verified downloader preserve every case. This is measurement work, not a new policy benchmark, PiPER shoe result or hardware qualification.
A frozen 24-attempt PiPER diagnostic separates three rigid shapes, 30 g and 300 g loads, and mounted versus absent rake conditions. All attempts are valid; eight of twelve lightweight controls retain a direct lift while every 300 g attempt fails, including the small block. Removing the rake gains one narrow-shoe result and loses one block result, with no net completion gain. A verified settled reference, dense contact traces, unchanged drive fingerprint and independent scoring expose limits in the modeled grasp and force response. Recorded replays and runnable CPU code retain every failure. No autonomous tool removal, retrieval, learned skill or physical hardware qualification is claimed.
24/24 valid · 30 g: 8/12 lifts · 300 g: 0/12 · no net gain from removing rake
· Frozen native comparison with independent contact audit
A frozen twenty-attempt native MuJoCo comparison adds continuous acquisition checks and bounded lowering to the mounted-rake PiPER controller. Both policies complete the same 2/10 fresh cases: no gains or losses. Nine bilateral-contact-loss alarms follow a trace-verified native origin by 20–52 ms, median 30 ms; three acquisition failures are separate. Twelve supported lowering responses produce no additional completion. A non-finger-support gap remains unmonitored. Complete recorded trajectories, independent audit and development failures are public. Authored policies, synthetic contact and privileged observations establish no learned skill or physical robot qualification.
20/20 valid · 2/10 completed under both policies · 9 contact-loss alarms verified
· Two native environments with authored policies and recorded benchmark evidence
A frozen sixteen-attempt native MuJoCo study tests hinged shoe-box access and a mounted rake for an out-of-workspace shoe. Guarded access avoids two baseline lid collisions while task completion stays at 2/4; a transient withdrawal adds 0.70 simulated seconds without being necessary in its matched baseline. The mounted rake reaches an intermediate retrieval checkpoint in 3/4 cases, but all subsequent retained lifts fail and the short-tool case is deferred. All native traces and failures remain public. The browser replays recorded states; fresh physics runs locally. Privileged observations, synthetic contact and authored policies establish no learned skill or hardware qualification.
A six-axis PiPER and its coupled gripper respond to user targets while MuJoCo runs locally in a browser worker. The final native run retains 20 valid attempts: 14/16 target trials pass, both high-target repeats fail, and jaw, impulse, disabled-table and 600-second hold checks pass. A ten-minute headless Chromium run reports 51.389 render calls per second and a 0.9999795 simulation/wall-time ratio on the tested Apple M5 host; simulated movement response is 61.9 ms p95 across 61 commands. Render calls do not measure GPU presentation. Native/WASM numerical and loaded-contact-count checks pass, while strict raw contact counts differ in 13/1,500 states. All fifteen development shoe-lift attempts fail. Complete development, failure and timing records remain separate. This authored rigid-shoe environment establishes no learned skill, calibrated material model or physical robot qualification.
Six original MIT rigid shoe proxies compose with the pinned UR5e/Robotiq, PiPER and SO-101 models through versioned scene descriptors and offline native 3D previews. A frozen 54-attempt test records 27/27 supported pairs and 0/27 support successes when table collisions are disabled; all 54 gravity checks pass without numerical warnings. No loaded non-table shoe contacts appear in the 20 ms samples, which cannot rule out shorter transients. All sampled trajectories and 27,000 native-step durations remain available. On one Apple M5 host, 54 simulated seconds take 12.3616 wall seconds including fresh model construction; the slowest attempt takes 6.7047 seconds. Geometry and physical properties are authored assumptions. Loading, gravity and passive support do not establish shoe grasping, calibrated deformation, a learned policy or hardware transfer.
Six shoe proxies · three arms · support 27/27, disabled table 0/27 · manipulation unqualified
· Frozen paired reliability experiment with complete native evidence
Three frozen fresh PiPER cohorts retain 252 numerically valid attempts and 144 failed negative controls. A fixed diagonal grasp with bounded pose planning completes 23/36 placements versus 15/36 for frozen v0.4 and 18/36 with second-lift recovery alone: eight gained completions and none lost. The fifteen shared successes are 0.772 simulated seconds slower on average. Three lift-only second probes qualify and finish their tasks; the full grasp candidate needs none. Twelve low-friction acquisitions and one later retention failure remain. Every trajectory, native task outcome and raw computation duration is retained, including 1,035 windows exceeding 20 ms and a 3.082-second outlier on a loaded host. Native mechanics and scoring remain unchanged. Separate development keeps 200 earlier attempts, including discarded regressions. Authored privileged simulation establishes no learned skill, real-time guarantee or physical qualification.
A fresh frozen 84-attempt PiPER comparison completes 4/12 placements for v0.3 history, v0.4 carry-only and v0.4 full; all 48 matched open-jaw and hold controls fail. Two completed post-hold placements finish 2.440 and 2.640 simulated seconds sooner with unchanged 220/240 ms settling holds. Four low-friction failures reach refusal 2.88–2.90 seconds sooner without becoming successes. Fresh nominal-friction 60 g layouts expose two held-but-too-low resume failures in every mode; neither reaches speed restoration. Six earlier acquisition failures are traced to insufficient support under the pinned position servo and side pinch, not the actuator force cap. All native mechanics and outcome criteria remain unchanged. Complete trajectories and 84,000 raw computation windows are retained; none exceeds 20 ms on this host. Source-snapshotted development remains separate. Privileged authored simulation establishes no learned skill, true-slip accuracy or physical qualification.
All modes 4/12 · two resumed tasks faster · controls 0/48 · hardware unqualified
· Paired probe-only and contact-history experiment with complete confirmation receipt
A frozen paired PiPER experiment retains all 84 numerically valid attempts across twelve synthetic rigid-block scenes. History completes 6/12 placements versus 4/12 for both original motion and the identical acquisition probe without carry monitoring; all 48 separately matched open-jaw and hold controls fail. The two added completions occur at nominal friction with 60 g blocks. Four tasks complete after five closed holds/resumes, but only four of five resume windows meet the independent low absolute TCP-speed criterion. All six supported acquisition retries fail. Native gains, forces and outcome rules remain unchanged; requested movement reduction is distinct from actual speed, and two slowdown windows include early holds. Seventy-five of 84,000 computation windows exceed 20 ms. Complete sealed trajectories, original model notices, source-snapshotted development and pinned offline inspection preserve both success and failure. Privileged authored simulation establishes no learned skill, true-slip detector accuracy, shoe competence or physical qualification.
History 6/12 · baseline and probe-only 4/12 · controls 0/48 · hardware unqualified
· Paired authored controller experiment and complete confirmation receipt
A slow test lift and bounded supported retry add recorded acquisition decisions to the pinned PiPER contact pilot, but completion regresses: at moderate friction baseline completes 2/2 and guarded completes 0/2. Both complete 2/2 normal cases; neither completes the two low-friction cases. All 30 attempts remain numerically valid, including 18 failed controls and full-duration aborts. Four qualification decisions are followed by a brief independent following window, yet two tasks still fail; no successful recovery or overall improvement is demonstrated. Actual motion continues after hold requests, and 53/30,000 computation windows exceed 20 ms. Complete compressed receipts, original model notices and pinned offline inspection preserve the evidence. Authored privileged-state simulation establishes no detector accuracy, learned shoe skill, calibrated contact or physical robot qualification.
A pinned six-axis arm and coupled gripper complete 6/6 frozen synthetic rigid-block placements, while matched recorded-arm/open-jaw and hold controls complete 0/12. Native contact must produce grasp, sustained lift, retained carry, release and settled placement with tool retreat. All 18 attempts and timing traces remain in the receipt; one placement takes 29.51 wall seconds for 20 simulated seconds and misses 251 of 1,000 computation windows, so real-time operation is not established. An offline 3D mesh replay exposes the recorded motion. The authored privileged-state baseline provides a benchmark for a future compact DVIDIA action policy, not a learned footage-to-action model, validated shoe simulation or physical robot qualification.
A separate UR5e/Robotiq reference preserves pinned geometry, inertias, moving-link collision proxies and coupled gripper structure: fourteen modeled coordinates and seven commands. Eighteen deterministic unloaded motion/closure runs are numerically valid; at a 1 ms step, CPU physics throughput measures 40.80–47.29 simulated seconds per measured stepping wall second on one host, excluding loading, sensing, rendering, policy and real actuation. Adjacent timestep comparisons and a matched static overlap expose numerical sensitivity and collision participation. A pure-Python paired trace scorer measures joint, tool and jaw mismatch without automatic qualification. Left/right five-finger references are separately audited; LeRobot collection with an original DVIDIA policy is proposed. Serial calibration, physical response, shoe task learning and bimanual execution remain unmeasured. An offline 3D mesh replay now exposes the recorded arm/gripper poses without rerunning physics. PiPER and SO-101 now have pinned CPU profiles with 6/6 valid unloaded numerical attempts each and explicit native command units. PiPER also has a frozen authored rigid-block contact pilot: nominal placement 2/2, low-friction placement 0/1, open-jaw 0/3 and hold 0/3, with all nine attempts numerically valid. One of 9,000 computation windows exceeds 20 ms; hardware real-time response is unqualified. SO-101 object tasks, learned policies and physical qualification remain open. YAM, OpenArm, ARX X5 and PAROL6 remain upcoming.
Pinned CPU mechanics · PiPER contact pilot · physical fidelity unmeasured
· Local observation workflow and engineering feasibility pilot
DVIDIA Observation Lab supplies local object/palm proposals, reviewed timeline revisions and separate causal image-motion forecasts; real annotation and motion accuracy remain unmeasured. A new CPU pilot learns next-20-ms joint/jaw deltas from current native state and issued commands. Twelve seeded groups retain 36 recordings with 8/2/2 train/development/test grouping; 4,553 test transitions are not independent robot trials. The 6,438-byte action model computes at 0.207 ms p95 on one host and improves RMSE, while jaw MAE/worst error regress against persistence and an initial opening is substantially overpredicted. These are privileged simulator measurements and model-only timings. A proposed shoe capture plan has no footage or executed shoe benchmark. The v0.1 release and hosted synthetic review demo remain separate; no shoe policy, physical adapter, validated shoe physics or hardware qualification is established.
Local review release · motion and actuator source pilots · hardware unqualified
· Architecture proposal and staged validation roadmap
An updated architecture connects immutable Skillspace recordings, reviewed task-label proposals and synchronized measured telemetry to grouped datasets, separate visual and motor learners, and a proposed local state supervisor. The implemented CPU baseline retains authored phases, gripper decisions and recovery around its learned joint-delta head. New annotation and supervisor pilots, fresh frozen confirmation, physics calibration and compatible skill-installation gates define the next milestones. Automatic labeling, learned supervision, human-video action recovery and physical arm qualification remain unestablished; this publication adds no new training or hardware result.
Architecture proposal · current simulation alpha · hardware unqualified
· Product implementation and measured synthetic pilot
The public Dvidia-Inference/dvidia-training repository provides a standalone CPU pipeline that audits Skillspace media, freezes grouped splits and exports inspectable artifacts. Ten synthetic six-second clips train a visual predictor with a 0.5106-second median pipeline time across three repeats on one macOS host. Aligned native simulator telemetry supplies 4,029 training labels for a learned joint-delta head, evaluated on one held-out recording. Its capsule passes native placement qualification in that recording's exact scene; identical joint targets with open jaws fail. Installation and hardware guides accompany the package. Human-video action recovery, shoe organization, demonstration sufficiency, independent scene generalization and physical robot competence remain unestablished.
Public CPU package · one native scene qualified · simulation-only
· Learned movement artifact and installation prototype
A compact learned CPU movement head replaces joint-target computation inside an authored placement supervisor. Teacher and student both pass 7/8 in a new frozen evaluation, while episode wall time increases from 6.273 to 6.360 seconds. A 39,845-byte JSON capsule imports into the local lab, checks its exact runtime and qualifies the current scene through native placement and a recorded-arm/open-jaw control. Scene changes require a fresh test. One known scene and repeat pass native network denial; perception, complete task learning, other embodiments and hardware remain unqualified.
Simulation-only · teacher/student 7/8 · no overall speedup
· Paired simulation benchmark and product assessment
Two controller revisions improve development completion from 14/20 to 17/20, but the frozen paired test declines from 30/32 to 29/32: both pass all 24 normal-strength cases while actuator-stress completion falls from 6/8 to 5/8. Instrumented CPU throughput also declines. We publish the regression, unchanged contact and success rules, exact controller snapshots, richer physical inputs, runtime-bound installation and a proposed staged Skillspace contract. Contact forces and penetration remain uncalibrated; learned perception and physical qualification are open.
Mixed held-out result · 30/32 baseline, 29/32 updated
· Product prototype and native contact qualification
The first link-to-arm product path installs an existing DVIDIA placement envelope, binds a local authored controller to one simulated arm, and reuses it in independently grounded scenes. Native jaw contacts carry a free box; six layouts complete, while no-motion and identical joint commands with open jaws each complete zero of six. Installed execution passes process-level offline checks. Task metadata contains no learned policy; perception, cup geometry, full arm collisions and physical qualification remain open.
Public skill link to authored adapter · 6/6 scene placements
The first runnable product loop combines an anchored cable environment, local controller-parameter search, frozen evaluation, offline replay and a manifest-backed skill pack. The selected controller and a fixed feedback baseline both completed 10/10 held-out simulated episodes; zero-force and release controls completed 0/10. A native macOS network-denial run completed 3/3 additional episodes. Ideal endpoint attachment and privileged state bound the result; physical rope calibration, gripping, sensors and GPU throughput remain untested.
CPU simulation-only · Controller search and frozen evaluation executed
A design for an offline, self-hosted training environment that turns demonstrations into calibrated practice and qualified robot skills. We examine contact, deformation, sensor feedback and the performance–accuracy tradeoff, then report 54 deterministic native MuJoCo CPU fixture trials. Fine endpoint agreement did not establish accurate contact transients, and coarse timesteps missed collisions. Minimum GPU memory, rope accuracy and physical transfer remain unmeasured.
54 CPU fixture trials · GPU and physical transfer untested
Three Grok 4.7 research passes surface observation-to-action, synthetic-practice and reusable-repair ideas. Independent primary-source checks compare those findings with our thesis: observation supplies goals and state, language retrieves a skill, spatial expectations guide attention, and executable feedback with evaluation establishes competence. X posts remain discovery leads. No universal demonstration count or arbitrary-robot transfer follows from the reviewed results.
A synthesis of learning from human demonstrations, language-conditioned spatial attention, simulation expansion and robot-specific skill delivery. Spatial priors can accelerate inspection but do not determine contact state or control. The proposed downloadable skill packages a controller, initiation and termination conditions, compatible sensing and hardware, recovery behavior and measured evidence. Separate experiments would test attention, data coverage, feedback and transfer.
A preregistered image-API feasibility run processed five licensed three-second POV excerpts using four timestamped frames, a Gemma caption and a Clef-flash check. All five completed at a price-derived inference estimate of $0.00140634. Post-run inspection found an object error accepted by the checker and omitted state changes. API and schema compatibility were demonstrated; annotation accuracy and whole-task success were not.
Five licensed excerpts · Accuracy evaluation outstanding
An Argus review and a proposal to connect original recordings, reviewed episodes, immutable datasets, training runs, held-out evaluation and robot-tested releases. The review separates video annotation from action supervision and defines compatibility beyond a robot’s degree-of-freedom count. A proposed 40-episode annotation pilot and evidence-based graduation criteria remain unrun.
A research agenda covering visible capture evidence, relations over time, evaluation provenance and physical grounding. Each question has a bounded protocol and a failure condition. The aim is to measure whether structure and physical signals improve a defined task before scaling collection. Strategic opinions, author-reported results and our untested proposals are kept distinct.
Four baseline protocols proposed
No publications match this search.
Research footprints
Learn a first PiPER placement primitive from demonstrations
A compact feedforward model trained on 32 synthetic teacher demonstrations completes 5/12 frozen placement attempts from unseen starts. The teacher completes 12/12; three controls complete none. All twelve learned final poses settle near their targets, but seven fail full contact-history gates. The recorded viewer, complete evidence and installable local runner preserve the reliability gap. Learned feedback, human-video learning and physical transfer remain open.
All 64 frozen requests returned valid responses. No false completion was observed, but images plus telemetry recognized only 1/8 completed states, and images alone recognized 0/8. Occluded finished scenes failed in both conditions. Median hosted latency was 1.776 seconds. The original protocol remains unchanged; all measured cases and independent review are public.
Thirty-two native PiPER fixtures include four moving/settled pairs with identical images and different physical completion labels. The frozen 64-request Jev protocol compares RGB with privileged simulator telemetry. Jev has not been run; all provider trials remain explicitly unrun, with accuracy and service latency unmeasured. Native states, images, source hashes and physical labels are public.
Connect visual goals to measured physical feedback
Fourteen passive rigid-box arm replays reproduce every original sampled state and outcome, recording 249,502 native ticks. Millisecond contact gaps appear between stored observations; a successful comparator also has gaps. The separate architecture note evaluates Jev as a candidate decision layer and defines a goal-image reaching test. No visual model is integrated and no controller is promoted.
Separate object difficulty from the gripper and attached tool
A frozen direct-grasp diagnostic retains 24 valid attempts. Lightweight controls complete 8/12 lifts; every 300 g condition fails, including the small block. Removing the rake gains one narrow-shoe result and loses one block result. Relative lift, settled references and dense contact traces make the modeled drive and geometry limits visible. These are diagnostic controls, not a shoe retrieval rate or hardware qualification.
Measure contact-loss response without claiming a better grasp
Twenty valid fresh attempts complete the same 2/10 cases under both controllers. Nine trace-verified bilateral-contact-loss alarms arrive in 20–52 ms; twelve supported lowering responses produce no additional completion. Full trajectories and an independent audit expose failed acquisition and an unmonitored support-contamination gap. Hardware transfer remains open.
Make skill prerequisites and failed recovery measurable
Two native environments retain sixteen valid held-out attempts. A lid guard avoids two baseline contacts while completion remains 2/4. A mounted rake reaches three of four intermediate retrieval checkpoints, but no subsequent retained lift succeeds. Recorded replays expose every failure; fresh physics runs locally. Tool acquisition, learned control and hardware transfer remain open.
Drag a target and nudge a free rigid trainer with live browser MuJoCo physics. The final native run keeps 20 valid attempts: 14/16 targets pass, both high-target repeats fail, and four mechanics checks pass. A ten-minute browser run reports 51.39 render calls per second on the tested host. Strict raw-contact parity fails in 13/1,500 sampled states despite numerical agreement; all fifteen development shoe-lift attempts fail. Learned shoe skills, calibrated contact and hardware transfer remain open.
Six original rigid shoe proxies now compose with UR5e/Robotiq, PiPER and SO-101. Versioned scene files, offline 3D previews and a frozen 54-attempt benchmark retain every trajectory: supported pairs 27/27, disabled-table support 0/27, all gravity checks pass. Native loading and passive contact are tested; shoe grasping, deformation and physical transfer remain unqualified.
Complete more placements with a bounded second lift and revised grasp
Three fresh cohorts retain 252 valid attempts. The revised grasp completes 23/36 placements versus 15/36 for v0.4 and 18/36 with second lift alone; all 144 controls fail. Eight completions are gained and none lost, while shared successes average 0.772 simulated seconds slower. Twelve low-friction acquisitions and one retention failure remain. All 1,035 computation overruns are retained; physical qualification is open.
Separate faster recovery from an ineffective retry
A fresh 84-attempt comparison completes 4/12 placements in every mode; all 48 controls fail. Two resumed tasks finish 2.440–2.640 simulated seconds sooner after unchanged settling holds, while four failed grips are refused 2.88–2.90 seconds sooner. Eight failures remain, including two held blocks below the resume-height gate. Every native trajectory and raw computation duration is retained; physical qualification is open.
A frozen 84-attempt paired cohort completes 6/12 history placements versus 4/12 original and probe-only placements; all 48 controls fail. Four tasks complete after five closed holds/resumes, but all six supported acquisition retries fail. Only four of five resume windows meet the independent low absolute tool-speed check. Actual motion and 75 missed computation windows remain visible; physical robot qualification is open.
A slow probe and one supported retry retain 30 valid attempts. At moderate friction baseline completes 2/2 while guarded completes 0/2; normal cases both pass and low-friction cases both fail. No successful recovery or overall improvement is demonstrated. Four brief following windows do not establish detector accuracy; 53 computation windows miss 20 ms. Every full attempt remains public.
A frozen authored rigid-block pilot retains nine valid attempts: nominal placement 2/2, low-friction placement 0/1, open-jaw 0/3 and hold 0/3. One of 9,000 computation windows exceeds 20 ms. Complete task receipts remain distinct from unloaded profiles; learned skills, shoe physics and physical qualification are open.
PiPER and SO-101 join the library with pinned models, explicit arm/gripper units, preserved licenses and complete numerical receipts. Each completes six unloaded motion checks offline. Their learned-policy and physical qualification remain open. The PiPER contact pilot and UR5e grasp demonstration have separate task receipts.
A free rigid block must be grasped, lifted, carried, released and left settled at its destination. Frozen scenarios compare the authored controller with identical arm commands and open jaws, and with a hold control. Full traces and 3D replay preserve the evidence for the next compact action-learning experiment. Shoe physics, a learned task policy and hardware transfer remain open.
A pinned six-axis arm and coupled gripper expose fourteen coordinates and seven commands. All 18 unloaded numerical runs are valid; 1 ms CPU physics measures 40.80–47.29× elapsed-time throughput with sensing, rendering and policy excluded. A paired trace scorer makes physical mismatch measurable. Five-finger references and LeRobot collection have separate contracts; hardware fidelity and shoe competence remain unmeasured.
A 6,438-byte CPU model predicts the next 20 ms of joint/jaw movement from native state and issued commands. Twelve seeded groups retain 36 recordings; 4,553 test transitions are not independent trials. Warm computation measures 0.207 ms p95, but jaw mean absolute/worst errors regress against persistence and the first opening is overpredicted. Shoe collection, hardware sensing and validated shoe physics remain open.
A manually seeded CPU source alpha records pixel speed and causal forecasts. Six authored cases process 720 frames in 1.454 seconds; occlusion and low-texture losses remain visible, and a 500 ms reversal forecast misses by nearly 90 pixels. The v0.1 release/demo remain separate; real-scene accuracy, metric speed and live robot control are unqualified.
A diagram connects footage review, measured robot state, local training, frozen simulation evaluation and compatible skill installation. Automatic annotation and a learned task supervisor are proposed; their companion validation studies and physical robot qualification remain unrun.
One-click local installation binds a DVIDIA placement envelope to an authored contact controller. Six scene layouts pass; identical joint commands with open jaws and no-motion controls each pass 0/6. Physical transfer and learned policies remain open.
A local controller-training loop and simulation-only skill pack now run on CPU. Trained and baseline feedback each pass 10/10 simulated seeds; zero force and early release each pass 0/10. Real gripping, calibration and GPU qualification remain open.
54 deterministic CPU fixture trials recorded. Endpoint agreement coexists with unqualified force transients; coarse wall tests expose missed contact. No GPU or physical-transfer claim.
Compare the observation-to-skill thesis with prior work
Spatial attention, demonstration coverage, executable simulation and reusable repairs are reviewed separately. Three parallel Grok 4.7 searches support discovery; primary sources support the claims.
Four baseline protocols and a Skillspace graduation proposal establish the questions to test. A proposed protocol is distinct from an executed experiment.
A conversation can carry a photo and desired outcome through scene review, skill retrieval, compatible installation, simulation and inspectable action traces. The local prototype uses ten LIBERO-10 task manifests sharing a pinned OpenVLA checkpoint. Real SSDlite inference and a repeatable native task-5 reset are recorded; the checkpoint transfer stopped after an 8 MiB partial file, so learned policy actions and activation-steered behavior remain unrun. The note separates observed evidence, candidate relevance, executable compatibility and measured completion, and defines staged evaluation for the chat workflow and raw MLP channel interventions. General household planning and hardware execution remain unqualified.
Photo inference and one native reset verified · OpenVLA actions and steering not run
· Learned jaw adapter with matched blind controls and retained negative studies
After five seven-command residual candidates each failed all 16 development cases, a separate 25-node learned jaw adapter preserves the frozen six-axis PiPER arm references. Trained on 64 synthetic teacher episodes and 64,000 causal labels, it completes 6/24 frozen confirmation cases, versus 8/24 for its matched blind control, 5/24 feedforward, 24/24 authored teacher and 0/24 open jaws. Feedback succeeds in 0/12 interrupted cases; 14/24 terminal-only passes conceal strict task failures. All 120 confirmation attempts are valid, and an independent numeric audit reconstructs 360 retained attempts. CPU inference p95 is 0.501 ms; this establishes no live-feedback advantage, recovered grip, human-video learning or hardware qualification.
A compact feedforward joint-and-jaw primitive trained on 32 successful synthetic demonstrations completes 5/12 frozen PiPER placement attempts from unseen starting positions. The authored teacher completes 12/12; three controls complete 0/12 each. All twelve learned terminal poses pass settling checks, while seven fail the full native contact-history gates. Complete tapes, failed development candidates, an independent audit and an installable local runner preserve the reliability gap. This is privileged-state reference distillation for a fixed rigid block and two trained goals, not human-video learning, learned feedback or physical robot qualification.
Learned 5/12 · teacher 12/12 · three controls 0/12 each · simulation only
· Paired synthetic benchmark for camera and drive evidence
A fresh eight-layout PiPER simulation benchmark adds separately processed RGB and drive checks to a local physical-goal verifier. The checks prevent 69 of 112 false completion readings while leaving 43 replay, identity, orientation, support and sampling blind spots; the conservative gate abstains on 73 of 80 baseline true completions, including all 64 deliberate sensor-fault controls. The measured CPU path is 22.1 ms median and 31.5 ms p95, excluding 200 ms acquisition. All raw channels and results are preserved; this is synthetic evidence, not hardware validation.
An offline audit traces the seven missed Jev completions without claiming an internal model cause. A local deterministic verifier then checks timestamped pose, motion, support, release and uncertainty on 200 fresh cases. It recognizes all 16 native positives and rejects all 48 native negatives; 128 evidence faults yield 120 abstentions and 8 incomplete answers. All 8 consistent forged streams produce physical false completions, exposing the remaining sensor-trust problem. CPU-only p95 is 0.318 ms, excluding the required 200 ms history and sensing. Complete native inputs, every decision, independent review and explicit failure cohorts remain public; no new Jev calls or hardware qualification.
The first measured run preserves all 64 requests from the image-goal v0.1 protocol. Jev returned valid structured responses for every trial and made no false-completion declaration, but recognized only 1/8 physically complete cases with privileged native telemetry and 0/8 with images alone. All four occluded complete scenes were called incomplete in both conditions. RGB abstention matched 8/16 ambiguous references. Median online latency was 1.776 seconds, p95 3.287 seconds. The release preserves every result, the independent review and the original unrun protocol. This small synthetic diagnostic does not qualify a robot completion gate, actuator loop or learned skill.
A frozen PiPER image-goal cohort crosses eight physical conditions with four layouts. Four moving/settled pairs have byte-identical images and different completion labels, exposing when one image cannot establish task completion. Native measurements verify 32 authored fixtures; a paired 64-request Jev protocol distinguishes RGB judgments from privileged simulator telemetry. The provider evaluation has not run because credentials were unavailable: accuracy, false-completion rates and service latency remain unmeasured. Every native state, image, frozen request hash and explicit unrun result is retained. No learned policy or hardware qualification is claimed.
32 native fixtures · 4 identical-image pairs · 64 Jev trials not run
· Research direction and passive native contact audit
A goal image specifies a destination; physical feedback verifies whether a robot gets there. We describe a bounded decision role for TypeSafe Jev, distinguish it from action-conditioned world-model planning, and propose an independently scored reaching experiment. A separate passive audit reproduces fourteen previously inspected rigid-box arm episodes exactly and records 249,502 native ticks. Millisecond contact gaps hidden between stored observations become visible, while task outcomes remain unchanged. Complete inputs, traces, source snapshots and a verified downloader preserve every case. This is measurement work, not a new policy benchmark, PiPER shoe result or hardware qualification.
A frozen 24-attempt PiPER diagnostic separates three rigid shapes, 30 g and 300 g loads, and mounted versus absent rake conditions. All attempts are valid; eight of twelve lightweight controls retain a direct lift while every 300 g attempt fails, including the small block. Removing the rake gains one narrow-shoe result and loses one block result, with no net completion gain. A verified settled reference, dense contact traces, unchanged drive fingerprint and independent scoring expose limits in the modeled grasp and force response. Recorded replays and runnable CPU code retain every failure. No autonomous tool removal, retrieval, learned skill or physical hardware qualification is claimed.
24/24 valid · 30 g: 8/12 lifts · 300 g: 0/12 · no net gain from removing rake
· Frozen native comparison with independent contact audit
A frozen twenty-attempt native MuJoCo comparison adds continuous acquisition checks and bounded lowering to the mounted-rake PiPER controller. Both policies complete the same 2/10 fresh cases: no gains or losses. Nine bilateral-contact-loss alarms follow a trace-verified native origin by 20–52 ms, median 30 ms; three acquisition failures are separate. Twelve supported lowering responses produce no additional completion. A non-finger-support gap remains unmonitored. Complete recorded trajectories, independent audit and development failures are public. Authored policies, synthetic contact and privileged observations establish no learned skill or physical robot qualification.
20/20 valid · 2/10 completed under both policies · 9 contact-loss alarms verified
· Two native environments with authored policies and recorded benchmark evidence
A frozen sixteen-attempt native MuJoCo study tests hinged shoe-box access and a mounted rake for an out-of-workspace shoe. Guarded access avoids two baseline lid collisions while task completion stays at 2/4; a transient withdrawal adds 0.70 simulated seconds without being necessary in its matched baseline. The mounted rake reaches an intermediate retrieval checkpoint in 3/4 cases, but all subsequent retained lifts fail and the short-tool case is deferred. All native traces and failures remain public. The browser replays recorded states; fresh physics runs locally. Privileged observations, synthetic contact and authored policies establish no learned skill or hardware qualification.
A six-axis PiPER and its coupled gripper respond to user targets while MuJoCo runs locally in a browser worker. The final native run retains 20 valid attempts: 14/16 target trials pass, both high-target repeats fail, and jaw, impulse, disabled-table and 600-second hold checks pass. A ten-minute headless Chromium run reports 51.389 render calls per second and a 0.9999795 simulation/wall-time ratio on the tested Apple M5 host; simulated movement response is 61.9 ms p95 across 61 commands. Render calls do not measure GPU presentation. Native/WASM numerical and loaded-contact-count checks pass, while strict raw contact counts differ in 13/1,500 states. All fifteen development shoe-lift attempts fail. Complete development, failure and timing records remain separate. This authored rigid-shoe environment establishes no learned skill, calibrated material model or physical robot qualification.
Six original MIT rigid shoe proxies compose with the pinned UR5e/Robotiq, PiPER and SO-101 models through versioned scene descriptors and offline native 3D previews. A frozen 54-attempt test records 27/27 supported pairs and 0/27 support successes when table collisions are disabled; all 54 gravity checks pass without numerical warnings. No loaded non-table shoe contacts appear in the 20 ms samples, which cannot rule out shorter transients. All sampled trajectories and 27,000 native-step durations remain available. On one Apple M5 host, 54 simulated seconds take 12.3616 wall seconds including fresh model construction; the slowest attempt takes 6.7047 seconds. Geometry and physical properties are authored assumptions. Loading, gravity and passive support do not establish shoe grasping, calibrated deformation, a learned policy or hardware transfer.
Six shoe proxies · three arms · support 27/27, disabled table 0/27 · manipulation unqualified
· Frozen paired reliability experiment with complete native evidence
Three frozen fresh PiPER cohorts retain 252 numerically valid attempts and 144 failed negative controls. A fixed diagonal grasp with bounded pose planning completes 23/36 placements versus 15/36 for frozen v0.4 and 18/36 with second-lift recovery alone: eight gained completions and none lost. The fifteen shared successes are 0.772 simulated seconds slower on average. Three lift-only second probes qualify and finish their tasks; the full grasp candidate needs none. Twelve low-friction acquisitions and one later retention failure remain. Every trajectory, native task outcome and raw computation duration is retained, including 1,035 windows exceeding 20 ms and a 3.082-second outlier on a loaded host. Native mechanics and scoring remain unchanged. Separate development keeps 200 earlier attempts, including discarded regressions. Authored privileged simulation establishes no learned skill, real-time guarantee or physical qualification.
A fresh frozen 84-attempt PiPER comparison completes 4/12 placements for v0.3 history, v0.4 carry-only and v0.4 full; all 48 matched open-jaw and hold controls fail. Two completed post-hold placements finish 2.440 and 2.640 simulated seconds sooner with unchanged 220/240 ms settling holds. Four low-friction failures reach refusal 2.88–2.90 seconds sooner without becoming successes. Fresh nominal-friction 60 g layouts expose two held-but-too-low resume failures in every mode; neither reaches speed restoration. Six earlier acquisition failures are traced to insufficient support under the pinned position servo and side pinch, not the actuator force cap. All native mechanics and outcome criteria remain unchanged. Complete trajectories and 84,000 raw computation windows are retained; none exceeds 20 ms on this host. Source-snapshotted development remains separate. Privileged authored simulation establishes no learned skill, true-slip accuracy or physical qualification.
All modes 4/12 · two resumed tasks faster · controls 0/48 · hardware unqualified
· Paired probe-only and contact-history experiment with complete confirmation receipt
A frozen paired PiPER experiment retains all 84 numerically valid attempts across twelve synthetic rigid-block scenes. History completes 6/12 placements versus 4/12 for both original motion and the identical acquisition probe without carry monitoring; all 48 separately matched open-jaw and hold controls fail. The two added completions occur at nominal friction with 60 g blocks. Four tasks complete after five closed holds/resumes, but only four of five resume windows meet the independent low absolute TCP-speed criterion. All six supported acquisition retries fail. Native gains, forces and outcome rules remain unchanged; requested movement reduction is distinct from actual speed, and two slowdown windows include early holds. Seventy-five of 84,000 computation windows exceed 20 ms. Complete sealed trajectories, original model notices, source-snapshotted development and pinned offline inspection preserve both success and failure. Privileged authored simulation establishes no learned skill, true-slip detector accuracy, shoe competence or physical qualification.
History 6/12 · baseline and probe-only 4/12 · controls 0/48 · hardware unqualified
· Paired authored controller experiment and complete confirmation receipt
A slow test lift and bounded supported retry add recorded acquisition decisions to the pinned PiPER contact pilot, but completion regresses: at moderate friction baseline completes 2/2 and guarded completes 0/2. Both complete 2/2 normal cases; neither completes the two low-friction cases. All 30 attempts remain numerically valid, including 18 failed controls and full-duration aborts. Four qualification decisions are followed by a brief independent following window, yet two tasks still fail; no successful recovery or overall improvement is demonstrated. Actual motion continues after hold requests, and 53/30,000 computation windows exceed 20 ms. Complete compressed receipts, original model notices and pinned offline inspection preserve the evidence. Authored privileged-state simulation establishes no detector accuracy, learned shoe skill, calibrated contact or physical robot qualification.
A pinned six-axis arm and coupled gripper complete 6/6 frozen synthetic rigid-block placements, while matched recorded-arm/open-jaw and hold controls complete 0/12. Native contact must produce grasp, sustained lift, retained carry, release and settled placement with tool retreat. All 18 attempts and timing traces remain in the receipt; one placement takes 29.51 wall seconds for 20 simulated seconds and misses 251 of 1,000 computation windows, so real-time operation is not established. An offline 3D mesh replay exposes the recorded motion. The authored privileged-state baseline provides a benchmark for a future compact DVIDIA action policy, not a learned footage-to-action model, validated shoe simulation or physical robot qualification.
A separate UR5e/Robotiq reference preserves pinned geometry, inertias, moving-link collision proxies and coupled gripper structure: fourteen modeled coordinates and seven commands. Eighteen deterministic unloaded motion/closure runs are numerically valid; at a 1 ms step, CPU physics throughput measures 40.80–47.29 simulated seconds per measured stepping wall second on one host, excluding loading, sensing, rendering, policy and real actuation. Adjacent timestep comparisons and a matched static overlap expose numerical sensitivity and collision participation. A pure-Python paired trace scorer measures joint, tool and jaw mismatch without automatic qualification. Left/right five-finger references are separately audited; LeRobot collection with an original DVIDIA policy is proposed. Serial calibration, physical response, shoe task learning and bimanual execution remain unmeasured. An offline 3D mesh replay now exposes the recorded arm/gripper poses without rerunning physics. PiPER and SO-101 now have pinned CPU profiles with 6/6 valid unloaded numerical attempts each and explicit native command units. PiPER also has a frozen authored rigid-block contact pilot: nominal placement 2/2, low-friction placement 0/1, open-jaw 0/3 and hold 0/3, with all nine attempts numerically valid. One of 9,000 computation windows exceeds 20 ms; hardware real-time response is unqualified. SO-101 object tasks, learned policies and physical qualification remain open. YAM, OpenArm, ARX X5 and PAROL6 remain upcoming.
Pinned CPU mechanics · PiPER contact pilot · physical fidelity unmeasured
· Local observation workflow and engineering feasibility pilot
DVIDIA Observation Lab supplies local object/palm proposals, reviewed timeline revisions and separate causal image-motion forecasts; real annotation and motion accuracy remain unmeasured. A new CPU pilot learns next-20-ms joint/jaw deltas from current native state and issued commands. Twelve seeded groups retain 36 recordings with 8/2/2 train/development/test grouping; 4,553 test transitions are not independent robot trials. The 6,438-byte action model computes at 0.207 ms p95 on one host and improves RMSE, while jaw MAE/worst error regress against persistence and an initial opening is substantially overpredicted. These are privileged simulator measurements and model-only timings. A proposed shoe capture plan has no footage or executed shoe benchmark. The v0.1 release and hosted synthetic review demo remain separate; no shoe policy, physical adapter, validated shoe physics or hardware qualification is established.
Local review release · motion and actuator source pilots · hardware unqualified
· Architecture proposal and staged validation roadmap
An updated architecture connects immutable Skillspace recordings, reviewed task-label proposals and synchronized measured telemetry to grouped datasets, separate visual and motor learners, and a proposed local state supervisor. The implemented CPU baseline retains authored phases, gripper decisions and recovery around its learned joint-delta head. New annotation and supervisor pilots, fresh frozen confirmation, physics calibration and compatible skill-installation gates define the next milestones. Automatic labeling, learned supervision, human-video action recovery and physical arm qualification remain unestablished; this publication adds no new training or hardware result.
Architecture proposal · current simulation alpha · hardware unqualified
· Product implementation and measured synthetic pilot
The public Dvidia-Inference/dvidia-training repository provides a standalone CPU pipeline that audits Skillspace media, freezes grouped splits and exports inspectable artifacts. Ten synthetic six-second clips train a visual predictor with a 0.5106-second median pipeline time across three repeats on one macOS host. Aligned native simulator telemetry supplies 4,029 training labels for a learned joint-delta head, evaluated on one held-out recording. Its capsule passes native placement qualification in that recording's exact scene; identical joint targets with open jaws fail. Installation and hardware guides accompany the package. Human-video action recovery, shoe organization, demonstration sufficiency, independent scene generalization and physical robot competence remain unestablished.
Public CPU package · one native scene qualified · simulation-only
· Learned movement artifact and installation prototype
A compact learned CPU movement head replaces joint-target computation inside an authored placement supervisor. Teacher and student both pass 7/8 in a new frozen evaluation, while episode wall time increases from 6.273 to 6.360 seconds. A 39,845-byte JSON capsule imports into the local lab, checks its exact runtime and qualifies the current scene through native placement and a recorded-arm/open-jaw control. Scene changes require a fresh test. One known scene and repeat pass native network denial; perception, complete task learning, other embodiments and hardware remain unqualified.
Simulation-only · teacher/student 7/8 · no overall speedup
· Paired simulation benchmark and product assessment
Two controller revisions improve development completion from 14/20 to 17/20, but the frozen paired test declines from 30/32 to 29/32: both pass all 24 normal-strength cases while actuator-stress completion falls from 6/8 to 5/8. Instrumented CPU throughput also declines. We publish the regression, unchanged contact and success rules, exact controller snapshots, richer physical inputs, runtime-bound installation and a proposed staged Skillspace contract. Contact forces and penetration remain uncalibrated; learned perception and physical qualification are open.
Mixed held-out result · 30/32 baseline, 29/32 updated
· Product prototype and native contact qualification
The first link-to-arm product path installs an existing DVIDIA placement envelope, binds a local authored controller to one simulated arm, and reuses it in independently grounded scenes. Native jaw contacts carry a free box; six layouts complete, while no-motion and identical joint commands with open jaws each complete zero of six. Installed execution passes process-level offline checks. Task metadata contains no learned policy; perception, cup geometry, full arm collisions and physical qualification remain open.
Public skill link to authored adapter · 6/6 scene placements
The first runnable product loop combines an anchored cable environment, local controller-parameter search, frozen evaluation, offline replay and a manifest-backed skill pack. The selected controller and a fixed feedback baseline both completed 10/10 held-out simulated episodes; zero-force and release controls completed 0/10. A native macOS network-denial run completed 3/3 additional episodes. Ideal endpoint attachment and privileged state bound the result; physical rope calibration, gripping, sensors and GPU throughput remain untested.
CPU simulation-only · Controller search and frozen evaluation executed
A design for an offline, self-hosted training environment that turns demonstrations into calibrated practice and qualified robot skills. We examine contact, deformation, sensor feedback and the performance–accuracy tradeoff, then report 54 deterministic native MuJoCo CPU fixture trials. Fine endpoint agreement did not establish accurate contact transients, and coarse timesteps missed collisions. Minimum GPU memory, rope accuracy and physical transfer remain unmeasured.
54 CPU fixture trials · GPU and physical transfer untested
Three Grok 4.7 research passes surface observation-to-action, synthetic-practice and reusable-repair ideas. Independent primary-source checks compare those findings with our thesis: observation supplies goals and state, language retrieves a skill, spatial expectations guide attention, and executable feedback with evaluation establishes competence. X posts remain discovery leads. No universal demonstration count or arbitrary-robot transfer follows from the reviewed results.
A synthesis of learning from human demonstrations, language-conditioned spatial attention, simulation expansion and robot-specific skill delivery. Spatial priors can accelerate inspection but do not determine contact state or control. The proposed downloadable skill packages a controller, initiation and termination conditions, compatible sensing and hardware, recovery behavior and measured evidence. Separate experiments would test attention, data coverage, feedback and transfer.
A preregistered image-API feasibility run processed five licensed three-second POV excerpts using four timestamped frames, a Gemma caption and a Clef-flash check. All five completed at a price-derived inference estimate of $0.00140634. Post-run inspection found an object error accepted by the checker and omitted state changes. API and schema compatibility were demonstrated; annotation accuracy and whole-task success were not.
Five licensed excerpts · Accuracy evaluation outstanding
An Argus review and a proposal to connect original recordings, reviewed episodes, immutable datasets, training runs, held-out evaluation and robot-tested releases. The review separates video annotation from action supervision and defines compatibility beyond a robot’s degree-of-freedom count. A proposed 40-episode annotation pilot and evidence-based graduation criteria remain unrun.
A research agenda covering visible capture evidence, relations over time, evaluation provenance and physical grounding. Each question has a bounded protocol and a failure condition. The aim is to measure whether structure and physical signals improve a defined task before scaling collection. Strategic opinions, author-reported results and our untested proposals are kept distinct.
Four baseline protocols proposed
No publications match this search.
Research footprints
Learn a first PiPER placement primitive from demonstrations
A compact feedforward model trained on 32 synthetic teacher demonstrations completes 5/12 frozen placement attempts from unseen starts. The teacher completes 12/12; three controls complete none. All twelve learned final poses settle near their targets, but seven fail full contact-history gates. The recorded viewer, complete evidence and installable local runner preserve the reliability gap. Learned feedback, human-video learning and physical transfer remain open.
All 64 frozen requests returned valid responses. No false completion was observed, but images plus telemetry recognized only 1/8 completed states, and images alone recognized 0/8. Occluded finished scenes failed in both conditions. Median hosted latency was 1.776 seconds. The original protocol remains unchanged; all measured cases and independent review are public.
Thirty-two native PiPER fixtures include four moving/settled pairs with identical images and different physical completion labels. The frozen 64-request Jev protocol compares RGB with privileged simulator telemetry. Jev has not been run; all provider trials remain explicitly unrun, with accuracy and service latency unmeasured. Native states, images, source hashes and physical labels are public.
Connect visual goals to measured physical feedback
Fourteen passive rigid-box arm replays reproduce every original sampled state and outcome, recording 249,502 native ticks. Millisecond contact gaps appear between stored observations; a successful comparator also has gaps. The separate architecture note evaluates Jev as a candidate decision layer and defines a goal-image reaching test. No visual model is integrated and no controller is promoted.
Separate object difficulty from the gripper and attached tool
A frozen direct-grasp diagnostic retains 24 valid attempts. Lightweight controls complete 8/12 lifts; every 300 g condition fails, including the small block. Removing the rake gains one narrow-shoe result and loses one block result. Relative lift, settled references and dense contact traces make the modeled drive and geometry limits visible. These are diagnostic controls, not a shoe retrieval rate or hardware qualification.
Measure contact-loss response without claiming a better grasp
Twenty valid fresh attempts complete the same 2/10 cases under both controllers. Nine trace-verified bilateral-contact-loss alarms arrive in 20–52 ms; twelve supported lowering responses produce no additional completion. Full trajectories and an independent audit expose failed acquisition and an unmonitored support-contamination gap. Hardware transfer remains open.
Make skill prerequisites and failed recovery measurable
Two native environments retain sixteen valid held-out attempts. A lid guard avoids two baseline contacts while completion remains 2/4. A mounted rake reaches three of four intermediate retrieval checkpoints, but no subsequent retained lift succeeds. Recorded replays expose every failure; fresh physics runs locally. Tool acquisition, learned control and hardware transfer remain open.
Drag a target and nudge a free rigid trainer with live browser MuJoCo physics. The final native run keeps 20 valid attempts: 14/16 targets pass, both high-target repeats fail, and four mechanics checks pass. A ten-minute browser run reports 51.39 render calls per second on the tested host. Strict raw-contact parity fails in 13/1,500 sampled states despite numerical agreement; all fifteen development shoe-lift attempts fail. Learned shoe skills, calibrated contact and hardware transfer remain open.
Six original rigid shoe proxies now compose with UR5e/Robotiq, PiPER and SO-101. Versioned scene files, offline 3D previews and a frozen 54-attempt benchmark retain every trajectory: supported pairs 27/27, disabled-table support 0/27, all gravity checks pass. Native loading and passive contact are tested; shoe grasping, deformation and physical transfer remain unqualified.
Complete more placements with a bounded second lift and revised grasp
Three fresh cohorts retain 252 valid attempts. The revised grasp completes 23/36 placements versus 15/36 for v0.4 and 18/36 with second lift alone; all 144 controls fail. Eight completions are gained and none lost, while shared successes average 0.772 simulated seconds slower. Twelve low-friction acquisitions and one retention failure remain. All 1,035 computation overruns are retained; physical qualification is open.
Separate faster recovery from an ineffective retry
A fresh 84-attempt comparison completes 4/12 placements in every mode; all 48 controls fail. Two resumed tasks finish 2.440–2.640 simulated seconds sooner after unchanged settling holds, while four failed grips are refused 2.88–2.90 seconds sooner. Eight failures remain, including two held blocks below the resume-height gate. Every native trajectory and raw computation duration is retained; physical qualification is open.
A frozen 84-attempt paired cohort completes 6/12 history placements versus 4/12 original and probe-only placements; all 48 controls fail. Four tasks complete after five closed holds/resumes, but all six supported acquisition retries fail. Only four of five resume windows meet the independent low absolute tool-speed check. Actual motion and 75 missed computation windows remain visible; physical robot qualification is open.
A slow probe and one supported retry retain 30 valid attempts. At moderate friction baseline completes 2/2 while guarded completes 0/2; normal cases both pass and low-friction cases both fail. No successful recovery or overall improvement is demonstrated. Four brief following windows do not establish detector accuracy; 53 computation windows miss 20 ms. Every full attempt remains public.
A frozen authored rigid-block pilot retains nine valid attempts: nominal placement 2/2, low-friction placement 0/1, open-jaw 0/3 and hold 0/3. One of 9,000 computation windows exceeds 20 ms. Complete task receipts remain distinct from unloaded profiles; learned skills, shoe physics and physical qualification are open.
PiPER and SO-101 join the library with pinned models, explicit arm/gripper units, preserved licenses and complete numerical receipts. Each completes six unloaded motion checks offline. Their learned-policy and physical qualification remain open. The PiPER contact pilot and UR5e grasp demonstration have separate task receipts.
A free rigid block must be grasped, lifted, carried, released and left settled at its destination. Frozen scenarios compare the authored controller with identical arm commands and open jaws, and with a hold control. Full traces and 3D replay preserve the evidence for the next compact action-learning experiment. Shoe physics, a learned task policy and hardware transfer remain open.
A pinned six-axis arm and coupled gripper expose fourteen coordinates and seven commands. All 18 unloaded numerical runs are valid; 1 ms CPU physics measures 40.80–47.29× elapsed-time throughput with sensing, rendering and policy excluded. A paired trace scorer makes physical mismatch measurable. Five-finger references and LeRobot collection have separate contracts; hardware fidelity and shoe competence remain unmeasured.
A 6,438-byte CPU model predicts the next 20 ms of joint/jaw movement from native state and issued commands. Twelve seeded groups retain 36 recordings; 4,553 test transitions are not independent trials. Warm computation measures 0.207 ms p95, but jaw mean absolute/worst errors regress against persistence and the first opening is overpredicted. Shoe collection, hardware sensing and validated shoe physics remain open.
A manually seeded CPU source alpha records pixel speed and causal forecasts. Six authored cases process 720 frames in 1.454 seconds; occlusion and low-texture losses remain visible, and a 500 ms reversal forecast misses by nearly 90 pixels. The v0.1 release/demo remain separate; real-scene accuracy, metric speed and live robot control are unqualified.
A diagram connects footage review, measured robot state, local training, frozen simulation evaluation and compatible skill installation. Automatic annotation and a learned task supervisor are proposed; their companion validation studies and physical robot qualification remain unrun.
One-click local installation binds a DVIDIA placement envelope to an authored contact controller. Six scene layouts pass; identical joint commands with open jaws and no-motion controls each pass 0/6. Physical transfer and learned policies remain open.
A local controller-training loop and simulation-only skill pack now run on CPU. Trained and baseline feedback each pass 10/10 simulated seeds; zero force and early release each pass 0/10. Real gripping, calibration and GPU qualification remain open.
54 deterministic CPU fixture trials recorded. Endpoint agreement coexists with unqualified force transients; coarse wall tests expose missed contact. No GPU or physical-transfer claim.
Compare the observation-to-skill thesis with prior work
Spatial attention, demonstration coverage, executable simulation and reusable repairs are reviewed separately. Three parallel Grok 4.7 searches support discovery; primary sources support the claims.
Four baseline protocols and a Skillspace graduation proposal establish the questions to test. A proposed protocol is distinct from an executed experiment.