diff --git a/docs/downloads/reports/Skillspace footage training pipeline.md b/docs/downloads/reports/Skillspace footage training pipeline.md index c65ec36..4bd972c 100644 --- a/docs/downloads/reports/Skillspace footage training pipeline.md +++ b/docs/downloads/reports/Skillspace footage training pipeline.md @@ -2,6 +2,16 @@ The public, standalone [DVIDIA training repository](https://github.com/Dvidia-Inference/dvidia-training) provides a local CPU pipeline that turns actual Skillspace media into a fitted visual model and, when aligned numeric actions are supplied, a learned movement head. The useful advance is a reproducible path from source files through provenance checks, grouped splits, measured fitting and portable artifacts. **Video prediction and robot movement remain separate claims.** Ten synthetic six-second clips demonstrate visual fitting; simulator telemetry supplies the movement pilot's action labels. Its exported capsule installs and passes native qualification in one exact scene, while identical joint targets with open jaws fail. Neither experiment learns shoe organization or reconstructs robot actions from human footage. This report documents the implemented path and its limited measured evidence, rather than establishing a sufficient demonstration count or hardware competence. ([Standalone source archive](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-08-footage-pipeline-v1/release/dvidia-training-v0.1.zip), [Qualification receipt](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-08-footage-pipeline-v1/qualification/qualification.json)) +## Published artifacts on Hugging Face + +The [DVIDIA organization on Hugging Face](https://huggingface.co/Dvidia) mirrors the measured pilot for inspection and local reproduction: + +- [Example dataset](https://huggingface.co/datasets/Dvidia/dvidia-training-examples): explicitly synthetic moving-disc footage and native simulator recordings, with frozen prepared inputs and grouped train/development/test splits. No human footage is included. +- [Pilot model artifacts](https://huggingface.co/Dvidia/dvidia-training-pilot): visual weights, the learned joint-delta candidate, evaluation reports and native qualification/control evidence. The movement candidate learns from aligned numerical simulator labels and remains bound to its declared adapter. +- [Training evidence Space](https://huggingface.co/spaces/Dvidia/dvidia-training): a static overview of the measurements and the saved contact/lift/place replay from one exact held-out scene. + +Training runs on the user's own computer or server through the [local installation guide](https://github.com/Dvidia-Inference/dvidia-training/blob/main/docs/installation.md). The Space presents fixed evidence; it provides no hosted training or uploads. These published artifacts remain research-alpha, simulation-only evidence, with no qualified hardware skill or established human-video action bridge. + ## Actual media and connected source groups gate training Start with the repository's [installation guide](https://github.com/Dvidia-Inference/dvidia-training/blob/main/docs/installation.md) and [hardware guide](https://github.com/Dvidia-Inference/dvidia-training/blob/main/docs/hardware.md). The pipeline accepts a local folder, ZIP or prepared dataset; explicitly enabled online mode also accepts a supported public DVIDIA manifest and its declared media. Visual training requires Python 3.12+, NumPy and FFmpeg/ffprobe; arm simulation adds MuJoCo. A Skillspace description with no accessible video does not become a dataset. Images alone are rejected. An audit-only preparation step checks media, copies the exact bytes, records hashes and freezes train, development and test assignments before fitting. Fresh output directories prevent silent replacement of earlier runs. The command-line interface and a loopback training studio expose this same path. ([Implementation](https://github.com/Dvidia-Inference/dvidia-training)) diff --git a/docs/index.html b/docs/index.html index a4eb3dc..93489cc 100644 --- a/docs/index.html +++ b/docs/index.html @@ -1,4 +1,4 @@ Research journal · DVIDIA Research -

An open research notebook

From observation
to physical skill.

We study how demonstrations become usable evidence, how simulation becomes useful practice, and when a robot skill earns a release.

Published by DVIDIA · hello@dvidia.org

Publications

11 papers and working notes

· Product implementation and measured synthetic pilot

Skillspace footage training pipeline

The public Dvidia-Inference/dvidia-training repository provides a standalone CPU pipeline that audits Skillspace media, freezes grouped splits and exports inspectable artifacts. Ten synthetic six-second clips train a visual predictor with a 0.5106-second median pipeline time across three repeats on one macOS host. Aligned native simulator telemetry supplies 4,029 training labels for a learned joint-delta head, evaluated on one held-out recording. Its capsule passes native placement qualification in that recording's exact scene; identical joint targets with open jaws fail. Installation and hardware guides accompany the package. Human-video action recovery, shoe organization, demonstration sufficiency, independent scene generalization and physical robot competence remain unestablished.

Public CPU package · one native scene qualified · simulation-only

· Learned movement artifact and installation prototype

Skill capsule acquisition and optimization

A compact learned CPU movement head replaces joint-target computation inside an authored placement supervisor. Teacher and student both pass 7/8 in a new frozen evaluation, while episode wall time increases from 6.273 to 6.360 seconds. A 39,845-byte JSON capsule imports into the local lab, checks its exact runtime and qualifies the current scene through native placement and a recorded-arm/open-jaw control. Scene changes require a fresh test. One known scene and repeat pass native network denial; perception, complete task learning, other embodiments and hardware remain unqualified.

Simulation-only · teacher/student 7/8 · no overall speedup

· Paired simulation benchmark and product assessment

Skillspace arm benchmarks and evolution

Two controller revisions improve development completion from 14/20 to 17/20, but the frozen paired test declines from 30/32 to 29/32: both pass all 24 normal-strength cases while actuator-stress completion falls from 6/8 to 5/8. Instrumented CPU throughput also declines. We publish the regression, unchanged contact and success rules, exact controller snapshots, richer physical inputs, runtime-bound installation and a proposed staged Skillspace contract. Contact forces and penetration remain uncalibrated; learned perception and physical qualification are open.

Mixed held-out result · 30/32 baseline, 29/32 updated

· Product prototype and native contact qualification

Installing a Skillspace on a simulated arm

The first link-to-arm product path installs an existing DVIDIA placement envelope, binds a local authored controller to one simulated arm, and reuses it in independently grounded scenes. Native jaw contacts carry a free box; six layouts complete, while no-motion and identical joint commands with open jaws each complete zero of six. Installed execution passes process-level offline checks. Task metadata contains no learned policy; perception, cup geometry, full arm collisions and physical qualification remain open.

Public skill link to authored adapter · 6/6 scene placements

· Product prototype and local qualification

Offline cable training environment

The first runnable product loop combines an anchored cable environment, local controller-parameter search, frozen evaluation, offline replay and a manifest-backed skill pack. The selected controller and a fixed feedback baseline both completed 10/10 held-out simulated episodes; zero-force and release controls completed 0/10. A native macOS network-denial run completed 3/3 additional episodes. Ideal endpoint attachment and privileged state bound the result; physical rope calibration, gripping, sensors and GPU throughput remain untested.

CPU simulation-only · Controller search and frozen evaluation executed

· Decision report and local experiment

Fast accurate robot training simulation

A design for an offline, self-hosted training environment that turns demonstrations into calibrated practice and qualified robot skills. We examine contact, deformation, sensor feedback and the performance–accuracy tradeoff, then report 54 deterministic native MuJoCo CPU fixture trials. Fine endpoint agreement did not establish accurate contact transients, and coarse timesteps missed collisions. Minimum GPU memory, rope accuracy and physical transfer remain unmeasured.

54 CPU fixture trials · GPU and physical transfer untested

· Source review and thesis comparison

Grok robotics research on X

Three Grok 4.7 research passes surface observation-to-action, synthetic-practice and reusable-repair ideas. Independent primary-source checks compare those findings with our thesis: observation supplies goals and state, language retrieves a skill, spatial expectations guide attention, and executable feedback with evaluation establishes competence. X posts remain discovery leads. No universal demonstration count or arbitrary-robot transfer follows from the reviewed results.

Primary sources checked · Experiments proposed

· Research synthesis and proposed experiments

Spatially grounded downloadable robot skills

A synthesis of learning from human demonstrations, language-conditioned spatial attention, simulation expansion and robot-specific skill delivery. Spatial priors can accelerate inspection but do not determine contact state or control. The proposed downloadable skill packages a controller, initiation and termination conditions, compatible sensing and hardware, recovery behavior and measured evidence. Separate experiments would test attention, data coverage, feedback and transfer.

Source review · DVIDIA experiments not run

· Engineering feasibility pilot

Clef and grounded video observations

A preregistered image-API feasibility run processed five licensed three-second POV excerpts using four timestamped frames, a Gemma caption and a Clef-flash check. All five completed at a price-derived inference estimate of $0.00140634. Post-run inspection found an object error accepted by the checker and omitted state changes. API and schema compatibility were demonstrated; annotation accuracy and whole-task success were not.

Five licensed excerpts · Accuracy evaluation outstanding

· Source review and implementation proposal

From Skillspace to robot skill

An Argus review and a proposal to connect original recordings, reviewed episodes, immutable datasets, training runs, held-out evaluation and robot-tested releases. The review separates video annotation from action supervision and defines compatibility beyond a robot’s degree-of-freedom count. A proposed 40-episode annotation pilot and evidence-based graduation criteria remain unrun.

Graduation and robot training not run

· Research agenda

Turn physical footage into testable evidence

A research agenda covering visible capture evidence, relations over time, evaluation provenance and physical grounding. Each question has a bounded protocol and a failure condition. The aim is to measure whether structure and physical signals improve a defined task before scaling collection. Strategic opinions, author-reported results and our untested proposals are kept distinct.

Four baseline protocols proposed

Research footprints

  1. A public skill link reaches a simulated arm

    One-click local installation binds a DVIDIA placement envelope to an authored contact controller. Six scene layouts pass; identical joint commands with open jaws and no-motion controls each pass 0/6. Physical transfer and learned policies remain open.

    Read the installation contract and arm replay
  2. The offline cable environment is runnable

    A local controller-training loop and simulation-only skill pack now run on CPU. Trained and baseline feedback each pass 10/10 simulated seeds; zero force and early release each pass 0/10. Real gripping, calibration and GPU qualification remain open.

    Read the first product build and replay
  3. Contact accuracy meets runtime

    54 deterministic CPU fixture trials recorded. Endpoint agreement coexists with unqualified force transients; coarse wall tests expose missed contact. No GPU or physical-transfer claim.

    Read the measurements
  4. Compare the observation-to-skill thesis with prior work

    Spatial attention, demonstration coverage, executable simulation and reusable repairs are reviewed separately. Three parallel Grok 4.7 searches support discovery; primary sources support the claims.

    Read the comparison
  5. Five licensed POV excerpts processed

    Ten image calls completed. A checker accepted an object error and captions omitted visible state changes. The separate accuracy pilot remains unrun.

    Read the feasibility run
  6. Define the evidence and release questions

    Four baseline protocols and a Skillspace graduation proposal establish the questions to test. A proposed protocol is distinct from an executed experiment.

    Read the agenda

Open questions

Follow new publications through RSS or inspect the source and revisions on GitHub.

+

An open research notebook

From observation
to physical skill.

We study how demonstrations become usable evidence, how simulation becomes useful practice, and when a robot skill earns a release.

Published by DVIDIA · hello@dvidia.org

Publications

11 papers and working notes

· Product implementation and measured synthetic pilot

Skillspace footage training pipeline

The public Dvidia-Inference/dvidia-training repository provides a standalone CPU pipeline that audits Skillspace media, freezes grouped splits and exports inspectable artifacts. Ten synthetic six-second clips train a visual predictor with a 0.5106-second median pipeline time across three repeats on one macOS host. Aligned native simulator telemetry supplies 4,029 training labels for a learned joint-delta head, evaluated on one held-out recording. Its capsule passes native placement qualification in that recording's exact scene; identical joint targets with open jaws fail. Installation and hardware guides accompany the package. Human-video action recovery, shoe organization, demonstration sufficiency, independent scene generalization and physical robot competence remain unestablished.

Public CPU package · one native scene qualified · simulation-only

· Learned movement artifact and installation prototype

Skill capsule acquisition and optimization

A compact learned CPU movement head replaces joint-target computation inside an authored placement supervisor. Teacher and student both pass 7/8 in a new frozen evaluation, while episode wall time increases from 6.273 to 6.360 seconds. A 39,845-byte JSON capsule imports into the local lab, checks its exact runtime and qualifies the current scene through native placement and a recorded-arm/open-jaw control. Scene changes require a fresh test. One known scene and repeat pass native network denial; perception, complete task learning, other embodiments and hardware remain unqualified.

Simulation-only · teacher/student 7/8 · no overall speedup

· Paired simulation benchmark and product assessment

Skillspace arm benchmarks and evolution

Two controller revisions improve development completion from 14/20 to 17/20, but the frozen paired test declines from 30/32 to 29/32: both pass all 24 normal-strength cases while actuator-stress completion falls from 6/8 to 5/8. Instrumented CPU throughput also declines. We publish the regression, unchanged contact and success rules, exact controller snapshots, richer physical inputs, runtime-bound installation and a proposed staged Skillspace contract. Contact forces and penetration remain uncalibrated; learned perception and physical qualification are open.

Mixed held-out result · 30/32 baseline, 29/32 updated

· Product prototype and native contact qualification

Installing a Skillspace on a simulated arm

The first link-to-arm product path installs an existing DVIDIA placement envelope, binds a local authored controller to one simulated arm, and reuses it in independently grounded scenes. Native jaw contacts carry a free box; six layouts complete, while no-motion and identical joint commands with open jaws each complete zero of six. Installed execution passes process-level offline checks. Task metadata contains no learned policy; perception, cup geometry, full arm collisions and physical qualification remain open.

Public skill link to authored adapter · 6/6 scene placements

· Product prototype and local qualification

Offline cable training environment

The first runnable product loop combines an anchored cable environment, local controller-parameter search, frozen evaluation, offline replay and a manifest-backed skill pack. The selected controller and a fixed feedback baseline both completed 10/10 held-out simulated episodes; zero-force and release controls completed 0/10. A native macOS network-denial run completed 3/3 additional episodes. Ideal endpoint attachment and privileged state bound the result; physical rope calibration, gripping, sensors and GPU throughput remain untested.

CPU simulation-only · Controller search and frozen evaluation executed

· Decision report and local experiment

Fast accurate robot training simulation

A design for an offline, self-hosted training environment that turns demonstrations into calibrated practice and qualified robot skills. We examine contact, deformation, sensor feedback and the performance–accuracy tradeoff, then report 54 deterministic native MuJoCo CPU fixture trials. Fine endpoint agreement did not establish accurate contact transients, and coarse timesteps missed collisions. Minimum GPU memory, rope accuracy and physical transfer remain unmeasured.

54 CPU fixture trials · GPU and physical transfer untested

· Source review and thesis comparison

Grok robotics research on X

Three Grok 4.7 research passes surface observation-to-action, synthetic-practice and reusable-repair ideas. Independent primary-source checks compare those findings with our thesis: observation supplies goals and state, language retrieves a skill, spatial expectations guide attention, and executable feedback with evaluation establishes competence. X posts remain discovery leads. No universal demonstration count or arbitrary-robot transfer follows from the reviewed results.

Primary sources checked · Experiments proposed

· Research synthesis and proposed experiments

Spatially grounded downloadable robot skills

A synthesis of learning from human demonstrations, language-conditioned spatial attention, simulation expansion and robot-specific skill delivery. Spatial priors can accelerate inspection but do not determine contact state or control. The proposed downloadable skill packages a controller, initiation and termination conditions, compatible sensing and hardware, recovery behavior and measured evidence. Separate experiments would test attention, data coverage, feedback and transfer.

Source review · DVIDIA experiments not run

· Engineering feasibility pilot

Clef and grounded video observations

A preregistered image-API feasibility run processed five licensed three-second POV excerpts using four timestamped frames, a Gemma caption and a Clef-flash check. All five completed at a price-derived inference estimate of $0.00140634. Post-run inspection found an object error accepted by the checker and omitted state changes. API and schema compatibility were demonstrated; annotation accuracy and whole-task success were not.

Five licensed excerpts · Accuracy evaluation outstanding

· Source review and implementation proposal

From Skillspace to robot skill

An Argus review and a proposal to connect original recordings, reviewed episodes, immutable datasets, training runs, held-out evaluation and robot-tested releases. The review separates video annotation from action supervision and defines compatibility beyond a robot’s degree-of-freedom count. A proposed 40-episode annotation pilot and evidence-based graduation criteria remain unrun.

Graduation and robot training not run

· Research agenda

Turn physical footage into testable evidence

A research agenda covering visible capture evidence, relations over time, evaluation provenance and physical grounding. Each question has a bounded protocol and a failure condition. The aim is to measure whether structure and physical signals improve a defined task before scaling collection. Strategic opinions, author-reported results and our untested proposals are kept distinct.

Four baseline protocols proposed

Research footprints

  1. A public skill link reaches a simulated arm

    One-click local installation binds a DVIDIA placement envelope to an authored contact controller. Six scene layouts pass; identical joint commands with open jaws and no-motion controls each pass 0/6. Physical transfer and learned policies remain open.

    Read the installation contract and arm replay
  2. The offline cable environment is runnable

    A local controller-training loop and simulation-only skill pack now run on CPU. Trained and baseline feedback each pass 10/10 simulated seeds; zero force and early release each pass 0/10. Real gripping, calibration and GPU qualification remain open.

    Read the first product build and replay
  3. Contact accuracy meets runtime

    54 deterministic CPU fixture trials recorded. Endpoint agreement coexists with unqualified force transients; coarse wall tests expose missed contact. No GPU or physical-transfer claim.

    Read the measurements
  4. Compare the observation-to-skill thesis with prior work

    Spatial attention, demonstration coverage, executable simulation and reusable repairs are reviewed separately. Three parallel Grok 4.7 searches support discovery; primary sources support the claims.

    Read the comparison
  5. Five licensed POV excerpts processed

    Ten image calls completed. A checker accepted an object error and captions omitted visible state changes. The separate accuracy pilot remains unrun.

    Read the feasibility run
  6. Define the evidence and release questions

    Four baseline protocols and a Skillspace graduation proposal establish the questions to test. A proposed protocol is distinct from an executed experiment.

    Read the agenda

Open questions

Follow new publications through RSS or inspect the source and revisions on GitHub.

diff --git a/docs/papers/clef-and-grounded-video-observations/index.html b/docs/papers/clef-and-grounded-video-observations/index.html index 116fc51..2c6198b 100644 --- a/docs/papers/clef-and-grounded-video-observations/index.html +++ b/docs/papers/clef-and-grounded-video-observations/index.html @@ -1,7 +1,7 @@ Clef and grounded video observations · DVIDIA Research -

Engineering feasibility pilot

Clef and grounded video observations

· DVIDIA

Five licensed excerpts · Accuracy evaluation outstanding

Source & history · Download Markdown

Abstract

A preregistered image-API feasibility run processed five licensed three-second POV excerpts using four timestamped frames, a Gemma caption and a Clef-flash check. All five completed at a price-derived inference estimate of $0.00140634. Post-run inspection found an object error accepted by the checker and omitted state changes. API and schema compatibility were demonstrated; annotation accuracy and whole-task success were not.

In this paper

Engineering pilot executed · 6 October 2026 · Accuracy evaluation outstanding

+

Engineering feasibility pilot

Clef and grounded video observations

· DVIDIA

Five licensed excerpts · Accuracy evaluation outstanding

Source & history · Download Markdown

Abstract

A preregistered image-API feasibility run processed five licensed three-second POV excerpts using four timestamped frames, a Gemma caption and a Clef-flash check. All five completed at a price-derived inference estimate of $0.00140634. Post-run inspection found an object error accepted by the checker and omitted state changes. API and schema compatibility were demonstrated; annotation accuracy and whole-task success were not.

In this paper

Engineering pilot executed · 6 October 2026 · Accuracy evaluation outstanding

We executed a small, preregistered feasibility run: five existing public, licensed three-second POV excerpts, four original-timestamped frames per excerpt, one Gemma caption call and one Clef-flash check per excerpt. All five completed. The estimated inference cost was $0.00140634. This establishes that the image APIs and bounded data contract work; it does not establish that the annotations are accurate.

The useful finding was a failure: a caption called a pink plate a cutting board, and the second model agreed. Several descriptions listed objects or hand positions while missing visible folding or transfer. Model agreement must not become a “verified” badge. The observations below come from AI-assisted inspection of the exact input frames after outputs were frozen, not independent human annotations.

Preregistration · Complete sanitized results and source/frame hashes · Prompts and request recipes · Next evaluation protocol

@@ -37,4 +37,4 @@

Product integration and next rese

From a command to a learned physical skill

“Put both bottles in the cart” needs an observable goal, objects and starting conditions. A useful annotation might describe reaching, grasping, lifting, transporting and releasing, each with evidence and uncertainty. These are the proposed representation, not observations from our five clips or the user's screenshot.

That symbolic sequence is not muscle memory. The latter analogy fits a learned control policy only after it maps observations to actions on a specified robot, with measured feedback and evaluation. DOF counts alone do not define compatibility. Keep the chain explicit: observations → accepted task episodes → versioned dataset → robot-specific training → held-out physical evaluation. A Skillspace can organize that history, but more videos do not automatically advance its readiness. See the graduation and compatibility proposal.

-
+
diff --git a/docs/papers/fast-accurate-robot-training-simulation/index.html b/docs/papers/fast-accurate-robot-training-simulation/index.html index 8ff30cc..d4c1045 100644 --- a/docs/papers/fast-accurate-robot-training-simulation/index.html +++ b/docs/papers/fast-accurate-robot-training-simulation/index.html @@ -1,7 +1,7 @@ Fast accurate robot training simulation · DVIDIA Research -

Decision report and local experiment

Fast accurate robot training simulation

· DVIDIA

54 CPU fixture trials · GPU and physical transfer untested

Source & history · Download Markdown

Abstract

A design for an offline, self-hosted training environment that turns demonstrations into calibrated practice and qualified robot skills. We examine contact, deformation, sensor feedback and the performance–accuracy tradeoff, then report 54 deterministic native MuJoCo CPU fixture trials. Fine endpoint agreement did not establish accurate contact transients, and coarse timesteps missed collisions. Minimum GPU memory, rope accuracy and physical transfer remain unmeasured.

In this paper

Decision report · 7 October 2026 · Grok 4.7 research plus primary-source verification · 54 local CPU fixture trials; no GPU training or physical robot tests

+

Decision report and local experiment

Fast accurate robot training simulation

· DVIDIA

54 CPU fixture trials · GPU and physical transfer untested

Source & history · Download Markdown

Abstract

A design for an offline, self-hosted training environment that turns demonstrations into calibrated practice and qualified robot skills. We examine contact, deformation, sensor feedback and the performance–accuracy tradeoff, then report 54 deterministic native MuJoCo CPU fixture trials. Fine endpoint agreement did not establish accurate contact transients, and coarse timesteps missed collisions. Minimum GPU memory, rope accuracy and physical transfer remain unmeasured.

In this paper

Decision report · 7 October 2026 · Grok 4.7 research plus primary-source verification · 54 local CPU fixture trials; no GPU training or physical robot tests

Build an offline, self-hosted environment that converts demonstrations into calibrated practice and qualified robot skills. Start with existing physics engines and concentrate the product on task construction, uncertainty, failure/recovery coverage, efficient scheduling and qualification. Use native MuJoCo for local numerical checks, test MuJoCo Warp for batched rigid contact, and qualify Newton rods or another deformable backend against the actual rope task before selecting it. The microscopic intuition explains why objects resist and deform; the useful simulation interface is the resulting force, motion, friction and sensor response at robot scale. The first product vertical should be bounded rope grasping, pulling, threading and regrasping, with bow tying a later capability. One owned GPU is the starting design target; minimum useful VRAM and an “ultrafast” training rate remain unmeasured. Adding GPUs or servers should scale independent practice worlds, while a released skill retains a declared hardware profile and physical evidence.

Reproduce the response that changes the robot's decision

When a fingertip presses a table, resistance ultimately comes from electromagnetic interactions and quantum constraints on matter. “Electrons reject each other” is a useful intuition but incomplete: atoms also attract and bond, and Pauli exclusion restricts allowed electron states rather than adding a separate classical repulsive force. Molecular structure and collective interactions produce elasticity. We do not need to track electrons to calculate whether a gripper holds a lace; we need the effective mechanical behavior at the force, length and time scales the task uses. (Feynman on forces and elasticity, exclusion and matter)

@@ -42,4 +42,4 @@

Qualifica

The defensible product advantage is fewer resources to a reliably qualified capability, with difficult cases visible. Existing stacks already offer batching, deformables and training infrastructure. Our contribution must be demonstrated in the calibrated observation-to-practice-to-release loop: which missing decisions to train, where fast approximations remain useful, and when evidence justifies a skill claim.

Research provenance

Three completed native Grok 4.7 consultations ran through Pi and its existing xAI login with hosted X/web search: 23 X calls, 95 fetched post items and 45 web calls. Items can repeat and are not independently verified posts. Checked primary papers/documentation supply the claims above; results are author-reported unless this report labels them as our local measurements. The adapter preserved completed native responses and blocked Pi's redundant normalization request. Research used online search; the proposed product requires offline operation. No cloud GPU spend or robot deployment occurred. (Public method summary)

-
+
diff --git a/docs/papers/from-skillspace-to-robot-skill/index.html b/docs/papers/from-skillspace-to-robot-skill/index.html index d2dd4a8..41d999e 100644 --- a/docs/papers/from-skillspace-to-robot-skill/index.html +++ b/docs/papers/from-skillspace-to-robot-skill/index.html @@ -1,7 +1,7 @@ From Skillspace to robot skill · DVIDIA Research -

Source review and implementation proposal

From Skillspace to robot skill

· DVIDIA

Graduation and robot training not run

Source & history · Download Markdown

Abstract

An Argus review and a proposal to connect original recordings, reviewed episodes, immutable datasets, training runs, held-out evaluation and robot-tested releases. The review separates video annotation from action supervision and defines compatibility beyond a robot’s degree-of-freedom count. A proposed 40-episode annotation pilot and evidence-based graduation criteria remain unrun.

In this paper

Source review and proposal · 6 October 2026 · Graduation experiment not run

+

Source review and implementation proposal

From Skillspace to robot skill

· DVIDIA

Graduation and robot training not run

Source & history · Download Markdown

Abstract

An Argus review and a proposal to connect original recordings, reviewed episodes, immutable datasets, training runs, held-out evaluation and robot-tested releases. The review separates video annotation from action supervision and defines compatibility beyond a robot’s degree-of-freedom count. A proposed 40-episode annotation pilot and evidence-based graduation criteria remain unrun.

In this paper

Source review and proposal · 6 October 2026 · Graduation experiment not run

Follow-up: the Clef image feasibility pilot has now run on five public excerpts. It does not complete the 40-episode accuracy protocol below.

A Skillspace can become the home for a skill's learning history. More uploaded videos do not, by themselves, establish a better policy. We need evidence that new demonstrations add useful coverage, survive quality checks, and improve held-out performance on a specified robot.

This review follows Varun Nair's pipeline post, its linked Argus article, selected upstream source files, and an audit of the DVIDIA website. The design below is our proposal, not an implemented training service. No user footage was sent to any model, no training was run, and no robot was operated for this review.

@@ -84,4 +84,4 @@

Sources

  • [moveit2026model] MoveIt, URDF and SRDF, living documentation accessed 6 October 2026.
  • Bibliographic entries: evaluation and provenance bibliography. This report's open documentation license does not license user videos or downstream training data.

    -
    +
    diff --git a/docs/papers/grok-robotics-research-on-x/index.html b/docs/papers/grok-robotics-research-on-x/index.html index b4e76ef..6f3fc5a 100644 --- a/docs/papers/grok-robotics-research-on-x/index.html +++ b/docs/papers/grok-robotics-research-on-x/index.html @@ -1,7 +1,7 @@ Grok robotics research on X · DVIDIA Research -

    Source review and thesis comparison

    Grok robotics research on X

    · DVIDIA

    Primary sources checked · Experiments proposed

    Source & history · Download Markdown

    Abstract

    Three Grok 4.7 research passes surface observation-to-action, synthetic-practice and reusable-repair ideas. Independent primary-source checks compare those findings with our thesis: observation supplies goals and state, language retrieves a skill, spatial expectations guide attention, and executable feedback with evaluation establishes competence. X posts remain discovery leads. No universal demonstration count or arbitrary-robot transfer follows from the reviewed results.

    In this paper

    Research snapshot: 7 October 2026 · Grok 4.7 used through Pi CLI · No training, simulation or hardware experiment was run

    +

    Source review and thesis comparison

    Grok robotics research on X

    · DVIDIA

    Primary sources checked · Experiments proposed

    Source & history · Download Markdown

    Abstract

    Three Grok 4.7 research passes surface observation-to-action, synthetic-practice and reusable-repair ideas. Independent primary-source checks compare those findings with our thesis: observation supplies goals and state, language retrieves a skill, spatial expectations guide attention, and executable feedback with evaluation establishes competence. X posts remain discovery leads. No universal demonstration count or arbitrary-robot transfer follows from the reviewed results.

    In this paper

    Research snapshot: 7 October 2026 · Grok 4.7 used through Pi CLI · No training, simulation or hardware experiment was run

    Your initial thesis has substantial support when expressed as observation-derived goals and task state, language-based retrieval, contextual spatial attention, and simulation-assisted learning of a feedback skill. The evidence does not establish that a fixed quantity of video covers every variant, that XYZ determines what to do, or that a simulated policy downloads unchanged onto arbitrary robots. The strongest interpretation of your small-sample idea is adaptation: existing models supply reusable manipulation knowledge, while new demonstrations specify a task, object or operating region. Recent work makes that interpretation more credible, and also exposes its dependencies. Robots can learn through trial and error and retain useful repairs; execution still needs observable outcomes and compatible actions. A fast virtual training environment is consequently a plausible product hypothesis, but the research first needs to establish which observed information makes training more efficient and which simulated improvements survive physical transfer.

    The observation-to-skill thesis matches the evidence when each skill has a tested operating region

    The following mapping preserves the sequence you described. “Supported” means a component has demonstrated precedents, not that the complete proposed architecture has been demonstrated.

    @@ -35,4 +35,4 @@

    X supp

    The verification also corrected misleading native summaries: BIND's physical 63/79 figures are progress scores, and its paper/project simulation protocols disagree; they were not used as quantitative evidence here. (Public verification method) Results throughout remain author-reported, often recent preprints, and were not independently reproduced.

    Conclusion

    The strongest research direction in this thesis is reducing the incremental experience needed for a new, bounded skill by transferring observed task effects and then practicing the missing decisions. The spatial prior fits as an accelerator inside that process. The virtual environment's defensible opportunity is to make those decisions cheap to explore, reject invalid experience and preserve evidence of what improved. It should earn the claim through useful learning and transfer, rather than equate a large generated corpus with mastery. The three tests above can strengthen that opportunity—or show that the value lies in a narrower representation, recovery library or evaluation layer.

    -
    +
    diff --git a/docs/papers/offline-cable-training-environment/index.html b/docs/papers/offline-cable-training-environment/index.html index c5ae1ed..20b8030 100644 --- a/docs/papers/offline-cable-training-environment/index.html +++ b/docs/papers/offline-cable-training-environment/index.html @@ -1,7 +1,7 @@ Offline cable training environment · DVIDIA Research -

    Product prototype and local qualification

    Offline cable training environment

    · DVIDIA

    CPU simulation-only · Controller search and frozen evaluation executed

    Source & history · Download Markdown

    Abstract

    The first runnable product loop combines an anchored cable environment, local controller-parameter search, frozen evaluation, offline replay and a manifest-backed skill pack. The selected controller and a fixed feedback baseline both completed 10/10 held-out simulated episodes; zero-force and release controls completed 0/10. A native macOS network-denial run completed 3/3 additional episodes. Ideal endpoint attachment and privileged state bound the result; physical rope calibration, gripping, sensors and GPU throughput remain untested.

    In this paper

    Product prototype and local qualification · 7 October 2026 · Native CPU simulation only

    +

    Product prototype and local qualification

    Offline cable training environment

    · DVIDIA

    CPU simulation-only · Controller search and frozen evaluation executed

    Source & history · Download Markdown

    Abstract

    The first runnable product loop combines an anchored cable environment, local controller-parameter search, frozen evaluation, offline replay and a manifest-backed skill pack. The selected controller and a fixed feedback baseline both completed 10/10 held-out simulated episodes; zero-force and release controls completed 0/10. A native macOS network-denial run completed 3/3 additional episodes. Ideal endpoint attachment and privileged state bound the result; physical rope calibration, gripping, sensors and GPU throughput remain untested.

    In this paper

    Product prototype and local qualification · 7 October 2026 · Native CPU simulation only

    The first runnable product loop now connects an authored environment → local practice → a frozen controller → evaluation → an inspectable skill pack. CableEndReach-v0 bends an anchored cable using bounded forces at its terminal site. The selected controller completed 10/10 held-out simulated episodes, but a fixed feedback baseline also completed 10/10 and finished faster. The result establishes an executable research and packaging foundation, with explicit failure controls. It does not establish physical rope accuracy, shoe tying, realistic grasping or a performance advantage over existing simulators.

    Runnable source and instructions · Open the recorded replay · Download the skill pack · Complete qualification

    The task has an explicit operating envelope

    @@ -30,4 +30,4 @@

    Run and inspect the same pr

    The self-contained HTML replay supports episode selection, scrubbing and rotation without a server. The pack includes exact source, dependency lock, controller parameters, fixed evaluation evidence and a SHA-256 manifest. Its compatibility is the declared ideal endpoint-force, privileged-state simulation profile. Hash verification checks content consistency; it does not authenticate the publisher or qualify a physical robot. Dependency wheels are not bundled.

    A separate reproduction extracted the published pack into a temporary folder and used only its unpacked code with preinstalled pinned dependencies. Seeds 200–202 reproduced all recorded trace values and final diagnostics exactly. This verifies that the packaged code runs independently of the original workspace; it does not exercise air-gapped installation. Reproduction receipt.

    The initial thesis now has a running practice-to-evidence-to-package segment. Demonstration intake, language grounding, spatial inspection, calibrated materials, actual gripping/recovery, realistic sensors and physical qualification remain capability gates. A GPU backend and independent worker scheduling must preserve those task semantics before making scaling claims. The next product advance should close one of these measured gaps while keeping its evidence visible.

    -

    +
    diff --git a/docs/papers/physical-skill-research-agenda/index.html b/docs/papers/physical-skill-research-agenda/index.html index 1911e2b..72596e3 100644 --- a/docs/papers/physical-skill-research-agenda/index.html +++ b/docs/papers/physical-skill-research-agenda/index.html @@ -1,7 +1,7 @@ Turn physical footage into testable evidence · DVIDIA Research -

    Research agenda

    Turn physical footage into testable evidence

    · DVIDIA

    Four baseline protocols proposed

    Source & history · Download Markdown

    Abstract

    A research agenda covering visible capture evidence, relations over time, evaluation provenance and physical grounding. Each question has a bounded protocol and a failure condition. The aim is to measure whether structure and physical signals improve a defined task before scaling collection. Strategic opinions, author-reported results and our untested proposals are kept distinct.

    In this paper

    DVIDIA should test the usefulness of its evidence before expanding collection volume. The immediate opportunity is to make demonstrations easier to inspect, compare and reproduce, then measure whether added structure or physical signals help a defined task. Sam Padilla's 5 October essay provides a strategic prompt; the technical sources support narrower, testable questions. The four baseline protocols proposed in this agenda have not run, and neither customer demand nor robot transfer has been established. Four contributor-sized studies cover capture quality, relations over time, provenance and physical grounding.

    +

    Research agenda

    Turn physical footage into testable evidence

    · DVIDIA

    Four baseline protocols proposed

    Source & history · Download Markdown

    Abstract

    A research agenda covering visible capture evidence, relations over time, evaluation provenance and physical grounding. Each question has a bounded protocol and a failure condition. The aim is to measure whether structure and physical signals improve a defined task before scaling collection. Strategic opinions, author-reported results and our untested proposals are kept distinct.

    In this paper

    DVIDIA should test the usefulness of its evidence before expanding collection volume. The immediate opportunity is to make demonstrations easier to inspect, compare and reproduce, then measure whether added structure or physical signals help a defined task. Sam Padilla's 5 October essay provides a strategic prompt; the technical sources support narrower, testable questions. The four baseline protocols proposed in this agenda have not run, and neither customer demand nor robot transfer has been established. Four contributor-sized studies cover capture quality, relations over time, provenance and physical grounding.

    The essay motivates a hypothesis, not a market forecast

    In Robotics Data: Bet Hard Or Get Out, Sam Padilla, 5 October 2026, argues for exceptional collection scale, distinctive physical information or synthetic generation. He warns that buyers can internalize embodiment-specific collection and points to opportunities beyond raw data supply. His conversations and volume anecdote are not independently verified demand evidence. (Original essay).

    Our inference is a practical test: does an attributable demonstration with observable state changes improve a specific evaluation more than a clip with coarse tags? This would establish a useful property of a research artifact. It would not establish willingness to pay, a durable business model or an executable robot skill. The first deliverable should therefore be a small benchmark with a clear failure condition, rather than a volume target.

    @@ -20,4 +20,4 @@

    Provenance makes small res

    A tiny permission-cleared fixture will contain deliberate corruption, timestamp errors and duplicate derivatives. The acceptance criterion is reproducible inventory/split hashes, detection of all seeded structural faults, and readback within declared alignment tolerances. Near-duplicate detection is evaluated separately; a byte hash does not identify semantic equivalence. All derivatives from an original recording share its split. See the provenance protocol.

    Contribution value comes from resolved uncertainty

    The most useful early result can be a failed hypothesis: a visibility score that accepts obscured interactions, a relation model that cannot calibrate contact, or metadata whose annotation cost exceeds its retrieval benefit. Publishing the protocol and failure evidence makes that result reusable. Expanding collection or instrumentation should follow a demonstrated bottleneck and a measured benefit, with physical execution evaluated as a separate claim.

    -
    +
    diff --git a/docs/papers/skill-capsule-acquisition/index.html b/docs/papers/skill-capsule-acquisition/index.html index 3b9d626..6f26e82 100644 --- a/docs/papers/skill-capsule-acquisition/index.html +++ b/docs/papers/skill-capsule-acquisition/index.html @@ -1,7 +1,7 @@ Skill capsule acquisition and optimization · DVIDIA Research -

    Learned movement artifact and installation prototype

    Skill capsule acquisition and optimization

    · DVIDIA

    Simulation-only · teacher/student 7/8 · no overall speedup

    Source & history · Download Markdown

    Abstract

    A compact learned CPU movement head replaces joint-target computation inside an authored placement supervisor. Teacher and student both pass 7/8 in a new frozen evaluation, while episode wall time increases from 6.273 to 6.360 seconds. A 39,845-byte JSON capsule imports into the local lab, checks its exact runtime and qualifies the current scene through native placement and a recorded-arm/open-jaw control. Scene changes require a fresh test. One known scene and repeat pass native network denial; perception, complete task learning, other embodiments and hardware remain unqualified.

    In this paper

    Measured prototype and proposed next steps · 7 October 2026 · Simulation-only

    +

    Learned movement artifact and installation prototype

    Skill capsule acquisition and optimization

    · DVIDIA

    Simulation-only · teacher/student 7/8 · no overall speedup

    Source & history · Download Markdown

    Abstract

    A compact learned CPU movement head replaces joint-target computation inside an authored placement supervisor. Teacher and student both pass 7/8 in a new frozen evaluation, while episode wall time increases from 6.273 to 6.360 seconds. A 39,845-byte JSON capsule imports into the local lab, checks its exact runtime and qualifies the current scene through native placement and a recorded-arm/open-jaw control. Scene changes require a fresh test. One known scene and repeat pass native network denial; perception, complete task learning, other embodiments and hardware remain unqualified.

    In this paper

    Measured prototype and proposed next steps · 7 October 2026 · Simulation-only

    DVIDIA now has a compact learned movement artifact that can be packaged for a compatible simulated arm. A normalized RBF head replaces the teacher's joint-target computation; task phases, waypoints, gripper/contact supervision, and bounded recovery remain authored. The frozen head contains 34,171 canonical JSON bytes, and the compiled candidate capsule contains 39,845 bytes. In a new eight-scene evaluation, teacher and student both completed 7/8, without teacher fallback, while total episode wall time increased from 6.273 to 6.360 seconds. This establishes a bounded teacher-to-student acquisition step, with neither reliability improvement nor overall acceleration demonstrated. The useful product path is import → compatibility check → actual local execution and negative control → scene-specific qualification → execution. Human-video learning, calibrated perception/contact, and physical-arm competence remain separate future capabilities. (Training receipt, profiling, candidate capsule).

    The acquired behavior is movement inside an authored task

    The experiment declares 16 training scenes, four separate development-selection scenes, and eight evaluation scenes with disjoint scene digests. Historical v0.3 held-out cases were excluded and their earlier results remain unchanged. The teacher completed 16/16 collection scenes, generating 6,344 supervised rows: 3,172 sampled native teacher calls and 3,172 extra teacher queries with perturbed Cartesian goals at the same physical states. Augmentation adds movement labels, not another 3,172 physical attempts. The full canonical dataset occupies 3,814,171 bytes. (Protocol, collection).

    @@ -39,4 +39,4 @@

    Be

    Conclusion

    The useful capsule is frozen learned parameters plus the exact machinery that gives them meaning. This prototype shows a small movement component can preserve an authored teacher's outcomes on a new bounded suite. Its value is transferable computation and an inspectable acquisition contract, while the measured bottleneck remains native stepping and observation work.

    Keep candidate integrity, local execution, independent task evaluation, and physical qualification as distinct evidence. Optimize the measured bottleneck, request demonstrations that resolve missing decisions, and release only the capability the complete installed controller has established. The source bundle and candidate capsule make that bounded research artifact concrete.

    -
    +
    diff --git a/docs/papers/skillspace-arm-benchmarks/index.html b/docs/papers/skillspace-arm-benchmarks/index.html index a8e9fa0..e8b94b1 100644 --- a/docs/papers/skillspace-arm-benchmarks/index.html +++ b/docs/papers/skillspace-arm-benchmarks/index.html @@ -1,7 +1,7 @@ Skillspace arm benchmarks and evolution · DVIDIA Research -

    Paired simulation benchmark and product assessment

    Skillspace arm benchmarks and evolution

    · DVIDIA

    Mixed held-out result · 30/32 baseline, 29/32 updated

    Source & history · Download Markdown

    Abstract

    Two controller revisions improve development completion from 14/20 to 17/20, but the frozen paired test declines from 30/32 to 29/32: both pass all 24 normal-strength cases while actuator-stress completion falls from 6/8 to 5/8. Instrumented CPU throughput also declines. We publish the regression, unchanged contact and success rules, exact controller snapshots, richer physical inputs, runtime-bound installation and a proposed staged Skillspace contract. Contact forces and penetration remain uncalibrated; learned perception and physical qualification are open.

    In this paper

    Research and implementation assessment · 7 October 2026 · Simulation-only evidence

    +

    Paired simulation benchmark and product assessment

    Skillspace arm benchmarks and evolution

    · DVIDIA

    Mixed held-out result · 30/32 baseline, 29/32 updated

    Source & history · Download Markdown

    Abstract

    Two controller revisions improve development completion from 14/20 to 17/20, but the frozen paired test declines from 30/32 to 29/32: both pass all 24 normal-strength cases while actuator-stress completion falls from 6/8 to 5/8. Instrumented CPU throughput also declines. We publish the regression, unchanged contact and success rules, exact controller snapshots, richer physical inputs, runtime-bound installation and a proposed staged Skillspace contract. Contact forces and penetration remain uncalibrated; learned perception and physical qualification are open.

    In this paper

    Research and implementation assessment · 7 October 2026 · Simulation-only evidence

    Skillspace → install → simulated arm makes sense as a grounded, compatible execution workflow. The present implementation imports task metadata, binds an explicitly authored adapter, supplies a metric scene, executes native contact dynamics, and checks completion. Two engineering rounds increased development success from 14/20 to 16/20 to 17/20, but the frozen held-out comparison declined from 30/32 to 29/32: both controllers passed all 24 nominal cases, while actuator-stress success fell from 6/8 to 5/8. There were zero held-out improvements and one regression. Observed instrumented CPU throughput also declined from 12.283× to 11.388× simulated seconds per wall second. The result establishes an auditable simulation workflow and useful failure diagnostics; it establishes neither improved held-out reliability nor calibrated physical accuracy. Skillspaces should evolve toward immutable releases that bind task, embodiment, observations, controller, and independently evaluated evidence. (Frozen assessment).

    Installation supplies an explicit execution bridge

    The public place_cup envelope contains a task label, robot identifier, recording format, and demonstration count. It does not contain learned weights, actions, object dimensions, metric target coordinates, or camera calibration. The local bridge supplies a declared rigid-box proxy and contact-pick-place-box-v0 adapter for dvidia-authored-6dof-parallel-jaw-v0. Thus installation selects existing authored behavior; it does not infer cup manipulation from the referenced demonstrations. This distinction preserves the useful architecture: language identifies the goal, grounding supplies the state and physical assumptions, a compatible controller acts, and a verifier judges the result. (Public metadata, execution guide).

    @@ -35,4 +35,4 @@

    Med

    Conclusion

    The useful advance is that a skill label now leads to reproducible, contact-dependent execution with an explicit failure boundary. The preserved regression makes the release more informative: iteration improved selected development behavior while failing to improve the sealed comparison. Future Skillspace value should be measured by fewer resources to an independently qualified capability, with unsupported inputs and failed recoveries visible.

    The next download should carry the exact controller, grounded scenario, observation contract, runtime versions, and evaluation receipt together. Start from the source release and its declared simulation scope, then qualify new task families and hardware through new evidence rather than extending the meaning of a familiar task name.

    -
    +
    diff --git a/docs/papers/skillspace-arm-installation/index.html b/docs/papers/skillspace-arm-installation/index.html index dfd0e7d..b98e51e 100644 --- a/docs/papers/skillspace-arm-installation/index.html +++ b/docs/papers/skillspace-arm-installation/index.html @@ -1,7 +1,7 @@ Installing a Skillspace on a simulated arm · DVIDIA Research -

    Product prototype and native contact qualification

    Installing a Skillspace on a simulated arm

    · DVIDIA

    Public skill link to authored adapter · 6/6 scene placements

    Source & history · Download Markdown

    Abstract

    The first link-to-arm product path installs an existing DVIDIA placement envelope, binds a local authored controller to one simulated arm, and reuses it in independently grounded scenes. Native jaw contacts carry a free box; six layouts complete, while no-motion and identical joint commands with open jaws each complete zero of six. Installed execution passes process-level offline checks. Task metadata contains no learned policy; perception, cup geometry, full arm collisions and physical qualification remain open.

    In this paper

    Research note, 7 October 2026. The current bridge makes a narrow part of the proposed skill workflow executable: import a DVIDIA skill envelope, install an explicitly authored local simulation adapter, create a scene, and run an articulated arm. It provides a concrete place to investigate observation-to-simulation-to-skill packaging. It does not yet infer an executable policy, object geometry, material properties, or robot calibration from human video.

    +

    Product prototype and native contact qualification

    Installing a Skillspace on a simulated arm

    · DVIDIA

    Public skill link to authored adapter · 6/6 scene placements

    Source & history · Download Markdown

    Abstract

    The first link-to-arm product path installs an existing DVIDIA placement envelope, binds a local authored controller to one simulated arm, and reuses it in independently grounded scenes. Native jaw contacts carry a free box; six layouts complete, while no-motion and identical joint commands with open jaws each complete zero of six. Installed execution passes process-level offline checks. Task metadata contains no learned policy; perception, cup geometry, full arm collisions and physical qualification remain open.

    In this paper

    Research note, 7 October 2026. The current bridge makes a narrow part of the proposed skill workflow executable: import a DVIDIA skill envelope, install an explicitly authored local simulation adapter, create a scene, and run an articulated arm. It provides a concrete place to investigate observation-to-simulation-to-skill packaging. It does not yet infer an executable policy, object geometry, material properties, or robot calibration from human video.

    The public example is DVIDIA place_cup, whose metadata is served at place_cup/skill.json. The recorded 360-byte source is vdia:0, version 0.3.0, with task “Set a cup on the mark.” Its exact-byte SHA-256 is 16b4e1ef0f3799345c1d18ce9f1da83b072863ab00ce30a83424080fb467d4ec. The envelope declares a demonstration count, recording format and robot identifier; these declarations do not supply trajectories, observations, trained weights, or an evaluated controller. The installation receipt preserves the source bytes, URL, source hash, separate grounding hash, adapter identity and physical_robot_ready: false. A later download may differ; its receipt must identify its own bytes.

    In the local studio, one click installs the compatible public envelope and binds contact-pick-place-box-v0 to dvidia-authored-6dof-parallel-jaw-v0. A bundled envelope supports installation without fetching the public site. JSON upload/drop accepts the supported DVIDIA formats. Missing grounding is supplied through a visible, locally authored adapter; inline grounding remains separately validated. Installation downloads metadata and executes the already installed local controller. Object and target coordinates belong to the scene and can change between executions. The browser displays recorded native simulation poses rather than inventing an object trajectory. Execution and replay are designed to work with installed dependencies and local assets; the broader product's air-gapped deployment remains a separate validation task.

    The embodiment is an original six-hinge arm with two actuated sliding jaws. Native MuJoCo 3.15.0 simulates a free rigid box, gravity and jaw/object/table contact. The default proxy is a 40 mm cube weighing 40 g on a table at 0.29 m. No weld, mocap attachment, or object-state update carries the object during execution. Arm controls use bounded position servos, model-based bias compensation and current-state damped Jacobian control. The declared limits are 40 N·m per arm actuator and 15 N per jaw. Physics uses a 1 ms timestep, implicitfast integration, Newton solving and an elliptic Coulomb friction cone. These choices describe an authored fixture, not measured hardware or calibrated material fidelity.

    @@ -15,4 +15,4 @@

    Frozen scene evaluation

    Product and evidence

    The public release provides a standalone arm replay, an executable source adapter archive, full control evidence, gzip JSON, compact metrics, integrity manifest, reproduction receipt, native offline receipt, and a local product guide. The replay samples recorded observations every 100 ms; full evidence retains 20 ms control observations and action commands. Hashes establish content consistency, not publisher authenticity or physical competence.

    This implements the link-to-compatible-arm execution path within an explicit simulated skill space. The environment supplies metric object/target state, the installed adapter converts current state into joint/jaw actions, and the verifier checks the resulting object state. The initial thesis's spatial operating region becomes a bounded task contract; feedback supplies the missing connection between a skill name and effective movement. Demonstrations becoming learned policies, calibrated objects, realistic perception, repair policies and robot-specific physical qualification remain the next capability gates.

    -
    +
    diff --git a/docs/papers/skillspace-footage-training/index.html b/docs/papers/skillspace-footage-training/index.html index 4de2807..5ae3cb4 100644 --- a/docs/papers/skillspace-footage-training/index.html +++ b/docs/papers/skillspace-footage-training/index.html @@ -1,7 +1,15 @@ Skillspace footage training pipeline · DVIDIA Research -

    Product implementation and measured synthetic pilot

    Skillspace footage training pipeline

    · DVIDIA

    Public CPU package · one native scene qualified · simulation-only

    Source & history · Download Markdown

    Abstract

    The public Dvidia-Inference/dvidia-training repository provides a standalone CPU pipeline that audits Skillspace media, freezes grouped splits and exports inspectable artifacts. Ten synthetic six-second clips train a visual predictor with a 0.5106-second median pipeline time across three repeats on one macOS host. Aligned native simulator telemetry supplies 4,029 training labels for a learned joint-delta head, evaluated on one held-out recording. Its capsule passes native placement qualification in that recording's exact scene; identical joint targets with open jaws fail. Installation and hardware guides accompany the package. Human-video action recovery, shoe organization, demonstration sufficiency, independent scene generalization and physical robot competence remain unestablished.

    In this paper

    The public, standalone DVIDIA training repository provides a local CPU pipeline that turns actual Skillspace media into a fitted visual model and, when aligned numeric actions are supplied, a learned movement head. The useful advance is a reproducible path from source files through provenance checks, grouped splits, measured fitting and portable artifacts. Video prediction and robot movement remain separate claims. Ten synthetic six-second clips demonstrate visual fitting; simulator telemetry supplies the movement pilot's action labels. Its exported capsule installs and passes native qualification in one exact scene, while identical joint targets with open jaws fail. Neither experiment learns shoe organization or reconstructs robot actions from human footage. This report documents the implemented path and its limited measured evidence, rather than establishing a sufficient demonstration count or hardware competence. (Standalone source archive, Qualification receipt)

    +

    Product implementation and measured synthetic pilot

    Skillspace footage training pipeline

    · DVIDIA

    Public CPU package · one native scene qualified · simulation-only

    Source & history · Download Markdown

    Abstract

    The public Dvidia-Inference/dvidia-training repository provides a standalone CPU pipeline that audits Skillspace media, freezes grouped splits and exports inspectable artifacts. Ten synthetic six-second clips train a visual predictor with a 0.5106-second median pipeline time across three repeats on one macOS host. Aligned native simulator telemetry supplies 4,029 training labels for a learned joint-delta head, evaluated on one held-out recording. Its capsule passes native placement qualification in that recording's exact scene; identical joint targets with open jaws fail. Installation and hardware guides accompany the package. Human-video action recovery, shoe organization, demonstration sufficiency, independent scene generalization and physical robot competence remain unestablished.

    In this paper

    The public, standalone DVIDIA training repository provides a local CPU pipeline that turns actual Skillspace media into a fitted visual model and, when aligned numeric actions are supplied, a learned movement head. The useful advance is a reproducible path from source files through provenance checks, grouped splits, measured fitting and portable artifacts. Video prediction and robot movement remain separate claims. Ten synthetic six-second clips demonstrate visual fitting; simulator telemetry supplies the movement pilot's action labels. Its exported capsule installs and passes native qualification in one exact scene, while identical joint targets with open jaws fail. Neither experiment learns shoe organization or reconstructs robot actions from human footage. This report documents the implemented path and its limited measured evidence, rather than establishing a sufficient demonstration count or hardware competence. (Standalone source archive, Qualification receipt)

    +

    Published artifacts on Hugging Face

    +

    The DVIDIA organization on Hugging Face mirrors the measured pilot for inspection and local reproduction:

    +
      +
    • Example dataset: explicitly synthetic moving-disc footage and native simulator recordings, with frozen prepared inputs and grouped train/development/test splits. No human footage is included.
    • +
    • Pilot model artifacts: visual weights, the learned joint-delta candidate, evaluation reports and native qualification/control evidence. The movement candidate learns from aligned numerical simulator labels and remains bound to its declared adapter.
    • +
    • Training evidence Space: a static overview of the measurements and the saved contact/lift/place replay from one exact held-out scene.
    • +
    +

    Training runs on the user's own computer or server through the local installation guide. The Space presents fixed evidence; it provides no hosted training or uploads. These published artifacts remain research-alpha, simulation-only evidence, with no qualified hardware skill or established human-video action bridge.

    Actual media and connected source groups gate training

    Start with the repository's installation guide and hardware guide. The pipeline accepts a local folder, ZIP or prepared dataset; explicitly enabled online mode also accepts a supported public DVIDIA manifest and its declared media. Visual training requires Python 3.12+, NumPy and FFmpeg/ffprobe; arm simulation adds MuJoCo. A Skillspace description with no accessible video does not become a dataset. Images alone are rejected. An audit-only preparation step checks media, copies the exact bytes, records hashes and freezes train, development and test assignments before fitting. Fresh output directories prevent silent replacement of earlier runs. The command-line interface and a loopback training studio expose this same path. (Implementation)

    Split integrity depends on connected source groups, rather than independent filenames. Clips sharing a source recording, session, shoe-pair identifier or identical media bytes stay together. At least three groups are required to populate all three splits. Plain video folders can enter with explicit lineage warnings, but their per-file groups do not prove that recordings are independent. A supplied “complete” flag records the contributor's declaration; it does not establish that the entire task appears or that the demonstration is correct. Thus the implementation prevents declared lineage from crossing splits while retaining the unresolved need for semantic and provenance review. (Example visual Skillspace)

    @@ -18,4 +26,4 @@

    Executable

    The next experiment should measure the missing bridge

    The current local path avoids API dependence once its tools and data are installed. Local media decoding restricts FFmpeg protocols, while optional remote intake is explicit. Separate continuous-integration checks passed visual fitting and studio tests on Linux, macOS and Windows with Python 3.12 and 3.13, the optional Linux arm pilot, and an actual Docker example, training run and inspection under --network none. The image build required network access; this does not establish installation on a new air-gapped machine or minimum hardware. No GPU scaling, throughput improvement over another implementation or hardware transfer follows from the pilots. The package makes experiments inspectable and repeatable; its scientific value depends on what demonstrations, labels and task environments enter it. (Passing software checks, Source and training guide)

    For shoe organization, the next decisive step is a reviewed corpus of complete one-shoe-to-marked-slot attempts and a validated observation-to-action bridge for a defined arm, gripper and sensing arrangement. Sample-count comparisons should hold architecture, task definition and evaluation fixed, group related originals, and report independent closed-loop episodes alongside prediction error. Until those components exist, a shorter visual training run cannot answer how many human videos make a robot competent. The pipeline's contribution is to preserve those distinctions in executable product gates, making the missing evidence measurable before a candidate becomes a downloadable skill.

    -
    +
    diff --git a/docs/papers/spatially-grounded-downloadable-robot-skills/index.html b/docs/papers/spatially-grounded-downloadable-robot-skills/index.html index 20c0b24..da34776 100644 --- a/docs/papers/spatially-grounded-downloadable-robot-skills/index.html +++ b/docs/papers/spatially-grounded-downloadable-robot-skills/index.html @@ -1,7 +1,7 @@ Spatially grounded downloadable robot skills · DVIDIA Research -

    Research synthesis and proposed experiments

    Spatially grounded downloadable robot skills

    · DVIDIA

    Source review · DVIDIA experiments not run

    Source & history · Download Markdown

    Abstract

    A synthesis of learning from human demonstrations, language-conditioned spatial attention, simulation expansion and robot-specific skill delivery. Spatial priors can accelerate inspection but do not determine contact state or control. The proposed downloadable skill packages a controller, initiation and termination conditions, compatible sensing and hardware, recovery behavior and measured evidence. Separate experiments would test attention, data coverage, feedback and transfer.

    In this paper

    Research synthesis and proposed experiments · 7 October 2026 · No DVIDIA experiment in this report has run

    +

    Research synthesis and proposed experiments

    Spatially grounded downloadable robot skills

    · DVIDIA

    Source review · DVIDIA experiments not run

    Source & history · Download Markdown

    Abstract

    A synthesis of learning from human demonstrations, language-conditioned spatial attention, simulation expansion and robot-specific skill delivery. Spatial priors can accelerate inspection but do not determine contact state or control. The proposed downloadable skill packages a controller, initiation and termination conditions, compatible sensing and hardware, recovery behavior and measured evidence. Separate experiments would test attention, data coverage, feedback and transfer.

    In this paper

    Research synthesis and proposed experiments · 7 October 2026 · No DVIDIA experiment in this report has run

    My judgment is that the thesis identifies a useful architecture, but its strongest version needs a measurable operating boundary. Human demonstrations can teach what a task means, which state changes matter, and where to inspect; turning those observations into robot control needs an action and embodiment bridge. A command-conditioned spatial prior could accelerate target discovery, provided observation corrects it when a shoe is on a table or the person changes posture. Simulation can expand grounded experience, but generated volume cannot establish coverage of every material, contact, damaged object, or recovery. Fifty examples could adapt a substantial pretrained physical skill model; they are not an established threshold for acquiring all of shoe tying. The falsifiable research claim is: for a fixed pretrained model and robot, task-state annotations, spatially directed inspection, and targeted real/simulated recovery data improve held-out physical success per unit of collection cost, while preserving performance on unusual placements. A downloadable skill is the resulting tested controller, its compatibility and task contract, and evidence of where it works.

    This synthesis combines three parallel primary-source research tracks with the existing DVIDIA research context. Grok 4.7 was inaccessible and was not used: the inspected browser was signed out, the exact model could not be verified, and no prompt or response exists. Recent 2026 results below include author-reported preprints; none was independently reproduced here. Architecture, experiments, budgets, and release criteria are proposals.

    Demonstrations teach meaning before they supply motor control

    @@ -83,4 +83,4 @@

    Continu

    Conclusion

    The most productive interpretation of a Skillspace is a versioned collection of decisions and their physical evidence: what state existed, what action or correction occurred, and whether the desired change held. That makes a failed loop or an unexpected shoe position potentially more valuable than another clean replay. It also gives “download a skill” a concrete meaning: install already learned, tested behavior on a compatible body, then confirm eligibility and the outcome locally.

    I would test whether fifty well-chosen episodes change one grounded model's held-out behavior, while separately testing whether command-conditioned attention saves total time. Those experiments directly address the thesis without requiring a claim to have simulated every possible lace. Their value lies in discovering which missing decisions require real evidence and which variations an already competent model can synthesize reliably.

    -
    +
    diff --git a/docs/topics/capture-quality/index.html b/docs/topics/capture-quality/index.html index 719335e..c82f9eb 100644 --- a/docs/topics/capture-quality/index.html +++ b/docs/topics/capture-quality/index.html @@ -1,7 +1,7 @@ Capture quality · DVIDIA Research -

    Research question

    Capture quality

    DVIDIA · Visible evidence

    Protocols and progress are scoped below

    Question

    Test whether hands, relevant objects and state changes are actually observable in a POV demonstration.

    Question: Test whether hands, relevant objects and state changes are actually observable in a POV demonstration.

    +

    Research question

    Capture quality

    DVIDIA · Visible evidence

    Protocols and progress are scoped below

    Question

    Test whether hands, relevant objects and state changes are actually observable in a POV demonstration.

    Question: Test whether hands, relevant objects and state changes are actually observable in a POV demonstration.

    Status: scoping · Updated 6 October 2026 · Results: not run

    Open a research question · Baseline protocol · Bibliography

    Primary sources

    @@ -36,4 +36,4 @@

    Milestones

    Results

    Not run. Source review is complete; no experiment, validation claim or independent reproduction is complete. Add measured results and their limitations only after execution.

    -
    +
    diff --git a/docs/topics/evaluation-provenance/index.html b/docs/topics/evaluation-provenance/index.html index 854a975..c87415f 100644 --- a/docs/topics/evaluation-provenance/index.html +++ b/docs/topics/evaluation-provenance/index.html @@ -1,7 +1,7 @@ Evaluation and provenance · DVIDIA Research -

    Research question

    Evaluation and provenance

    DVIDIA · Reproducible evidence

    Protocols and progress are scoped below

    Question

    Test episode readback, original-to-derivative lineage and split integrity using small, auditable fixtures.

    Question: Test episode readback, original-to-derivative lineage and split integrity using small, auditable fixtures.

    +

    Research question

    Evaluation and provenance

    DVIDIA · Reproducible evidence

    Protocols and progress are scoped below

    Question

    Test episode readback, original-to-derivative lineage and split integrity using small, auditable fixtures.

    Question: Test episode readback, original-to-derivative lineage and split integrity using small, auditable fixtures.

    Status: evaluating · Updated 6 October 2026 · Results: image feasibility run complete; reference accuracy and provenance baselines not run

    Open a research question · Baseline protocol · Bibliography

    Primary sources

    @@ -37,4 +37,4 @@

    Milestones

    Results

    The five-clip Clef feasibility run completed ten image calls for an estimated $0.00140634. It exposed caption omissions and a checker-agreed object error. Raw results and preregistration are available; independent review and the original baselines remain outstanding.

    -
    +
    diff --git a/docs/topics/physical-grounding/index.html b/docs/topics/physical-grounding/index.html index e81a4a4..b8459a8 100644 --- a/docs/topics/physical-grounding/index.html +++ b/docs/topics/physical-grounding/index.html @@ -1,7 +1,7 @@ Physical grounding · DVIDIA Research -

    Research question

    Physical grounding

    DVIDIA · Signals beyond appearance

    Protocols and progress are scoped below

    Question

    Measure whether state/contact evidence and controlled synthetic augmentation improve a defined physical-skill task.

    Skillspace footage training pipeline +

    Research question

    Physical grounding

    DVIDIA · Signals beyond appearance

    Protocols and progress are scoped below

    Question

    Measure whether state/contact evidence and controlled synthetic augmentation improve a defined physical-skill task.

    Skillspace footage training pipeline introduces the separate public DVIDIA Training repository: CPU footage intake, connected source groups, measured visual fitting, optional aligned movement training and simulation capsule export. Hardware guidance, @@ -52,4 +52,4 @@

    Milestones

    Results

    Not run. No data acquisition, annotation, training, robot execution or synthetic-generation result is claimed. Published vendor/paper figures remain attributed to their original settings.

    -
    +
    diff --git a/docs/topics/skill-relations/index.html b/docs/topics/skill-relations/index.html index 84e98a3..a64a1fa 100644 --- a/docs/topics/skill-relations/index.html +++ b/docs/topics/skill-relations/index.html @@ -1,7 +1,7 @@ Skill relations · DVIDIA Research -

    Research question

    Skill relations

    DVIDIA · Events with evidence

    Protocols and progress are scoped below

    Question

    Calibrate hand–object relations, then test temporal event graphs whose claims point back to video intervals.

    Question: Calibrate hand–object relations, then test temporal event graphs whose claims point back to video intervals.

    +

    Research question

    Skill relations

    DVIDIA · Events with evidence

    Protocols and progress are scoped below

    Question

    Calibrate hand–object relations, then test temporal event graphs whose claims point back to video intervals.

    Question: Calibrate hand–object relations, then test temporal event graphs whose claims point back to video intervals.

    Status: scoping · Updated 6 October 2026 · Results: not run

    Open a research question · Baseline protocol · Bibliography

    Primary sources

    @@ -36,4 +36,4 @@

    Milestones

    Results

    Not run. Source review is complete; no experiment, validation claim or independent reproduction is complete. Add measured results and their limitations only after execution.

    -
    +
    diff --git a/reports/Skillspace footage training pipeline.md b/reports/Skillspace footage training pipeline.md index c65ec36..4bd972c 100644 --- a/reports/Skillspace footage training pipeline.md +++ b/reports/Skillspace footage training pipeline.md @@ -2,6 +2,16 @@ The public, standalone [DVIDIA training repository](https://github.com/Dvidia-Inference/dvidia-training) provides a local CPU pipeline that turns actual Skillspace media into a fitted visual model and, when aligned numeric actions are supplied, a learned movement head. The useful advance is a reproducible path from source files through provenance checks, grouped splits, measured fitting and portable artifacts. **Video prediction and robot movement remain separate claims.** Ten synthetic six-second clips demonstrate visual fitting; simulator telemetry supplies the movement pilot's action labels. Its exported capsule installs and passes native qualification in one exact scene, while identical joint targets with open jaws fail. Neither experiment learns shoe organization or reconstructs robot actions from human footage. This report documents the implemented path and its limited measured evidence, rather than establishing a sufficient demonstration count or hardware competence. ([Standalone source archive](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-08-footage-pipeline-v1/release/dvidia-training-v0.1.zip), [Qualification receipt](https://research.dvidia.org/downloads/topics/physical-grounding/runs/2026-10-08-footage-pipeline-v1/qualification/qualification.json)) +## Published artifacts on Hugging Face + +The [DVIDIA organization on Hugging Face](https://huggingface.co/Dvidia) mirrors the measured pilot for inspection and local reproduction: + +- [Example dataset](https://huggingface.co/datasets/Dvidia/dvidia-training-examples): explicitly synthetic moving-disc footage and native simulator recordings, with frozen prepared inputs and grouped train/development/test splits. No human footage is included. +- [Pilot model artifacts](https://huggingface.co/Dvidia/dvidia-training-pilot): visual weights, the learned joint-delta candidate, evaluation reports and native qualification/control evidence. The movement candidate learns from aligned numerical simulator labels and remains bound to its declared adapter. +- [Training evidence Space](https://huggingface.co/spaces/Dvidia/dvidia-training): a static overview of the measurements and the saved contact/lift/place replay from one exact held-out scene. + +Training runs on the user's own computer or server through the [local installation guide](https://github.com/Dvidia-Inference/dvidia-training/blob/main/docs/installation.md). The Space presents fixed evidence; it provides no hosted training or uploads. These published artifacts remain research-alpha, simulation-only evidence, with no qualified hardware skill or established human-video action bridge. + ## Actual media and connected source groups gate training Start with the repository's [installation guide](https://github.com/Dvidia-Inference/dvidia-training/blob/main/docs/installation.md) and [hardware guide](https://github.com/Dvidia-Inference/dvidia-training/blob/main/docs/hardware.md). The pipeline accepts a local folder, ZIP or prepared dataset; explicitly enabled online mode also accepts a supported public DVIDIA manifest and its declared media. Visual training requires Python 3.12+, NumPy and FFmpeg/ffprobe; arm simulation adds MuJoCo. A Skillspace description with no accessible video does not become a dataset. Images alone are rejected. An audit-only preparation step checks media, copies the exact bytes, records hashes and freezes train, development and test assignments before fitting. Fresh output directories prevent silent replacement of earlier runs. The command-line interface and a loopback training studio expose this same path. ([Implementation](https://github.com/Dvidia-Inference/dvidia-training)) diff --git a/scripts/build-papers.mjs b/scripts/build-papers.mjs index 5601a42..bfd0696 100644 --- a/scripts/build-papers.mjs +++ b/scripts/build-papers.mjs @@ -7,6 +7,7 @@ import { Marked } from "marked"; export const ROOT = resolve(dirname(fileURLToPath(import.meta.url)), ".."); export const ORIGIN = "https://research.dvidia.org"; export const REPOSITORY = "https://github.com/Dvidia-Inference/dvidia-research"; +const HUGGING_FACE = "https://huggingface.co/Dvidia"; const DOCS = resolve(ROOT, "docs"); const TOPICS = ["capture-quality", "skill-relations", "evaluation-provenance", "physical-grounding"]; const SLUG = /^[a-z0-9]+(?:-[a-z0-9]+)*$/; @@ -98,14 +99,14 @@ function defaultTable(token) { function navigation(page, publications, topics, active = "") { const a = (path, label, slug) => `${escapeHtml(label)}`; - return ``; + return ``; } function layout({ page, title, description, content, catalog, topics, active = "", date }) { const nav = navigation(page, catalog.publications, topics, active); const canonical = `${ORIGIN}/${page === "index.html" ? "" : page.replace(/index\.html$/, "")}`; const jsonLd = { "@context": "https://schema.org", "@type": active === "index" ? "CollectionPage" : "Article", headline: title, description, url: canonical, publisher: { "@type": "Organization", name: "DVIDIA", url: "https://dvidia.org" }, ...(date ? { datePublished: date } : {}) }; - return `\n\n${escapeHtml(title)} · DVIDIA Research\n
    ${content}
    \n`; + return `\n\n${escapeHtml(title)} · DVIDIA Research\n
    ${content}
    \n`; } function stripTitle(source) { return source.replace(/^# [^\n]+\n+/, ""); }