diff --git a/index.html b/index.html index 08d4e03..60b331d 100644 --- a/index.html +++ b/index.html @@ -24,7 +24,7 @@

Video generation from a causal perspective.

Research

Projects

Each project page brings together its research question, method, evidence, limitations, paper, code, and related discussions.

-
Public project pages will appear here.
+

active · Peiyuan Zhu

Video Action Editing

VADD: Video Action Editing via Demonstrations and Disentanglement, with theory, methods, and interactive comparisons on synthetic and real videos.

video-editing action-editing disentanglement

View project →
diff --git a/people/index.html b/people/index.html index cac6b5b..ad3aabd 100644 --- a/people/index.html +++ b/people/index.html @@ -3,7 +3,7 @@

Group Leader · guangyi

Guangyi Chen

Discussion Leaders

diff --git a/projects/index.html b/projects/index.html index b2b988b..8634732 100644 --- a/projects/index.html +++ b/projects/index.html @@ -1,5 +1,5 @@ Projects · CausalVideoGroup
-
No public projects have been added yet.
+

active · Peiyuan Zhu

Video Action Editing

VADD: Video Action Editing via Demonstrations and Disentanglement, with theory, methods, and interactive comparisons on synthetic and real videos.

video-editing action-editing disentanglement

View project →
diff --git a/projects/video-action-editing/assets/.gitkeep b/projects/video-action-editing/assets/.gitkeep new file mode 100644 index 0000000..e69de29 diff --git a/projects/video-action-editing/assets/index-CQBftp-1.css b/projects/video-action-editing/assets/index-CQBftp-1.css new file mode 100644 index 0000000..4c7277c --- /dev/null +++ b/projects/video-action-editing/assets/index-CQBftp-1.css @@ -0,0 +1 @@ +:root{--navy:#102b4e;--navy-2:#173c67;--blue:#1e5a96;--blue-soft:#dfeaf3;--red:#a33b34;--green:#2f6a52;--amber:#8a641f;--ink:#17212b;--muted:#5e6b78;--paper:#fbfaf7;--paper-alt:#f1f3f4;--white:#fff;--line:#c9d0d5;--line-dark:#8c98a2;--type-body:15.5px;--type-support:14.25px;--type-label:12.5px;--type-emphasis:16.5px}.progress-cover-grid .status-strip span{padding:10px 12px;font-size:16px}.progress-cover-grid .status-strip b{font-size:14px}.plain-status-grid{flex:1;grid-template-columns:repeat(3,minmax(0,1fr));gap:16px;display:grid}.plain-status-grid article{border:1px solid var(--line);border-top:8px solid var(--navy);background:var(--white);flex-direction:column;min-height:330px;padding:clamp(24px,2.5vw,38px);display:flex}.plain-status-grid .plain-status-known{border-top-color:var(--green)}.plain-status-grid .plain-status-changed{border-top-color:var(--blue)}.plain-status-grid .plain-status-open{border-top-color:var(--red)}.plain-status-grid article>span,.proxy-contrast article>span,.valid-comparison article>span,.preservation-balance article>span,.balance-center>span,.drift-story article>span,.method-boundary b,.result-hero>span,.result-columns article>span,.result-media-slot>b,.shared-conditions>b,.single-variable article>span,.decision-question>span{font:750 clamp(14px, 1.05vw, 16px)/1.25 var(--font-geist-mono), monospace;letter-spacing:.07em}.plain-status-grid article>span{color:var(--navy)}.plain-status-grid .plain-status-known>span{color:var(--green)}.plain-status-grid .plain-status-changed>span{color:var(--blue)}.plain-status-grid .plain-status-open>span{color:var(--red)}.plain-status-grid h3{color:var(--navy);letter-spacing:-.025em;margin:auto 0 0;font-size:clamp(26px,2.2vw,34px);line-height:1.18}.plain-status-question{border:0;border-left:7px solid var(--red);background:var(--navy);color:var(--white);margin:18px 0 0;padding:20px 25px;font-size:clamp(24px,2.25vw,34px);font-weight:650;line-height:1.25}:is(#failure-ledger,#supervision-boundary,#latent-method,#action-reference,#source-preservation,#training-inference,#current-result,#single-decision) .subtitle{max-width:1180px;font-size:clamp(19px,1.5vw,23px)}:is(#failure-ledger,#supervision-boundary,#latent-method,#action-reference,#source-preservation,#training-inference,#current-result,#single-decision) .section-label{font-size:14px}.plain-lesson{flex-direction:column;flex:1;min-height:0;display:flex}.proxy-contrast{flex:1;grid-template-columns:minmax(0,1fr) auto minmax(0,1fr);align-items:stretch;gap:20px;display:grid}.proxy-contrast article{border:1px solid var(--line);border-top:8px solid var(--blue);background:var(--white);flex-direction:column;min-height:300px;padding:clamp(24px,2.6vw,40px);display:flex}.proxy-contrast .video-failed{border-top-color:var(--red);background:#f7ecea}.proxy-improved>span{color:var(--blue)}.video-failed>span{color:var(--red)}.proxy-contrast h3{color:var(--navy);letter-spacing:-.025em;margin:auto 0 16px;font-size:clamp(27px,2.35vw,36px);line-height:1.16}.proxy-contrast p{color:var(--muted);margin:0;font-size:clamp(18px,1.35vw,21px);line-height:1.42}.contrast-word{background:var(--navy);width:64px;height:64px;color:var(--white);font:800 16px var(--font-geist-mono), monospace;border-radius:50%;align-self:center;place-items:center;display:grid}.large-rule{border:0;border-left:7px solid var(--red);background:var(--navy);color:var(--white);margin:18px 0 0;padding:18px 24px;font-size:clamp(25px,2.25vw,34px);font-weight:680;line-height:1.24}.large-footnote{color:var(--muted);margin:13px 0 0;font-size:clamp(18px,1.35vw,21px);line-height:1.42}.difference-layout{flex-direction:column;flex:1;display:flex}.difference-equation{grid-template-columns:minmax(0,1fr) auto minmax(0,1fr) auto minmax(0,.7fr);align-items:center;gap:14px;display:grid}.difference-equation span{border:1px solid var(--line);background:var(--white);min-height:100px;color:var(--navy);font:760 clamp(19px, 1.7vw, 26px)/1.2 var(--font-geist-mono), monospace;text-align:center;place-items:center;padding:20px;display:grid}.difference-equation span.difference-motion{color:var(--red);background:#f6e8e6;border-color:#d4aaa5}.difference-equation>b,.difference-equation>strong{color:var(--navy);font-size:clamp(34px,3vw,48px)}.difference-equation>strong{color:var(--red)}.confound-row{grid-template-columns:repeat(4,minmax(0,1fr));gap:12px;margin:16px 0;display:grid}.confound-row span{color:#68413e;text-align:center;background:#f3e8e6;border:1px solid #d3b5b1;padding:13px 15px;font-size:clamp(18px,1.35vw,21px);font-weight:650}.valid-comparison{flex:1;grid-template-columns:repeat(2,minmax(0,1fr));gap:16px;display:grid}.valid-comparison article{border:1px solid var(--line);border-left:7px solid var(--green);background:var(--white);min-height:220px;padding:24px}.valid-comparison article>span{color:var(--green)}.valid-comparison h3{color:var(--navy);margin:22px 0 10px;font-size:clamp(24px,2vw,31px);line-height:1.18}.valid-comparison p{color:var(--muted);margin:0;font-size:clamp(18px,1.35vw,21px);line-height:1.4}.preservation-balance{flex:1;grid-template-columns:minmax(0,1fr) minmax(230px,.72fr) minmax(0,1fr);align-items:stretch;gap:18px;display:grid}.preservation-balance>article{border:1px solid var(--line);border-top:8px solid var(--red);background:var(--white);flex-direction:column;min-height:360px;padding:clamp(24px,2.5vw,38px);display:flex}.preservation-balance .preservation-tight{border-top-color:var(--amber)}.preservation-loose>span{color:var(--red)}.preservation-tight>span{color:var(--amber)}.balance-icon{color:var(--navy);font:760 clamp(52px, 5vw, 78px)/1 var(--font-geist-mono), monospace;margin:auto 0 20px}.preservation-balance h3{color:var(--navy);margin:0;font-size:clamp(25px,2.15vw,34px);line-height:1.18}.balance-center{background:var(--navy);color:var(--white);text-align:center;flex-direction:column;justify-content:center;padding:28px 20px;display:flex}.balance-center>span{color:#f1bf7c;margin-bottom:34px}.balance-center b{font-size:clamp(24px,2vw,31px);line-height:1.2}.balance-center b+b{color:#b8d8c8;margin-top:22px}.drift-story{flex:1;grid-template-columns:repeat(3,minmax(0,1fr));gap:16px;display:grid}.drift-story article{border:1px solid var(--line);border-top:8px solid var(--red);background:var(--white);flex-direction:column;min-height:370px;padding:clamp(22px,2.3vw,34px);display:flex}.drift-story .drift-repair{border-top-color:var(--amber)}.drift-story .drift-prevent{border-top-color:var(--green)}.drift-start>span{color:var(--red)}.drift-repair>span{color:var(--amber)}.drift-prevent>span{color:var(--green)}.drift-story h3{color:var(--navy);margin:auto 0 0;font-size:clamp(24px,1.95vw,30px);line-height:1.2}.drift-visual{justify-content:center;align-items:center;height:100px;margin:auto 0;display:flex}.drift-visual i{border:4px solid var(--navy);background:#dfeaf3;width:72px;height:54px;transform:rotate(-7deg)}.drift-visual i+i{margin-left:-24px;transform:rotate(3deg)translateY(-8px)}.drift-visual i+i+i{transform:rotate(10deg)translateY(-15px)}.drift-cross,.drift-anchor{color:var(--red);font:760 clamp(52px, 5vw, 78px)/1 var(--font-geist-mono), monospace;text-align:center;margin:auto 0}.drift-anchor{color:var(--green);font-size:clamp(28px,3vw,45px)}.single-sentence{border-left:7px solid var(--green);color:#274f40;background:#e7f2ec;margin:18px 0 0;padding:18px 22px;font-size:clamp(22px,1.85vw,29px);font-weight:650;line-height:1.3}:is(#failure-ledger,#supervision-boundary,#latent-method,#action-reference,#source-preservation,#training-inference,#current-result,#single-decision) .slide-heading{margin-bottom:12px;padding-bottom:10px}:is(#failure-ledger,#supervision-boundary,#latent-method,#action-reference,#source-preservation,#training-inference,#current-result,#single-decision) .subtitle{margin-top:6px;font-size:17px;line-height:1.32}.failure-review-table{border:1px solid var(--line-dark);background:var(--white);flex:1;grid-template-rows:auto repeat(5,minmax(0,1fr));min-height:0;display:grid}.failure-review-head,.failure-review-row{grid-template-columns:1.05fr 1.35fr 1.65fr .78fr;display:grid}.failure-review-head{background:var(--navy);color:var(--white)}.failure-review-head>span{font:760 14.5px/1.2 var(--font-geist-mono), monospace;letter-spacing:.04em;border-right:1px solid #ffffff40;padding:8px 11px}.failure-review-row{border-top:1px solid var(--line)}.failure-review-row>*{border-right:1px solid var(--line);align-items:center;margin:0;padding:8px 11px;font-size:clamp(17px,1.25vw,19px);line-height:1.28;display:flex}.failure-review-row>:last-child,.failure-review-head>:last-child{border-right:0}.failure-review-row>strong{color:var(--navy);font-size:clamp(17.5px,1.3vw,19.5px)}.failure-review-row>span{color:#475563}.failure-review-row>b{color:var(--red);font:760 15.5px/1.25 var(--font-geist-mono), monospace;background:#f7ecea}.failure-survivors{grid-template-columns:repeat(3,minmax(0,1fr));gap:9px;margin-top:10px;display:grid}.failure-survivors span{color:#294f40;background:#edf6f1;border:1px solid #91af9f;align-items:center;min-height:58px;padding:10px 12px;font-size:16.5px;line-height:1.28;display:flex}.failure-survivors b{background:var(--green);width:27px;height:27px;color:var(--white);font:760 13px var(--font-geist-mono), monospace;border-radius:50%;flex:none;place-items:center;margin-right:9px;display:grid}.authority-flow{flex:1;grid-template-columns:minmax(0,1fr) 38px minmax(0,1fr) 38px minmax(0,1fr);gap:9px;min-height:0;display:grid}.authority-flow>article{border:1px solid var(--line-dark);background:var(--white);grid-template-rows:auto 1fr;min-width:0;display:grid}.authority-flow article>header{border-bottom:1px solid var(--line);background:var(--navy);color:var(--white);justify-content:space-between;align-items:center;gap:12px;padding:10px 12px;display:flex}.authority-flow article>header span{font:760 15.5px/1.2 var(--font-geist-mono), monospace}.authority-flow article>header b{color:#f1bf7c;font:760 13.5px/1.2 var(--font-geist-mono), monospace;text-align:right}.authority-flow .authority-reference>header{background:#a94d25}.authority-flow .authority-source>header{background:var(--green)}.authority-flow .authority-candidate>header{background:var(--blue)}.authority-content{grid-template-rows:repeat(2,minmax(0,1fr));display:grid}.authority-content section{border-bottom:1px solid var(--line);padding:14px 16px}.authority-content section:last-child{border-bottom:0}.authority-content strong{color:var(--navy);font-size:20px}.authority-content p{color:var(--muted);margin:7px 0 0;font-size:clamp(17.5px,1.2vw,19px);line-height:1.36}.authority-content .authority-forbidden{background:#f8ecea}.authority-content .authority-forbidden strong{color:var(--red)}.authority-join,.authority-arrow{color:var(--navy);font:800 28px var(--font-geist-mono), monospace;text-align:center;align-self:center}.authority-matrix{border:1px solid var(--line-dark);background:var(--white);margin-top:10px}.authority-matrix>div{border-top:1px solid var(--line);grid-template-columns:1.05fr 2.4fr .8fr;display:grid}.authority-matrix>div:first-child{border-top:0}.authority-matrix>div>*{border-right:1px solid var(--line);padding:7px 10px;font-size:16px;line-height:1.24}.authority-matrix>div>:last-child{border-right:0}.authority-matrix b{color:var(--navy)}.authority-matrix span{color:var(--muted)}.authority-matrix strong{color:var(--red);font:760 14px/1.24 var(--font-geist-mono), monospace}.authority-matrix>div:first-child strong{color:var(--green)}.action-reference-pipeline,.source-condition-pipeline{grid-template-columns:minmax(0,.9fr) 24px minmax(0,1.22fr) 24px minmax(0,1fr) 24px minmax(0,1fr) 24px minmax(0,.9fr);align-items:stretch;gap:7px;display:grid}.action-reference-pipeline article,.source-condition-pipeline article{border:1px solid var(--line-dark);border-top:5px solid var(--blue);background:var(--white);flex-direction:column;min-width:0;min-height:155px;padding:13px 14px;display:flex}.action-reference-pipeline article:nth-of-type(4){border-top-color:#6d55a3}.action-reference-pipeline .action-reference-output{background:#fff5ee;border-top-color:#d86b31}.action-reference-pipeline article>span,.source-condition-pipeline article>span,.source-objective-layout article>span,.source-objective-definition header>span,.train-infer-split header>span,.evidence-summary header>span,.causal-test-layout header>span{color:var(--blue);font:760 12.5px/1.2 var(--font-geist-mono), monospace;letter-spacing:.04em}.action-reference-pipeline strong,.source-condition-pipeline strong{color:var(--navy);margin-top:15px;font-size:17px;line-height:1.2}.action-reference-pipeline p,.source-condition-pipeline p{color:var(--muted);margin:8px 0 0;font-size:14px;line-height:1.32}.action-reference-pipeline code,.source-condition-pipeline code{border-top:1px solid var(--line);color:#3d5267;font:690 12.5px/1.25 var(--font-geist-mono), monospace;margin-top:auto;padding-top:9px}.action-reference-pipeline>i,.source-condition-pipeline>i{color:var(--navy);font:800 22px var(--font-geist-mono), monospace;text-align:center;align-self:center;font-style:normal}.same-video-controls{border:1px solid var(--line-dark);background:var(--white);flex:1;grid-template-rows:auto repeat(4,minmax(0,1fr));min-height:0;margin-top:11px;display:grid}.same-video-controls>div{grid-template-columns:.78fr 1fr 1.5fr 1.35fr;display:grid}.same-video-controls>div:not(.same-video-head){border-top:1px solid var(--line)}.same-video-controls>div>*{border-right:1px solid var(--line);align-items:center;padding:8px 11px;font-size:13.5px;line-height:1.25;display:flex}.same-video-controls>div>:last-child{border-right:0}.same-video-controls .same-video-head{background:var(--navy);color:var(--white)}.same-video-head span{font:760 12px/1.2 var(--font-geist-mono), monospace}.same-video-controls b{color:var(--navy)}.same-video-controls span{color:var(--muted)}.method-warning,.method-finding{border-left:5px solid var(--red);background:#f7ecea;grid-template-columns:auto 1fr;align-items:center;gap:12px;margin-top:10px;padding:10px 13px;display:grid}.method-warning b,.method-finding b{color:var(--red);font-size:15px}.method-warning span,.method-finding span{color:#604744;font-size:14.5px;line-height:1.3}.source-condition-pipeline{grid-template-columns:minmax(0,.75fr) 24px minmax(0,1fr) 24px minmax(0,.85fr) 24px minmax(0,.8fr) 24px minmax(0,1.25fr)}.source-condition-pipeline article{border-top-color:var(--green);min-height:125px}.source-condition-pipeline .source-condition-output{background:#edf6f1}.source-condition-pipeline article>span{color:var(--green)}.source-objective-layout{flex:1;grid-template-columns:1.05fr 1.35fr 1.15fr;gap:10px;min-height:0;margin-top:11px;display:grid}.source-objective-layout>article{border:1px solid var(--line-dark);background:var(--white);min-width:0;padding:14px 15px}.source-objective-definition header{justify-content:space-between;align-items:center;gap:10px;display:flex}.source-objective-definition header>span,.source-loss-formula>span,.source-gradient-rule>span{color:var(--green)}.source-objective-definition header b{color:var(--navy);font:760 20px var(--font-geist-mono), monospace}.source-phase-row{grid-template-columns:repeat(4,minmax(0,1fr));gap:5px;margin-top:18px;display:grid}.source-phase-row span{color:var(--green);font:690 12.5px var(--font-geist-mono), monospace;text-align:center;background:#edf6f1;border:1px solid #87aa9a;padding:9px 6px}.source-objective-layout p{color:var(--muted);margin:14px 0 0;font-size:14.5px;line-height:1.36}.source-loss-formula code{color:var(--navy);font:720 15px/1.45 var(--font-geist-mono), monospace;background:#edf6f1;border:1px solid #87aa9a;margin-top:22px;padding:16px;display:block}.source-gradient-rule ol{color:var(--ink);margin:17px 0 0;padding-left:22px;font-size:14.5px;line-height:1.4}.source-gradient-rule li+li{margin-top:8px}.method-finding{border-left-color:var(--green);background:#edf6f1}.method-finding b{color:var(--green)}.method-finding span{color:#294f40}.branch-constants{border:1px solid var(--line-dark);background:var(--white);flex-wrap:wrap;align-items:center;gap:6px;padding:9px 11px;display:flex}.branch-constants b{color:var(--navy);font:760 12.5px var(--font-geist-mono), monospace;margin-right:auto}.branch-constants span{color:#334c64;background:#edf3f8;border:1px solid #aec2d5;padding:5px 8px;font-size:13px}.branch-table{border:1px solid var(--line-dark);background:var(--white);margin-top:9px}.branch-table>div{grid-template-columns:.65fr 1.15fr 2.6fr .55fr;display:grid}.branch-table>div:not(.branch-head){border-top:1px solid var(--line)}.branch-table>div>*{border-right:1px solid var(--line);padding:9px 11px;font-size:14px;line-height:1.27}.branch-table>div>:last-child{border-right:0}.branch-head{background:var(--navy);color:var(--white)}.branch-head span{font:760 12.5px var(--font-geist-mono), monospace}.branch-table b{color:var(--navy)}.branch-table span{color:var(--muted)}.branch-table strong{color:var(--red);font:800 13px var(--font-geist-mono), monospace}.branch-table .branch-correct{background:#edf6f1}.branch-table .branch-correct strong{color:var(--green)}.train-infer-split{flex:1;grid-template-columns:repeat(2,minmax(0,1fr));gap:10px;min-height:0;margin-top:10px;display:grid}.train-infer-split article{border:1px solid var(--line-dark);background:var(--white);border-top:5px solid #d14677;padding:14px 16px}.train-infer-split article:last-child{border-top-color:var(--blue)}.train-infer-split header{justify-content:space-between;gap:12px;display:flex}.train-infer-split header>span{color:#ad2859}.train-infer-split article:last-child header>span{color:var(--blue)}.train-infer-split header b{color:var(--navy);font-size:17px}.train-infer-split ol{color:var(--ink);margin:13px 0 0;padding-left:23px;font-size:14.5px;line-height:1.37}.train-infer-split li+li{margin-top:7px}.evidence-summary{grid-template-columns:1.65fr .85fr;gap:10px;display:grid}.evidence-summary article{border:1px solid var(--line-dark);background:var(--white);padding:13px 15px}.evidence-summary .evidence-positive{border-top:5px solid var(--green)}.evidence-summary .evidence-scope{border-top:5px solid var(--blue)}.evidence-summary header{justify-content:space-between;gap:12px;display:flex}.evidence-summary header>span{color:var(--green)}.evidence-summary .evidence-scope header>span{color:var(--blue)}.evidence-summary header b{color:var(--navy);font-size:17px}.evidence-positive ul{color:var(--ink);margin:11px 0 0;padding-left:22px;font-size:14.5px;line-height:1.32}.evidence-positive li+li{margin-top:5px}.evidence-scope dl{margin:11px 0 0}.evidence-scope dl>div{border-top:1px solid var(--line);grid-template-columns:1fr 1fr;gap:8px;padding:7px 0;display:grid}.evidence-scope dt{color:var(--muted);font-size:13.5px}.evidence-scope dd{color:var(--navy);text-align:right;margin:0;font-size:14px;font-weight:700}.open-gates-table{border:1px solid var(--line-dark);background:var(--white);flex:1;grid-template-rows:auto repeat(6,minmax(0,1fr));min-height:0;margin-top:10px;display:grid}.open-gates-table>div{grid-template-columns:1fr 3fr .55fr;display:grid}.open-gates-table>div:not(.open-gates-head){border-top:1px solid var(--line)}.open-gates-table>div>*{border-right:1px solid var(--line);align-items:center;padding:8px 11px;font-size:13.5px;line-height:1.25;display:flex}.open-gates-table>div>:last-child{border-right:0}.open-gates-head{background:var(--navy);color:var(--white)}.open-gates-head span{font:760 12px var(--font-geist-mono), monospace}.open-gates-table b{color:var(--navy)}.open-gates-table span{color:var(--muted)}.open-gates-table strong{color:var(--red);font:800 12px var(--font-geist-mono), monospace}.causal-test-variable{background:#ffffff14;border:1px solid #ffffff52;grid-template-columns:auto 1fr auto;align-items:center;gap:16px;padding:11px 14px;display:grid}.causal-test-variable>span{color:#f1bf7c;font:760 13px var(--font-geist-mono), monospace}.causal-test-variable>b{color:var(--white);font-size:19px}.causal-test-variable>div{align-items:center;gap:12px;display:flex}.causal-test-variable strong{color:#d8e4ed;min-width:54px;font:800 17px var(--font-geist-mono), monospace;text-align:center;border:1px solid #ffffff61;padding:7px 10px}.causal-test-variable strong:last-child{color:#a9d1bd;border-color:#86b89f}.causal-test-variable i{color:#f1bf7c;font-style:normal}.causal-test-layout{flex:1;grid-template-columns:1.22fr 1.05fr 1fr;gap:10px;min-height:0;margin-top:10px;display:grid}.causal-test-layout article{background:#ffffff12;border:1px solid #ffffff4d;border-top:5px solid #f1bf7c;padding:14px 16px}.causal-test-layout .causal-arms{border-top-color:#9dc7b1}.causal-test-layout .causal-decision{border-top-color:#8eb4d2}.causal-test-layout header{justify-content:space-between;gap:10px;display:flex}.causal-test-layout header>span{color:#f1bf7c}.causal-test-layout .causal-arms header>span{color:#a9d1bd}.causal-test-layout .causal-decision header>span{color:#abd0ea}.causal-test-layout header b{color:var(--white);text-align:right;font-size:17px}.causal-test-layout ol,.causal-test-layout ul{color:#d7e1e9;margin:14px 0 0;padding-left:22px;font-size:14.5px;line-height:1.38}.causal-test-layout li+li{margin-top:7px}.causal-arms>div{border:1px solid #ffffff40;grid-template-columns:55px 1fr;align-items:start;gap:11px;margin-top:13px;padding:12px;display:grid}.causal-arms>div>strong{color:#f1bf7c;font:800 17px var(--font-geist-mono), monospace}.causal-arms>div:last-child>strong{color:#a9d1bd}.causal-arms p{color:#d7e1e9;margin:0;font-size:14px;line-height:1.35}.causal-outcome{grid-template-columns:repeat(2,minmax(0,1fr));gap:9px;margin-top:10px;display:grid}.causal-outcome p{color:#d7e1e9;border:1px solid #ffffff45;margin:0;padding:10px 13px;font-size:14px;line-height:1.3}.causal-outcome b{color:#f1bf7c}.latent-system-map{flex:1;grid-template-rows:minmax(138px,.78fr) minmax(230px,1.35fr) minmax(175px,1fr);gap:9px;min-height:0;display:grid}#latent-method .slide-heading{margin-bottom:12px;padding-bottom:10px}#latent-method .subtitle{font-size:17px}.generated-latent-method-figure{flex:1;place-items:center;min-height:0;margin:0;display:grid}.generated-latent-method-frame{place-items:center;width:100%;height:100%;min-height:0;display:grid}.generated-latent-method-frame img{object-fit:contain;object-position:center;width:auto;max-width:100%;height:auto;max-height:100%;display:block}.method-overview-figure{flex:1;place-items:center;min-height:0;margin:0;display:grid}.method-overview-frame{place-items:center;width:100%;height:100%;min-height:0;display:grid}.method-overview-frame img{object-fit:contain;object-position:center;width:auto;max-width:100%;height:auto;max-height:100%;display:block}.method-overview-rule{border:1px solid var(--line-dark);border-top:5px solid var(--navy);background:var(--white);grid-template-columns:repeat(3,minmax(0,1fr));margin-top:8px;display:grid}.method-overview-rule span{border-right:1px solid var(--line);color:#32475a;padding:11px 16px;font-size:17px;line-height:1.28}.method-overview-rule span:last-child{border-right:0}.method-overview-rule b{color:var(--navy);font:800 16px var(--font-geist-mono), monospace;margin-right:8px}.method-overview-rule span:nth-child(2) b{color:#c62f6b}.method-overview-rule span:nth-child(3) b{color:var(--red)}.latent-glyph{grid-template-columns:auto minmax(0,1fr);align-items:center;gap:11px;min-width:0;display:grid}.latent-glyph>div{background:#e8f2fc;border:2px solid #3274bc;grid-template-rows:repeat(3,1fr);grid-template-columns:repeat(4,1fr);gap:3px;width:96px;height:62px;padding:7px;display:grid;transform:skewY(-3deg)}.latent-glyph>div i{background:#b9d7f3;border:1px solid #5f91c5}.latent-glyph>span{color:var(--navy);font-size:17px;font-weight:760;line-height:1.16}.latent-glyph-green>div{border-color:var(--green);background:#e4f2eb}.latent-glyph-green>div i{background:#afd6c3;border-color:#679982}.latent-glyph-orange>div{background:#fff1e7;border-color:#c65a24}.latent-glyph-orange>div i{background:#f3c3a9;border-color:#d9845d}.latent-glyph-compact>div{gap:2px;width:72px;height:46px;padding:5px}.latent-glyph-compact>span{font-size:16.5px}.action-target-route{background:var(--navy);min-height:64px;color:var(--white);grid-template-columns:1fr 42px .9fr 42px 1.25fr;align-items:center;padding:10px 18px;display:grid}.action-target-route>span{color:#f2bd80;font:800 18px var(--font-geist-mono), monospace;letter-spacing:.055em}.action-target-route>b{text-align:center;font-size:19px}.action-target-route>strong{color:#fff1dd;text-align:center;font-size:23px}.action-target-route em{color:#f1bc77;font:800 24px var(--font-geist-mono), monospace}.action-target-route>i{color:#f1bc77;font:800 28px var(--font-geist-mono), monospace;text-align:center;font-style:normal}.action-contrast-map{border:1px solid var(--line-dark);background:var(--white);flex:1;grid-template-columns:205px minmax(0,1fr);min-height:0;margin-top:10px;display:grid}.action-contrast-map>aside{border-right:1px solid var(--line-dark);background:#e9eef3;flex-direction:column;justify-content:center;gap:8px;padding:17px;display:flex}.action-contrast-map>aside b{color:var(--navy);font:800 16px/1.25 var(--font-geist-mono), monospace;margin-bottom:5px}.action-contrast-map>aside span{border-left:4px solid var(--blue);background:var(--white);color:#31485e;padding:7px 10px;font-size:17px;font-weight:650}.action-branch-lanes{grid-template-rows:repeat(3,minmax(0,1fr));min-width:0;display:grid}.action-branch-lanes>article{border-bottom:1px solid var(--line);grid-template-columns:190px minmax(0,1fr);align-items:center;gap:14px;min-width:0;padding:9px 12px;display:grid}.action-branch-lanes>article:last-child{border-bottom:0}.action-branch-lanes>article:first-child{background:#fff5ec}.action-branch-lanes header{min-width:0}.action-branch-lanes header b{color:var(--navy);font:800 16.5px/1.2 var(--font-geist-mono), monospace;display:block}.action-branch-lanes>article:first-child header b{color:#bd4f1f}.action-branch-lanes header span{color:var(--muted);margin-top:5px;font-size:16.5px;display:block}.action-branch-lanes article>div{grid-template-columns:minmax(120px,.8fr) 22px minmax(150px,1fr) 22px minmax(105px,.8fr) 22px minmax(95px,.6fr);align-items:center;gap:6px;min-width:0;display:grid}.action-branch-lanes article>div>strong,.action-branch-lanes article>div>span{color:var(--navy);text-align:center;font-size:17px;line-height:1.18}.action-branch-lanes article>div>strong{background:#edf3f8;border:1px solid #7896b3;padding:10px}.action-branch-lanes article>div>span{border:1px solid var(--line);background:var(--paper);padding:9px}.action-branch-lanes article>div>i{color:var(--blue);font:800 23px var(--font-geist-mono), monospace;text-align:center;font-style:normal}.action-branch-lanes article>div>em{color:var(--navy);font:800 19px var(--font-geist-mono), monospace;text-align:center;font-style:normal}.action-branch-positive article>div>em,.action-branch-positive>div>em{color:#bd4f1f}.action-loss-equation{border:2px solid var(--navy);background:#f7f9fb;grid-template-columns:112px 24px minmax(120px,.52fr) 24px minmax(260px,1.12fr) 24px minmax(280px,1.16fr);align-items:center;gap:8px;margin-top:10px;padding:13px 17px;display:grid}.action-loss-equation>strong{color:var(--navy);font:800 25px var(--font-geist-mono), monospace}.action-loss-equation>span{color:var(--navy);font:800 25px var(--font-geist-mono), monospace;text-align:center}.action-loss-equation>div{text-align:center;min-width:0}.action-loss-equation code{color:#183f6b;font:760 20px/1.2 var(--font-geist-mono), monospace;white-space:nowrap;display:block}.action-loss-equation>div:first-of-type code{color:#bd4f1f;font-size:24px}.action-loss-equation small{color:var(--muted);margin-top:6px;font-size:16px;line-height:1.2;display:block}.objective-ruleline{color:#5f3a28;background:#fff1e5;border-left:7px solid #c55b25;grid-template-columns:auto 1fr;align-items:center;gap:16px;margin-top:8px;padding:10px 16px;font-size:18px;line-height:1.28;display:grid}.objective-ruleline b{color:#a9441b;font-size:20px}.source-latent-comparison{flex:1;grid-template-columns:minmax(300px,.95fr) 36px minmax(245px,.72fr) 36px minmax(430px,1.35fr);align-items:stretch;gap:10px;min-height:0;display:grid}.source-aligned-pair,.source-pooling-stage,.source-comparison-terms{border:1px solid var(--line-dark);background:var(--white)}.source-aligned-pair{grid-template-columns:1fr;align-content:center;gap:13px;padding:18px;display:grid}.source-aligned-pair header{border-bottom:2px solid var(--green);padding-bottom:11px}.source-aligned-pair header b{color:var(--green);font:800 18px var(--font-geist-mono), monospace;display:block}.source-aligned-pair header span{color:var(--muted);margin-top:5px;font-size:17px;display:block}.source-aligned-pair>i{color:var(--green);font:800 30px var(--font-geist-mono), monospace;text-align:center;font-style:normal}.source-flow-arrow{color:var(--green);font:800 31px var(--font-geist-mono), monospace;text-align:center;align-self:center;font-style:normal}.source-pooling-stage{text-align:center;flex-direction:column;justify-content:center;align-items:center;padding:20px;display:flex}.source-pooling-stage>b{color:var(--navy);font:800 18px var(--font-geist-mono), monospace}.source-pooling-stage>div{border:2px solid var(--green);background:#e7f2ec;grid-template-columns:repeat(3,1fr);gap:6px;width:142px;height:142px;margin:17px auto;padding:9px;display:grid}.source-pooling-stage>div span{background:#acd2bf;border:1px solid #689a82}.source-pooling-stage p{color:#405466;margin:0;font-size:17px;font-weight:630;line-height:1.35}.source-comparison-terms{grid-template-rows:repeat(3,minmax(0,1fr));display:grid}.source-comparison-terms article{border-bottom:1px solid var(--line);grid-template-rows:auto auto;grid-template-columns:145px 1fr;align-content:center;gap:5px 15px;padding:14px 17px;display:grid}.source-comparison-terms article:last-child{border-bottom:0}.source-comparison-terms b{color:var(--green);font:800 16.5px/1.2 var(--font-geist-mono), monospace;grid-row:1/span 2;align-self:center}.source-comparison-terms strong{color:var(--navy);font:760 21px var(--font-geist-mono), monospace}.source-comparison-terms span{color:var(--muted);font-size:17px}.source-loss-equation{border:2px solid var(--green);text-align:center;background:#e7f2ec;grid-template-columns:auto 32px 1fr 32px 1fr 32px 1fr;align-items:center;gap:10px;margin-top:12px;padding:18px 22px;display:grid}.source-loss-equation strong,.source-loss-equation span,.source-loss-equation code{color:#245742;font:800 24px var(--font-geist-mono), monospace}.source-loss-equation code{background:#ffffffc7;padding:10px}.source-loss-meaning{border:1px solid var(--line-dark);background:var(--white);grid-template-columns:repeat(3,minmax(0,1fr));margin-top:10px;display:grid}.source-loss-meaning article{border-right:1px solid var(--line);padding:12px 15px}.source-loss-meaning article:last-child{border-right:0}.source-loss-meaning b{color:var(--green);font:800 16px var(--font-geist-mono), monospace;display:block}.source-loss-meaning span{color:#34495c;margin-top:5px;font-size:17px;line-height:1.28;display:block}.source-loss-meaning .source-target-exclusion{background:#f7e9e7}.source-loss-meaning .source-target-exclusion b{color:var(--red)}.objective-authority-row{grid-template-columns:repeat(3,minmax(0,1fr));gap:12px;display:grid}.objective-authority-row article{border:1px solid var(--line-dark);background:var(--white);border-top:7px solid #c55b25;min-height:190px;padding:18px 20px}.objective-authority-row .objective-temporal-rule{border-top-color:var(--blue)}.objective-authority-row .objective-source-rule{border-top-color:var(--green)}.objective-authority-row header{justify-content:space-between;align-items:baseline;gap:14px;display:flex}.objective-authority-row header span{color:var(--red);font:800 16px var(--font-geist-mono), monospace}.objective-authority-row .objective-temporal-rule header span{color:var(--blue)}.objective-authority-row .objective-source-rule header span{color:var(--green)}.objective-authority-row header b{color:var(--navy);font-size:21px}.objective-authority-row article>strong{color:var(--navy);font:760 22px/1.25 var(--font-geist-mono), monospace;margin-top:28px;display:block}.objective-authority-row article>p{color:var(--muted);margin:13px 0 0;font-size:18px;line-height:1.35}.gradient-composition-equation{border:2px solid var(--navy);background:var(--white);text-align:center;grid-template-columns:auto 25px minmax(90px,.45fr) 25px minmax(275px,1.25fr) 25px minmax(310px,1.35fr) 34px minmax(145px,.7fr);align-items:center;gap:8px;margin-top:13px;padding:19px;display:grid}.gradient-composition-equation>b{color:var(--navy);font:800 25px var(--font-geist-mono), monospace}.gradient-composition-equation>span,.gradient-composition-equation>i{color:var(--navy);font:800 24px var(--font-geist-mono), monospace;font-style:normal}.gradient-composition-equation code{font:760 17px/1.3 var(--font-geist-mono), monospace;white-space:normal;padding:12px 9px}.gradient-action-term{color:#af451d;background:#fff0e6}.gradient-temporal-term{color:var(--blue);background:#e8f0f8}.gradient-source-term{color:var(--green);background:#e7f2ec}.gradient-composition-equation>strong{color:#aa2556;font:800 17px/1.25 var(--font-geist-mono), monospace;background:#fdebf2;border:2px solid #c62f6b;padding:15px}.conflict-projection-explainer{border-left:7px solid var(--blue);background:#e8f0f7;grid-template-columns:235px minmax(0,1fr);align-items:center;gap:23px;margin-top:12px;padding:12px 19px;display:grid}.conflict-projection-explainer p{color:#344b61;margin:0;font-size:18px;line-height:1.4}.conflict-projection-explainer b{color:var(--navy)}.gradient-vector-sketch{border-bottom:2px solid #8191a0;border-left:2px solid #8191a0;width:210px;height:92px;position:relative}.gradient-vector-sketch span{transform-origin:0;border-radius:5px;height:5px;position:absolute;bottom:24px;left:28px}.gradient-vector-sketch span:after{content:"";border-top:8px solid #0000;border-bottom:8px solid #0000;border-left:12px solid;position:absolute;top:-6px;right:-2px}.gradient-vector-sketch .vector-origin{background:var(--navy);border-radius:50%;width:9px;height:9px}.gradient-vector-sketch .vector-origin:after{display:none}.gradient-vector-sketch .vector-action{color:#c55b25;background:#c55b25;width:145px;transform:rotate(-18deg)}.gradient-vector-sketch .vector-conflict{background:var(--red);width:92px;color:var(--red);transform:rotate(-112deg)}.gradient-vector-sketch .vector-accepted{background:var(--green);width:112px;color:var(--green);transform:rotate(-64deg)}.inference-latent-ribbon{background:var(--navy);color:var(--white);text-align:center;grid-template-columns:auto minmax(260px,1.3fr) 28px minmax(210px,1fr) 28px minmax(110px,.6fr) 28px minmax(100px,.55fr) minmax(250px,1.15fr);align-items:center;gap:8px;margin-top:12px;padding:13px 16px;display:grid}.inference-latent-ribbon>b{color:#f0bc7b;font:800 17px var(--font-geist-mono), monospace}.inference-latent-ribbon>span{font-size:17px;font-weight:650}.inference-latent-ribbon>strong{font-size:19px}.inference-latent-ribbon>i{color:#f0bc7b;font:800 22px var(--font-geist-mono), monospace;font-style:normal}.inference-latent-ribbon>em{color:#b9d6c8;font:800 15.5px/1.25 var(--font-geist-mono), monospace;border:1px solid #ffffff73;padding:9px;font-style:normal}.evidence-causal-chain{flex:1;grid-template-columns:minmax(0,1fr) 38px minmax(0,1fr) 38px minmax(0,1fr);align-items:stretch;gap:8px;min-height:0;display:grid}.evidence-causal-chain>i{color:var(--navy);font:800 34px var(--font-geist-mono), monospace;text-align:center;align-self:center;font-style:normal}.evidence-causal-chain article{border:1px solid var(--line-dark);border-top:8px solid var(--green);background:var(--white);flex-direction:column;padding:21px;display:flex}.evidence-causal-chain .evidence-replication{border-top-color:var(--red);background:#f8ecea}.evidence-causal-chain .evidence-determinism{border-top-color:var(--amber);background:#f8f2e7}.evidence-causal-chain header span{color:var(--green);font:800 16px var(--font-geist-mono), monospace}.evidence-causal-chain .evidence-replication header span{color:var(--red)}.evidence-causal-chain .evidence-determinism header span{color:var(--amber)}.evidence-causal-chain header b{color:var(--navy);margin-top:10px;font-size:25px;line-height:1.16;display:block}.evidence-causal-chain ul{color:#374b5d;margin:25px 0 20px;padding-left:23px;font-size:18px;line-height:1.42}.evidence-causal-chain li+li{margin-top:10px}.evidence-causal-chain article>strong{color:var(--green);font:800 18px/1.25 var(--font-geist-mono), monospace;text-align:center;border-top:2px solid;margin-top:auto;padding:13px}.evidence-causal-chain .evidence-replication>strong{color:var(--red)}.evidence-causal-chain .evidence-determinism>strong{color:var(--amber)}.evidence-final-verdict{border:2px solid var(--navy);background:var(--white);grid-template-columns:1.25fr 1fr 1fr;margin-top:13px;display:grid}.evidence-final-verdict>strong{background:var(--navy);color:var(--white);align-items:center;padding:19px 22px;font-size:27px;line-height:1.16;display:flex}.evidence-final-verdict article{border-right:1px solid var(--line);padding:16px 18px}.evidence-final-verdict article:last-child{background:#f7e9e7;border-right:0}.evidence-final-verdict b{color:var(--green);font:800 17px var(--font-geist-mono), monospace;display:block}.evidence-final-verdict article:last-child b{color:var(--red)}.evidence-final-verdict span{color:#354a5d;margin-top:7px;font-size:17px;line-height:1.33;display:block}.system-path{border:1px solid var(--line);background:#ffffffdb;align-items:stretch;gap:9px;min-width:0;padding:9px;display:grid}.system-action-path{border-left:6px solid #d86b31;grid-template-columns:148px minmax(155px,.85fr) 25px minmax(255px,1.45fr) 25px minmax(230px,1.18fr)}.system-render-path{border-left:6px solid var(--blue);grid-template-columns:148px minmax(260px,1.2fr) 25px minmax(400px,2.2fr) 25px minmax(175px,.82fr)}.system-objective-path{border-left:6px solid var(--green);grid-template-columns:148px minmax(480px,2.7fr) 25px minmax(285px,1.35fr) 25px minmax(180px,.85fr)}.system-path-label{border-right:1px solid var(--line);grid-template-rows:auto 1fr;grid-template-columns:34px 1fr;align-items:start;column-gap:9px;padding:10px 11px;display:grid}.system-path-label>b{background:var(--navy);width:32px;height:32px;color:var(--white);font:800 16px var(--font-geist-mono), monospace;border-radius:50%;grid-row:1/span 2;place-items:center;display:grid}.system-action-path .system-path-label>b{background:#c75d28}.system-objective-path .system-path-label>b{background:var(--green)}.system-path-label>span{color:var(--navy);font:780 14px/1.15 var(--font-geist-mono), monospace;letter-spacing:.04em}.system-path-label>small{color:var(--muted);align-self:end;font-size:13px;line-height:1.25}.system-node,.gradient-composition{border:1px solid var(--line-dark);background:var(--white);border-radius:5px;flex-direction:column;justify-content:center;min-width:0;padding:11px 13px;display:flex}.system-node>strong,.gradient-composition>strong{color:var(--navy);font-size:17px;line-height:1.18}.system-node>span,.gradient-composition>span{color:var(--muted);margin-top:5px;font-size:13.5px;line-height:1.28}.reference-video{background:#fff6ef;border-color:#d86b31}.frozen-readers{background:#f2f6fa;border-color:#7997b6}.frozen-readers>div{grid-template-columns:repeat(3,minmax(0,1fr));gap:5px;margin-top:8px;display:grid}.frozen-readers>div span{background:var(--white);color:#334b63;border:1px solid #b8c8d8;padding:6px;font-size:12.5px;line-height:1.2}.detached-condition{background:#fff9f5;border:2px dashed #d86b31}.detached-condition code{color:#b74f1f;font:760 15px var(--font-geist-mono), monospace;margin-top:7px}.system-arrow{color:var(--navy);font:800 25px var(--font-geist-mono), monospace;text-align:center;align-self:center;font-style:normal}.renderer-inputs{grid-template-columns:repeat(2,minmax(0,1fr));gap:6px;display:grid}.renderer-inputs article{background:#edf6f1;border:1px solid #86aa9b;padding:8px 9px}.renderer-inputs article:nth-child(3){background:#f3f0f8;border-color:#9884c6}.renderer-inputs article:nth-child(4){background:#edf3fa;border-color:#7797bf}.renderer-inputs strong{color:var(--navy);font-size:14px;line-height:1.16;display:block}.renderer-inputs span{color:var(--muted);margin-top:4px;font-size:12.5px;line-height:1.22;display:block}.bernini-latent-core{border:2px solid var(--blue);background:#edf4fa;border-radius:7px;min-width:0;padding:9px 11px}.bernini-latent-core>header{justify-content:space-between;gap:12px;display:flex}.bernini-latent-core>header strong{color:var(--navy);font-size:18px}.bernini-latent-core>header span{color:var(--muted);font-size:12.5px}.latent-token-strip{font:760 12px/1.2 var(--font-geist-mono), monospace;border:1px solid #6688ad;grid-template-columns:42% 58%;margin-top:7px;display:grid;overflow:hidden}.latent-token-strip span{padding:6px 8px}.source-tokens{color:var(--green);background:#cfe8dc}.target-tokens{color:var(--blue);background:#d7e6f6}.dit-blocks{grid-template-columns:1fr auto 1fr auto 1fr auto 1fr;align-items:center;gap:4px;margin-top:7px;display:grid}.dit-blocks span{border:1px solid var(--blue);background:var(--white);color:var(--navy);font:720 12px var(--font-geist-mono), monospace;text-align:center;padding:6px}.dit-blocks i{color:var(--muted);font-style:normal}.adapter-route{background:#fdeef4;border:1px solid #d14677;grid-template-columns:auto 1fr 1fr;align-items:center;gap:7px;margin-top:7px;padding:7px 8px;display:grid}.adapter-route b{color:#ad2859;font:780 12.5px var(--font-geist-mono), monospace}.adapter-route span{color:#71354d;font-size:12.5px;line-height:1.2}.edited-output{border-color:var(--green);background:#eef7f2}.edited-output>b{color:var(--green);border-top:1px solid #9dbdad;margin-top:10px;padding-top:8px;font-size:18px}.objective-stack{grid-template-columns:repeat(3,minmax(0,1fr));gap:6px;display:grid}.objective-stack article{border:1px solid var(--line);background:var(--white);border-top:4px solid #d86b31;min-width:0;padding:9px 10px}.objective-stack .objective-temporal{border-top-color:var(--blue)}.objective-stack .objective-source{border-top-color:var(--green)}.objective-stack strong{color:var(--navy);font-size:14.5px;line-height:1.18;display:block}.objective-stack span{color:var(--muted);margin-top:5px;font-size:12.5px;line-height:1.22;display:block}.objective-stack code{color:#454f59;font:680 11.5px/1.22 var(--font-geist-mono), monospace;margin-top:6px;display:block}.gradient-composition{border-color:var(--green);background:#eef7f2}.gradient-composition>span{border-left:3px solid #86aa9b;padding-left:9px}.update-scope{background:#fdeef4;border-color:#d14677}.update-scope>b{color:#ad2859;margin-top:8px;font-size:16px}.source-moments{grid-template-columns:repeat(4,minmax(0,1fr));gap:16px;display:grid;position:relative}.source-moments:before{content:"";z-index:0;background:var(--green);height:4px;position:absolute;top:50%;left:4%;right:4%}.source-moments article{z-index:1;border:2px solid var(--green);background:var(--white);grid-template-columns:auto 1fr;align-content:center;gap:5px 13px;min-height:120px;padding:17px;display:grid;position:relative}.source-moments b{color:var(--green);font:760 clamp(34px, 3vw, 46px)/1 var(--font-geist-mono), monospace;grid-row:1/span 2;align-self:center}.source-moments span{color:var(--navy);font:750 clamp(16px, 1.2vw, 19px)/1.25 var(--font-geist-mono), monospace}.source-moments small{color:var(--muted);font-size:17px}.preservation-checks{flex:1;grid-template-columns:repeat(3,minmax(0,1fr));gap:16px;margin-top:18px;display:grid}.preservation-checks article{border:1px solid var(--line);background:var(--white);min-height:225px;padding:24px}.preservation-checks b{color:var(--green);font:760 clamp(34px, 3vw, 46px)/1 var(--font-geist-mono), monospace}.preservation-checks h3{color:var(--navy);margin:24px 0 9px;font-size:clamp(22px,1.8vw,28px)}.preservation-checks p{color:var(--muted);margin:0;font-size:clamp(17px,1.25vw,20px);line-height:1.38}.result-hero{border-left:8px solid var(--green);background:#e7f2ec;padding:22px 26px}.result-hero>span{color:var(--green)}.result-hero h3{color:var(--navy);margin:12px 0 6px;font-size:clamp(26px,2.25vw,35px);line-height:1.17}.result-hero p{color:var(--red);margin:0;font-size:clamp(19px,1.45vw,23px);font-weight:700}.result-columns{grid-template-columns:repeat(2,minmax(0,1fr));gap:16px;margin-top:16px;display:grid}.result-columns article{border:1px solid var(--line);border-top:7px solid var(--green);background:var(--white);min-height:225px;padding:20px 24px}.result-columns .result-open{border-top-color:var(--red)}.result-observed>span{color:var(--green)}.result-open>span{color:var(--red)}.result-columns ul{color:var(--ink);margin:16px 0 0;padding-left:24px;font-size:clamp(17px,1.25vw,20px);line-height:1.42}.result-columns li+li{margin-top:7px}.result-media-slot{border:2px dashed var(--line-dark);background:#f4f5f5;margin-top:16px;padding:14px 17px}.result-media-slot>b{color:var(--muted)}.result-media-slot>div{grid-template-columns:repeat(4,minmax(0,1fr));gap:9px;margin-top:10px;display:grid}.result-media-slot span{border:1px solid var(--line);background:var(--white);min-height:48px;color:var(--navy);text-align:center;place-items:center;padding:9px;font-size:17px;font-weight:650;display:grid}.shared-conditions{background:#ffffff12;border:1px solid #ffffff4d;flex-wrap:wrap;align-items:center;gap:10px;padding:15px 18px;display:flex}.shared-conditions>b{color:#f1bf7c;margin-right:auto}.shared-conditions span{color:#e0e8ef;border:1px solid #ffffff47;padding:8px 11px;font-size:16px}.single-variable{grid-template-columns:minmax(0,1fr) auto minmax(0,1fr);align-items:stretch;gap:20px;margin-top:18px;display:grid}.single-variable article{background:#ffffff12;border:1px solid #ffffff47;border-top:8px solid #bd716b;grid-template-columns:1fr auto;align-items:end;gap:15px;min-height:210px;padding:24px 28px;display:grid}.single-variable .objective-on{border-top-color:#76a98f}.single-variable article>span{color:#e1b0ab;grid-column:1/-1;align-self:start}.single-variable .objective-on>span{color:#a9d1bd}.single-variable h3{color:var(--white);margin:0;font-size:clamp(24px,2vw,31px);line-height:1.18}.single-variable article>b{color:#e7aaa4;font:800 clamp(42px, 4vw, 62px)/1 var(--font-geist-mono), monospace}.single-variable .objective-on>b{color:#9fd0b7}.versus{color:#f1bf7c;font:800 18px var(--font-geist-mono), monospace;align-self:center}.decision-question{background:#f1bf7c1c;border-left:7px solid #f1bf7c;margin-top:18px;padding:17px 21px}.decision-question>span{color:#f1bf7c}.decision-question h3{color:var(--white);margin:8px 0 0;font-size:clamp(25px,2.15vw,33px);line-height:1.2}.decision-outcomes{grid-template-columns:repeat(2,minmax(0,1fr));gap:14px;margin-top:15px;display:grid}.decision-outcomes p{color:#d6e1ea;border:1px solid #ffffff3d;margin:0;padding:15px 18px;font-size:clamp(17px,1.25vw,20px);line-height:1.38}.decision-outcomes b{color:#f1bf7c}@media screen and (width<=1000px){.plain-status-grid,.proxy-contrast,.preservation-balance,.drift-story{grid-template-columns:1fr}.proxy-contrast article,.preservation-balance>article,.drift-story article,.plain-status-grid article{min-height:230px}.contrast-word{justify-self:center}.method-legend{grid-template-columns:1fr}.difference-equation{grid-template-columns:1fr auto 1fr}.difference-equation>strong{grid-column:1/-1;justify-self:center}.difference-equation .difference-motion{grid-column:1/-1}.source-moments{grid-template-columns:repeat(2,minmax(0,1fr))}.authority-flow,.source-objective-layout,.evidence-summary,.causal-test-layout{grid-template-columns:1fr}.authority-join,.authority-arrow{transform:rotate(90deg)}.authority-content{grid-template-rows:auto;grid-template-columns:repeat(2,minmax(0,1fr))}.failure-review-table,.same-video-controls,.branch-table,.open-gates-table,.action-reference-pipeline,.source-condition-pipeline,.latent-system-map{overflow-x:auto}.failure-review-head,.failure-review-row{min-width:900px}.same-video-controls>div,.branch-table>div,.open-gates-table>div{min-width:760px}.action-reference-pipeline,.source-condition-pipeline{min-width:1050px}.system-path{min-width:1100px}.method-overview-rule,.source-loss-meaning,.objective-authority-row,.evidence-final-verdict{grid-template-columns:1fr}.method-overview-rule span,.source-loss-meaning article,.evidence-final-verdict article{border-right:0;border-bottom:1px solid var(--line)}.action-target-route{text-align:center;grid-template-columns:1fr;gap:7px}.action-target-route>i{transform:rotate(90deg)}.action-contrast-map{grid-template-columns:1fr}.action-contrast-map>aside{border-right:0;border-bottom:1px solid var(--line-dark);grid-template-columns:repeat(4,1fr);display:grid}.action-contrast-map>aside b{grid-column:1/-1}.action-branch-lanes{overflow-x:auto}.action-branch-lanes>article{min-width:850px}.action-loss-equation,.source-loss-equation,.gradient-composition-equation,.inference-latent-ribbon{text-align:left;grid-template-columns:1fr}.action-loss-equation>span,.source-loss-equation>span,.gradient-composition-equation>span,.gradient-composition-equation>i,.inference-latent-ribbon>i{display:none}.source-latent-comparison{grid-template-columns:1fr}.source-flow-arrow{transform:rotate(90deg)}.conflict-projection-explainer,.evidence-causal-chain{grid-template-columns:1fr}.evidence-causal-chain>i{transform:rotate(90deg)}}@media screen and (width<=700px){.valid-comparison,.preservation-checks,.result-columns,.decision-outcomes,.result-media-slot>div{grid-template-columns:1fr}.confound-row{grid-template-columns:repeat(2,minmax(0,1fr))}.source-moments{grid-template-columns:1fr}.source-moments:before{display:none}.single-variable{grid-template-columns:1fr}.versus{justify-self:center}.method-boundary,.failure-survivors,.train-infer-split,.causal-outcome,.authority-content,.causal-test-variable{grid-template-columns:1fr}.action-contrast-map>aside{grid-template-columns:1fr 1fr}}@media screen and (width>=1001px) and (height<=760px){:is(#failure-ledger,#supervision-boundary,#latent-method,#action-reference,#source-preservation,#training-inference,#current-result,#single-decision) .slide-heading{margin-bottom:12px;padding-bottom:10px}.proxy-contrast article,.plain-status-grid article,.preservation-balance>article,.drift-story article{min-height:255px}.valid-comparison article,.preservation-checks article,.result-columns article{min-height:170px}.latent-method-figure img{height:min(38vh,330px)}.large-rule{padding-block:13px}.failure-review-row>*{padding-block:5px;font-size:16px;line-height:1.24}.failure-review-row>strong{font-size:16.5px}.failure-review-row>b{font-size:14.5px}.authority-content section{padding:11px 14px}.authority-content strong{font-size:18px}.authority-content p{margin-top:5px;font-size:16px;line-height:1.3}.authority-matrix>div>*{padding-block:5px;font-size:14.5px}.authority-matrix strong{font-size:13px}.action-reference-pipeline article{min-height:125px}.source-condition-pipeline article{min-height:105px}.source-objective-layout>article{padding-block:10px}.open-gates-table>div>*{padding-block:5px}.method-overview-rule span{padding-block:7px;font-size:15px}.action-target-route{min-height:52px}.action-branch-lanes>article{padding-block:6px}.action-loss-equation{padding-block:9px}.objective-authority-row article{min-height:150px;padding-block:12px}.objective-authority-row article>strong{margin-top:16px}.gradient-composition-equation{padding-block:10px}.conflict-projection-explainer{margin-top:8px;padding-block:7px}.inference-latent-ribbon{margin-top:8px;padding-block:9px}.evidence-causal-chain article{padding:15px}.evidence-causal-chain ul{margin-block:13px;font-size:16px}.evidence-final-verdict>strong{font-size:22px}}@media print{.plain-status-grid article,.proxy-contrast article,.valid-comparison article,.preservation-balance>article,.drift-story article,.latent-method-figure,.source-moments article,.preservation-checks article,.result-columns article,.single-variable article,.failure-review-row,.authority-flow>article,.action-reference-pipeline article,.source-condition-pipeline article,.source-objective-layout article,.train-infer-split article,.evidence-summary article,.open-gates-table>div,.causal-test-layout article{break-inside:avoid}}*{box-sizing:border-box}html{scroll-behavior:auto;background:var(--paper)}body{background:var(--paper);color:var(--ink);font-family:var(--font-geist-sans), Arial, Helvetica, sans-serif;-webkit-font-smoothing:antialiased;margin:0}button,a{font:inherit;color:inherit}button:focus-visible,a:focus-visible{outline-offset:2px;outline:3px solid #e0a832}.deck{position:relative;overflow-x:clip}.progress{z-index:90;background:#d5dadd;height:3px;position:fixed;top:0;left:0;right:0}.progress span{background:var(--red);height:100%;display:block}.topbar{z-index:80;height:49px;color:var(--navy);background:#fbfaf7f7;border-bottom:1px solid #d5dadd;justify-content:space-between;align-items:center;gap:24px;padding:0 28px;display:flex;position:fixed;top:3px;left:0;right:0}.brand-button,.utility-button{cursor:pointer;background:0 0;border:0}.brand-button{align-items:baseline;gap:10px;padding:0;display:flex}.brand-button strong{letter-spacing:.08em;font-size:13.5px}.brand-button span{color:var(--muted);font-size:13px}.top-actions{align-items:center;gap:8px;display:flex}.page-counter{font:13px var(--font-geist-mono), monospace;color:var(--muted);margin-right:8px}.utility-button{border:1px solid var(--navy);padding:6px 10px;font-size:13px}.results-link{color:inherit;text-decoration:none}.utility-primary{background:var(--navy);color:var(--white)}.slide{background:var(--paper);min-height:100svh;position:relative;overflow:hidden}.slide-paper{background:var(--paper)}.slide-gray{background:var(--paper-alt)}.slide-navy{background:var(--navy);color:var(--white)}.slide-inner{flex-direction:column;width:min(1500px,100%);min-height:100svh;margin:0 auto;padding:72px 5vw 30px;display:flex}.slide-heading{border-bottom:2px solid var(--navy);justify-content:space-between;align-items:flex-start;gap:36px;margin-bottom:22px;padding-bottom:15px;display:flex}.slide-navy .slide-heading{border-bottom-color:#ffffff8c}.slide-heading>div{min-width:0}.section-label{color:var(--red);font:700 12.5px var(--font-geist-mono), monospace;letter-spacing:.14em;margin:0 0 8px}.slide-navy .section-label{color:#f1bf7c}.slide h1,.slide h2{color:var(--navy);letter-spacing:-.035em;margin:0}.slide h1{font-size:clamp(52px,6.7vw,98px);font-weight:720;line-height:.96}.slide h1 em{color:#f1bf7c;font-style:normal;font-weight:440}.slide h2{font-size:clamp(32px,3.25vw,50px);font-weight:700;line-height:1.02}.slide-navy h1,.slide-navy h2{color:var(--white)}.subtitle{max-width:1120px;color:var(--muted);margin:9px 0 0;font-size:18px;line-height:1.42}.slide-navy .subtitle{color:#c9d6e3}.slide-number{color:#abb4bc;font:500 26px var(--font-geist-mono), monospace;flex:none}.slide-navy .slide-number{color:#ffffff73}.slide-content{flex-direction:column;flex:1;min-height:0;display:flex}.paper-link{color:var(--blue);text-underline-offset:2px;text-decoration-color:#1e5a9666}.slide-navy .paper-link{color:#b9dcf5;text-decoration-color:#b9dcf580}.references{border-top:1px solid var(--line);grid-template-columns:105px 1fr;align-items:start;gap:14px;margin-top:auto;padding-top:12px;font-size:9px;line-height:1.35;display:grid}.slide-navy .references{border-color:#ffffff40}.references>span{color:var(--muted);font:700 8px var(--font-geist-mono), monospace;letter-spacing:.08em;text-transform:uppercase}.slide-navy .references>span{color:#b8c6d4}.references>div{flex-wrap:wrap;gap:4px 13px;display:flex}.status{font:700 7px var(--font-geist-mono), monospace;letter-spacing:.06em;text-transform:uppercase;white-space:nowrap;border:1px solid;padding:3px 6px;display:inline-block}.status-open,.status-code{color:var(--green);background:#e7f2ec}.status-partial{color:var(--amber);background:#f5eddc}.status-paper{color:#626a72;background:#eceeef}.status-closed{color:var(--red);background:#f5e8e6}.status-benchmark{color:var(--blue);background:#e3edf6}.cover-grid{flex:1;grid-template-columns:1.25fr .75fr;align-items:center;gap:7vw;display:grid}.cover-thesis{max-width:800px}.lead{color:#d5e0e9;margin:0 0 28px;font-size:clamp(18px,1.6vw,24px);line-height:1.55}.canonical-interface{flex-wrap:wrap;align-items:center;gap:8px;margin-bottom:22px;display:flex}.canonical-interface span,.canonical-interface strong{font:11px var(--font-geist-mono), monospace;border:1px solid #ffffff59;padding:9px 11px}.canonical-interface strong{color:#ffe2aa;border-color:#f1bf7c}.canonical-interface b{color:#aebdcb}.scope-note{color:#c7d4df;border-left:3px solid #f1bf7c;margin:0;padding-left:13px;font-size:16px;line-height:1.48}.cover-agenda{border-top:1px solid #fff6}.cover-agenda>div{border-bottom:1px solid #ffffff40;grid-template-columns:38px 1fr;column-gap:10px;padding:11px 0;display:grid}.cover-agenda span{font:12px var(--font-geist-mono), monospace;color:#f1bf7c;grid-row:1/span 2}.cover-agenda strong{font-size:18px}.cover-agenda small{color:#aebdcb;margin-top:3px;font-size:11px}.equation-panel{border-left:5px solid var(--red);background:var(--white);padding:17px 22px}.equation{color:var(--navy);font:600 clamp(24px, 2.7vw, 40px) var(--font-geist-mono), monospace}.equation-key{color:var(--muted);flex-wrap:wrap;gap:7px 22px;margin-top:10px;font-size:10px;display:flex}.scope-grid{grid-template-columns:repeat(3,1fr);gap:11px;margin-top:18px;display:grid}.scope-grid article{border:1px solid var(--line);background:#ffffffb3;min-height:99px;padding:15px 16px}.scope-grid b{color:var(--navy);font-size:14px}.scope-grid p{color:var(--muted);margin:6px 0 0;font-size:12px;line-height:1.5}.exclusion-note,.academic-note{border-left:3px solid var(--blue);background:var(--blue-soft);color:#33475a;margin-top:15px;padding:10px 13px;font-size:12px;line-height:1.45}.objective-formula{border:1px solid var(--line);background:var(--white);color:var(--navy);font:500 18px var(--font-geist-mono), monospace;text-align:center;margin-bottom:19px;padding:12px 17px}.objective-formula span{color:var(--blue);margin:0 8px}.objective-grid{grid-template-columns:repeat(4,1fr);gap:12px;display:grid}.objective-grid article{border-top:5px solid var(--navy);background:var(--white);min-height:220px;padding:20px}.objective-grid article:nth-child(2){border-color:var(--blue)}.objective-grid article:nth-child(3){border-color:var(--green)}.objective-grid article:nth-child(4){border-color:var(--red)}.objective-grid article>span{color:var(--muted);font:10px var(--font-geist-mono), monospace}.objective-grid h3{color:var(--navy);margin:30px 0 10px;font-size:22px}.objective-grid p{min-height:70px;color:var(--muted);margin:0;font-size:12px;line-height:1.55}.objective-grid small{border-top:1px solid var(--line);color:var(--red);padding-top:11px;font-size:11px;display:block}.timeline-table{border-top:2px solid var(--navy)}.timeline-row{border-bottom:1px solid var(--line);grid-template-columns:80px 1.45fr 1.15fr 1.1fr;gap:0;display:grid}.timeline-row>*{border-right:1px solid var(--line);margin:0;padding:16px 17px;font-size:12px;line-height:1.5}.timeline-row>:last-child{border-right:0}.timeline-row>strong{color:var(--navy);font:700 22px var(--font-geist-mono), monospace}.timeline-head>span{background:var(--navy);color:var(--white);font:700 8px var(--font-geist-mono), monospace;letter-spacing:.08em;text-transform:uppercase;padding-top:9px;padding-bottom:9px}.emphasis-row{background:#eaf0f5}.timeline-thesis{border-left:4px solid var(--red);color:#3e4a56;margin-top:15px;padding:12px 15px;font-size:12px}.architecture-diagram{grid-template-rows:1fr 1fr;grid-template-columns:.8fr 1.2fr 1.2fr 1.6fr .8fr;align-items:stretch;gap:14px;min-height:270px;display:grid;position:relative}.arch-input,.arch-output,.arch-path,.arch-renderer{z-index:2;border:1px solid var(--line);background:var(--white);flex-direction:column;justify-content:center;padding:18px;display:flex;position:relative}.arch-input:first-child{grid-area:2/1}.arch-input:nth-child(2){grid-area:1/1}.arch-path.semantic{border-top:5px solid var(--red);grid-area:1/2}.arch-path.detail{border-top:5px solid var(--green);grid-area:2/2}.arch-renderer{border:2px solid var(--navy);grid-area:1/3/span 2/span 2}.arch-output{background:var(--navy);color:var(--white);grid-area:1/5/span 2}.arch-input span,.arch-output span{font:700 22px var(--font-geist-mono), monospace;color:var(--blue)}.arch-output span{color:#f1bf7c}.arch-input b,.arch-output b{margin-top:5px;font-size:12px}.arch-path small,.arch-renderer small{color:var(--red);font:700 8px var(--font-geist-mono), monospace;letter-spacing:.08em}.arch-path.detail small{color:var(--green)}.arch-path strong,.arch-renderer strong{color:var(--navy);margin:14px 0 8px;font-size:19px}.arch-path p,.arch-renderer p{color:var(--muted);margin:0;font-size:12px;line-height:1.45}.arch-line{z-index:3;background:var(--red);width:19px;height:19px;color:var(--white);font:8px var(--font-geist-mono), monospace;border-radius:50%;place-items:center;font-style:normal;display:grid;position:absolute}.line-a{top:22%;left:17%}.line-b{bottom:22%;left:17%}.line-c{top:22%;left:43%}.line-d{top:47%;right:16%}.design-questions{grid-template-columns:repeat(3,1fr);gap:11px;margin-top:15px;display:grid}.design-questions article{border-left:3px solid var(--blue);background:#e8edf1;padding:12px 15px}.design-questions b{color:var(--navy);font-size:12px}.design-questions p{color:var(--muted);margin:4px 0 0;font-size:11px;line-height:1.45}.table-wrap{border:1px solid var(--line);background:var(--white);overflow:hidden}.academic-table{border-collapse:collapse;table-layout:fixed;width:100%}.academic-table th{background:var(--navy);color:var(--white);text-align:left;font:700 9px var(--font-geist-mono), monospace;letter-spacing:.06em;text-transform:uppercase;padding:9px 11px}.academic-table td{border-right:1px solid var(--line);border-bottom:1px solid var(--line);vertical-align:top;color:#43505c;padding:11px;font-size:11px;line-height:1.45}.academic-table td:last-child,.academic-table th:last-child{border-right:0}.academic-table tbody tr:last-child td{border-bottom:0}.academic-table tbody tr:nth-child(2n){background:#f4f6f7}.academic-table td b{color:var(--navy)}.academic-table td small{color:var(--muted);margin-top:4px;font-size:8px;display:block}.conditioning-table th:first-child{width:19%}.conditioning-table th:nth-child(2){width:20%}.conditioning-table th:nth-child(3){width:18%}.conditioning-table th:nth-child(4){width:20%}.conditioning-table th:nth-child(5){width:23%}.cost-identity{border:1px solid var(--line);background:#e7ecef;grid-template-columns:.8fr 1.2fr .8fr 1.2fr 2fr;align-items:center;gap:8px;margin-top:14px;padding:11px 13px;font-size:11px;display:grid}.cost-identity span{color:var(--muted);font:700 8px var(--font-geist-mono), monospace;text-transform:uppercase}.cost-identity b{color:var(--navy);font:700 12px var(--font-geist-mono), monospace}.cost-identity em{color:var(--muted);text-align:right;font-size:9px;font-style:normal}.unified-grid{grid-template-columns:repeat(3,1fr);gap:14px;display:grid}.unified-grid article{border:1px solid var(--line);border-top:5px solid var(--navy);background:var(--white);flex-direction:column;min-height:310px;padding:19px;display:flex}.unified-grid article:nth-child(2){border-top-color:var(--red)}.unified-grid article:nth-child(3){border-top-color:var(--green)}.class-index{color:var(--muted);font:10px var(--font-geist-mono), monospace}.unified-grid h3{color:var(--navy);margin:22px 0 9px;font-size:20px}.unified-grid p{min-height:65px;color:var(--muted);margin:0;font-size:12px;line-height:1.5}.mini-pipeline{border:1px solid var(--line);color:var(--navy);font:10px var(--font-geist-mono), monospace;text-align:center;background:#eef1f3;margin:16px 0;padding:12px}.unified-grid strong{margin-bottom:14px;font-size:11.5px;line-height:1.5}.unified-grid small{border-top:1px solid var(--line);color:var(--red);margin-top:auto;padding-top:11px;font-size:10.5px;line-height:1.45}.warning-band{border-left:4px solid var(--red);color:#554341;background:#f2e7e5;margin-top:14px;padding:11px 14px;font-size:11.5px;line-height:1.5}.method-focus-grid{gap:15px;display:grid}.method-focus-grid.two{grid-template-columns:1fr 1fr}.method-focus{border:1px solid var(--line);border-top:5px solid var(--navy);background:#ffffffc7;padding:18px 20px}.method-focus:nth-child(2){border-top-color:var(--red)}.method-header{justify-content:space-between;align-items:center;gap:12px;display:flex}.method-header h3{color:var(--navy);margin:0;font-size:24px}.method-focus dl{border-top:1px solid var(--line);grid-template-columns:105px 1fr;margin:16px 0 0;display:grid}.method-focus dt,.method-focus dd{border-bottom:1px solid var(--line);margin:0;padding:8px 0;font-size:11.5px;line-height:1.45}.method-focus dt{color:var(--navy);font-weight:700}.method-focus dd{color:var(--muted)}.method-focus ul{color:var(--muted);margin:15px 0 0;padding-left:17px;font-size:11.5px;line-height:1.5}.method-focus li+li{margin-top:6px}.limitation,.evidence-box{border-left:3px solid var(--red);color:#5d4d4a;background:#f3e9e7;margin:13px 0 0;padding:10px 11px;font-size:10.5px;line-height:1.5}.comparison-strip{border:1px solid var(--line);grid-template-columns:repeat(3,1fr);margin-top:14px;display:grid}.comparison-strip span{border-right:1px solid var(--line);color:var(--muted);padding:11px 13px;font-size:11px;line-height:1.45}.comparison-strip span:last-child{border-right:0}.comparison-strip b{color:var(--navy)}.layer-diagram{grid-template-columns:1.05fr .45fr .45fr .45fr .8fr 1.4fr;align-items:center;gap:5px;margin-top:15px;display:grid}.layer-diagram>*{border:1px solid var(--line);text-align:center;font:9px var(--font-geist-mono), monospace;padding:9px 5px;font-style:normal}.layer-diagram span,.layer-diagram strong{background:var(--navy);color:var(--white)}.layer-diagram i{color:var(--red);border-color:var(--red)}.kiwi-diagram{grid-template-columns:1fr 1fr 1fr .75fr 1.2fr}.architecture-row{border:1px solid var(--line);background:#eef1f3;flex-wrap:wrap;align-items:center;gap:6px;margin:15px 0;padding:12px;display:flex}.architecture-row span,.architecture-row b{text-align:center;font:9px var(--font-geist-mono), monospace;flex:120px;padding:8px}.architecture-row span{background:var(--navy);color:#fff}.architecture-row b{border:1px solid var(--red);color:var(--red)}.parameter-warning{border:1px solid var(--line);color:var(--muted);margin-top:14px;padding:11px 13px;font-size:11px}.bernini-layout{grid-template-columns:1.25fr .75fr;gap:18px;display:grid}.bernini-pipeline{grid-template-columns:1fr auto 1.25fr auto 1.45fr auto 1fr;align-items:stretch;gap:6px;display:grid}.bernini-pipeline>div{border:1px solid var(--line);background:var(--white);flex-direction:column;justify-content:center;min-height:220px;padding:14px;display:flex}.bernini-pipeline>b{color:var(--red);align-self:center}.bernini-pipeline .planner{border-top:5px solid var(--red)}.bernini-pipeline .renderer{border-top:5px solid var(--navy)}.bernini-pipeline small{color:var(--muted);font:7px var(--font-geist-mono), monospace;letter-spacing:.07em}.bernini-pipeline strong{color:var(--navy);margin:13px 0 6px;font-size:12px;line-height:1.35}.bernini-pipeline p{color:var(--muted);margin:0;font-size:10.5px;line-height:1.4}.bernini-evidence{grid-template-columns:1fr 1fr;gap:8px;display:grid}.bernini-evidence article{border:1px solid var(--line);background:var(--white);padding:12px}.bernini-evidence span{color:var(--red);font:7px var(--font-geist-mono), monospace;text-transform:uppercase}.bernini-evidence b{color:var(--navy);margin-top:8px;font-size:12px;display:block}.bernini-evidence p{color:var(--muted);margin:5px 0 0;font-size:10.5px;line-height:1.4}.reasoning-grid{grid-template-columns:1fr 1fr;gap:15px;display:grid}.reasoning-grid>article{border:1px solid var(--line);background:var(--white);padding:18px}.reasoning-grid>article>p{color:var(--muted);font-size:11.5px;line-height:1.5}.depth-stack{border:1px solid var(--line);grid-template-columns:.8fr 1.1fr 1fr;margin:15px 0;display:grid}.depth-stack>*{border-right:1px solid var(--line);border-bottom:1px solid var(--line);padding:11px;font-size:10px;font-style:normal}.depth-stack>:nth-child(3n){border-right:0}.depth-stack>:nth-last-child(-n+3){border-bottom:0}.depth-stack span{background:var(--navy);color:var(--white);font:8px var(--font-geist-mono), monospace;text-transform:uppercase}.depth-stack b{color:var(--navy)}.depth-stack i{color:var(--muted)}.token-roles{grid-template-columns:repeat(4,1fr);gap:5px;margin:15px 0;display:grid}.token-roles span{border:1px solid var(--navy);background:var(--blue-soft);color:var(--navy);text-align:center;font:9px var(--font-geist-mono), monospace;padding:14px 6px}.token-roles span:nth-child(2){border-color:var(--red);background:#f3e9e7}.token-roles span:nth-child(3){border-color:var(--green);background:#e7f2ec}.token-roles span:nth-child(4){border-color:var(--amber);background:#f5eddc}.loom-layout{grid-template-columns:1.05fr .95fr;gap:18px;display:grid}.token-cost{gap:10px;display:grid}.token-cost>div{border:1px solid var(--line);background:var(--white);padding:18px}.token-cost>div.selected{border:2px solid var(--navy)}.token-cost span{color:var(--red);font:700 8px var(--font-geist-mono), monospace;text-transform:uppercase}.token-cost b{color:var(--navy);font:10px var(--font-geist-mono), monospace;text-align:center;background:#edf0f2;margin:22px 0;padding:12px;display:block}.token-cost strong{color:var(--navy);font-size:14px}.loom-facts{grid-template-columns:1fr 1fr;gap:9px;display:grid}.loom-facts article{border:1px solid var(--line);background:var(--white);padding:15px}.loom-facts b{color:var(--navy);font-size:13px}.loom-facts p{color:var(--muted);margin:8px 0 0;font-size:11.5px;line-height:1.45}.control-axis{color:var(--muted);font:8px var(--font-geist-mono), monospace;text-transform:uppercase;grid-template-columns:auto 1fr auto;align-items:center;gap:12px;display:grid}.control-axis i{background:linear-gradient(90deg, #9eabb6, var(--blue), var(--red));height:3px}.control-ladder{grid-template-columns:repeat(5,1fr);gap:9px;margin-top:18px;display:grid}.control-ladder article{border:1px solid var(--line);border-top:4px solid var(--navy);background:var(--white);flex-direction:column;min-height:255px;padding:16px;display:flex}.control-ladder article:nth-child(2){border-top-color:var(--blue)}.control-ladder article:nth-child(3){border-top-color:var(--green)}.control-ladder article:nth-child(4){border-top-color:var(--amber)}.control-ladder article:nth-child(5){border-top-color:var(--red)}.control-ladder article>span{color:var(--muted);font:9px var(--font-geist-mono), monospace}.control-ladder h3{color:var(--navy);margin:27px 0 10px;font-size:17px}.control-ladder p{color:var(--muted);margin:0;font-size:11.5px;line-height:1.5}.control-ladder strong{border-top:1px solid var(--line);margin-top:auto;padding-top:13px;font-size:10px;line-height:1.55}.data-table th:first-child{width:18%}.data-table th:nth-child(2){width:16%}.data-table th:nth-child(3){width:25%}.data-table th:nth-child(4){width:20%}.data-table th:nth-child(5){width:21%}.data-alternatives{grid-template-columns:1fr 1fr;gap:10px;margin-top:12px;display:grid}.data-alternatives article{border-left:4px solid var(--blue);background:var(--white);grid-template-columns:120px 1fr;gap:4px 12px;padding:11px 13px;display:grid}.data-alternatives b{grid-row:1/span 2;font-size:11px}.data-alternatives span{color:var(--ink);font-size:11px}.data-alternatives small{color:var(--muted);font-size:9.5px}.long-system-diagram{border:1px solid var(--line);background:#e9edf0;grid-template-columns:repeat(5,1fr);gap:9px;min-height:125px;padding:15px 15px 50px;display:grid;position:relative}.long-system-diagram>span{background:var(--navy);min-height:55px;color:var(--white);font:9px var(--font-geist-mono), monospace;place-items:center;display:grid}.long-system-diagram>span:nth-child(4){color:var(--navy);border:1px dashed var(--line-dark);background:0 0}.boundary{color:#fff;background:var(--red);font:7px var(--font-geist-mono), monospace;padding:3px 5px;font-style:normal;position:absolute;top:44px}.boundary.b1{left:20%}.boundary.b2{left:40%}.global-anchor,.history-memory{color:var(--navy);font:8px var(--font-geist-mono), monospace;padding:5px 8px;position:absolute;bottom:12px}.global-anchor{border-left:3px solid var(--blue);left:16px}.history-memory{border-left:3px solid var(--red);right:16px}.system-grid{grid-template-columns:repeat(3,1fr);gap:11px;margin-top:13px;display:grid}.system-grid article{border:1px solid var(--line);background:var(--white);padding:15px}.system-grid .method-header h3{font-size:17px}.system-grid p{color:var(--muted);margin:13px 0 0;font-size:11.5px;line-height:1.5}.realtime-table th:first-child{width:17%}.realtime-table th:nth-child(2){width:26%}.realtime-table th:nth-child(3){width:9%}.realtime-table th:nth-child(4){width:21%}.realtime-table th:nth-child(5){width:27%}.latency-stack{border:1px solid var(--line);grid-template-columns:repeat(5,1fr);margin-top:13px;display:grid}.latency-stack>*{border-right:1px solid var(--line);text-align:center;font:8px var(--font-geist-mono), monospace;padding:11px 8px}.latency-stack>:last-child{border-right:0}.latency-stack span{color:var(--muted);background:var(--white)}.latency-stack strong{color:var(--white);background:var(--navy)}.evaluation-grid{grid-template-columns:1.35fr .65fr;gap:17px;display:grid}.benchmark-matrix{border-top:2px solid var(--navy)}.benchmark-row{border-bottom:1px solid var(--line);grid-template-columns:.8fr 1.3fr 1.3fr;display:grid}.benchmark-row>*{border-right:1px solid var(--line);margin:0;padding:12px 13px;font-size:11.5px;line-height:1.4}.benchmark-row>:last-child{border-right:0}.benchmark-head>span{color:var(--white);background:var(--navy);font:700 8px var(--font-geist-mono), monospace;text-transform:uppercase;padding-top:8px;padding-bottom:8px}.benchmark-row b{color:var(--navy)}.benchmark-row span,.benchmark-row p{color:var(--muted)}.protocol-checklist{background:var(--navy);color:var(--white);padding:17px 19px}.protocol-checklist h3{margin:0 0 12px;font-size:18px}.protocol-checklist ol{margin:0;padding-left:20px}.protocol-checklist li{color:#d3dde5;border-top:1px solid #ffffff2e;padding:6px 0;font-size:11px}.synthesis-grid{grid-template-columns:1.15fr .85fr;gap:17px;display:grid}.selection-table{border-top:2px solid #f1bf7c}.selection-row{border-bottom:1px solid #ffffff40;grid-template-columns:.9fr 1.05fr 1.25fr;display:grid}.selection-row>*{border-right:1px solid #ffffff2e;margin:0;padding:11px 12px;font-size:11px;line-height:1.45}.selection-row>:last-child{border-right:0}.selection-row b{color:var(--white)}.selection-row span,.selection-row p{color:#c5d2dd}.selection-head>span{color:#f1bf7c;font:700 8px var(--font-geist-mono), monospace;text-transform:uppercase;background:#ffffff1f}.agenda-list{border:1px solid #ffffff59;padding:17px 19px}.agenda-list h3{color:#f1bf7c;margin:0 0 10px;font-size:18px}.agenda-list ol{counter-reset:agenda;margin:0;padding:0;list-style:none}.agenda-list li{counter-increment:agenda;border-top:1px solid #ffffff2e;padding:8px 0 8px 34px;position:relative}.agenda-list li:before{content:counter(agenda, decimal-leading-zero);color:#f1bf7c;font:8px var(--font-geist-mono), monospace;position:absolute;top:10px;left:0}.agenda-list b,.agenda-list span{display:block}.agenda-list b{font-size:11px}.agenda-list span{color:#bac9d5;margin-top:2px;font-size:10.5px;line-height:1.4}blockquote{color:#d6e0e8;border-left:4px solid #f1bf7c;margin:14px 0 0;padding:12px 15px;font-size:17px;line-height:1.4}.cover-sequence{flex-wrap:wrap;align-items:center;gap:5px;margin:0 0 21px;display:flex}.cover-sequence span{color:#f4f7f9;font:650 8.5px var(--font-geist-mono), monospace;letter-spacing:.035em;text-transform:uppercase;border:1px solid #ffffff5c;padding:7px}.cover-sequence b{color:#f1bf7c;font-size:14px}.program-grid{grid-template-columns:repeat(5,minmax(0,1fr));gap:9px;display:grid}.program-grid article{border:1px solid var(--line);border-top:5px solid var(--navy);background:#ffffffd1;flex-direction:column;min-height:250px;padding:16px 15px;display:flex}.program-grid article:nth-child(2){border-top-color:var(--blue)}.program-grid article:nth-child(3){border-top-color:var(--green)}.program-grid article:nth-child(4){border-top-color:var(--red)}.program-grid article:nth-child(5){border-top-color:var(--amber)}.program-grid article>span,.factory-grid article>span,.protocol-grid article>span,.assumption-grid article>span,.control-clusters article>span,.motion-contrast article>span,.geometry-grid article>span,.shift-grid article>span,.state-grid article>span,.interference-grid article>span{color:var(--red);font:700 8px var(--font-geist-mono), monospace;letter-spacing:.08em;text-transform:uppercase}.program-grid h3{color:var(--navy);margin:25px 0 9px;font-size:17px;line-height:1.2}.program-grid p{color:var(--muted);margin:0;font-size:11.25px;line-height:1.48}.program-grid strong{border-top:1px solid var(--line);color:var(--navy);margin-top:auto;padding-top:12px;font-size:9.5px;line-height:1.45}.coupled-objective{border:1px solid var(--line);color:var(--navy);background:#e6eaed;grid-template-columns:1.2fr repeat(7,auto);align-items:center;gap:8px;margin-top:12px;padding:10px 13px;font-size:10px;display:grid}.coupled-objective b{font-size:11px}.coupled-objective span{background:var(--white);text-align:center;padding:5px 7px}.coupled-objective i{color:var(--red);font-style:normal;font-weight:800}.tuple-table th:first-child{width:20%}.tuple-table th:nth-child(2){width:30%}.tuple-table th:nth-child(3){width:24%}.tuple-table th:nth-child(4){width:26%}.tuple-table code,.control-clusters code{color:var(--navy);font:9.5px var(--font-geist-mono), monospace;background:#e8edf1;padding:2px 4px}.factory-grid{grid-template-columns:repeat(3,minmax(0,1fr));gap:9px;display:grid}.factory-grid article{border:1px solid var(--line);background:#ffffffdb;flex-direction:column;min-height:176px;padding:14px 15px;display:flex}.factory-grid h3{color:var(--navy);margin:8px 0 6px;font-size:15px}.factory-grid p{color:var(--muted);margin:0;font-size:10.5px;line-height:1.42}.factory-grid strong{color:var(--navy);margin-top:auto;padding-top:8px;font-size:9.5px}.factory-grid small{border-top:1px solid var(--line);color:var(--red);margin-top:5px;padding-top:5px;font-size:8.5px;line-height:1.35;display:block}.scale-band{grid-template-columns:repeat(3,minmax(0,1fr));gap:9px;margin-top:12px;display:grid}.scale-band article,.scale-band p{border-left:3px solid var(--blue);background:#e8edf1;min-height:66px;margin:0;padding:11px 13px}.scale-band article{flex-direction:column;justify-content:center;display:flex}.scale-band b{color:var(--navy);font-size:14px;line-height:1.3}.scale-band span,.scale-band p{color:var(--muted);font-size:var(--type-body);line-height:1.44}.scale-band p{border-left-color:var(--red);grid-column:1/-1;align-items:center;min-height:0;display:flex}.metric-strip{border:1px solid var(--line);background:var(--white);grid-template-columns:repeat(5,1fr);margin-top:12px;display:grid}.metric-strip span{border-right:1px solid var(--line);color:var(--navy);font:700 8px var(--font-geist-mono), monospace;text-align:center;text-transform:uppercase;padding:10px 8px}.metric-strip span:last-child{border-right:0}.protocol-grid{grid-template-columns:repeat(4,minmax(0,1fr));gap:10px;display:grid}.protocol-grid article{border:1px solid var(--line);border-top:4px solid var(--navy);background:var(--white);flex-direction:column;min-height:185px;padding:16px;display:flex}.protocol-grid article:nth-child(2){border-top-color:var(--blue)}.protocol-grid article:nth-child(3){border-top-color:var(--green)}.protocol-grid article:nth-child(4){border-top-color:var(--red)}.protocol-grid h3{color:var(--navy);margin:5px 0 11px;font-size:17px}.protocol-grid p{color:var(--muted);margin:0;font-size:11px;line-height:1.5}.protocol-grid small{border-top:1px solid var(--line);color:var(--red);margin-top:auto;padding-top:10px;font-size:9.5px;line-height:1.4}.reporting-checks{border:1px solid var(--line);grid-template-columns:repeat(4,minmax(0,1fr));margin-top:10px;display:grid}.reporting-checks>*{border-right:1px solid var(--line);text-align:center;padding:8px 7px;font-size:8.5px}.reporting-checks>:last-child{border-right:0}.reporting-checks b{background:var(--navy);color:var(--white)}.reporting-checks span{background:var(--white);color:var(--muted)}.family-grid{grid-template-columns:repeat(5,minmax(0,1fr));gap:10px;display:grid}.family-grid article{background:#ffffff0f;border:1px solid #ffffff52;border-top:5px solid #f1bf7c;flex-direction:column;min-height:250px;padding:16px;display:flex}.family-grid article>span{color:#f1bf7c;font:700 8px var(--font-geist-mono), monospace;letter-spacing:.07em}.family-grid h3{color:var(--white);margin:25px 0 12px;font-size:17px;line-height:1.25}.family-grid p{color:#bed4e4;min-height:48px;margin:0;font-size:10px;line-height:1.45}.family-grid small{color:#c7d3dd;border-top:1px solid #fff3;margin-top:auto;padding-top:11px;font-size:9.5px;line-height:1.45}.dark-cards .paper-link{color:#b9dcf5}.slide-thesis{border-left:4px solid var(--red);background:#e8edf1;grid-template-columns:minmax(150px,.3fr) 1fr;align-items:center;gap:14px;margin-top:12px;padding:11px 14px;display:grid}.slide-thesis b{color:var(--navy);font-size:11px}.slide-thesis p{color:var(--muted);margin:0;font-size:10.5px;line-height:1.45}.dark-thesis{background:#ffffff14;border-left-color:#f1bf7c}.dark-thesis b{color:#f1bf7c}.dark-thesis p{color:#c8d5df}.flow-equation{border-left:5px solid var(--red);background:var(--white);grid-template-columns:.75fr 2fr 1.15fr;align-items:center;gap:14px;padding:14px 17px;display:grid}.flow-equation span{color:var(--red);font:700 8px var(--font-geist-mono), monospace;text-transform:uppercase}.flow-equation b{color:var(--navy);font:600 clamp(15px, 1.55vw, 23px) var(--font-geist-mono), monospace;text-align:center}.flow-equation small{color:var(--muted);font-size:8.5px;line-height:1.4}.flow-claims{grid-template-columns:repeat(4,minmax(0,1fr));gap:9px;margin-top:10px;display:grid}.flow-claims article{border:1px solid var(--line);background:#ffffffc7;flex-direction:column;min-height:190px;padding:14px;display:flex}.flow-claims h3{color:var(--navy);margin:0 0 9px;font-size:15px}.flow-claims p{color:var(--muted);margin:0;font-size:10.5px;line-height:1.45}.flow-claims small{border-top:1px solid var(--line);color:var(--red);margin-top:auto;padding-top:9px;font-size:9px;line-height:1.4}.assumption-grid{grid-template-columns:repeat(3,minmax(0,1fr));gap:9px;display:grid}.assumption-grid article{border:1px solid var(--line);background:#ffffffd9;flex-direction:column;min-height:161px;padding:14px 15px;display:flex}.assumption-grid h3{color:var(--navy);margin:0 0 8px;font-size:15px}.assumption-grid p{color:var(--muted);margin:0;font-size:10.5px;line-height:1.42}.assumption-grid b{border-top:1px solid var(--line);color:var(--red);margin-top:auto;padding-top:8px;font-size:9px}.control-clusters,.motion-contrast{grid-template-columns:1fr 1fr;gap:14px;display:grid}.control-clusters article,.motion-contrast article{border:1px solid var(--line);border-top:5px solid var(--blue);background:var(--white);padding:18px}.control-clusters article:nth-child(2),.motion-contrast article:nth-child(2){border-top-color:var(--red)}.control-clusters article>span,.motion-contrast article>span{color:var(--blue)}.control-clusters article:nth-child(2)>span,.motion-contrast article:nth-child(2)>span{color:var(--red)}.control-clusters h3,.motion-contrast h3{color:var(--navy);margin:14px 0 10px;font-size:18px}.control-clusters ul,.motion-contrast ul{color:var(--muted);margin:0;padding-left:17px;font-size:10.75px;line-height:1.45}.control-clusters li+li,.motion-contrast li+li{margin-top:6px}.control-clusters p,.motion-contrast p{color:var(--muted);font-size:11px;line-height:1.48}.control-clusters p{border-top:1px solid var(--line);margin:14px 0 0;padding-top:10px}.motion-contrast p{margin:0 0 13px}.geometry-grid,.shift-grid,.state-grid{grid-template-columns:repeat(4,minmax(0,1fr));gap:10px;display:grid}.geometry-grid article,.shift-grid article,.state-grid article{border:1px solid var(--line);border-top:4px solid var(--navy);background:var(--white);flex-direction:column;min-height:245px;padding:16px;display:flex}.geometry-grid article:nth-child(2),.shift-grid article:nth-child(2),.state-grid article:nth-child(2){border-top-color:var(--blue)}.geometry-grid article:nth-child(3),.shift-grid article:nth-child(3),.state-grid article:nth-child(3){border-top-color:var(--green)}.geometry-grid article:nth-child(4),.shift-grid article:nth-child(4),.state-grid article:nth-child(4){border-top-color:var(--red)}.geometry-grid h3,.shift-grid h3,.state-grid h3{color:var(--navy);margin:22px 0 10px;font-size:17px;line-height:1.25}.geometry-grid p,.shift-grid p,.state-grid p{color:var(--muted);margin:0;font-size:10.75px;line-height:1.48}.geometry-grid small,.shift-grid small,.state-grid small{border-top:1px solid var(--line);color:var(--red);margin-top:auto;padding-top:10px;font-size:9px;line-height:1.4}.dark-table{background:0 0;border-color:#ffffff47}.dark-table .academic-table th{color:var(--navy);background:#f1bf7c}.dark-table .academic-table td{color:#ccd8e1;background:#ffffff0f;border-color:#fff3}.dark-table .academic-table tbody tr:nth-child(2n){background:0 0}.dark-table .academic-table tbody tr:nth-child(2n) td{background:#ffffff1a}.dark-table .academic-table td b{color:var(--white)}.dark-table .academic-table .paper-link{color:#b9dcf5}.semantic-table th:first-child{width:20%}.semantic-table th:nth-child(2){width:17%}.semantic-table th:nth-child(3){width:22%}.semantic-table th:nth-child(4){width:20%}.semantic-table th:nth-child(5){width:21%}.spectrum-caption{border:1px solid var(--line);background:#e8edf1;grid-template-columns:1fr auto 1fr auto 1fr auto 1fr;align-items:center;gap:8px;margin-top:11px;padding:10px 12px;display:grid}.spectrum-caption span{color:var(--navy);font:700 8px var(--font-geist-mono), monospace;text-align:center;text-transform:uppercase}.spectrum-caption i{color:var(--red);font-style:normal;font-weight:800}.deep-dive{grid-template-columns:minmax(0,53fr) minmax(390px,47fr);align-items:stretch;gap:17px;min-height:0;display:grid}.paper-figure{flex-direction:column;min-width:0;min-height:0;margin:0;display:flex}.figure-frame{border:1px solid var(--line);border-top:5px solid var(--navy);background:var(--white);place-items:center;height:clamp(330px,48vh,475px);min-height:0;padding:9px;display:grid;overflow:hidden}.figure-frame img{object-fit:contain;object-position:center;width:100%;height:100%;display:block}.paper-figure figcaption{border-left:3px solid var(--red);color:var(--muted);margin-top:7px;padding-left:9px;font-size:8.25px;line-height:1.38}.full-page-method-figure{flex-direction:column;flex:1;align-items:center;min-height:0;margin:0;display:flex}.full-page-method-frame{border:1px solid var(--line);border-top:5px solid var(--navy);background:var(--white);flex:none;width:min(1180px,88%);height:min(57vh,520px);min-height:0;padding:7px;overflow:hidden}.full-page-method-frame img{object-fit:contain;object-position:center;width:100%;height:100%;display:block}.full-page-method-figure figcaption{border-left:5px solid var(--blue);color:#33475a;background:#eaf0f5;width:min(900px,88%);margin:10px auto 0;padding:10px 14px;font-size:16px;line-height:1.4}.method-figure-takeaway strong{color:var(--navy);font-size:17px}.deep-dive-copy{border:1px solid var(--line);border-top:5px solid var(--red);background:#ffffffdb;flex-direction:column;min-width:0;padding:15px 16px;display:flex}.deep-dive-head{justify-content:space-between;align-items:center;gap:12px;display:flex}.deep-dive-head h3{min-width:0;color:var(--navy);margin:0;font-size:20px;line-height:1.15}.deep-dive-copy dl{border-top:1px solid var(--line);grid-template-columns:105px 1fr;margin:13px 0 0;display:grid}.deep-dive-copy dt,.deep-dive-copy dd{border-bottom:1px solid var(--line);margin:0;padding:7px 0;font-size:9.75px;line-height:1.4}.deep-dive-copy dt{color:var(--navy);padding-right:10px;font-weight:750}.deep-dive-copy dd{color:var(--muted)}.spotlight-callout{border-left:3px solid var(--blue);background:var(--blue-soft);grid-template-columns:110px 1fr;align-items:center;gap:10px;margin-top:auto;padding:9px 10px;display:grid}.spotlight-callout b{color:var(--navy);font-size:9px}.spotlight-callout span{color:#405469;font-size:9px;line-height:1.38}.route-counts{grid-template-columns:repeat(3,1fr);gap:5px;margin-top:auto;display:grid}.route-counts span{border:1px solid var(--line);color:var(--navy);font:700 11px var(--font-geist-mono), monospace;text-align:center;background:#e8edf1;padding:8px 5px}.route-counts small{color:var(--muted);font:7px var(--font-geist-sans), sans-serif}.interference-grid{grid-template-columns:repeat(3,minmax(0,1fr));gap:11px;display:grid}.interference-grid article{background:#ffffff0f;border:1px solid #ffffff52;border-top:5px solid #f1bf7c;flex-direction:column;min-height:220px;padding:17px;display:flex}.interference-grid article>span{color:#f1bf7c}.interference-grid h3{color:var(--white);margin:23px 0 10px;font-size:20px;line-height:1.25}.interference-grid p{color:#d4dfe7;margin:0;font-size:11px;line-height:1.45}.interference-grid small{color:#b9c7d2;border-top:1px solid #fff3;margin-top:auto;padding-top:10px;font-size:9px;line-height:1.42}.mitigation-grid{border:1px solid #ffffff47;grid-template-columns:repeat(3,minmax(0,1fr));margin-top:11px;display:grid}.mitigation-grid>*{text-align:center;border-right:1px solid #fff3;padding:9px 7px;font-size:8px;line-height:1.35}.mitigation-grid>:last-child{border-right:0}.mitigation-grid b{color:var(--navy);background:#f1bf7c}.mitigation-grid span{color:#cfdae3;background:#ffffff0f}.evidence-table th:first-child{width:22%}.evidence-table th:nth-child(2){width:19%}.evidence-table th:nth-child(3){width:18%}.evidence-table th:nth-child(4){width:20%}.evidence-table th:nth-child(5){width:21%}.history-contrast{border:1px solid var(--line);background:var(--white);grid-template-columns:.9fr 1.25fr auto .75fr 1.25fr;align-items:stretch;gap:9px;margin-top:12px;display:grid}.history-contrast>*{align-items:center;margin:0;padding:10px 11px;display:flex}.history-contrast b{color:var(--white);background:var(--navy);font-size:9px}.history-contrast span{color:var(--muted);font-size:9px;line-height:1.4}.history-contrast i{color:var(--red);justify-content:center;font-style:normal;font-weight:800}.artifact-link{color:var(--green);text-underline-offset:2px;font-weight:700;text-decoration-color:#2f6a5273}.runnable-table th:first-child{width:13%}.runnable-table th:nth-child(2){width:15%}.runnable-table th:nth-child(3),.runnable-table th:nth-child(4){width:20%}.runnable-table th:nth-child(5){width:32%}.diagnostic-table th:first-child{width:14%}.diagnostic-table th:nth-child(2){width:21%}.diagnostic-table th:nth-child(3){width:17%}.diagnostic-table th:nth-child(4){width:25%}.diagnostic-table th:nth-child(5){width:23%}.runnable-table td,.diagnostic-table td{padding:7px 9px;font-size:9.25px;line-height:1.34}.runnable-table th,.diagnostic-table th{padding:8px 9px;font-size:8px}.runnable-table code,.diagnostic-table code{color:var(--navy);font:8px var(--font-geist-mono), monospace}.model-priority-band{grid-template-columns:repeat(5,minmax(0,1fr));gap:7px;margin-top:11px;display:grid}.model-priority-band article{border:1px solid var(--line);border-top:3px solid var(--blue);background:var(--white);padding:9px 10px}.model-priority-band article:nth-child(2){border-top-color:var(--red)}.model-priority-band article:nth-child(3){border-top-color:var(--amber)}.model-priority-band article:nth-child(4){border-top-color:var(--green)}.model-priority-band article:nth-child(5){border-top-color:var(--navy)}.model-priority-band b{color:var(--muted);font:700 7px var(--font-geist-mono), monospace;text-transform:uppercase;display:block}.model-priority-band span{color:var(--navy);margin-top:7px;font-size:9.5px;font-weight:700;line-height:1.3;display:block}.resource-summary{border:1px solid var(--line);background:#e8edf1;grid-template-columns:1fr 1.45fr 1.35fr 1.45fr;margin-top:7px;display:grid}.resource-summary>*{border-right:1px solid var(--line);color:var(--muted);text-align:center;padding:7px 8px;font-size:8px;line-height:1.3}.resource-summary>:last-child{border-right:0}.resource-summary b{color:var(--navy);font:750 10px var(--font-geist-mono), monospace}.resource-summary strong{color:var(--red);background:#f3e9e7}.workflow-pipeline{grid-template-columns:.8fr auto 1.35fr auto 1.25fr auto .95fr auto .95fr;align-items:stretch;gap:7px;display:grid}.workflow-pipeline div{background:#ffffff12;border:1px solid #ffffff52;flex-direction:column;justify-content:center;min-height:102px;padding:13px;display:flex}.workflow-pipeline small{color:#f1bf7c;font:700 7px var(--font-geist-mono), monospace;letter-spacing:.08em}.workflow-pipeline b{color:var(--white);margin-top:12px;font-size:10px;line-height:1.4}.workflow-pipeline i{color:#f1bf7c;align-self:center;font-style:normal;font-weight:800}.agenda-two-col{grid-template-columns:1fr 1fr;gap:13px;margin-top:13px;display:grid}.agenda-two-col article{background:#ffffff0d;border:1px solid #ffffff47;padding:14px 17px}.agenda-two-col h3{color:#f1bf7c;margin:0 0 9px;font-size:16px}.agenda-two-col ul,.agenda-two-col ol{color:#ced9e2;margin:0;padding-left:18px;font-size:9.75px;line-height:1.45}.agenda-two-col li+li{margin-top:4px}.agenda-two-col .paper-link{color:#b9dcf5}.term{vertical-align:baseline;max-width:100%;display:inline-block;position:relative}.term-trigger{color:var(--blue);font:inherit;font-weight:700;line-height:inherit;text-align:inherit;cursor:help;background:0 0;border:0;border-bottom:1px dotted;margin:0;padding:0 .08em;display:inline}.term-trigger sup{color:var(--red);font:800 .62em var(--font-geist-mono), monospace;margin-left:.16em;position:relative;top:-.18em}.term-trigger[aria-expanded=true]{background:var(--blue-soft);color:var(--navy)}.slide-navy .term-trigger{color:#c5e2f7}.slide-navy .term-trigger sup{color:#f1bf7c}.slide-navy .term-trigger[aria-expanded=true]{color:var(--white);background:#ffffff24}.term-popover{z-index:105;border:1px solid var(--line-dark);border-top:4px solid var(--red);background:var(--paper);width:min(340px,78vw);color:var(--ink);text-align:left;text-transform:none;letter-spacing:normal;padding:11px 13px;font-size:12.5px;font-weight:450;line-height:1.48;position:absolute;bottom:calc(100% + 8px);left:0;box-shadow:0 10px 28px #102b4e33}.subtitle{font-size:16.5px}.academic-table th{font-size:10px}.academic-table td{font-size:13px;line-height:1.43}.academic-table td small{font-size:10px}.program-grid h3,.protocol-grid h3,.family-grid h3,.geometry-grid h3,.shift-grid h3,.state-grid h3{font-size:18px}.factory-grid h3,.flow-claims h3,.assumption-grid h3{font-size:16.5px}.program-grid p,.factory-grid p,.protocol-grid p,.family-grid p,.flow-claims p,.assumption-grid p,.geometry-grid p,.shift-grid p,.state-grid p,.control-clusters p,.control-clusters ul,.motion-contrast p,.motion-contrast ul,.interference-grid p{font-size:13px;line-height:1.46}.program-grid strong,.factory-grid strong,.protocol-grid small,.family-grid small,.flow-claims small,.assumption-grid b,.geometry-grid small,.shift-grid small,.state-grid small,.interference-grid small{font-size:11.25px;line-height:1.42}.warning-band,.academic-note,.slide-thesis p,.comparison-strip span{font-size:13px;line-height:1.45}.slide-thesis b{font-size:12px}.flow-equation small,.reporting-checks>*{font-size:10.5px}.scale-band p{font-size:var(--type-body)}.deep-dive-copy dt,.deep-dive-copy dd{padding-top:8px;padding-bottom:8px;font-size:12.5px;line-height:1.42}.deep-dive-copy dt{font-size:11.75px}.spotlight-callout b{font-size:11.25px}.spotlight-callout span{font-size:12px;line-height:1.42}.runnable-table td,.diagnostic-table td{font-size:11.25px;line-height:1.36}.runnable-table th,.diagnostic-table th{font-size:9.25px}.runnable-table code,.diagnostic-table code{font-size:9.5px}.model-priority-band span{font-size:11.25px}.resource-summary>*{font-size:10.25px}.workflow-pipeline b{font-size:12px}.agenda-two-col ul,.agenda-two-col ol{font-size:12px;line-height:1.44}.mitigation-grid>*{font-size:10.5px}.history-contrast b,.history-contrast span{font-size:11px}.omni-interface-line{grid-template-columns:1fr 30px 1.35fr 30px 1fr;align-items:stretch;gap:10px;display:grid}.omni-interface-line>i{color:var(--red);text-align:center;align-self:center;font-size:22px;font-style:normal}.omni-interface-line>article,.omni-io{border:1px solid var(--line);border-top:5px solid var(--blue);background:var(--white);flex-direction:column;justify-content:center;min-height:150px;padding:16px 18px;display:flex}.omni-interface-line>article{border-top-color:var(--red)}.omni-io.output{border-top-color:var(--green)}.omni-interface-line span,.omni-capability-grid>article>span,.omni-boundary-grid>article>span,.omni-score-list span,.omni-prompt-rule>span{color:var(--red);font:750 var(--type-label) var(--font-geist-mono), monospace;letter-spacing:.07em;text-transform:uppercase}.omni-io b{color:var(--navy);margin-top:12px;font-size:19px}.omni-interface-line h3{color:var(--navy);font:700 18px var(--font-geist-mono), monospace;margin:12px 0 7px}.omni-interface-line p{color:var(--muted);font-size:var(--type-body);margin:7px 0 0;line-height:1.44}.omni-capability-grid{grid-template-columns:repeat(4,minmax(0,1fr));gap:10px;margin-top:12px;display:grid}.omni-capability-grid article{border:1px solid var(--line);background:#ffffffd1;min-height:178px;padding:15px 16px}.omni-capability-grid h3{color:var(--navy);margin:17px 0 8px;font-size:18px;line-height:1.25}.omni-capability-grid p{color:var(--muted);font-size:var(--type-body);margin:0;line-height:1.46}.omni-capability-grid code{color:var(--navy);font-size:var(--type-support)}.omni-performance-layout{grid-template-columns:1.12fr .88fr;align-items:stretch;gap:18px;display:grid}.omni-benchmark-figure{flex-direction:column;min-width:0;margin:0;display:flex}.omni-benchmark-figure>div{border:1px solid var(--line);background:#f5f7fa;flex:1;min-height:0;overflow:hidden}.omni-benchmark-figure img{object-fit:contain;width:100%;height:100%;display:block}.omni-benchmark-figure figcaption{color:var(--muted);margin-top:6px;font-size:10.5px;line-height:1.35}.omni-score-list{gap:7px;display:grid}.omni-score-list article{border-left:4px solid var(--navy);background:var(--white);grid-template-columns:146px 1fr;align-items:center;gap:12px;padding:10px 12px;display:grid}.omni-score-list article:nth-child(2){border-left-color:var(--blue)}.omni-score-list article:nth-child(3){border-left-color:var(--red)}.omni-score-list article:nth-child(4){border-left-color:var(--green)}.omni-score-list article:nth-child(5){border-left-color:var(--amber)}.omni-score-list div{gap:4px;display:grid}.omni-score-list b{color:var(--navy);font:750 18px var(--font-geist-mono), monospace}.omni-score-list p{color:var(--muted);font-size:var(--type-body);margin:0;line-height:1.4}.omni-boundary-grid{grid-template-columns:repeat(4,minmax(0,1fr));gap:11px;display:grid}.omni-boundary-grid article{background:#ffffff0f;border:1px solid #ffffff47;border-top:5px solid #f1bf7c;flex-direction:column;min-height:300px;padding:18px;display:flex}.omni-boundary-grid h3{color:var(--white);margin:22px 0 11px;font-size:19px;line-height:1.25}.omni-boundary-grid p{color:#cbd8e3;font-size:var(--type-body);margin:0;line-height:1.46}.omni-boundary-grid strong{color:#f1bf7c;font-size:var(--type-support);border-top:1px solid #fff3;margin-top:auto;padding-top:12px;line-height:1.42}.omni-boundary-grid code{color:inherit}.omni-prompt-rule{background:#ffffff14;border-left:5px solid #f1bf7c;grid-template-columns:185px 1.1fr 1fr;align-items:center;gap:15px;margin-top:12px;padding:12px 15px;display:grid}.omni-prompt-rule b{color:var(--white);font-size:15px;line-height:1.42}.omni-prompt-rule p{color:#cbd8e3;font-size:var(--type-body);margin:0;line-height:1.42}.experiment-task-grid{grid-template-columns:repeat(4,minmax(0,1fr));gap:12px;display:grid}.experiment-task-card{border:1px solid var(--line);border-top:5px solid var(--navy);background:#ffffffdb;flex-direction:column;min-height:245px;padding:18px;display:flex}.experiment-task-card:nth-child(2){border-top-color:var(--blue)}.experiment-task-card:nth-child(3){border-top-color:var(--green)}.experiment-task-card:nth-child(4){border-top-color:var(--red)}.experiment-task-card>span{color:var(--red);font:750 9px var(--font-geist-mono), monospace;letter-spacing:.08em;text-transform:uppercase}.experiment-task-card h3{color:var(--navy);margin:24px 0 10px;font-size:20px;line-height:1.24}.experiment-task-card p{color:var(--muted);margin:0;font-size:13px;line-height:1.48}.experiment-task-card small{border-top:1px solid var(--line);color:var(--red);margin-top:auto;padding-top:12px;font-size:11.5px;line-height:1.42}.experiment-protocol{border:1px solid var(--line);background:var(--line);grid-template-columns:repeat(5,minmax(0,1fr));gap:1px;margin-top:12px;display:grid}.experiment-protocol span{background:var(--white);color:var(--muted);text-align:center;padding:10px 12px;font-size:11.5px;line-height:1.35}.experiment-protocol b{color:var(--navy);font:750 9px var(--font-geist-mono), monospace;text-transform:uppercase;margin-bottom:3px;display:block}.experiment-sync-group{min-width:0}.experiment-syncbar{border:1px solid var(--line);border-left:4px solid var(--blue);background:#ffffffe0;justify-content:space-between;align-items:center;gap:12px;min-height:38px;margin-bottom:7px;padding:5px 6px 5px 10px;display:flex}.experiment-sync-copy{flex-wrap:wrap;align-items:baseline;gap:3px 9px;min-width:0;display:flex}.experiment-sync-copy>span{color:var(--red);font:750 12px var(--font-geist-mono), monospace;letter-spacing:.08em}.experiment-sync-copy>strong{color:var(--navy);font-size:15px;line-height:1.3}.experiment-sync-copy>small{color:var(--muted);font-size:14px;line-height:1.3}.experiment-sync-actions{flex:none;gap:5px;display:flex}.experiment-sync-button{border:1px solid var(--navy);background:var(--navy);min-height:28px;color:var(--white);cursor:pointer;padding:5px 10px;font-size:13px;font-weight:700}.experiment-sync-button.active{border-color:var(--red);background:var(--red)}.experiment-sync-button.secondary{color:var(--navy);background:0 0}.experiment-media{--media-ratio:16 / 9;min-width:0;margin:0}.experiment-media-wide{--media-ratio:16 / 9}.experiment-media-fourThree{--media-ratio:4 / 3}.experiment-media-portraitTwoThree{--media-ratio:2 / 3}.experiment-media-portraitThirteenEighteen{--media-ratio:13 / 18}.experiment-media-frame{width:100%;aspect-ratio:var(--media-ratio,16 / 9);border:1px solid var(--line);border-top:4px solid var(--navy);background:#09131f;display:block;position:relative;overflow:hidden}.experiment-media-frame>video,.experiment-media-frame>img{object-fit:contain;object-position:center;background:#09131f;width:100%;height:100%;display:block;position:absolute;inset:0}.experiment-print-poster{display:none!important}.experiment-media figcaption{color:var(--muted);justify-content:space-between;align-items:baseline;gap:8px;margin-top:5px;font-size:13.5px;line-height:1.32;display:flex}.experiment-media figcaption b{color:var(--navy);font-size:14.5px}.experiment-media figcaption span{text-align:right}.experiment-media-compact figcaption b{font-size:12.25px}.experiment-mt-layout{grid-template-columns:minmax(0,1fr) 82px repeat(3,minmax(0,1fr));align-items:start;gap:8px;display:grid}.experiment-matrix-head{border-bottom:2px solid var(--navy);color:var(--navy);font:750 10.25px var(--font-geist-mono), monospace;text-align:center;text-transform:uppercase;align-self:end;padding:6px 5px}.experiment-matrix-label{border-left:4px solid var(--line-dark);min-height:0;color:var(--navy);background:#e8edf1;flex-direction:column;justify-content:center;align-self:stretch;padding:12px 8px;font-size:11.5px;line-height:1.35;display:flex}.experiment-matrix-label b{font-size:12px}.experiment-matrix-label span{color:var(--muted);margin-top:4px;font-size:10.5px}.experiment-matrix-label.ours{border-left-color:var(--red);background:#f2e7e5}.experiment-result-note{border-left:4px solid var(--green);background:#e7f2ec;grid-template-columns:minmax(160px,.28fr) 1fr;align-items:center;gap:14px;margin-top:11px;padding:10px 13px;display:grid}.experiment-result-note b{color:var(--green);font-size:12px}.experiment-result-note p{color:#3d5f51;margin:0;font-size:13px;line-height:1.42}.experiment-result-note.negative{border-left-color:var(--red);background:#f3e9e7}.experiment-result-note.negative b{color:var(--red)}.experiment-result-note.negative p{color:#654b49}.experiment-case-stack{gap:12px;display:grid}.experiment-case-row{grid-template-columns:minmax(190px,.68fr) repeat(3,minmax(0,1fr));align-items:center;gap:10px;display:grid}.experiment-case-copy{border-left:5px solid var(--blue);background:#e8edf1;flex-direction:column;justify-content:center;align-self:stretch;padding:13px 14px;display:flex}.experiment-case-row:nth-child(2) .experiment-case-copy,.experiment-case-stack>.experiment-sync-group:nth-child(2) .experiment-case-copy{border-left-color:var(--red);background:#f2e7e5}.experiment-case-copy span{color:var(--red);font:750 8.5px var(--font-geist-mono), monospace;text-transform:uppercase}.experiment-case-copy h3{color:var(--navy);margin:7px 0;font-size:18px;line-height:1.2}.experiment-case-copy p{color:var(--muted);margin:0;font-size:12.25px;line-height:1.42}.experiment-case-row .experiment-media figcaption span{display:none}.experiment-four-grid,.experiment-three-grid,.experiment-two-grid{align-items:start;gap:11px;display:grid}.experiment-four-grid{grid-template-columns:repeat(4,minmax(0,1fr))}.experiment-three-grid{grid-template-columns:repeat(3,minmax(0,1fr))}.experiment-two-grid{grid-template-columns:repeat(2,minmax(0,1fr))}.compact-note{margin-top:7px;padding-top:8px;padding-bottom:8px}.compact-case-stack{gap:8px}.compact-case-stack .experiment-syncbar{margin-bottom:5px}.compact-case-stack .experiment-case-copy{padding-top:10px;padding-bottom:10px}.compact-case-stack .experiment-case-copy h3{margin-top:5px;margin-bottom:5px}.experiment-context{border-left:4px solid var(--blue);background:var(--blue-soft);grid-template-columns:150px 1fr;align-items:center;gap:14px;margin-bottom:8px;padding:9px 13px;display:grid}.experiment-context b{color:var(--navy);font-size:var(--type-emphasis)}.experiment-context span{color:#33475a;font-size:var(--type-body);line-height:1.44}.experiment-instruction-grid{grid-template-columns:repeat(2,minmax(0,1fr));gap:10px;margin-top:9px;display:grid}.experiment-instruction-grid article{border:1px solid var(--line);border-top:4px solid var(--red);background:#ffffffe6;padding:12px 14px}.experiment-instruction-grid article:nth-child(2){border-top-color:var(--blue)}.experiment-instruction-grid span,.experiment-paired-prompts span{color:var(--red);font:750 var(--type-label) var(--font-geist-mono), monospace;letter-spacing:.06em}.experiment-instruction-grid p{color:var(--muted);font-size:var(--type-body);margin:8px 0 0;line-height:1.43}.experiment-paired-prompts{grid-template-columns:repeat(2,minmax(0,1fr));gap:12px;margin-bottom:10px;display:grid}.experiment-paired-prompts article{border-left:5px solid var(--blue);background:var(--blue-soft);padding:12px 15px}.experiment-paired-prompts article:nth-child(2){border-left-color:var(--red);background:#f2e7e5}.experiment-paired-prompts p{color:#33475a;margin:7px 0 0;font-size:15px;line-height:1.43}.experiment-paired-prompts article:nth-child(2) p{color:#584342}.experiment-verdict-grid{grid-template-columns:repeat(2,minmax(0,1fr));gap:12px;margin-top:10px;display:grid}.experiment-verdict-grid article{border-left:5px solid var(--green);background:#e7f2ec;padding:11px 14px}.experiment-verdict-grid article.fail{border-left-color:var(--red);background:#f3e9e7}.experiment-verdict-grid b{color:var(--green);font-size:15px}.experiment-verdict-grid .fail b{color:var(--red)}.experiment-verdict-grid p{color:#3d5f51;font-size:var(--type-body);margin:5px 0 0;line-height:1.42}.experiment-verdict-grid .fail p{color:#654b49}.experiment-pair-layout{grid-template-columns:repeat(3,minmax(0,1fr));align-items:start;gap:14px;display:grid}.experiment-pair-layout .experiment-media{justify-self:center;width:min(100%,clamp(240px,34.4vh,336px))}.experiment-pair-layout .experiment-media-frame{aspect-ratio:4/5;width:100%;height:auto}.experiment-instruction{border-left:4px solid var(--red);color:#584342;background:#f2e7e5;flex-wrap:wrap;align-items:flex-start;gap:8px 14px;margin-bottom:11px;padding:10px 14px;font-size:15px;line-height:1.42;display:flex}.experiment-instruction b{color:var(--red);flex:none}.experiment-instruction span{flex:210px;min-width:0}.experiment-instruction span+span{border-left:1px solid #a33b3447;padding-left:14px}.experiment-provenance{color:var(--muted);font:9px var(--font-geist-mono), monospace;margin-top:8px;line-height:1.35}.equation-key,.scope-grid p,.exclusion-note,.academic-note,.objective-grid p,.timeline-row:not(.timeline-head)>:not(strong),.timeline-thesis,.arch-path p,.arch-renderer p,.design-questions p,.academic-table td,.unified-grid p,.warning-band,.method-focus dt,.method-focus dd,.method-focus ul,.limitation,.evidence-box,.comparison-strip span,.parameter-warning,.bernini-pipeline p,.bernini-evidence p,.reasoning-grid>article>p,.loom-facts p,.control-ladder p,.data-alternatives span,.system-grid p,.benchmark-row:not(.benchmark-head)>*,.protocol-checklist li,.selection-row:not(.selection-head)>*,.agenda-list span,.program-grid p,.factory-grid p,.protocol-grid p,.family-grid p,.slide-thesis p,.flow-equation small,.flow-claims p,.assumption-grid p,.control-clusters p,.control-clusters ul,.motion-contrast p,.motion-contrast ul,.geometry-grid p,.shift-grid p,.state-grid p,.deep-dive-copy dd,.spotlight-callout span,.interference-grid p,.workflow-pipeline b,.agenda-two-col ul,.agenda-two-col ol,.term-popover,.experiment-task-card p,.experiment-instruction,.experiment-result-note p,.experiment-case-copy p{font-size:var(--type-body);line-height:1.46}.canonical-interface span,.canonical-interface strong,.cover-agenda small,.objective-grid small,.academic-table td small,.cost-identity,.cost-identity span,.cost-identity em,.mini-pipeline,.unified-grid strong,.unified-grid small,.depth-stack>*,.token-cost b,.control-ladder strong,.data-alternatives small,.program-grid strong,.coupled-objective,.factory-grid strong,.factory-grid small,.protocol-grid small,.reporting-checks>*,.family-grid small,.flow-claims small,.assumption-grid b,.geometry-grid small,.shift-grid small,.state-grid small,.deep-dive-copy dt,.spotlight-callout b,.route-counts span,.interference-grid small,.mitigation-grid>*,.history-contrast b,.history-contrast span,.runnable-table td,.diagnostic-table td,.model-priority-band span,.resource-summary>*,.resource-summary b,.experiment-task-card small,.experiment-protocol span,.experiment-matrix-label,.experiment-matrix-label span,.experiment-result-note b{font-size:var(--type-support);line-height:1.42}.arch-input b,.arch-output b,.design-questions b,.cost-identity b,.bernini-pipeline strong,.bernini-evidence b,.data-alternatives b,.agenda-list b,.coupled-objective b,.slide-thesis b,.spotlight-callout b,.experiment-matrix-label b,.experiment-result-note b{font-size:var(--type-emphasis)}.cover-sequence span,.arch-path small,.arch-renderer small,.bernini-pipeline small,.bernini-evidence span,.academic-table th,.timeline-head>span,.layer-diagram>*,.architecture-row span,.architecture-row b,.depth-stack span,.token-roles span,.token-cost span,.control-axis,.long-system-diagram>span,.latency-stack>*,.benchmark-head>span,.selection-head>span,.tuple-table code,.control-clusters code,.metric-strip span,.flow-equation span,.spectrum-caption span,.route-counts small,.runnable-table th,.diagnostic-table th,.runnable-table code,.diagnostic-table code,.model-priority-band b,.workflow-pipeline small,.experiment-protocol b,.experiment-matrix-head{font-size:var(--type-label);line-height:1.35}.factory-grid article{padding:12px 14px}.factory-grid h3{margin-top:6px}.program-grid h3,.family-grid h3{margin-top:18px}.deep-dive-copy{padding:13px 14px}.deep-dive-copy dl{margin-top:10px}.deep-dive-copy dt,.deep-dive-copy dd{padding-top:6px;padding-bottom:6px}.nav-drawer{z-index:110;position:fixed;inset:0}.drawer-scrim{background:#0a141e9e;border:0;position:absolute;inset:0}.drawer-panel{background:var(--paper);width:min(480px,92vw);color:var(--ink);padding:23px;position:absolute;top:0;bottom:0;right:0;overflow:auto}.drawer-head{border-bottom:2px solid var(--navy);color:var(--navy);font:10px var(--font-geist-mono), monospace;text-transform:uppercase;justify-content:space-between;align-items:center;padding-bottom:13px;display:flex}.drawer-head button{cursor:pointer;background:0 0;border:0;font-size:25px}.drawer-panel ol{margin:0;padding:0;list-style:none}.drawer-panel li{border-bottom:1px solid var(--line)}.drawer-panel li button{cursor:pointer;text-align:left;background:0 0;border:0;grid-template-columns:38px 1fr;gap:8px;width:100%;padding:10px 4px;font-size:11px;display:grid}.drawer-panel li button span{color:var(--muted);font:9px var(--font-geist-mono), monospace}.drawer-panel li button.active{color:var(--blue);font-weight:700}.bottom-controls{z-index:70;gap:5px;display:flex;position:fixed;bottom:16px;right:20px}.bottom-controls button{border:1px solid var(--navy);background:var(--paper);width:34px;height:34px;color:var(--navy);cursor:pointer}.bottom-controls button:disabled{color:#a9afb4;cursor:default;border-color:#c6cbd0}@media (width<=1000px){.slide{overflow:visible}.slide-inner{padding:68px 24px 44px}.slide-number{display:none}.cover-grid,.bernini-layout,.loom-layout,.evaluation-grid,.synthesis-grid{grid-template-columns:1fr}.scope-grid,.objective-grid,.unified-grid,.control-ladder,.program-grid,.factory-grid,.protocol-grid,.family-grid,.flow-claims,.assumption-grid,.geometry-grid,.shift-grid,.state-grid{grid-template-columns:1fr 1fr}.timeline-row{grid-template-columns:70px 1fr}.timeline-row>*{border-bottom:1px solid var(--line)}.timeline-head{display:none}.architecture-diagram{grid-template-rows:auto;grid-template-columns:1fr 1fr}.arch-input:first-child,.arch-input:nth-child(2),.arch-path.semantic,.arch-path.detail,.arch-renderer,.arch-output{grid-area:auto}.arch-line{display:none}.method-focus-grid.two,.reasoning-grid,.bernini-pipeline{grid-template-columns:1fr}.bernini-pipeline>div{min-height:0}.bernini-pipeline>b{display:none}.long-system-diagram{grid-template-columns:repeat(3,1fr)}.system-grid{grid-template-columns:1fr}.academic-table{min-width:860px}.table-wrap{overflow-x:auto}.cover-sequence{max-width:690px}.coupled-objective{grid-template-columns:1fr 1fr 24px 1fr 24px 1fr 24px 1fr}.coupled-objective b{grid-column:1/-1}.scale-band{grid-template-columns:1fr 1fr}.reporting-checks{grid-template-columns:repeat(4,1fr)}.reporting-checks>*{border-bottom:1px solid var(--line)}.flow-equation{text-align:center;grid-template-columns:1fr}.control-clusters,.motion-contrast,.agenda-two-col,.deep-dive{grid-template-columns:1fr}.figure-frame{height:min(62vw,520px)}.full-page-method-frame{width:94%;height:min(61vw,500px)}.interference-grid{grid-template-columns:1fr}.mitigation-grid{grid-template-columns:repeat(3,1fr)}.workflow-pipeline{grid-template-columns:1fr}.workflow-pipeline i{display:none}.workflow-pipeline div{min-height:0}.model-priority-band,.resource-summary,.omni-capability-grid,.omni-boundary-grid{grid-template-columns:1fr 1fr}.omni-performance-layout{grid-template-columns:1fr}.omni-benchmark-figure>div{min-height:360px}.omni-prompt-rule{grid-template-columns:1fr}.experiment-task-grid,.experiment-protocol{grid-template-columns:1fr 1fr}.experiment-mt-layout{grid-template-columns:minmax(0,1fr) 72px repeat(3,minmax(0,1fr))}.experiment-case-row{grid-template-columns:1fr 1fr 1fr}.experiment-case-copy{grid-column:1/-1}.experiment-four-grid{grid-template-columns:1fr 1fr}}@media (width<=650px){.brand-button span,.utility-button:first-of-type,.page-counter{display:none}.top-actions .results-link{display:inline-flex}.topbar{padding:0 14px}.slide h1{font-size:43px}.slide h2{font-size:31px}.scope-grid,.objective-grid,.unified-grid,.control-ladder,.design-questions,.comparison-strip,.bernini-evidence,.loom-facts,.data-alternatives,.program-grid,.factory-grid,.protocol-grid,.family-grid,.flow-claims,.assumption-grid,.geometry-grid,.shift-grid,.state-grid{grid-template-columns:1fr}.equation-key{grid-template-columns:1fr 1fr;display:grid}.cost-identity{grid-template-columns:1fr 1fr}.cost-identity em{text-align:left;grid-column:1/-1}.layer-diagram,.kiwi-diagram{grid-template-columns:1fr}.token-roles,.long-system-diagram{grid-template-columns:1fr 1fr}.boundary{display:none}.selection-row,.benchmark-row{grid-template-columns:1fr}.bottom-controls{bottom:10px;right:10px}.cover-sequence b{display:none}.cover-sequence span{text-align:center;flex:145px}.program-grid article,.factory-grid article,.protocol-grid article,.family-grid article,.flow-claims article,.assumption-grid article,.geometry-grid article,.shift-grid article,.state-grid article,.interference-grid article{min-height:0}.coupled-objective,.scale-band,.metric-strip,.reporting-checks,.mitigation-grid,.spectrum-caption,.history-contrast{grid-template-columns:1fr}.coupled-objective i,.spectrum-caption i,.history-contrast i{display:none}.metric-strip span,.reporting-checks>*,.mitigation-grid>*{border-right:0;border-bottom:1px solid var(--line)}.slide-thesis{grid-template-columns:1fr}.deep-dive-copy dl{grid-template-columns:92px 1fr}.figure-frame{height:64vw;min-height:260px}.spotlight-callout,.route-counts{grid-template-columns:1fr}.history-contrast>*{text-align:center;justify-content:center}.model-priority-band,.resource-summary{grid-template-columns:1fr}.resource-summary>*{border-right:0;border-bottom:1px solid var(--line)}.omni-interface-line,.omni-capability-grid,.omni-boundary-grid,.omni-performance-layout,.omni-prompt-rule{grid-template-columns:1fr}.omni-interface-line>i{display:none}.omni-score-list article,.experiment-task-grid,.experiment-protocol,.experiment-case-row,.experiment-pair-layout,.experiment-four-grid,.experiment-three-grid,.experiment-two-grid,.experiment-instruction-grid,.experiment-paired-prompts,.experiment-verdict-grid,.experiment-context{grid-template-columns:1fr}.experiment-task-card{min-height:0}.experiment-mt-layout{grid-template-columns:minmax(185px,1fr) 66px repeat(3,minmax(185px,1fr));overflow-x:auto}.experiment-result-note{grid-template-columns:1fr}.experiment-pair-layout .experiment-media-frame{aspect-ratio:4/5;height:auto}.experiment-instruction{grid-template-columns:1fr;display:grid}.experiment-instruction span+span{border-left:0;padding-left:0}.experiment-syncbar{flex-direction:column;align-items:flex-start}.experiment-sync-actions{width:100%}.experiment-sync-button{flex:1 1 0}.term-popover{z-index:120;width:auto;max-height:42vh;padding:13px 14px;font-size:13.5px;position:fixed;bottom:14px;left:14px;right:14px;overflow:auto}}@media (width>=1001px) and (height<=860px){section[id^=experiments-] .slide-inner{padding-top:60px;padding-bottom:18px}section[id^=experiments-] .slide-heading{margin-bottom:12px;padding-bottom:9px}.experiment-task-card{min-height:220px;padding:14px}.experiment-task-card h3{margin-top:16px}.experiment-protocol span{padding:7px 9px}.experiment-instruction{margin-bottom:7px;padding:7px 12px}.experiment-syncbar{min-height:34px;margin-bottom:5px;padding-block:3px}.experiment-mt-layout{gap:6px 5px}.experiment-result-note{margin-top:7px;padding:7px 11px}.experiment-provenance{margin-top:5px}}@media print{@page{size:16in 9in;margin:0}html,body{background:#fff}.topbar,.progress,.bottom-controls,.nav-drawer,.experiment-syncbar{display:none!important}.slide{break-after:page;page-break-after:always;-webkit-print-color-adjust:exact;print-color-adjust:exact;width:16in;height:9in;min-height:9in;overflow:hidden}.slide-inner{width:16in;height:9in;min-height:9in;padding:42px 64px 28px}.slide-heading{margin-bottom:16px;padding-bottom:11px}.slide h1{font-size:76px}.slide h2{font-size:39px}.subtitle{font-size:15px}.slide-number{font-size:21px;display:block}.references{padding-top:8px}.objective-grid article{min-height:190px}.unified-grid article{min-height:275px}.control-ladder article{min-height:225px}.program-grid article{min-height:205px;padding:13px}.program-grid h3{margin-top:18px;font-size:15px}.factory-grid article{min-height:145px;padding:11px 13px}.factory-grid h3{font-size:13px}.protocol-grid article{min-height:165px}.family-grid article{min-height:215px;padding:13px}.family-grid h3{margin-top:18px;font-size:15px}.flow-claims article{min-height:165px}.assumption-grid article{min-height:135px;padding:11px 13px}.geometry-grid article,.shift-grid article,.state-grid article{min-height:210px;padding:13px}.deep-dive{grid-template-columns:minmax(0,53fr) minmax(360px,47fr);gap:14px}.figure-frame{height:4.35in}.full-page-method-frame{width:90%;height:4.85in}.full-page-method-figure figcaption{font-size:8px}.deep-dive-copy{padding:12px 13px}.deep-dive-copy dl{grid-template-columns:92px 1fr;margin-top:10px}.deep-dive-copy dt,.deep-dive-copy dd{padding:5px 0}.deep-dive-copy dt{font-size:var(--type-support)}.deep-dive-copy dd{font-size:var(--type-body)}.paper-figure figcaption{font-size:7.5px}.interference-grid article{min-height:188px;padding:14px}.workflow-pipeline div{min-height:82px}.runnable-table td,.diagnostic-table td{font-size:var(--type-support);padding:5px 7px}.model-priority-band article{padding:7px 8px}.experiment-task-card{min-height:205px;padding:14px}.experiment-task-card h3{margin-top:17px;font-size:17px}.experiment-task-card p{font-size:var(--type-body)}.experiment-protocol span{font-size:var(--type-support);padding:7px 8px}section[id^=experiments-] .subtitle{font-size:13px}.experiment-media video{display:none!important}.experiment-media img.experiment-print-poster{display:block!important}.experiment-media figcaption b{font-size:11.5px}.experiment-media figcaption{font-size:11px}.experiment-mt-layout{grid-template-columns:minmax(0,1fr) 70px repeat(3,minmax(0,1fr));gap:6px}.experiment-case-row{grid-template-columns:170px repeat(3,minmax(0,1fr));gap:7px}.experiment-case-copy{padding:10px}.experiment-case-copy h3{font-size:16px}.experiment-case-copy p{font-size:var(--type-body)}.experiment-pair-layout .experiment-media{width:2.92in}.experiment-pair-layout .experiment-media-frame{aspect-ratio:4/5;width:100%;height:3.65in}.term-popover{display:none!important}.term-trigger{border-bottom:0;padding:0;color:inherit!important;background:0 0!important}.term-trigger sup{display:none}}.provenance-grid,.provenance-cards{grid-template-columns:repeat(auto-fit,minmax(220px,1fr));gap:12px;display:grid}.provenance-card{border:1px solid var(--line);border-top:3px solid var(--navy);background:#ffffffbd;min-width:0;padding:14px 15px 13px;position:relative}.provenance-card.tone-strong{border-top-color:var(--green)}.provenance-card.tone-caution{border-top-color:var(--amber)}.provenance-card header,.provenance-card .provenance-head{justify-content:space-between;align-items:baseline;gap:10px;margin-bottom:9px;display:flex}.provenance-kicker,.provenance-card header span,.provenance-card .provenance-head span{color:var(--blue);font:700 9.5px/1.3 var(--font-geist-mono), monospace;letter-spacing:.09em;text-transform:uppercase}.provenance-card h3{color:var(--navy);margin:0;font-size:14px;line-height:1.25}.provenance-card p{color:var(--muted);font-size:var(--type-support);margin:7px 0 0;line-height:1.45}.provenance-path,.provenance-meta{color:var(--muted);font:9.5px/1.45 var(--font-geist-mono), monospace;text-overflow:ellipsis;white-space:nowrap;margin-top:10px;display:block;overflow:hidden}.method-pipeline{align-items:stretch;gap:10px;display:flex}.method-stage{border:1px solid var(--line-dark);background:var(--white);min-width:0;box-shadow:inset 0 3px 0 var(--blue);flex:1 1 0;padding:14px;position:relative}.method-stage.is-anchor{box-shadow:inset 0 3px 0 var(--green)}.method-stage.is-objective{box-shadow:inset 0 3px 0 var(--red)}.method-stage .method-index{background:var(--navy);width:22px;height:22px;color:var(--white);font:700 10px var(--font-geist-mono), monospace;place-items:center;margin-bottom:12px;display:inline-grid}.method-stage h3{color:var(--navy);margin:0;font-size:17px;line-height:1.25}.method-stage p{color:var(--muted);font-size:var(--type-support);margin:7px 0 0;line-height:1.45}.method-stage code{color:var(--blue);font:13px/1.4 var(--font-geist-mono), monospace;white-space:normal;margin-top:9px;display:block}.method-arrow{color:var(--red);font:700 20px var(--font-geist-mono), monospace;flex:0 0 24px;align-self:center;place-items:center;display:grid}.evidence-matrix{border:1px solid var(--line-dark);background:var(--white);overflow:hidden}.evidence-row{grid-template-columns:minmax(165px,1.15fr) repeat(3,minmax(115px,1fr));display:grid}.evidence-row+.evidence-row{border-top:1px solid var(--line)}.evidence-row.is-header{background:var(--navy);color:var(--white)}.evidence-cell{min-width:0;font-size:var(--type-support);padding:10px 11px;line-height:1.35}.evidence-cell+.evidence-cell{border-left:1px solid var(--line)}.evidence-row.is-header .evidence-cell{border-left-color:#ffffff3d}.evidence-row.is-header .evidence-cell,.evidence-cell strong{letter-spacing:.035em;text-transform:uppercase;font-size:10.5px;font-weight:700}.evidence-cell.is-source{background:#edf1f4}.evidence-cell.is-baseline{color:#6e2622;background:#f7e9e6}.evidence-cell.is-anchor{color:#24513f;background:#e5f0e9}.evidence-cell.is-warning{color:#684b16;background:#f6eddc}.evidence-cell small{color:var(--muted);margin-top:4px;font-size:10px;line-height:1.35;display:block}.risk-grid,.risk-cards{grid-template-columns:repeat(auto-fit,minmax(230px,1fr));gap:12px;display:grid}.risk-card{border:1px solid var(--line);background:#ffffffd1;min-width:0;padding:16px 15px 14px;position:relative;overflow:hidden}.risk-card:before{content:"";background:var(--line-dark);height:4px;position:absolute;inset:0 0 auto}.risk-card.severity-high:before{background:var(--red)}.risk-card.severity-medium:before{background:var(--amber)}.risk-card.severity-watch:before{background:var(--blue)}.risk-label,.risk-status{min-height:21px;color:var(--muted);font:700 9px var(--font-geist-mono), monospace;letter-spacing:.07em;text-transform:uppercase;border:1px solid;align-items:center;padding:3px 7px;display:inline-flex}.severity-high .risk-label,.severity-high .risk-status{color:var(--red)}.severity-medium .risk-label,.severity-medium .risk-status{color:var(--amber)}.severity-watch .risk-label,.severity-watch .risk-status{color:var(--blue)}.risk-card h3{color:var(--navy);margin:14px 0 0;font-size:15px;line-height:1.25}.risk-card p,.risk-card li{color:var(--muted);font-size:var(--type-support);line-height:1.45}.risk-card p{margin:7px 0 0}.risk-card ul{margin:9px 0 0;padding-left:18px}@media (width<=1000px){.method-pipeline{grid-template-columns:1fr 1fr;display:grid}.method-arrow{display:none}.evidence-row{grid-template-columns:minmax(145px,1.1fr) repeat(3,minmax(105px,1fr))}.evidence-matrix{overflow-x:auto}}@media (width<=650px){.provenance-grid,.provenance-cards,.method-pipeline,.risk-grid,.risk-cards{grid-template-columns:1fr}.evidence-matrix{background:0 0;border:0}.evidence-row{border:1px solid var(--line);background:var(--white);display:block}.evidence-row+.evidence-row{margin-top:10px}.evidence-row.is-header{display:none}.evidence-cell{grid-template-columns:minmax(92px,.72fr) 1fr;gap:10px;display:grid}.evidence-cell+.evidence-cell{border-top:1px solid var(--line);border-left:0}.evidence-cell[data-label]:before{content:attr(data-label);color:var(--navy);font:700 9.5px/1.35 var(--font-geist-mono), monospace;letter-spacing:.045em;text-transform:uppercase}}@media print{.provenance-grid,.provenance-cards,.risk-grid,.risk-cards{gap:9px}.provenance-card,.method-stage,.risk-card{break-inside:avoid}.method-pipeline{gap:7px}.method-arrow{flex-basis:18px;font-size:16px}.evidence-cell{padding:7px 8px}}.evidence-badge{background:var(--white);width:fit-content;min-height:28px;font:750 12px/1.2 var(--font-geist-mono), monospace;letter-spacing:.075em;text-transform:uppercase;white-space:nowrap;border:1px solid;align-items:center;padding:5px 9px;display:inline-flex}.evidence-established{color:var(--green);background:#e7f2ec}.evidence-component{color:var(--blue);background:#e3edf6}.evidence-provisional{color:var(--amber);background:#f6eddc}.evidence-nogo{color:var(--red);background:#f5e8e6}.status-strip{flex-wrap:wrap;gap:8px;margin:24px 0 28px;display:flex}.status-strip span{color:#d5e0e9;border:1px solid #ffffff47;gap:7px;padding:8px 10px;font-size:14px;line-height:1.25;display:inline-flex}.status-strip b{color:#fff;font:750 12px/1.35 var(--font-geist-mono), monospace;letter-spacing:.06em}.status-strip .status-partial{background:#8a641f40;border-color:#d3af72}.status-strip .status-established{background:#2f6a5242;border-color:#76a98f}.status-strip .status-nogo{background:#a33b3447;border-color:#d48179}.executive-grid{grid-template-columns:repeat(3,minmax(0,1fr));gap:12px;display:grid}.progress-status-card{border:1px solid var(--line);background:#ffffffe0;min-height:150px;padding:15px 16px 13px;position:relative;overflow:hidden}.progress-status-card:before{content:"";background:var(--line-dark);height:4px;position:absolute;inset:0 0 auto}.progress-status-card.status-good:before{background:var(--green)}.progress-status-card.status-partial-card:before,.progress-status-card.status-watch:before{background:var(--amber)}.progress-status-card.status-bad:before{background:var(--red)}.progress-status-card>span,.example-kicker{color:var(--blue);font:750 12px/1.3 var(--font-geist-mono), monospace;letter-spacing:.075em}.progress-status-card.status-good>span{color:var(--green)}.progress-status-card.status-bad>span{color:var(--red)}.progress-status-card.status-partial-card>span,.progress-status-card.status-watch>span{color:var(--amber)}.progress-status-card h3{color:var(--navy);margin:17px 0 7px;font-size:17px;line-height:1.2}.progress-status-card p{color:var(--muted);font-size:var(--type-body);margin:0;line-height:1.43}.progress-quote{border:0;border-left:5px solid var(--red);background:var(--navy);color:var(--white);margin:16px 0 0;padding:15px 20px;font-size:clamp(18px,1.8vw,25px);font-weight:560;line-height:1.35}.local-recovery-layout{grid-template-columns:minmax(0,1.72fr) minmax(300px,.78fr);gap:18px;min-height:0;margin-top:10px;display:grid}.local-recovery-figure{min-width:0;margin:0}.local-recovery-frame{border:1px solid var(--line);border-top:5px solid var(--blue);background:var(--white);height:clamp(350px,50vh,500px);min-height:0;padding:9px;overflow:hidden}.local-recovery-frame img{object-fit:contain;object-position:center;width:100%;height:100%;display:block}.local-recovery-figure figcaption{border-left:3px solid var(--purple,#a855f7);color:var(--muted);margin-top:7px;padding-left:9px;font-size:15px;line-height:1.38}.local-recovery-copy{grid-template-rows:auto repeat(3,minmax(0,1fr)) auto;gap:8px;min-width:0;display:grid}.local-recovery-copy article{border:1px solid var(--line);border-left:4px solid var(--green);background:#ffffffe6;min-width:0;padding:11px 12px}.local-recovery-copy article>span,.local-recovery-rule b{color:var(--red);font:750 var(--type-label)/1.3 var(--font-geist-mono), monospace;letter-spacing:.06em}.local-recovery-copy h3{color:var(--navy);margin:7px 0 4px;font-size:15px;line-height:1.18}.local-recovery-copy p{color:var(--muted);font-size:var(--type-body);margin:0;line-height:1.4}.local-recovery-rule{background:#f0e9fa;border-left:4px solid #a855f7;grid-template-columns:100px 1fr;align-items:center;gap:10px;padding:9px 10px;display:grid}.local-recovery-rule span{color:#4f4760;font-size:var(--type-support);line-height:1.38}.two-up{grid-template-columns:repeat(2,minmax(0,1fr));gap:16px;display:grid}.motivation-two-up{flex:1;align-items:stretch}.motivation-contract,.motivation-example,.training-objective,.qualification-list{border:1px solid var(--line);background:#ffffffe6;padding:19px 20px}.motivation-contract{border-top:5px solid var(--green)}.motivation-example{border-top:5px solid var(--red)}.motivation-contract h3,.motivation-example h3,.training-objective h3,.qualification-list h3{color:var(--navy);margin:18px 0 12px;font-size:21px;line-height:1.2}.motivation-contract ol,.motivation-example p,.training-objective dl,.qualification-list ol{color:var(--muted);font-size:var(--type-body);line-height:1.5}.motivation-contract ol,.qualification-list ol{margin:0;padding-left:21px}.motivation-contract li+li,.qualification-list li+li{margin-top:7px}.motivation-example p{margin:16px 0 0}.failure-tags{flex-wrap:wrap;gap:7px;margin-top:17px;display:flex}.failure-tags span{color:#75302c;font:700 12.5px/1.25 var(--font-geist-mono), monospace;background:#f5e8e6;border:1px solid #d7a8a4;padding:7px 9px}.progress-conclusion{border-left:4px solid var(--green);background:#e7f2ec;grid-template-columns:minmax(150px,.25fr) 1fr;align-items:center;gap:14px;margin-top:13px;padding:11px 14px;display:grid}.progress-conclusion b{color:var(--green);font-size:var(--type-emphasis)}.progress-conclusion p{color:#3d5f51;font-size:var(--type-body);margin:0;line-height:1.43}.progress-conclusion.negative{border-left-color:var(--red);background:#f3e9e7}.progress-conclusion.negative b{color:var(--red)}.progress-conclusion.negative p{color:#654b49}.compact-conclusion{margin-top:8px;padding-top:8px;padding-bottom:8px}.failure-mode-grid{grid-template-columns:repeat(3,minmax(0,1fr));gap:13px;display:grid}.failure-mode-card{border:1px solid var(--line);border-top:5px solid var(--blue);background:#ffffffeb;flex-direction:column;min-height:275px;padding:18px;display:flex}.failure-mode-card.failure-inventory{background:#fbf6ea;border-top-color:#9b6a18}.failure-mode-card.failure-identity{border-top-color:var(--red);background:#fbf4f2}.failure-mode-card>span{color:var(--red);font:750 12.5px/1.25 var(--font-geist-mono), monospace;letter-spacing:.08em}.failure-mode-card h3{color:var(--navy);margin:30px 0 11px;font-size:clamp(18px,1.6vw,24px);line-height:1.18}.failure-mode-card p{color:var(--muted);font-size:var(--type-body);margin:0;line-height:1.48}.failure-mode-card small{color:#657281;font-size:var(--type-support);margin-top:auto;padding-top:18px;line-height:1.4}.failure-mode-card small a{color:var(--blue);text-underline-offset:2px;font-weight:700;text-decoration-thickness:1px}.failure-gate-conclusion{margin-top:15px}.equation-grid{grid-template-columns:repeat(3,minmax(0,1fr));gap:13px;display:grid}.equation-grid article{border:1px solid var(--line);border-top:5px solid var(--blue);background:#ffffffe6;min-width:0;min-height:215px;padding:18px}.equation-grid article:nth-child(2){border-top-color:var(--green)}.equation-grid .equation-target{border-top-color:var(--red);background:#fbf4f2}.equation-grid span{color:var(--red);font:750 12px var(--font-geist-mono), monospace;letter-spacing:.08em}.equation-grid code{color:var(--navy);font:650 clamp(17px, 1.6vw, 24px)/1.3 var(--font-geist-mono), monospace;margin:35px 0 18px;display:block}.equation-grid p{color:var(--muted);font-size:var(--type-body);margin:0;line-height:1.45}.counterfactual-intervention-definition{border-left:4px solid var(--red);background:#f7ece9;grid-template-columns:max-content max-content minmax(0,1fr);align-items:center;gap:12px;margin-bottom:9px;padding:7px 12px;display:grid}.counterfactual-intervention-definition>span{color:var(--red);font:750 12px/1.2 var(--font-geist-mono), monospace;letter-spacing:.08em}.counterfactual-intervention-definition p{min-width:0;color:var(--muted);font-size:var(--type-support);margin:0;line-height:1.3}.counterfactual-math,.invariant-math,.intervention-math{color:var(--navy);font-family:STIX Two Math,Cambria Math,Latin Modern Math,serif;display:block}.intervention-math{max-width:100%;font-size:clamp(16px,1.2vw,20px)}.counterfactual-formula{align-content:center;justify-items:start;gap:5px;min-width:0;min-height:76px;margin:24px 0 17px;display:grid}.counterfactual-math{max-width:100%;font-size:clamp(17px,1.3vw,22px)}.counterfactual-invariant{background:#f8f0df;border:1px solid #d7c293;grid-template-columns:minmax(0,.85fr) minmax(0,1.15fr);align-items:center;gap:18px;margin-top:11px;padding:10px 14px;display:grid}.counterfactual-invariant span{color:#805b19;font:750 12px var(--font-geist-mono), monospace;letter-spacing:.08em}.counterfactual-invariant p{color:#665634;font-size:var(--type-support);margin:0;line-height:1.4}.invariant-formula{min-width:0;margin-top:3px;display:block}.invariant-math{max-width:100%;font-size:clamp(15px,1.2vw,20px)}.equation-legend{color:var(--muted);font-size:var(--type-support);margin:7px 2px 0;line-height:1.35}.progress-warning{background:#f6eddc;border:1px solid #dbc79d;align-items:center;gap:15px;margin-top:14px;padding:12px 14px;display:flex}.progress-warning>div{min-width:0}.progress-warning b{color:#624716;font-size:var(--type-emphasis)}.progress-warning p{color:#6c5831;font-size:var(--type-support);margin:3px 0 0;line-height:1.4}.asymmetry-matrix{margin-top:6px}.evidence-provenance-grid{grid-template-columns:repeat(2,minmax(0,1fr))}.provenance-card .provenance-head{justify-content:space-between;align-items:center;gap:8px;display:flex}.provenance-card .provenance-head .evidence-badge{flex:none;font-size:8px}.provenance-card ul{margin:13px 0 0;padding-left:19px}.provenance-card li{color:var(--muted);font-size:var(--type-body);line-height:1.48}.provenance-card li+li{margin-top:7px}.anchor-authority{box-shadow:inset 0 4px 0 var(--green)}.intersection-callout{grid-template-columns:repeat(3,minmax(0,1fr) 28px) minmax(190px,1.2fr);align-items:stretch;gap:7px;margin-top:16px;display:grid}.intersection-callout div,.intersection-callout strong{border:1px solid var(--line);background:var(--white);flex-direction:column;justify-content:center;min-height:92px;padding:15px 13px;display:flex}.intersection-callout div span{color:var(--red);font:700 9px var(--font-geist-mono), monospace;letter-spacing:.07em}.intersection-callout div b{color:var(--navy);margin-top:8px;font-size:16px}.intersection-callout i{color:var(--red);font:750 20px var(--font-geist-mono), monospace;text-align:center;align-self:center}.intersection-callout strong{border-color:var(--navy);background:var(--navy);color:var(--white);font-size:17px;line-height:1.3}.three-stream-pipeline{margin-top:12px}.three-stream-pipeline .method-stage{min-height:180px}.architecture-contract{grid-template-columns:repeat(3,minmax(0,1fr));gap:10px;margin-top:14px;display:grid}.architecture-contract article{border:1px solid var(--line);background:#ffffffd6;padding:13px 14px}.architecture-contract span{color:var(--red);font:750 12px var(--font-geist-mono), monospace;letter-spacing:.07em}.architecture-contract code{color:var(--blue);font:13px/1.38 var(--font-geist-mono), monospace;white-space:normal;margin-top:8px;display:block}.architecture-contract p{color:var(--muted);font-size:var(--type-support);margin:8px 0 0;line-height:1.4}.structured-grid{grid-template-columns:repeat(3,minmax(0,1fr));gap:11px;margin-top:11px;display:grid}.structured-grid article{border:1px solid var(--line);border-left:4px solid var(--blue);background:#ffffffe6;min-height:125px;padding:14px}.structured-grid article:nth-child(2),.structured-grid article:nth-child(5){border-left-color:var(--green)}.structured-grid article:nth-child(3),.structured-grid article:nth-child(6){border-left-color:var(--red)}.structured-grid code{color:var(--red);font:700 13px var(--font-geist-mono), monospace}.structured-grid h3{color:var(--navy);margin:10px 0 6px;font-size:16px}.structured-grid p{color:var(--muted);font-size:var(--type-support);margin:0;line-height:1.4}.do-not-reconstruct{border-left:4px solid var(--red);background:#f3e9e7;flex-wrap:wrap;align-items:center;gap:7px;margin-top:12px;padding:10px 12px;display:flex}.do-not-reconstruct b{color:var(--red);font:750 12px var(--font-geist-mono), monospace;letter-spacing:.06em;margin-right:3px}.do-not-reconstruct span{background:var(--white);color:#684a47;border:1px solid #dcb5b1;padding:4px 7px;font-size:13px}.training-objective{border-top:5px solid var(--blue)}.qualification-list{border-top:5px solid var(--red)}.training-objective dl{grid-template-columns:135px 1fr;margin:14px 0 0;display:grid}.training-objective dt,.training-objective dd{border-bottom:1px solid var(--line);margin:0;padding:5px 0}.training-objective dt{color:var(--blue);font:700 11px var(--font-geist-mono), monospace}.training-objective dd{color:var(--muted);font-size:var(--type-support)}.anchor-rule,.noncompensatory-rule{border-left:4px solid var(--red);color:#664744;font-size:var(--type-emphasis);background:#f3e9e7;margin:14px 0 0;padding:9px 11px;font-weight:650;line-height:1.4}.progress-metrics{border:1px solid var(--line);background:var(--line);grid-template-columns:1.8fr 1fr 1fr;gap:1px;margin-top:12px;display:grid}.progress-metrics span{background:var(--white);color:var(--muted);font-size:var(--type-support);padding:10px 12px;line-height:1.35}.progress-metrics b{color:var(--navy);font:750 12px var(--font-geist-mono), monospace;letter-spacing:.045em;text-transform:uppercase;margin-bottom:3px;display:block}.progress-metrics .metric-alert{color:#70423e;background:#f5e8e6}.progress-metrics .metric-alert b{color:var(--red)}.progress-video-grid{align-items:start;gap:10px;display:grid}.progress-video-grid.four{grid-template-columns:repeat(4,minmax(0,1fr))}.progress-video-grid.three{grid-template-columns:repeat(3,minmax(0,1fr))}.progress-video-grid .experiment-media-frame{aspect-ratio:var(--media-ratio,16 / 9)}.oracle-layout{grid-template-columns:minmax(0,1.65fr) minmax(250px,.75fr);gap:10px;margin-top:10px;display:grid}.oracle-table-wrap{min-width:0;overflow-x:auto}.progress-table{border-collapse:collapse;border:1px solid var(--line);background:var(--white);width:100%}.progress-table th{background:var(--navy);color:var(--white);font:700 12.5px/1.3 var(--font-geist-mono), monospace;letter-spacing:.035em;text-align:left;text-transform:uppercase;padding:7px 9px}.progress-table td{border-top:1px solid var(--line);color:var(--muted);padding:7px 9px;font-size:14.5px}.progress-table th+th,.progress-table td+td{border-left:1px solid var(--line)}.progress-table td.positive,.positive{color:var(--green);background:#edf5f0;font-weight:750}.progress-table td.negative,.negative{color:var(--red)}.oracle-layout .progress-conclusion{grid-template-columns:1fr;align-content:center;margin-top:0}.oracle-analysis-grid{grid-template-columns:repeat(3,minmax(0,.65fr)) minmax(280px,1.35fr);gap:9px;margin-top:11px;display:grid}.metric-card,.scope-card{border:1px solid var(--line);background:var(--white);padding:11px 12px}.metric-card span{color:var(--blue);font:700 12px var(--font-geist-mono), monospace;letter-spacing:.05em}.metric-card b{color:var(--navy);font:720 24px var(--font-geist-mono), monospace;margin:7px 0 3px;display:block}.metric-card small{color:var(--muted);font-size:14px;line-height:1.35}.metric-danger{background:#f5e8e6;border-color:#d3a7a3}.metric-danger b{color:var(--red)}.scope-card{align-items:center;gap:10px;display:flex}.scope-card p{color:var(--muted);font-size:var(--type-support);margin:0;line-height:1.4}.verdict-split{grid-template-columns:repeat(2,minmax(0,1fr));gap:10px;margin-top:10px;display:grid}.verdict-split article{border-left:5px solid var(--green);background:#e7f2ec;padding:11px 14px}.verdict-split .verdict-fail{border-left-color:var(--red);background:#f3e9e7}.verdict-split span{color:var(--green);font:750 8.5px var(--font-geist-mono), monospace;letter-spacing:.06em}.verdict-split .verdict-fail span{color:var(--red)}.verdict-split h3{color:var(--navy);margin:6px 0 4px;font-size:15px}.verdict-split p{color:var(--muted);font-size:var(--type-support);margin:0;line-height:1.4}.gate-table{border:1px solid var(--line);background:var(--white);margin-top:10px}.gate-table>div{grid-template-columns:minmax(195px,1.25fr) repeat(5,minmax(80px,1fr));display:grid}.gate-table>div+div{border-top:1px solid var(--line)}.gate-table span,.gate-table b{border-left:1px solid var(--line);text-align:center;padding:7px 8px;font-size:10.5px}.gate-table b{color:var(--navy);text-align:left;border-left:0}.gate-head{background:var(--navy);color:var(--white)}.gate-head span{font:700 8.5px var(--font-geist-mono), monospace;letter-spacing:.035em;text-transform:uppercase;border-left-color:#fff3}.gate-head span:first-child{text-align:left;border-left:0}.gate-pass{color:var(--green);background:#edf5f0;font-weight:750}.gate-fail{color:var(--red);background:#fbf1ef;font-weight:750}.compact-sync-group+.compact-sync-group{margin-top:8px}.compact-sync-group .experiment-syncbar{min-height:31px;margin-bottom:4px;padding-block:3px}.compact-sync-group .experiment-sync-copy>small{display:none}.compact-sync-group .experiment-sync-button{min-height:28px;padding-block:4px;font-size:12.5px}.progress-case-stack{gap:2px;display:grid}.progress-case-row{grid-template-columns:minmax(190px,.9fr) repeat(4,minmax(0,1fr));align-items:center;gap:8px;display:grid}.progress-case-copy{border-left:5px solid var(--red);background:#f2e7e5;flex-direction:column;justify-content:center;align-self:stretch;padding:10px 12px;display:flex}.progress-case-copy span{color:var(--red);font:750 12px var(--font-geist-mono), monospace;letter-spacing:.06em}.progress-case-copy h3{color:var(--navy);margin:6px 0 5px;font-size:17px;line-height:1.2}.progress-case-copy p{color:var(--muted);margin:0;font-size:14.25px;line-height:1.38}.progress-case-row .experiment-media-frame{aspect-ratio:var(--media-ratio,16 / 9)}.progress-case-row .experiment-media figcaption{margin-top:3px}.progress-case-row .experiment-media figcaption b{font-size:13.5px}.progress-case-row .experiment-media figcaption span{display:none}.r0-layout{grid-template-columns:minmax(270px,.72fr) minmax(0,1.55fr);gap:14px;margin-top:12px;display:grid}.r0-summary{border:1px solid var(--line);border-top:5px solid var(--red);background:var(--white);padding:17px}.r0-summary>span{color:var(--red);font:750 12px var(--font-geist-mono), monospace;letter-spacing:.06em}.r0-summary h3{color:var(--navy);margin:20px 0 10px;font-size:20px}.r0-summary ul{color:var(--muted);font-size:var(--type-body);margin:0;padding-left:18px;line-height:1.5}.r0-status{border:1px solid var(--red);color:var(--red);font:750 12.5px/1.35 var(--font-geist-mono), monospace;background:#f5e8e6;margin-top:18px;padding:9px 10px}.r0-table{min-width:0}.evidence-ledger{grid-template-columns:repeat(3,minmax(0,1fr));gap:11px;margin-bottom:12px;display:grid}.evidence-ledger article{border:1px solid var(--line);background:var(--white);padding:13px 14px}.evidence-ledger .ledger-established{border-top:5px solid var(--green)}.evidence-ledger .ledger-component{border-top:5px solid var(--blue)}.evidence-ledger .ledger-unresolved{border-top:5px solid var(--red)}.evidence-ledger h3{color:var(--navy);margin:11px 0 7px;font-size:16px}.evidence-ledger ul{color:var(--muted);font-size:var(--type-support);margin:0;padding-left:17px;line-height:1.42}.evidence-ledger li+li{margin-top:4px}#risks .risk-grid{grid-template-columns:repeat(4,minmax(0,1fr));gap:9px}#risks .risk-card{padding:13px 12px 11px}#risks .risk-card h3{margin-top:10px;font-size:17px}#risks .risk-card p{font-size:14px;line-height:1.4}.next-step-grid{grid-template-columns:repeat(3,minmax(0,1fr));gap:12px;display:grid}.next-step-grid article{background:#ffffff0f;border:1px solid #ffffff47;border-top:4px solid #f1bf7c;min-height:150px;padding:15px 16px}.next-step-grid span{color:#f1bf7c;font:750 12.5px var(--font-geist-mono), monospace}.next-step-grid h3{color:var(--white);margin:14px 0 7px;font-size:17px}.next-step-grid p{color:#c7d4df;font-size:var(--type-support);margin:0;line-height:1.43}.stop-rule{background:#a33b344d;border:1px solid #d48179;grid-template-columns:130px 1fr;gap:15px;margin-top:13px;padding:11px 14px;display:grid}.stop-rule b{color:#ffd0cb;font:750 12.5px var(--font-geist-mono), monospace;letter-spacing:.06em}.stop-rule span{color:var(--white);font-size:var(--type-emphasis);font-weight:650}.closing-quote{color:#f1bf7c;text-align:center;border:0;margin:12px 0 0;padding:0;font-size:clamp(18px,1.8vw,25px);font-weight:620;line-height:1.35}@media (width>=1001px){.progress-video-grid .experiment-media-portrait{justify-self:center;width:min(100%,30svh)}#gap16-a .progress-case-row .experiment-media-portrait{justify-self:center;width:min(100%,18svh)}}@media (width>=1001px) and (height<=860px){#oracle-evidence .slide-inner,#oracle-analysis .slide-inner,#event00 .slide-inner,#event01 .slide-inner,#factorial .slide-inner,#gap16-a .slide-inner,#gap16-late-endpoint .slide-inner,#gap16-b .slide-inner{padding-top:60px;padding-bottom:17px}#oracle-evidence .slide-heading,#oracle-analysis .slide-heading,#event00 .slide-heading,#event01 .slide-heading,#factorial .slide-heading,#gap16-a .slide-heading,#gap16-late-endpoint .slide-heading,#gap16-b .slide-heading{margin-bottom:11px;padding-bottom:8px}#oracle-evidence .experiment-syncbar,#oracle-analysis .experiment-syncbar,#event00 .experiment-syncbar,#event01 .experiment-syncbar,#factorial .experiment-syncbar{min-height:32px;margin-bottom:4px;padding-block:2px}}@media (width<=1000px){.executive-grid,.failure-mode-grid,.structured-grid,.architecture-contract,.next-step-grid{grid-template-columns:repeat(2,minmax(0,1fr))}.failure-mode-card:last-child{grid-column:1/-1}.equation-grid,.evidence-ledger,#risks .risk-grid{grid-template-columns:1fr 1fr}.intersection-callout{grid-template-columns:1fr}.intersection-callout i{display:none}.intersection-callout div,.intersection-callout strong{min-height:0}.architecture-contract article:last-child{grid-column:1/-1}.progress-video-grid.four{grid-template-columns:repeat(2,minmax(0,1fr))}.oracle-layout,.r0-layout{grid-template-columns:1fr}.oracle-analysis-grid{grid-template-columns:repeat(3,1fr)}.oracle-analysis-grid .scope-card{grid-column:1/-1}.progress-case-row{grid-template-columns:repeat(2,minmax(0,1fr))}.progress-case-copy{grid-column:1/-1}.gate-table{overflow-x:auto}.gate-table>div{min-width:760px}}@media (width<=650px){.executive-grid,.two-up,.failure-mode-grid,.equation-grid,.evidence-provenance-grid,.structured-grid,.architecture-contract,.progress-metrics,.progress-video-grid.four,.progress-video-grid.three,.oracle-analysis-grid,.verdict-split,.evidence-ledger,#risks .risk-grid,.next-step-grid{grid-template-columns:1fr}.failure-mode-card:last-child{grid-column:auto}.counterfactual-invariant{grid-template-columns:1fr}.counterfactual-intervention-definition{grid-template-columns:1fr;gap:3px}.progress-status-card,.equation-grid article,.next-step-grid article{min-height:0}.equation-grid code{margin-block:20px 12px}.progress-conclusion{grid-template-columns:1fr}.progress-warning{flex-direction:column;align-items:flex-start}.training-objective dl{grid-template-columns:1fr}.training-objective dt{border-bottom:0;padding-bottom:1px}.training-objective dd{padding-top:1px}.progress-case-row{grid-template-columns:1fr}.progress-case-copy{grid-column:auto}.stop-rule{grid-template-columns:1fr}}@media print{.evidence-badge{min-height:19px;padding:3px 6px;font-size:7.5px}.progress-status-card{min-height:126px;padding:12px 13px}.progress-status-card h3{margin-top:12px;font-size:15px}.progress-quote{margin-top:12px;padding:11px 16px;font-size:20px}.motivation-contract,.motivation-example,.training-objective,.qualification-list{padding:14px 16px}.failure-mode-grid{grid-template-columns:repeat(3,minmax(0,1fr))}.failure-mode-card,.failure-mode-card:last-child{grid-column:auto;min-height:240px;padding:14px}.failure-mode-card h3{margin-top:23px;font-size:19px}.failure-mode-card small{padding-top:13px}.equation-grid{grid-template-columns:repeat(3,minmax(0,1fr))}.equation-grid article{min-height:176px;padding:14px}.equation-grid code{margin:26px 0 13px;font-size:19px}.counterfactual-intervention-definition{margin-bottom:6px;padding:5px 9px}.counterfactual-intervention-definition p{font-size:9.5px}.intervention-math{font-size:16px}.counterfactual-formula{gap:3px;min-height:58px;margin:17px 0 12px}.counterfactual-math{font-size:18px}.counterfactual-invariant{margin-top:8px;padding:7px 11px}.invariant-math{font-size:17px}.equation-legend{margin-top:5px}.progress-conclusion{margin-top:8px;padding:8px 11px}.method-pipeline{display:flex}.method-arrow{display:grid}.three-stream-pipeline .method-stage{min-height:150px;padding:12px}.architecture-contract{margin-top:9px}.structured-grid article{min-height:105px;padding:11px}.progress-video-grid{gap:7px}.progress-video-grid.four{grid-template-columns:repeat(4,minmax(0,1fr))}.progress-video-grid.three{grid-template-columns:repeat(3,minmax(0,1fr))}.progress-video-grid .experiment-media-portrait{justify-self:center;width:2.25in}.progress-video-grid .experiment-media figcaption{margin-top:3px}.oracle-layout,.oracle-analysis-grid,.verdict-split,.gate-table{margin-top:7px}.progress-case-stack{gap:1px}.compact-sync-group+.compact-sync-group{margin-top:5px}.progress-case-row{grid-template-columns:180px repeat(4,minmax(0,1fr));gap:6px}#gap16-a .progress-case-row .experiment-media-portrait{justify-self:center;width:1.4in}.progress-case-copy{grid-column:auto;padding:8px 9px}.progress-case-copy h3{margin-block:4px;font-size:13px}.progress-case-copy p{font-size:9.5px}.evidence-ledger{gap:8px;margin-bottom:8px}.evidence-ledger article{padding:10px 11px}.next-step-grid{gap:9px}.next-step-grid article{min-height:126px;padding:12px 13px}.stop-rule{margin-top:9px;padding:8px 11px}.closing-quote{margin-top:8px;font-size:20px}}.authority-grid{grid-template-columns:repeat(3,minmax(0,1fr));gap:12px;margin-top:11px;display:grid}.authority-card{border:1px solid var(--line);border-top:5px solid var(--blue);background:#ffffffe6;min-width:0;min-height:245px;padding:17px 18px 15px}.authority-action{border-top-color:var(--red);background:#fbf4f2}.authority-anchor{border-top-color:var(--green);background:#f1f7f3}.authority-card>span{color:var(--red);font:750 12px/1.3 var(--font-geist-mono), monospace;letter-spacing:.075em}.authority-card h3{color:var(--navy);margin:21px 0 10px;font-size:18px;line-height:1.2}.authority-card ul{margin:0;padding-left:18px}.authority-card li{color:var(--muted);font-size:var(--type-support);line-height:1.42}.authority-card li+li{margin-top:7px}.permission-rule{background:#f8f0df;border:1px solid #d7c293;grid-template-columns:auto minmax(140px,1fr) 24px auto minmax(140px,1fr) 24px auto minmax(140px,1fr);align-items:center;gap:8px;margin-top:12px;padding:10px 12px;display:grid}.permission-rule span{color:#805b19;font:750 12px/1.25 var(--font-geist-mono), monospace;letter-spacing:.07em}.permission-rule b{color:var(--navy);font-size:var(--type-support);line-height:1.35}.permission-rule i{color:var(--red);font:750 17px var(--font-geist-mono), monospace;text-align:center}.action-abi-strip{border:1px solid var(--navy);background:var(--navy);color:var(--white);flex-wrap:wrap;justify-content:center;align-items:center;gap:8px;margin-top:10px;padding:9px 12px;display:flex}.action-abi-strip code{color:var(--white);font:700 13px/1.35 var(--font-geist-mono), monospace}.action-abi-strip span{color:#f1bf7c;font:750 15px var(--font-geist-mono), monospace}.action-program-grid{margin-top:10px}.authorization-equations{border:1px solid var(--line-dark);background:var(--line);grid-template-columns:repeat(2,minmax(0,1fr));gap:1px;margin-top:10px;display:grid}.authorization-equations code{background:var(--white);min-width:0;color:var(--navy);font:650 13px/1.4 var(--font-geist-mono), monospace;white-space:normal;padding:9px 11px}.authorization-grid{grid-template-columns:repeat(4,minmax(0,1fr));gap:9px;margin-top:10px;display:grid}.authorization-card{border:1px solid var(--line);border-top:4px solid var(--blue);background:var(--white);min-width:0;min-height:168px;padding:13px 13px 12px}.auth-create{border-top-color:var(--green)}.auth-contact{border-top-color:var(--red)}.auth-null{border-top-color:var(--amber)}.authorization-card>span{color:var(--red);font:750 12px/1.3 var(--font-geist-mono), monospace;letter-spacing:.055em}.authorization-card h3{color:var(--navy);margin:14px 0 7px;font-size:15px;line-height:1.2}.authorization-card p{color:var(--muted);font-size:var(--type-support);margin:0;line-height:1.4}.authorization-warning{border-left:5px solid var(--red);background:#f3e9e7;grid-template-columns:minmax(190px,.32fr) 1fr;align-items:center;gap:14px;margin-top:10px;padding:9px 12px;display:grid}.authorization-warning b{color:var(--red);font-size:var(--type-emphasis)}.authorization-warning p{color:#654b49;font-size:var(--type-support);margin:0;line-height:1.4}.train-only-strip{background:#ffffffb8;border:1px dashed #9aa8b4;grid-template-columns:auto minmax(0,1fr) minmax(0,1.2fr) minmax(250px,1.25fr);align-items:center;gap:8px;margin-top:10px;padding:9px 10px;display:grid}.train-only-strip b{color:var(--red);font:750 12px var(--font-geist-mono), monospace;letter-spacing:.06em}.train-only-strip span{color:var(--muted);font:13px/1.35 var(--font-geist-mono), monospace}.train-only-strip strong{background:var(--navy);color:var(--white);font:750 12px/1.3 var(--font-geist-mono), monospace;text-align:center;padding:7px 9px}.stage-grid{grid-template-columns:repeat(3,minmax(0,1fr));gap:10px;margin-top:10px;display:grid}.stage-card{border:1px solid var(--line);border-top:5px solid var(--blue);background:var(--white);min-width:0;min-height:222px;padding:14px}.stage-card:nth-child(2){border-top-color:var(--green)}.stage-card:nth-child(3){border-top-color:var(--red)}.stage-card>span{color:var(--red);font:750 12px var(--font-geist-mono), monospace;letter-spacing:.07em}.stage-card h3{color:var(--navy);margin:13px 0 8px;font-size:18px;line-height:1.2}.stage-card code{min-height:55px;color:var(--blue);font:12.5px/1.42 var(--font-geist-mono), monospace;white-space:normal;overflow-wrap:anywhere;display:block}.stage-card p{color:var(--muted);font-size:var(--type-support);margin:10px 0 0;line-height:1.4}.loss-contract-grid{grid-template-columns:repeat(4,minmax(0,1fr));gap:8px;margin-top:10px;display:grid}.loss-contract-grid article{border:1px solid var(--line);background:#edf2f6;padding:9px 10px}.loss-contract-grid b{color:var(--blue);font:750 12.5px var(--font-geist-mono), monospace;display:block}.loss-contract-grid span{color:var(--muted);margin-top:4px;font-size:13.5px;line-height:1.35;display:block}.training-invalidation{border-left:5px solid var(--red);background:#f3e9e7;flex-wrap:wrap;align-items:center;gap:7px;margin-top:10px;padding:8px 10px;display:flex}.training-invalidation b{color:var(--red);font:750 12px var(--font-geist-mono), monospace;letter-spacing:.055em;margin-right:3px}.training-invalidation span{background:var(--white);color:#684a47;border:1px solid #dcb5b1;padding:4px 7px;font-size:13px}.evaluation-layout{grid-template-columns:minmax(0,1.15fr) minmax(300px,.85fr);gap:12px;margin-top:10px;display:grid}.strict-pass-card,.intervention-card{border:1px solid var(--line);background:var(--white);min-width:0;padding:14px 15px}.strict-pass-card{border-top:5px solid var(--red)}.intervention-card{border-top:5px solid var(--blue)}.strict-pass-card h3,.intervention-card h3{color:var(--navy);margin:12px 0 8px;font-size:17px;line-height:1.2}.strict-pass-card ol{columns:2;column-gap:26px;margin:10px 0 0;padding-left:20px}.strict-pass-card li{break-inside:avoid;color:var(--muted);font-size:var(--type-support);line-height:1.4}.strict-pass-card li+li{margin-top:5px}.pass-equation{background:var(--navy);color:var(--white);font:650 13px/1.45 var(--font-geist-mono), monospace;padding:9px 10px}.intervention-chips{flex-wrap:wrap;gap:5px;display:flex}.intervention-chips span{color:#355066;font:12px/1.25 var(--font-geist-mono), monospace;background:#edf2f6;border:1px solid #a8b7c3;padding:4px 6px}.basketball-check,.fallback-rule{border-left:4px solid var(--amber);background:#f8f0df;margin-top:10px;padding:9px 10px}.fallback-rule{border-left-color:var(--green);background:#e7f2ec}.basketball-check b,.fallback-rule b{color:var(--navy);font-size:14px}.basketball-check p,.fallback-rule p{color:var(--muted);margin:4px 0 0;font-size:13.5px;line-height:1.38}.gap-slide-meta{grid-template-columns:max-content minmax(0,1fr);align-items:center;gap:9px;margin-bottom:9px;display:grid}.rate-normalization-banner{border:1px solid #d7c293;border-left:5px solid var(--amber);background:#f8f0df;grid-template-columns:max-content minmax(0,1fr) max-content;align-items:center;gap:10px;min-width:0;padding:7px 10px;display:grid}.rate-normalization-banner b{color:#805b19;font:800 12.5px/1.25 var(--font-geist-mono), monospace;letter-spacing:.065em}.rate-normalization-banner span{color:var(--navy);font-size:var(--type-support);font-weight:700}.rate-normalization-banner small{color:#6b5a36;font:8.5px/1.3 var(--font-geist-mono), monospace;text-align:right}.gap-audit-layout{grid-template-columns:minmax(300px,.82fr) minmax(0,1.45fr);align-items:stretch;gap:10px;display:grid}.gap-audit-explanation{grid-template-rows:repeat(2,minmax(0,1fr));gap:8px;display:grid}.gap-audit-card{border:1px solid var(--line);border-left:5px solid var(--green);background:#ffffffeb;min-width:0;padding:11px 13px}.gap-audit-card.audit-rejected{border-left-color:var(--red);background:#fbf4f2}.gap-audit-card>span{color:var(--green);font:750 12px/1.3 var(--font-geist-mono), monospace;letter-spacing:.07em}.gap-audit-card.audit-rejected>span{color:var(--red)}.gap-audit-card h3{color:var(--navy);margin:7px 0 5px;font-size:17px;line-height:1.2}.gap-audit-card p{color:var(--muted);margin:0;font-size:14px;line-height:1.4}.gap-audit-table-wrap,.gap-vjepa-table-wrap{min-width:0;overflow-x:auto}.gap-audit-table th,.gap-audit-table td,.gap-vjepa-table th,.gap-vjepa-table td{padding:5px 7px}.gap-audit-table th:first-child{width:48%}.gap-audit-table th:nth-child(2){width:18%}.gap-audit-table th:nth-child(3){width:34%}.gap-audit-table td:nth-child(2){color:var(--navy);font:750 13px var(--font-geist-mono), monospace;white-space:nowrap}.gap-audit-table td:last-child{font-size:13.5px}.gap-rejection-row td{letter-spacing:.035em;background:#f5e8e6;border-top:2px solid #d4a29d;color:var(--red)!important;font-weight:800!important}.gap-method-strip{grid-template-columns:minmax(0,1fr) 18px minmax(0,1fr) 18px minmax(0,1fr) 18px minmax(0,1.25fr);align-items:stretch;gap:5px;margin-bottom:8px;display:grid}.gap-method-strip span{border:1px solid var(--line);min-width:0;color:var(--muted);font:13px/1.32 var(--font-geist-mono), monospace;background:#ffffffeb;padding:8px 9px}.gap-method-strip b{color:var(--blue);letter-spacing:.045em;margin-bottom:3px;font-size:12px;display:block}.gap-method-strip i{color:var(--red);font:800 15px var(--font-geist-mono), monospace;text-align:center;align-self:center;font-style:normal}.gap-vjepa-table th:first-child{width:33%}.gap-vjepa-table td:not(:first-child){text-align:center;white-space:nowrap}.gap-admitted-row td{color:var(--green);background:#edf5f0;font-weight:750}.gap-admitted-row td:first-child{color:var(--navy)}.gap-threshold-note{color:var(--muted);font:13px/1.35 var(--font-geist-mono), monospace;margin:4px 0 0}.gap-score-grid{grid-template-columns:repeat(4,minmax(0,1fr));gap:7px;margin-top:7px;display:grid}.gap-score-grid .metric-card{padding:8px 10px}.gap-score-grid .metric-card b{margin:4px 0 2px;font-size:20px}.gap-score-grid .metric-card small{line-height:1.3;display:block}.gap-score-grid .gap-score-pair b{font-size:13px;line-height:1.3}.gap-score-positive{background:#edf5f0;border-color:#a9c7b8}.gap-score-grid .gap-score-positive b{color:var(--green)}@media (width<=1000px){.authority-grid,.stage-grid{grid-template-columns:repeat(2,minmax(0,1fr))}.authority-card:last-child,.stage-card:last-child{grid-column:1/-1}.permission-rule{grid-template-columns:auto 1fr}.permission-rule i{display:none}.authorization-grid,.loss-contract-grid{grid-template-columns:repeat(2,minmax(0,1fr))}.train-only-strip{grid-template-columns:auto 1fr}.train-only-strip strong{grid-column:1/-1}.evaluation-layout,.gap-audit-layout{grid-template-columns:1fr}.gap-method-strip{grid-template-columns:repeat(2,minmax(0,1fr))}.gap-method-strip i{display:none}.gap-score-grid{grid-template-columns:repeat(2,minmax(0,1fr))}}@media (width<=650px){.authority-grid,.authorization-equations,.authorization-grid,.stage-grid,.loss-contract-grid{grid-template-columns:1fr}.authority-card:last-child,.stage-card:last-child{grid-column:auto}.authority-card,.authorization-card,.stage-card{min-height:0}.action-abi-strip{justify-content:flex-start}.authorization-warning,.train-only-strip{grid-template-columns:1fr}.strict-pass-card ol{columns:1}.gap-slide-meta,.rate-normalization-banner,.gap-method-strip,.gap-score-grid{grid-template-columns:1fr}.rate-normalization-banner small{text-align:left}}@media print{.authority-grid{gap:9px;margin-top:8px}.authority-card{min-height:210px;padding:13px 14px}.authority-card h3{margin-top:16px;font-size:16px}.permission-rule{margin-top:9px;padding:8px 10px}.action-abi-strip{margin-top:7px;padding:7px 10px}.action-program-grid,.authorization-equations{margin-top:7px}.authorization-equations code{padding:7px 9px;font-size:9.5px}.authorization-grid{gap:7px;margin-top:7px}.authorization-card{min-height:142px;padding:10px}.authorization-card h3{margin-top:10px;font-size:13px}.authorization-warning{margin-top:7px;padding:7px 9px}.train-only-strip{margin-top:7px;padding:7px 8px}.stage-grid{gap:8px;margin-top:7px}.stage-card{min-height:188px;padding:11px}.stage-card h3{margin-top:10px;font-size:14px}.stage-card code{min-height:47px;font-size:8.5px}.loss-contract-grid,.training-invalidation{margin-top:7px}.loss-contract-grid article{padding:7px 8px}.training-invalidation{padding:6px 8px}.evaluation-layout{gap:9px;margin-top:7px}.strict-pass-card,.intervention-card{padding:11px 12px}.strict-pass-card h3,.intervention-card h3{margin-top:8px;font-size:15px}.strict-pass-card ol{margin-top:7px}.basketball-check,.fallback-rule{margin-top:7px;padding:7px 8px}.gap-slide-meta{margin-bottom:6px}.rate-normalization-banner{padding:5px 8px}.gap-audit-layout{gap:7px}.gap-audit-card{padding:8px 10px}.gap-audit-table th,.gap-audit-table td,.gap-vjepa-table th,.gap-vjepa-table td{padding:4px 6px}.gap-method-strip{margin-bottom:6px}.gap-method-strip span{padding:6px 7px}.gap-score-grid{gap:5px;margin-top:5px}.gap-score-grid .metric-card{padding:6px 8px}}@media screen and (width>=1001px) and (height<=700px){#gap-qwen-audit .slide-inner,#gap-vjepa2-evidence .slide-inner,#counterfactual .slide-inner,#generation-editing-asymmetry .slide-inner,#evidence-provenance .slide-inner,#provenance-rights .slide-inner,#three-stream-editor .slide-inner,#structured-action .slide-inner,#training-contract .slide-inner{padding-top:58px;padding-bottom:9px}#gap-qwen-audit .slide-heading,#gap-vjepa2-evidence .slide-heading,#counterfactual .slide-heading,#generation-editing-asymmetry .slide-heading,#evidence-provenance .slide-heading,#provenance-rights .slide-heading,#three-stream-editor .slide-heading,#structured-action .slide-heading,#training-contract .slide-heading{margin-bottom:9px;padding-bottom:8px}#gap-qwen-audit .section-label,#gap-vjepa2-evidence .section-label,#counterfactual .section-label,#generation-editing-asymmetry .section-label,#evidence-provenance .section-label,#provenance-rights .section-label,#three-stream-editor .section-label,#structured-action .section-label,#training-contract .section-label{margin-bottom:4px}#gap-qwen-audit h2,#gap-vjepa2-evidence h2,#counterfactual h2,#generation-editing-asymmetry h2,#evidence-provenance h2,#provenance-rights h2,#three-stream-editor h2,#structured-action h2,#training-contract h2{font-size:41px}#gap-qwen-audit .subtitle,#gap-vjepa2-evidence .subtitle,#counterfactual .subtitle,#generation-editing-asymmetry .subtitle,#evidence-provenance .subtitle,#provenance-rights .subtitle,#three-stream-editor .subtitle,#structured-action .subtitle,#training-contract .subtitle{margin-top:5px;font-size:13.5px;line-height:1.35}#gap-qwen-audit .evidence-badge,#gap-vjepa2-evidence .evidence-badge,#generation-editing-asymmetry .evidence-badge,#evidence-provenance .evidence-badge,#provenance-rights .evidence-badge,#three-stream-editor .evidence-badge,#structured-action .evidence-badge,#training-contract .evidence-badge{min-height:19px;padding:3px 6px;font-size:7.5px}#gap-qwen-audit .gap-slide-meta,#gap-vjepa2-evidence .gap-slide-meta{gap:6px;margin-bottom:5px}#gap-qwen-audit .rate-normalization-banner,#gap-vjepa2-evidence .rate-normalization-banner{padding:4px 7px}#gap-qwen-audit .rate-normalization-banner span,#gap-vjepa2-evidence .rate-normalization-banner span{font-size:9.5px}#gap-qwen-audit .gap-audit-layout{gap:7px}#gap-qwen-audit .gap-audit-explanation{gap:5px}#gap-qwen-audit .gap-audit-card{padding:7px 9px}#gap-qwen-audit .gap-audit-card h3{margin:4px 0 3px;font-size:12.5px}#gap-qwen-audit .gap-audit-card p{font-size:9.5px;line-height:1.3}#gap-qwen-audit .gap-audit-table th,#gap-qwen-audit .gap-audit-table td{padding:3px 5px;font-size:8.75px}#gap-qwen-audit .progress-conclusion,#gap-vjepa2-evidence .progress-conclusion{margin-top:5px;padding:5px 9px}#gap-qwen-audit .progress-conclusion b,#gap-vjepa2-evidence .progress-conclusion b{font-size:11px}#gap-qwen-audit .progress-conclusion p,#gap-vjepa2-evidence .progress-conclusion p{font-size:9.75px;line-height:1.3}#gap-qwen-audit .experiment-provenance,#gap-vjepa2-evidence .experiment-provenance{margin-top:3px;font-size:7.25px;line-height:1.22}#gap-vjepa2-evidence .gap-method-strip{margin-bottom:5px}#gap-vjepa2-evidence .gap-method-strip span{padding:5px 7px;font-size:8.5px}#gap-vjepa2-evidence .gap-vjepa-table th,#gap-vjepa2-evidence .gap-vjepa-table td{padding:3px 5px;font-size:8.75px}#gap-vjepa2-evidence .gap-threshold-note{margin-top:2px;font-size:7.5px}#gap-vjepa2-evidence .gap-score-grid{gap:5px;margin-top:5px}#gap-vjepa2-evidence .gap-score-grid .metric-card{padding:5px 7px}#gap-vjepa2-evidence .gap-score-grid .metric-card b{margin-top:2px;font-size:16px}#gap-vjepa2-evidence .gap-score-grid .gap-score-pair b{font-size:11px}#gap-vjepa2-evidence .gap-score-grid .metric-card small{font-size:8px}#counterfactual .equation-grid{gap:10px}#counterfactual .counterfactual-intervention-definition{gap:8px;margin-bottom:5px;padding:4px 8px}#counterfactual .counterfactual-intervention-definition>span{font-size:7px}#counterfactual .counterfactual-intervention-definition p{font-size:9.5px}#counterfactual .intervention-math{font-size:15px}#counterfactual .equation-grid article{min-height:0;padding:11px 12px}#counterfactual .counterfactual-formula{min-height:48px;margin:9px 0 7px}#counterfactual .counterfactual-math{font-size:17.5px}#counterfactual .equation-grid p{font-size:10.75px;line-height:1.34}#counterfactual .counterfactual-invariant{gap:12px;margin-top:6px;padding:5px 10px}#counterfactual .invariant-math{font-size:15px}#counterfactual .counterfactual-invariant p{font-size:10.5px;line-height:1.32}#counterfactual .equation-legend{margin-top:4px;font-size:9.5px}#counterfactual .progress-conclusion{margin-top:4px;padding:6px 10px}#counterfactual .progress-conclusion b{font-size:11.5px}#counterfactual .progress-conclusion p{font-size:10.5px;line-height:1.32}#generation-editing-asymmetry .authority-grid{margin-top:7px}#generation-editing-asymmetry .authority-card{min-height:215px;padding:13px 14px}#generation-editing-asymmetry .authority-card h3{margin-top:15px;font-size:16px}#generation-editing-asymmetry .permission-rule{margin-top:8px;padding:7px 9px}#evidence-provenance .action-abi-strip{margin-top:6px;padding:6px 9px}#evidence-provenance .action-program-grid{margin-top:7px}#evidence-provenance .structured-grid article{min-height:104px;padding:9px 11px}#evidence-provenance .structured-grid h3{margin:7px 0 4px;font-size:14px}#evidence-provenance .do-not-reconstruct{margin-top:7px;padding:6px 9px}#provenance-rights .authorization-equations{margin-top:6px}#provenance-rights .authorization-equations code{padding:6px 8px}#provenance-rights .authorization-grid{margin-top:6px}#provenance-rights .authorization-card{min-height:136px;padding:9px 10px}#provenance-rights .authorization-card h3{margin-top:9px;font-size:13.5px}#provenance-rights .authorization-warning{margin-top:6px;padding:6px 9px}#three-stream-editor .three-stream-pipeline{margin-top:7px}#three-stream-editor .three-stream-pipeline .method-stage{min-height:154px;padding:10px 11px}#three-stream-editor .method-stage .method-index{margin-bottom:8px}#three-stream-editor .method-stage p{margin-top:5px}#three-stream-editor .method-stage code{margin-top:6px;font-size:9px}#three-stream-editor .train-only-strip{margin-top:6px;padding:6px 8px}#three-stream-editor .architecture-contract{margin-top:6px}#three-stream-editor .architecture-contract article{padding:8px 10px}#three-stream-editor .architecture-contract code,#three-stream-editor .architecture-contract p{margin-top:5px}#structured-action .stage-grid{margin-top:6px}#structured-action .stage-card{min-height:184px;padding:10px 11px}#structured-action .stage-card h3{margin:9px 0 6px;font-size:14px}#structured-action .stage-card code{min-height:44px;font-size:8.5px}#structured-action .stage-card p,#structured-action .loss-contract-grid,#structured-action .training-invalidation{margin-top:6px}#structured-action .loss-contract-grid article{padding:6px 8px}#structured-action .training-invalidation{padding:5px 8px}#training-contract .evaluation-layout{margin-top:6px}#training-contract .strict-pass-card,#training-contract .intervention-card{padding:10px 12px}#training-contract .strict-pass-card h3,#training-contract .intervention-card h3{margin:8px 0 6px;font-size:15px}#training-contract .strict-pass-card ol{margin-top:7px}#training-contract .basketball-check,#training-contract .fallback-rule{margin-top:6px;padding:6px 8px}#training-contract .noncompensatory-rule{margin-top:7px;padding:6px 9px}#training-contract .progress-metrics{margin-top:7px}#training-contract .progress-metrics span{padding:7px 9px}#oracle-evidence .slide-inner,#oracle-analysis .slide-inner,#event00 .slide-inner,#event01 .slide-inner,#factorial .slide-inner{padding-top:58px;padding-bottom:8px}#oracle-evidence .slide-heading,#oracle-analysis .slide-heading,#event00 .slide-heading,#event01 .slide-heading,#factorial .slide-heading{margin-bottom:8px;padding-bottom:7px}#oracle-evidence .section-label,#oracle-analysis .section-label,#event00 .section-label,#event01 .section-label,#factorial .section-label{margin-bottom:4px}#oracle-evidence h2,#oracle-analysis h2,#event00 h2,#event01 h2,#factorial h2{font-size:41px}#oracle-evidence .subtitle,#oracle-analysis .subtitle,#event00 .subtitle,#event01 .subtitle,#factorial .subtitle{margin-top:5px;font-size:13.5px;line-height:1.35}#oracle-evidence>.slide-inner>.slide-content>.evidence-badge,#oracle-analysis>.slide-inner>.slide-content>.evidence-badge,#event00>.slide-inner>.slide-content>.evidence-badge,#event01>.slide-inner>.slide-content>.evidence-badge,#factorial>.slide-inner>.slide-content>.evidence-badge{min-height:19px;padding:3px 6px;font-size:7.5px}#oracle-evidence .experiment-syncbar,#oracle-analysis .experiment-syncbar,#event00 .experiment-syncbar,#event01 .experiment-syncbar,#factorial .experiment-syncbar{min-height:28px;margin-bottom:3px;padding-block:1px}#oracle-evidence .progress-video-grid,#oracle-analysis .progress-video-grid,#event00 .progress-video-grid,#event01 .progress-video-grid,#factorial .progress-video-grid{gap:6px}#oracle-evidence .experiment-media-fourThree{justify-self:center;width:87%}#oracle-analysis .experiment-media-fourThree{justify-self:center;width:72%}#event00 .experiment-media-portrait{width:min(100%,23svh)}#event01 .experiment-media-portrait{width:min(100%,24svh)}#factorial .experiment-media-portrait{width:min(100%,20svh)}#oracle-evidence .experiment-media figcaption,#oracle-analysis .experiment-media figcaption,#event00 .experiment-media figcaption,#event01 .experiment-media figcaption,#factorial .experiment-media figcaption{margin-top:2px;font-size:9.5px}#oracle-evidence .experiment-media figcaption b,#oracle-analysis .experiment-media figcaption b,#event00 .experiment-media figcaption b,#event01 .experiment-media figcaption b,#factorial .experiment-media figcaption b{font-size:10.5px}#oracle-evidence .oracle-layout,#oracle-analysis .oracle-analysis-grid,#event00 .verdict-split,#factorial .gate-table{margin-top:5px}#oracle-evidence .progress-table th,#oracle-evidence .progress-table td{padding:5px 7px}#oracle-evidence .oracle-layout .progress-conclusion{padding:6px 9px}#oracle-analysis .metric-card,#oracle-analysis .scope-card{padding:8px 9px}#oracle-analysis .metric-card b{margin-top:4px;font-size:19px}#event00 .verdict-split article{padding:7px 10px}#event00 .verdict-split h3{margin:4px 0 2px;font-size:13px}#event00 .verdict-split p{font-size:10.5px;line-height:1.32}#event01 .experiment-instruction{margin-bottom:5px;padding:6px 10px;font-size:11.5px}#event01 .progress-conclusion,#factorial .progress-conclusion{margin-top:5px;padding:6px 9px}#event01 .progress-conclusion b,#factorial .progress-conclusion b{font-size:11.5px}#event01 .progress-conclusion p,#factorial .progress-conclusion p{font-size:10.5px;line-height:1.32}#factorial .gate-table span,#factorial .gate-table b{padding:4px 6px;font-size:9px}#factorial .gate-head span{font-size:7.5px}#oracle-evidence .experiment-provenance,#oracle-analysis .experiment-provenance,#event00 .experiment-provenance,#event01 .experiment-provenance,#factorial .experiment-provenance{margin-top:3px;font-size:7.75px;line-height:1.25}}.progress2-section-meta{align-items:center;gap:13px;margin-bottom:12px;display:flex}.progress2-section-meta>span:last-child{color:var(--muted);font-size:14px;line-height:1.4}.lesson-grid{grid-template-columns:repeat(2,minmax(0,1fr));gap:11px;display:grid}.lesson-card{border:1px solid var(--line);border-top:5px solid var(--navy);background:var(--white);flex-direction:column;min-height:190px;padding:18px 20px 15px;display:flex}.lesson-card.lesson-coordinate{border-top-color:var(--red)}.lesson-card.lesson-decoded{border-top-color:var(--amber)}.lesson-card.lesson-preservation{border-top-color:var(--green)}.lesson-card>span,.coordinate-panel>span,.contract-grid article>span,.source4-branch>span,.source4-controller>span,.costate-grid article>span,.signal-boundary-grid article>span,.decision-grid article>span,.evidence-slot>span{color:var(--red);font:750 12px/1.25 var(--font-geist-mono), monospace;letter-spacing:.07em}.lesson-card h3{color:var(--navy);margin:17px 0 8px;font-size:20px;line-height:1.18}.lesson-card p{color:var(--muted);margin:0;font-size:14.5px;line-height:1.42}.lesson-card small{color:#6d7780;margin-top:auto;padding-top:11px;font-size:12.5px;line-height:1.35}.classic-failure-layout{grid-template-columns:minmax(0,1.55fr) minmax(270px,.62fr);align-items:stretch;gap:14px;display:grid}.failure-ledger{border:1px solid var(--line);background:var(--white);overflow:hidden}.failure-ledger-row{grid-template-columns:1.05fr 1.15fr 1.65fr .58fr;display:grid}.failure-ledger-row+.failure-ledger-row{border-top:1px solid var(--line)}.failure-ledger-row>*{border-right:1px solid var(--line);min-width:0;color:var(--muted);margin:0;padding:13px 14px;font-size:13.5px;line-height:1.36}.failure-ledger-row>:last-child{border-right:0}.failure-ledger-row b{color:var(--navy)}.failure-ledger-row strong{color:var(--red);font:750 12px/1.3 var(--font-geist-mono), monospace}.failure-ledger-head>span{background:var(--navy);color:var(--white);font:750 11px/1.25 var(--font-geist-mono), monospace;letter-spacing:.06em;padding-block:9px}.evidence-slot{border:1px dashed #8795a1;border-top:5px solid var(--amber);background:#faf7ef;padding:18px}.evidence-slot h3{color:var(--navy);margin:28px 0 12px;font-size:21px;line-height:1.2}.evidence-slot p{color:var(--muted);margin:13px 0 0;font-size:13.5px;line-height:1.42}.slot-columns{grid-template-columns:repeat(4,minmax(0,1fr));gap:4px;display:grid}.slot-columns i{border:1px solid var(--line);min-height:62px;color:var(--navy);font:700 10.5px/1.25 var(--font-geist-mono), monospace;text-align:center;background:#e9edf0;place-items:center;padding:8px 5px;font-style:normal;display:grid}.stop-rule-paper{background:#f3e9e7;border-color:#d9afa9}.stop-rule-paper b{color:var(--red)}.stop-rule-paper span{color:#654b49}.coordinate-contrast{grid-template-columns:repeat(2,minmax(0,1fr));gap:14px;display:grid}.coordinate-panel{border:1px solid var(--line);border-top:6px solid var(--red);background:var(--white);flex-direction:column;min-height:460px;padding:19px 21px;display:flex}.coordinate-panel.coordinate-valid{border-top-color:var(--green)}.coordinate-valid>span{color:var(--green)}.coordinate-formula{color:var(--navy);font:650 clamp(17px, 1.55vw, 23px)/1.25 var(--font-geist-mono), monospace;text-align:center;background:#eef1f3;margin:17px 0 14px;padding:14px}.world-pair{grid-template-columns:1fr 30px 1fr;align-items:stretch;gap:5px;display:grid}.world-pair>div,.valid-control-grid>div{border:1px solid var(--line);background:#f7f8f8;padding:13px}.world-pair i{color:var(--red);font:800 20px var(--font-geist-mono), monospace;text-align:center;align-self:center;font-style:normal}.world-pair b,.valid-control-grid b{color:var(--navy);font-size:12.5px;display:block}.world-pair small,.valid-control-grid small{color:var(--muted);margin-top:6px;font-size:12px;line-height:1.35;display:block}.valid-control-grid{grid-template-columns:repeat(3,minmax(0,1fr));gap:5px;display:grid}.coordinate-panel ul{color:var(--muted);margin:17px 0 13px;padding-left:20px;font-size:14px;line-height:1.42}.coordinate-panel li+li{margin-top:6px}.coordinate-panel>strong{border-top:1px solid var(--line);color:var(--red);font:750 12.5px var(--font-geist-mono), monospace;margin-top:auto;padding-top:11px}.coordinate-valid>strong{color:var(--green)}.camera-lineage{grid-template-columns:repeat(3,minmax(0,1fr));gap:9px;display:grid}.camera-lineage article{border:1px solid var(--line);border-top:4px solid var(--red);background:var(--white);flex-direction:column;min-height:152px;padding:14px 16px;display:flex}.camera-lineage article.lineage-seed{border-top-color:var(--amber);background:#faf7ef}.camera-lineage article.lineage-positive{border-top-color:var(--green);background:#edf5f0}.camera-lineage span{color:var(--red);font:750 11.5px var(--font-geist-mono), monospace}.camera-lineage .lineage-seed span{color:var(--amber)}.camera-lineage .lineage-positive span{color:var(--green)}.camera-lineage h3{color:var(--navy);margin:12px 0 6px;font-size:17px;line-height:1.18}.camera-lineage p{color:var(--muted);margin:0;font-size:13px;line-height:1.36}.camera-lineage b{color:var(--red);font:750 11.5px var(--font-geist-mono), monospace;margin-top:auto;padding-top:9px}.camera-lineage .lineage-seed b{color:var(--amber)}.camera-lineage .lineage-positive b{color:var(--green)}.camera-diagnosis-grid{grid-template-columns:repeat(3,minmax(0,1fr));gap:9px;margin-top:12px;display:grid}.camera-diagnosis-grid article{border-left:4px solid var(--navy);background:#e8edf1;padding:12px 14px}.camera-diagnosis-grid article:nth-child(2){border-left-color:var(--green)}.camera-diagnosis-grid article:nth-child(3){border-left-color:var(--red)}.camera-diagnosis-grid span{color:var(--navy);font:750 11px var(--font-geist-mono), monospace}.camera-diagnosis-grid p{color:var(--muted);margin:5px 0 0;font-size:13px;line-height:1.36}.contract-grid{grid-template-columns:repeat(4,minmax(0,1fr));gap:10px;display:grid}.contract-grid article{border:1px solid var(--line);border-top:5px solid var(--navy);background:var(--white);min-height:252px;padding:18px}.contract-grid article:nth-child(2){border-top-color:var(--green)}.contract-grid article:nth-child(3){border-top-color:var(--blue)}.contract-grid article:nth-child(4){border-top-color:var(--red)}.contract-grid h3{color:var(--navy);margin:28px 0 10px;font-size:20px;line-height:1.2}.contract-grid p{color:var(--muted);margin:0;font-size:14px;line-height:1.45}.contract-pipeline{grid-template-columns:1fr auto 1fr auto 1fr;align-items:stretch;gap:7px;margin-top:12px;display:grid}.contract-pipeline>div{border:1px solid var(--line);background:var(--white);padding:12px 14px}.contract-pipeline>div.contract-output{background:var(--navy)}.contract-pipeline>i{color:var(--red);font:800 18px var(--font-geist-mono), monospace;align-self:center;font-style:normal}.contract-pipeline b{color:var(--navy);font:750 11.5px var(--font-geist-mono), monospace;display:block}.contract-pipeline span{color:var(--muted);margin-top:5px;font-size:13px;line-height:1.35;display:block}.contract-output b{color:#f1bf7c}.contract-output span{color:#d6e0e8}.source4-flow{grid-template-columns:repeat(2,minmax(0,1fr)) 52px minmax(270px,1.05fr);align-items:stretch;gap:9px;display:grid}.source4-branch,.source4-controller{border:1px solid var(--line);border-top:5px solid var(--red);background:var(--white);flex-direction:column;min-height:205px;padding:17px 18px;display:flex}.source4-source{border-top-color:var(--green)}.source4-source>span{color:var(--green)}.source4-controller{border-top-color:var(--navy);background:#e8eef3}.source4-controller>span{color:var(--navy)}.source4-branch h3,.source4-controller h3{color:var(--navy);margin:20px 0 9px;font-size:21px}.source4-branch p,.source4-controller p{color:var(--muted);margin:0 0 7px;font-size:13.5px;line-height:1.38}.source4-branch>strong,.source4-controller>strong{border-top:1px solid var(--line);color:var(--navy);font:750 11.5px/1.3 var(--font-geist-mono), monospace;margin-top:auto;padding-top:10px}.source4-merge{place-items:center;display:grid}.source4-merge span{background:var(--navy);width:38px;height:38px;color:var(--white);font:700 23px var(--font-geist-mono), monospace;border-radius:50%;place-items:center;display:grid}.costate-grid{grid-template-columns:repeat(3,minmax(0,1fr));gap:9px;margin-top:11px;display:grid}.costate-grid article{border:1px solid var(--line);border-left:5px solid var(--red);background:#f8f9f9;padding:13px 15px}.costate-grid article:nth-child(2){border-left-color:var(--amber)}.costate-grid article.costate-source{border-left-color:var(--green);background:#edf5f0}.costate-grid article:nth-child(2)>span{color:var(--amber)}.costate-grid .costate-source>span{color:var(--green)}.costate-grid h3{color:var(--navy);margin:0 0 0 8px;font-size:16px;display:inline}.costate-grid p{color:var(--muted);margin:8px 0 0;font-size:13px;line-height:1.36}.firewall-strip{background:#f3e9e7;border:1px solid #d4aaa5;flex-wrap:wrap;align-items:center;gap:7px;margin-top:10px;padding:10px 12px;display:flex}.firewall-strip b{color:var(--red);font:750 11.5px var(--font-geist-mono), monospace;margin-right:auto}.firewall-strip span{color:#654b49;border:1px solid #d4aaa5;padding:4px 7px;font-size:12px}.signal-banner{border-left:6px solid var(--green);background:#e7f2ec;grid-template-columns:minmax(290px,.72fr) 1.28fr;align-items:center;gap:18px;padding:15px 18px;display:grid}.signal-banner>div{gap:5px;display:grid}.signal-banner span{color:var(--green);font:750 11.5px var(--font-geist-mono), monospace;letter-spacing:.07em}.signal-banner b{color:var(--green);font-size:20px}.signal-banner p{color:#3d5f51;margin:0;font-size:14.5px;line-height:1.43}.signal-metrics{grid-template-columns:repeat(4,minmax(0,1fr));gap:8px;margin-top:10px;display:grid}.signal-metrics article{border:1px solid var(--line);background:var(--white);gap:4px;min-height:102px;padding:11px 12px;display:grid}.signal-metrics span{color:var(--muted);font:750 10.5px var(--font-geist-mono), monospace}.signal-metrics b{color:var(--navy);font:750 21px/1.12 var(--font-geist-mono), monospace}.signal-metrics small{color:var(--muted);font-size:12px;line-height:1.3}.signal-boundary-grid{grid-template-columns:repeat(2,minmax(0,1fr));gap:9px;margin-top:10px;display:grid}.signal-boundary-grid>article{border:1px solid var(--line);border-top:4px solid var(--green);background:var(--white);padding:13px 15px}.signal-boundary-grid>article.signal-open{border-top-color:var(--red)}.signal-boundary-grid .signal-observed>span{color:var(--green)}.signal-boundary-grid ul{color:var(--muted);margin:10px 0 0;padding-left:18px;font-size:12.8px;line-height:1.36}.signal-boundary-grid li+li{margin-top:4px}.evidence-slot-wide{border-top-width:3px;grid-column:1/-1;grid-template-columns:205px 1fr;align-items:center;column-gap:12px;padding:11px 14px;display:grid}.evidence-slot-wide p{grid-column:1/-1;margin-top:7px}.slot-columns-seven{grid-template-columns:repeat(7,minmax(0,1fr))}.slot-columns-seven i{min-height:35px}.decision-grid{grid-template-columns:repeat(3,minmax(0,1fr));gap:9px;display:grid}.decision-grid article{background:#ffffff12;border:1px solid #ffffff40;border-top:4px solid #8fb2cf;flex-direction:column;min-height:178px;padding:15px 17px;display:flex}.decision-grid article.decision-priority{border-top-color:#f1bf7c;grid-column:span 2}.decision-grid article>span{color:#f1bf7c}.decision-grid h3{color:var(--white);margin:13px 0 7px;font-size:18px}.decision-grid p{color:#c7d4df;margin:0;font-size:13.5px;line-height:1.38}.decision-grid b{color:#a9c8df;margin-top:auto;padding-top:9px;font-size:12.5px;line-height:1.3}.claim-ladder{grid-template-columns:1.35fr repeat(4,auto 1fr);align-items:stretch;gap:6px;margin-top:11px;display:grid}.claim-ladder span{color:#d5e0e9;text-align:center;border:1px solid #ffffff47;place-items:center;padding:10px 8px;font-size:12.5px;line-height:1.25;display:grid}.claim-ladder span.claim-current{color:#f1bf7c;background:#f1bf7c1f;border-color:#f1bf7c}.claim-ladder i{color:#f1bf7c;align-self:center;font-style:normal}.progress2-closing{margin-top:9px;font-size:19px}@media screen and (width<=1000px){.lesson-grid,.coordinate-contrast,.contract-grid,.signal-boundary-grid,.classic-failure-layout,.signal-banner{grid-template-columns:1fr}.camera-lineage,.camera-diagnosis-grid,.costate-grid,.decision-grid,.contract-grid,.source4-flow{grid-template-columns:repeat(2,minmax(0,1fr))}.source4-merge{display:none}.source4-controller,.decision-grid article.decision-priority{grid-column:1/-1}.claim-ladder{grid-template-columns:1fr}.claim-ladder i{justify-self:center;transform:rotate(90deg)}.evidence-slot-wide{grid-template-columns:1fr}.coordinate-panel{min-height:0}}@media screen and (width<=680px){.camera-lineage,.camera-diagnosis-grid,.contract-grid,.costate-grid,.decision-grid,.source4-flow,.signal-metrics{grid-template-columns:1fr}.source4-controller{grid-column:auto}.failure-ledger-row{grid-template-columns:1fr}.failure-ledger-row>*{border-right:0;border-bottom:1px solid var(--line)}.failure-ledger-row>:last-child{border-bottom:0}.failure-ledger-head{display:none}.slot-columns-seven{grid-template-columns:repeat(2,minmax(0,1fr))}.contract-pipeline{grid-template-columns:1fr}.contract-pipeline>i{justify-self:center;transform:rotate(90deg)}}@media screen and (width>=1001px) and (height<=760px){:is(#failure-memory,#proxy-failure,#invalid-difference,#camera-lineage,#surviving-contract,#source4-method,#source4-signal,#decisive-tests) .slide-heading{margin-bottom:12px;padding-bottom:10px}.lesson-card{min-height:158px;padding-block:13px}.lesson-card h3{margin-top:11px;font-size:18px}.coordinate-panel{min-height:390px;padding-block:14px}.camera-lineage article{min-height:130px;padding-block:10px}.contract-grid article{min-height:205px;padding:14px}.contract-grid h3{margin-top:18px;font-size:18px}.source4-branch,.source4-controller{min-height:172px;padding-block:13px}.signal-banner{padding-block:10px}.signal-metrics article{min-height:82px}.decision-grid article{min-height:150px;padding-block:11px}}@media print{.lesson-card,.failure-ledger,.evidence-slot,.coordinate-panel,.camera-lineage article,.contract-grid article,.source4-branch,.source4-controller,.signal-metrics article,.signal-boundary-grid>article,.decision-grid article{break-inside:avoid}}@media (width<=1000px){.local-recovery-layout{grid-template-columns:1fr}.local-recovery-frame{height:min(54vw,520px);min-height:300px}.local-recovery-copy{grid-template-rows:auto auto auto;grid-template-columns:repeat(3,minmax(0,1fr))}.local-recovery-copy>.evidence-badge,.local-recovery-rule{grid-column:1/-1}}@media (width<=650px){.local-recovery-frame{height:64vw;min-height:240px}.local-recovery-copy{grid-template-columns:1fr}.local-recovery-copy>.evidence-badge,.local-recovery-rule{grid-column:auto}.local-recovery-rule{grid-template-columns:1fr}}@media print{.local-recovery-layout{grid-template-columns:minmax(0,1.72fr) minmax(280px,.78fr);gap:14px;margin-top:5px}.local-recovery-frame{height:4.25in}.local-recovery-figure figcaption{font-size:8px}.local-recovery-copy{grid-template-rows:auto repeat(3,minmax(0,1fr)) auto;grid-template-columns:1fr}.local-recovery-copy article{padding:8px 9px}.local-recovery-copy h3{margin-top:5px;font-size:12px}.local-recovery-copy p{font-size:9.25px}.local-recovery-rule{grid-column:auto;grid-template-columns:80px 1fr;padding:7px 8px}.local-recovery-rule span{font-size:8.5px}}@media screen and (width>=1001px) and (height<=700px){#local-action-recovery .slide-inner{padding-top:58px;padding-bottom:9px}#local-action-recovery .slide-heading{margin-bottom:9px;padding-bottom:8px}#local-action-recovery .section-label{margin-bottom:4px}#local-action-recovery h2{font-size:41px}#local-action-recovery .subtitle{margin-top:5px;font-size:13.5px;line-height:1.35}#local-action-recovery .local-recovery-layout{gap:12px;margin-top:0}#local-action-recovery .local-recovery-frame{height:336px;padding:6px}#local-action-recovery .local-recovery-figure figcaption{margin-top:4px;font-size:8.5px}#local-action-recovery .local-recovery-copy{gap:5px}#local-action-recovery .evidence-badge{min-height:19px;padding:3px 6px;font-size:7.5px}#local-action-recovery .local-recovery-copy article{padding:6px 8px}#local-action-recovery .local-recovery-copy h3{margin:3px 0 2px;font-size:12px}#local-action-recovery .local-recovery-copy p{font-size:9.25px;line-height:1.3}#local-action-recovery .local-recovery-rule{grid-template-columns:78px 1fr;padding:5px 7px}#local-action-recovery .local-recovery-rule span{font-size:8.5px;line-height:1.28}#local-action-recovery .experiment-provenance{margin-top:3px;font-size:7.25px;line-height:1.22}}.result-update{flex-direction:column;flex:1;gap:12px;min-height:0;display:flex}.result-context-row{border-left:5px solid var(--navy);background:#ffffffc2;justify-content:space-between;align-items:center;gap:14px;padding:7px 10px;display:flex}.result-category-mark{gap:2px;min-width:0;display:grid}.result-category-mark b{color:var(--navy);font-size:13px;line-height:1.2}.result-category-mark small{color:var(--muted);font-size:14px;line-height:1.3}.result-phase{border:1px solid var(--line);color:var(--red);background:var(--white);font:750 12px/1.2 var(--font-geist-mono), monospace;letter-spacing:.055em;text-transform:uppercase;white-space:nowrap;flex:none;padding:5px 8px}.result-instruction{border-left:5px solid var(--red);background:#f3e9e7;grid-template-columns:120px 1fr;align-items:center;gap:13px;padding:8px 11px;display:grid}.result-instruction b{color:var(--red);font:750 13px/1.25 var(--font-geist-mono), monospace;letter-spacing:.06em}.result-instruction span{color:#5d4947;white-space:pre-line;overflow-wrap:anywhere;font-size:16px;line-height:1.4}.result-panel-grid{gap:8px;display:grid}.result-panel-grid-1{grid-template-columns:1fr}.result-panel-grid-2{grid-template-columns:repeat(2,minmax(0,1fr))}.result-panel-grid-3{grid-template-columns:repeat(3,minmax(0,1fr))}.result-panel-grid article{border:1px solid var(--line);border-top:5px solid var(--blue);background:#ffffffeb;min-width:0;padding:10px 12px}.result-panel-grid article.result-panel-green{border-top-color:var(--green)}.result-panel-grid article.result-panel-red{border-top-color:var(--red)}.result-panel-grid article.result-panel-amber{border-top-color:var(--amber)}.result-panel-grid span{color:var(--red);font:750 12.5px/1.25 var(--font-geist-mono), monospace;letter-spacing:.055em;text-transform:uppercase;display:block}.result-panel-grid p{color:var(--muted);margin:7px 0 0;font-size:17px;line-height:1.43}.result-formula{overflow-wrap:anywhere;border:1px solid var(--line);border-left:5px solid var(--blue);color:var(--navy);font:600 12px/1.4 var(--font-geist-mono), monospace;background:#eaf0f5;padding:8px 11px;display:block}.result-media-grid{align-items:start;gap:8px;display:grid}.result-media-groups{gap:6px;display:grid}.result-media-groups .compact-sync-group+.compact-sync-group{margin-top:0}.result-media-grid-2{grid-template-columns:repeat(2,minmax(0,1fr))}.result-media-grid-3{grid-template-columns:repeat(3,minmax(0,1fr))}.result-media-grid-4{grid-template-columns:repeat(4,minmax(0,1fr))}.result-media-grid-5{grid-template-columns:repeat(5,minmax(0,1fr))}.result-media-grid-6{grid-template-columns:repeat(6,minmax(0,1fr))}.result-media-grid .experiment-media-portrait{justify-self:center;width:min(100%,150px)}.result-media-grid .experiment-media figcaption{margin-top:5px;font-size:13.5px;line-height:1.32}.result-media-grid .experiment-media figcaption b{font-size:14.5px}.result-media-grid .experiment-media figcaption span{max-width:64%}.result-update .compact-sync-group .experiment-syncbar{min-height:33px;margin-bottom:4px;padding-block:3px}.result-update .compact-sync-group .experiment-sync-copy>span{font-size:9.5px}.result-update .compact-sync-group .experiment-sync-copy>strong{font-size:14.5px}.result-update .compact-sync-group .experiment-sync-copy>small{font-size:12.5px}.result-update .compact-sync-group .experiment-sync-button{min-height:29px;padding:5px 10px;font-size:12.5px}.result-metric-heading{color:var(--navy);font:750 13px/1.25 var(--font-geist-mono), monospace;letter-spacing:.06em;text-transform:uppercase;margin-bottom:10px}.result-metric-grid{gap:7px;display:grid}.result-metric-grid-1{grid-template-columns:1fr}.result-metric-grid-2{grid-template-columns:repeat(2,minmax(0,1fr))}.result-metric-grid-3{grid-template-columns:repeat(3,minmax(0,1fr))}.result-metric-grid-4{grid-template-columns:repeat(4,minmax(0,1fr))}.result-metric-grid-5{grid-template-columns:repeat(5,minmax(0,1fr))}.result-metric-grid article{border:1px solid var(--line);border-left:5px solid var(--navy);background:#fffffff0;grid-template-columns:1fr auto;align-items:baseline;column-gap:9px;min-width:0;padding:8px 10px;display:grid}.result-metric-grid article.metric-positive{border-left-color:var(--green);background:#eaf3ee}.result-metric-grid article.metric-negative{border-left-color:var(--red);background:#f5eae8}.result-metric-grid article>span{color:var(--muted);font:750 12px/1.25 var(--font-geist-mono), monospace;letter-spacing:.045em}.result-metric-grid article>b{color:var(--navy);font:750 24px/1.05 var(--font-geist-mono), monospace;text-align:right}.result-metric-grid article.metric-positive>b{color:var(--green)}.result-metric-grid article.metric-negative>b{color:var(--red)}.result-metric-grid article>small{color:var(--muted);grid-column:1/-1;margin-top:5px;font-size:14px;line-height:1.34}.result-metric-note{color:var(--muted);grid-column:1/-1;margin:5px 0 0;font-size:14.5px;line-height:1.35}.result-table-wrap{border:1px solid var(--line);background:#fffffff2;min-width:0;overflow-x:auto}.result-table{border-collapse:collapse;width:100%;color:var(--muted);font-size:15.5px;line-height:1.36}.result-table th,.result-table td{border-right:1px solid var(--line);border-bottom:1px solid var(--line);text-align:left;vertical-align:top;padding:7px 9px}.result-table tr>:last-child{border-right:0}.result-table tbody tr:last-child>*{border-bottom:0}.result-table thead th{background:var(--navy);color:var(--white);font:750 12.5px/1.25 var(--font-geist-mono), monospace;letter-spacing:.04em;text-transform:uppercase}.result-table tbody th{color:var(--navy);font-weight:750}.result-table tbody tr.result-row-positive>*{background:#eaf3ee}.result-table tbody tr.result-row-negative>*{background:#f5eae8}.result-table tbody tr.result-row-neutral>*{background:#f2f5f7}.result-table-note{border-top:1px solid var(--line);color:var(--muted);margin:0;padding:6px 9px;font-size:14px;line-height:1.36}.result-observation{border-left:5px solid var(--amber);background:#f6eddc;grid-template-columns:minmax(200px,.3fr) 1fr;align-items:center;gap:14px;padding:9px 12px;display:grid}.result-observation b{color:var(--amber);font-size:17px;line-height:1.32}.result-observation p{color:#6a562f;margin:0;font-size:16.5px;line-height:1.42}.result-observation-positive{border-left-color:var(--green);background:#e7f2ec}.result-observation-positive b{color:var(--green)}.result-observation-positive p{color:#3d5f51}.result-observation-negative{border-left-color:var(--red);background:#f3e9e7}.result-observation-negative b{color:var(--red)}.result-observation-negative p{color:#654b49}.signal-method-layout,.signal-quant-layout{flex-direction:column;flex:1;gap:12px;min-height:0;display:flex}.signal-method-flow{grid-template-columns:repeat(2,minmax(0,1fr));align-items:stretch;gap:9px;display:grid}.signal-method-flow article{border:1px solid var(--line);border-top:5px solid var(--blue);background:#fffffff0;min-width:0;padding:12px 14px}.signal-method-flow article:nth-of-type(2){border-top-color:var(--green)}.signal-method-flow article:nth-of-type(3){border-top-color:var(--amber)}.signal-method-flow article:nth-of-type(4){border-top-color:var(--red)}.signal-method-flow article>span{color:var(--red);font:750 12.5px/1.25 var(--font-geist-mono), monospace;letter-spacing:.075em}.signal-method-flow h3{color:var(--navy);margin:7px 0 5px;font-size:18px;line-height:1.17}.signal-method-flow p{color:var(--muted);margin:0;font-size:14.5px;line-height:1.39}.signal-method-formula{border-left:4px solid var(--blue);color:var(--navy);font:650 13px/1.34 var(--font-geist-mono), monospace;overflow-wrap:anywhere;background:#eaf0f5;margin-top:7px;padding:5px 7px;display:block}.signal-method-flow article:nth-of-type(2) .signal-method-formula{border-left-color:var(--green);background:#e7f2ec}.signal-method-flow article:nth-of-type(3) .signal-method-formula{border-left-color:var(--amber);background:#f6eddc}.signal-method-flow article:nth-of-type(4) .signal-method-formula{border-left-color:var(--red);background:#f3e9e7}.signal-method-flow small{color:#46596a;margin-top:5px;font-size:11.25px;line-height:1.33;display:block}.signal-method-flow small strong{color:var(--navy)}.signal-method-flow .signal-method-detail{color:#33475a;margin-top:7px;font-size:14px;font-weight:620;line-height:1.36}.signal-authority-grid{grid-template-columns:repeat(2,minmax(0,1fr));gap:10px;display:grid}.signal-authority-grid article{border-left:5px solid var(--blue);background:#eaf0f5;padding:13px 15px}.signal-authority-grid article:last-child{border-left-color:var(--green);background:#e7f2ec}.signal-authority-grid b{color:var(--navy);font:750 12.5px/1.25 var(--font-geist-mono), monospace;letter-spacing:.06em}.signal-authority-grid p{color:#415366;margin:5px 0 0;font-size:14px;line-height:1.37}.signal-authority-grid article:last-child p{color:#3d5f51}.signal-example-groups{flex:1;grid-template-rows:repeat(3,minmax(0,1fr));grid-template-columns:1fr;align-items:stretch;gap:8px;min-height:0;display:grid}.signal-example-groups .compact-sync-group{border:1px solid var(--line);background:#ffffffc7;grid-template-columns:minmax(360px,.86fr) minmax(0,1.64fr);align-items:center;gap:10px;min-width:0;padding:7px;display:grid}.signal-example-groups .compact-sync-group+.compact-sync-group{margin-top:0}.signal-example-groups .experiment-syncbar{flex-direction:column;justify-content:center;align-self:stretch;align-items:flex-start;min-height:0;margin-bottom:0;padding:5px 7px}.signal-example-groups .experiment-sync-copy{width:100%}.signal-example-groups .experiment-sync-copy>strong{overflow-wrap:anywhere;font-size:14px}.signal-example-groups .experiment-sync-copy>small{display:none}.signal-example-groups .experiment-sync-actions{width:100%}.signal-example-groups .experiment-sync-button{flex:1;min-height:25px;padding:3px 6px}.signal-example-groups .result-media-grid-3{grid-template-columns:repeat(3,minmax(0,1fr));gap:6px}.signal-example-groups .experiment-media{justify-self:center;width:min(100%,250px)}#results-signalaware-examples .signal-example-groups .experiment-media-frame{aspect-ratio:16/9;max-height:none}.signal-example-groups .experiment-media figcaption{margin-top:2px;font-size:13px;line-height:1.25}.signal-example-groups .experiment-media figcaption b{font-size:14px}.signal-example-groups .experiment-media figcaption span{margin-top:1px}.signal-example-verdict{border-left:5px solid var(--amber);background:#f6eddc;grid-template-columns:145px 1fr;align-items:center;gap:12px;margin-top:8px;padding:7px 10px;display:grid}.signal-example-verdict b{color:var(--amber);font-size:16px}.signal-example-verdict span{color:#6a562f;font-size:15px;line-height:1.38}.signal-quant-table-wrap{margin-top:1px}.signal-quant-layout .result-panel-grid p{font-size:15.5px}.signal-quant-layout .result-observation{margin-top:auto}@media (width>=1001px) and (height<=860px){section[id^=results-] .slide-inner{padding-top:59px;padding-bottom:10px}section[id^=results-] .slide-heading{margin-bottom:9px;padding-bottom:8px}section[id^=results-] .subtitle{margin-top:5px;font-size:17px;line-height:1.38}section[id^=results-] .result-update{gap:7px}section[id^=results-] .result-metric-heading{margin-bottom:8px}section[id^=results-] .result-panel-grid article{padding:8px 10px}section[id^=results-] .result-panel-grid p{margin-top:5px;font-size:15.5px;line-height:1.38}section[id^=results-] .result-media-grid .experiment-media-portrait{width:min(100%,122px)}section[id^=results-] .result-metric-grid article{padding:6px 8px}section[id^=results-] .result-metric-grid article>b{font-size:21px}section[id^=results-] .result-metric-grid article>small{font-size:13px}section[id^=results-] .result-observation{padding:7px 10px}section[id^=results-] .result-observation p{font-size:15px}}@media screen and (width>=1001px) and (height<=700px){section[id^=results-] .slide-inner{padding-top:54px;padding-bottom:7px}section[id^=results-] .slide-heading{margin-bottom:6px;padding-bottom:6px}section[id^=results-] .section-label{margin-bottom:3px}section[id^=results-] h2{font-size:42px}section[id^=results-] .subtitle{margin-top:4px;font-size:16px;line-height:1.36}section[id^=results-] .slide-number{font-size:22px}section[id^=results-] .result-update{gap:5px}section[id^=results-] .result-context-row{padding:4px 7px}section[id^=results-] .result-instruction{grid-template-columns:100px 1fr;padding:5px 8px}section[id^=results-] .result-instruction b{font-size:11px}section[id^=results-] .result-instruction span{font-size:14px;line-height:1.3}section[id^=results-] .result-panel-grid{gap:5px}section[id^=results-] .result-panel-grid article{border-top-width:4px;padding:6px 8px}section[id^=results-] .result-panel-grid span{font-size:11.5px}section[id^=results-] .result-panel-grid p{margin-top:4px;font-size:15px;line-height:1.36}section[id^=results-] .result-formula{padding:5px 8px;font-size:10px;line-height:1.3}section[id^=results-] .compact-sync-group .experiment-syncbar{min-height:25px;margin-bottom:2px;padding:2px 5px 2px 8px}section[id^=results-] .compact-sync-group .experiment-sync-copy>span{font-size:10px}section[id^=results-] .compact-sync-group .experiment-sync-copy>strong{font-size:13px}section[id^=results-] .compact-sync-group .experiment-sync-copy>small{display:none}section[id^=results-] .compact-sync-group .experiment-sync-button{min-height:25px;padding:3px 7px;font-size:11.5px}section[id^=results-] .result-media-grid{gap:5px}section[id^=results-] .result-media-grid .experiment-media-wide .experiment-media-frame,section[id^=results-] .result-media-grid .experiment-media-fourThree .experiment-media-frame{max-height:116px}section[id^=results-] .result-media-grid .experiment-media-portrait{width:min(100%,90px)}section[id^=results-] .result-media-grid .experiment-media figcaption{margin-top:3px;font-size:12.5px;line-height:1.26}section[id^=results-] .result-media-grid .experiment-media figcaption b{font-size:13.5px}section[id^=results-] .result-metric-heading{margin-bottom:7px;font-size:12px}section[id^=results-] .result-metric-grid{gap:4px}section[id^=results-] .result-metric-grid article{border-left-width:4px;padding:4px 6px}section[id^=results-] .result-metric-grid article>span{font-size:11.5px}section[id^=results-] .result-metric-grid article>b{font-size:20px}section[id^=results-] .result-metric-grid article>small{margin-top:2px;font-size:13px}section[id^=results-] .result-table{font-size:14px;line-height:1.3}section[id^=results-] .result-table th,section[id^=results-] .result-table td{padding:4px 6px}section[id^=results-] .result-table thead th{font-size:11.5px}section[id^=results-] .result-table-note{padding:5px 7px;font-size:12.5px}section[id^=results-] .result-observation{grid-template-columns:minmax(175px,.28fr) 1fr;padding:5px 8px}section[id^=results-] .result-observation b{font-size:15px}section[id^=results-] .result-observation p{font-size:14.5px;line-height:1.34}}@media (width<=1000px){.result-panel-grid-2,.result-panel-grid-3{grid-template-columns:1fr}.result-media-grid-4,.result-media-grid-5,.result-media-grid-6,.result-metric-grid-3,.result-metric-grid-4,.result-metric-grid-5{grid-template-columns:repeat(2,minmax(0,1fr))}.result-media-grid .experiment-media-portrait{width:min(100%,190px)}}@media (width<=650px){.result-context-row{flex-direction:column;align-items:flex-start}.result-instruction,.result-observation,.result-media-grid-2,.result-media-grid-3,.result-media-grid-4,.result-media-grid-5,.result-media-grid-6,.result-metric-grid-2,.result-metric-grid-3,.result-metric-grid-4,.result-metric-grid-5{grid-template-columns:1fr}.result-media-grid .experiment-media-portrait{width:min(100%,240px)}.result-table{min-width:620px}}@media print{section[id^=results-] .slide-inner{padding-top:40px;padding-bottom:18px}section[id^=results-] .slide-heading{margin-bottom:8px;padding-bottom:7px}section[id^=results-] h2{font-size:35px}section[id^=results-] .subtitle{margin-top:4px;font-size:13.5px}section[id^=results-] .result-update{gap:5px}section[id^=results-] .result-panel-grid article{padding:6px 8px}section[id^=results-] .result-panel-grid p{margin-top:3px;font-size:11.5px;line-height:1.32}section[id^=results-] .result-media-grid .experiment-media-portrait{width:min(100%,1.08in)}section[id^=results-] .result-media-grid .experiment-media-wide .experiment-media-frame,section[id^=results-] .result-media-grid .experiment-media-fourThree .experiment-media-frame{max-height:1.65in}section[id^=results-] .result-metric-grid article{padding:4px 6px}section[id^=results-] .result-table{font-size:10.5px}section[id^=results-] .result-table th,section[id^=results-] .result-table td{padding:3px 5px}section[id^=results-] .result-observation{padding:5px 8px}}@media (width>=1001px) and (height<=860px){#results-signalaware-method .signal-method-layout,#results-signalaware-quantitative .signal-quant-layout{gap:7px}#results-signalaware-method .signal-method-flow{gap:6px}#results-signalaware-method .signal-method-flow article{padding:7px 9px}#results-signalaware-method .signal-method-flow h3{margin:5px 0 3px;font-size:15px}#results-signalaware-method .signal-method-flow p{font-size:10.75px;line-height:1.3}#results-signalaware-method .signal-method-formula{margin-top:4px;padding:3px 5px;font-size:9.5px}#results-signalaware-method .signal-method-flow small{margin-top:3px;font-size:9.5px;line-height:1.26}#results-signalaware-method .signal-authority-grid article{padding:8px 10px}#results-signalaware-method .signal-authority-grid p{font-size:10.75px;line-height:1.3}#results-signalaware-examples .signal-example-groups{gap:7px}#results-signalaware-examples .signal-example-groups .experiment-media{width:min(100%,220px)}#results-signalaware-examples .signal-example-verdict{margin-top:5px;padding:5px 8px}}@media screen and (width>=1001px) and (height<=700px){#results-signalaware-examples .signal-example-groups .compact-sync-group{padding:4px}#results-signalaware-examples .signal-example-groups .experiment-syncbar{padding:2px 4px}#results-signalaware-examples .signal-example-groups .experiment-sync-copy>strong{font-size:11px}#results-signalaware-examples .signal-example-groups .experiment-sync-button{min-height:21px;padding:2px 4px;font-size:9.5px}#results-signalaware-examples .signal-example-groups .experiment-media{width:min(100%,185px)}#results-signalaware-examples .signal-example-groups .experiment-media figcaption{font-size:9px}#results-signalaware-examples .signal-example-groups .experiment-media figcaption b{font-size:10px}#results-signalaware-examples .signal-example-verdict{grid-template-columns:120px 1fr}#results-signalaware-examples .signal-example-verdict b,#results-signalaware-examples .signal-example-verdict span{font-size:10.5px}}@media (width<=1000px){.signal-method-flow{grid-template-columns:1fr;gap:7px}.signal-method-flow h3{margin-top:9px}.signal-authority-grid,.signal-example-groups,.signal-example-groups .compact-sync-group{grid-template-columns:1fr}.signal-example-groups .result-media-grid-3{grid-template-columns:repeat(3,minmax(0,1fr))}}@media (width<=650px){.signal-authority-grid,.signal-example-groups .result-media-grid-3,.signal-example-verdict{grid-template-columns:1fr}}@media print{#results-signalaware-method .signal-method-layout,#results-signalaware-quantitative .signal-quant-layout{gap:5px}#results-signalaware-method .signal-method-flow article{border-top-width:4px;padding:7px 8px}#results-signalaware-method .signal-method-flow article>span{font-size:7px}#results-signalaware-method .signal-method-flow h3{margin:6px 0 3px;font-size:11.5px}#results-signalaware-method .signal-method-flow p{font-size:8.25px;line-height:1.28}#results-signalaware-method .signal-method-formula{border-left-width:3px;margin-top:3px;padding:2px 4px;font-size:7.25px}#results-signalaware-method .signal-method-flow small{margin-top:2px;font-size:7px;line-height:1.2}#results-signalaware-method .signal-authority-grid{gap:5px}#results-signalaware-method .signal-authority-grid article{padding:5px 7px}#results-signalaware-method .signal-authority-grid b{font-size:7px}#results-signalaware-method .signal-authority-grid p{margin-top:2px;font-size:8px;line-height:1.25}#results-signalaware-examples .signal-example-groups{gap:5px}#results-signalaware-examples .signal-example-groups .compact-sync-group{padding:3px}#results-signalaware-examples .signal-example-groups .experiment-syncbar{padding:2px 3px}#results-signalaware-examples .signal-example-groups .experiment-sync-actions{display:none}#results-signalaware-examples .signal-example-groups .experiment-sync-copy>strong{font-size:8px}#results-signalaware-examples .signal-example-groups .experiment-media{width:min(100%,1.45in)}#results-signalaware-examples .signal-example-groups .experiment-media figcaption{font-size:7px}#results-signalaware-examples .signal-example-groups .experiment-media figcaption b{font-size:7.75px}#results-signalaware-examples .signal-example-verdict{margin-top:3px;padding:3px 5px}#results-signalaware-examples .signal-example-verdict b,#results-signalaware-examples .signal-example-verdict span{font-size:7.5px}#results-signalaware-quantitative .signal-quant-layout .result-panel-grid p{font-size:10px}}@media screen and (width>=1001px){#results-cross-anchor-event00 .result-media-groups{gap:2px}#results-cross-anchor-event00 .result-media-grid{justify-content:center;gap:4px}#results-cross-anchor-event00 .result-media-grid-4{grid-template-columns:repeat(4,minmax(0,clamp(94px,14.4svh,146px)))}#results-cross-anchor-event00 .result-media-grid-5{grid-template-columns:repeat(5,minmax(0,clamp(94px,14.4svh,146px)))}#results-cross-anchor-event00 .result-media-grid .experiment-media-portrait{width:100%}#results-cross-anchor-event00 .compact-sync-group .experiment-syncbar{min-height:27px;margin-bottom:2px;padding:2px 5px 2px 8px}#results-cross-anchor-event00 .result-media-grid .experiment-media figcaption{gap:1px;margin-top:2px;font-size:13px;line-height:1.2;display:grid}#results-cross-anchor-event00 .result-media-grid .experiment-media figcaption b{font-size:14px}#results-cross-anchor-event00 .result-media-grid .experiment-media figcaption span{text-align:left;max-width:none}}@media print{#results-cross-anchor-event00 .result-media-groups,#results-cross-anchor-event00 .result-media-grid{gap:.03in}#results-cross-anchor-event00 .result-media-grid .experiment-media figcaption{margin-top:.02in}}@media screen and (width>=1001px) and (height<=860px){#results-signalaware-method .signal-method-flow p,#results-signalaware-method .signal-method-flow .signal-method-detail{font-size:13.5px;line-height:1.34}#results-signalaware-method .signal-method-formula{font-size:12.5px}#results-signalaware-method .signal-authority-grid b{font-size:12px}#results-signalaware-method .signal-authority-grid p{font-size:13.5px;line-height:1.34}}@media screen and (width>=1001px) and (height<=700px){:is(#gap-qwen-audit,#gap-vjepa2-evidence,#counterfactual,#generation-editing-asymmetry,#evidence-provenance,#provenance-rights,#three-stream-editor,#structured-action,#training-contract,#oracle-evidence,#oracle-analysis,#event00,#event01,#factorial,#local-action-recovery) .subtitle{font-size:16px;line-height:1.34}:is(#gap-qwen-audit,#gap-vjepa2-evidence,#generation-editing-asymmetry,#evidence-provenance,#provenance-rights,#three-stream-editor,#structured-action,#training-contract,#oracle-evidence,#oracle-analysis,#event00,#event01,#factorial,#local-action-recovery) .evidence-badge{min-height:25px;padding:4px 8px;font-size:11.5px}#gap-qwen-audit .rate-normalization-banner span,#gap-vjepa2-evidence .rate-normalization-banner span{font-size:13.5px}#gap-qwen-audit .gap-audit-card h3{font-size:15px}#gap-qwen-audit .gap-audit-card p{font-size:12.5px;line-height:1.34}#gap-qwen-audit .gap-audit-table th,#gap-qwen-audit .gap-audit-table td,#gap-vjepa2-evidence .gap-vjepa-table th,#gap-vjepa2-evidence .gap-vjepa-table td,#gap-vjepa2-evidence .gap-method-strip span{font-size:12px}#gap-vjepa2-evidence .gap-method-strip b{font-size:11px}#gap-vjepa2-evidence .gap-threshold-note{font-size:12px}#gap-vjepa2-evidence .gap-score-grid .gap-score-pair b{font-size:13px}#gap-vjepa2-evidence .gap-score-grid .metric-card small{font-size:12.5px}#gap-qwen-audit .progress-conclusion b,#gap-vjepa2-evidence .progress-conclusion b{font-size:14px}#gap-qwen-audit .progress-conclusion p,#gap-vjepa2-evidence .progress-conclusion p{font-size:13px;line-height:1.34}#counterfactual .counterfactual-intervention-definition>span{font-size:11.5px}#counterfactual .counterfactual-intervention-definition p,#counterfactual .equation-grid p,#counterfactual .counterfactual-invariant p,#counterfactual .equation-legend{font-size:12.5px;line-height:1.34}#counterfactual .progress-conclusion b{font-size:14px}#counterfactual .progress-conclusion p{font-size:13px;line-height:1.34}#three-stream-editor .method-stage code,#three-stream-editor .architecture-contract code{font-size:12px}#three-stream-editor .method-stage p,#three-stream-editor .architecture-contract p{font-size:13px;line-height:1.34}#structured-action .stage-card code{font-size:11.5px}#structured-action .stage-card p,#structured-action .loss-contract-grid span,#training-contract .strict-pass-card li,#training-contract .basketball-check p,#training-contract .fallback-rule p{font-size:12.5px;line-height:1.34}#training-contract .progress-metrics b{font-size:12px}:is(#oracle-evidence,#oracle-analysis,#event00,#event01,#factorial) .experiment-media figcaption{font-size:12.5px}:is(#oracle-evidence,#oracle-analysis,#event00,#event01,#factorial) .experiment-media figcaption b{font-size:13.5px}#oracle-analysis .metric-card small{font-size:12.5px}#event00 .verdict-split p,#event01 .progress-conclusion p,#factorial .progress-conclusion p{font-size:12.5px;line-height:1.34}#event01 .experiment-instruction{font-size:14px}#factorial .gate-table span,#factorial .gate-table b{font-size:12px}#factorial .gate-head span{font-size:11px}#local-action-recovery .local-recovery-figure figcaption{font-size:13px}#local-action-recovery .local-recovery-copy h3{font-size:14px}#local-action-recovery .local-recovery-copy p,#local-action-recovery .local-recovery-rule span{font-size:12.5px;line-height:1.34}#results-signalaware-examples .signal-example-groups .experiment-sync-copy>strong{font-size:13px}#results-signalaware-examples .signal-example-groups .experiment-sync-button{font-size:11.5px}#results-signalaware-examples .signal-example-groups .experiment-media figcaption{font-size:12px}#results-signalaware-examples .signal-example-groups .experiment-media figcaption b,#results-signalaware-examples .signal-example-verdict b,#results-signalaware-examples .signal-example-verdict span{font-size:13px}section[id^=results-] .result-instruction b,section[id^=results-] .result-panel-grid span,section[id^=results-] .result-metric-grid article>span,section[id^=results-] .result-table thead th{font-size:12.5px}section[id^=results-] .result-formula{font-size:12px;line-height:1.34}}.showcase-case-stack{flex:1;grid-template-rows:repeat(2,minmax(0,1fr));gap:15px;min-height:0;display:grid}.showcase-case{border:1px solid var(--line-dark);background:#ffffffe0;grid-template-rows:auto minmax(0,1fr);gap:10px;min-height:0;padding:13px 15px 12px;display:grid;box-shadow:0 5px 17px #1128410e}.showcase-case-header{grid-template-columns:82px minmax(0,1fr);align-items:center;gap:14px;padding-right:178px;display:grid}.showcase-case-header>span{border-left:5px solid var(--red);color:var(--red);font:750 15px/1.2 var(--font-geist-mono), monospace;background:#f4e9e6;align-self:stretch;place-items:center;padding:8px 10px;display:grid}.showcase-case-header h3{color:var(--navy);margin:0;font-size:21px;line-height:1.15}.showcase-case-header p{color:#3b5063;margin:4px 0 0;font-size:16px;line-height:1.28}.showcase-case-header p b{color:var(--navy)}.showcase-comparison-grid{grid-template-columns:repeat(4,minmax(0,1fr));align-items:start;gap:11px;min-width:0;display:grid}.showcase-sample-playback{min-height:0;position:relative}.showcase-sample-playback .experiment-syncbar{z-index:4;background:0 0;border:0;min-height:36px;margin:0;padding:0;position:absolute;top:-57px;right:0}.showcase-sample-playback .experiment-sync-copy{display:none}.showcase-sample-playback .experiment-sync-button{min-height:36px;padding:7px 14px;font-size:14px;box-shadow:0 2px 7px #0a1f3426}.showcase-media{background:var(--white);border:1px solid #d2d9de;min-width:0;padding:6px 6px 8px}.showcase-media .experiment-media-frame{border-top-width:5px;box-shadow:0 2px 7px #0a1f341f}.showcase-source .experiment-media-frame{border-top-color:var(--navy)}.showcase-reference .experiment-media-frame{border-top-color:var(--amber)}.showcase-baseline .experiment-media-frame{border-top-color:#7c8790}.showcase-ours .experiment-media-frame{border-top-color:var(--green)}.showcase-media video{cursor:pointer}.showcase-media .experiment-media figcaption,.showcase-media .experiment-media-compact figcaption{gap:10px;margin-top:7px;font-size:14.5px;line-height:1.22}.showcase-media .experiment-media figcaption b,.showcase-media .experiment-media-compact figcaption b{color:var(--navy);font-size:16.5px;line-height:1.16}.showcase-media .experiment-media figcaption span{color:#657380}.showcase-action-banner{border-left:7px solid var(--red);background:#f4e9e6;grid-template-columns:125px minmax(310px,.9fr) minmax(360px,1.3fr);align-items:center;gap:17px;padding:14px 17px;display:grid}.showcase-action-banner>span{color:var(--red);font:750 15px/1.2 var(--font-geist-mono), monospace}.showcase-action-banner>strong{color:var(--navy);font-size:23px;line-height:1.17}.showcase-action-banner>p{color:#425568;border-left:1px solid #c8b8b4;margin:0;padding-left:17px;font-size:16.5px;line-height:1.34}.showcase-comparison-single,.showcase-reference-playback{margin-top:15px}.showcase-reference-playback .showcase-comparison-single{margin-top:0}.showcase-reference-playback .experiment-syncbar{border-left-color:var(--green)}.showcase-comparison-single .showcase-media{padding:8px 8px 10px}.showcase-comparison-single .showcase-media .experiment-media figcaption{margin-top:8px}.showcase-reading-rule{grid-template-columns:repeat(2,minmax(0,1fr));gap:13px;margin-top:15px;display:grid}.showcase-reading-rule article{border:1px solid var(--line);border-left:6px solid var(--amber);background:#fbf6ea;padding:13px 16px}.showcase-reading-rule article:last-child{border-left-color:var(--green);background:#eaf3ee}.showcase-reading-rule b{color:var(--navy);font-size:17.5px}.showcase-reading-rule p{color:#405569;margin:5px 0 0;font-size:16px;line-height:1.32}.showcase-receipt{border:1px solid var(--navy);background:var(--white);grid-template-columns:170px minmax(0,1fr);align-items:center;gap:16px;margin-top:13px;padding:10px 14px;display:grid}.showcase-receipt span{color:var(--blue);font:750 14px/1.2 var(--font-geist-mono), monospace}.showcase-receipt b{color:var(--navy);font-size:16px;line-height:1.25}@media screen and (width<=1000px){.showcase-case-stack{flex-direction:column;display:flex}.showcase-case-header{padding-right:0}.showcase-comparison-grid{grid-template-columns:repeat(2,minmax(0,1fr))}.showcase-action-banner{grid-template-columns:1fr}.showcase-action-banner>p{border-left:0;padding:0}.showcase-sample-playback .experiment-syncbar{border:1px solid var(--line);border-left:4px solid var(--blue);background:#ffffffe0;min-height:38px;margin-bottom:7px;padding:5px 6px 5px 10px;position:static}.showcase-sample-playback .experiment-sync-copy{display:flex}}@media screen and (width<=650px){.showcase-case-header{grid-template-columns:1fr}.showcase-case-header>span{justify-self:start;min-height:38px}.showcase-comparison-grid,.showcase-reading-rule,.showcase-receipt{grid-template-columns:1fr}}@media screen and (width>=1001px) and (height<=760px){:is(#source4-real-targets,#source4-generated-reference) .slide-heading{margin-bottom:11px;padding-bottom:9px}.showcase-case-stack{gap:9px}.showcase-case{gap:7px;padding:8px 10px}.showcase-case-header h3{font-size:18px}.showcase-case-header p{font-size:14.5px}.showcase-case-header>span{padding-block:5px;font-size:14px}.showcase-sample-playback .experiment-syncbar{top:-50px}.showcase-comparison-grid{gap:7px}.showcase-media{padding:4px 4px 5px}.showcase-media .experiment-media figcaption,.showcase-media .experiment-media-compact figcaption{margin-top:4px;font-size:13.5px}.showcase-media .experiment-media figcaption b,.showcase-media .experiment-media-compact figcaption b{font-size:15px}.showcase-action-banner{padding-block:9px}.showcase-comparison-single{margin-top:9px}.showcase-reading-rule{gap:9px;margin-top:9px}.showcase-reading-rule article{padding:8px 12px}.showcase-reading-rule b{font-size:16px}.showcase-reading-rule p{font-size:14.5px}.showcase-receipt{margin-top:8px;padding-block:7px}}@media print{.showcase-case,.showcase-media,.showcase-reading-rule article{break-inside:avoid}.showcase-case-stack{gap:.08in}.showcase-case{gap:.05in;padding:.07in .09in}.showcase-media{padding:.035in}.showcase-media .experiment-media figcaption{margin-top:.03in}}.source4-inline-equation,.source4-display-equation{font-variant-numeric:lining-nums tabular-nums;font-family:STIX Two Math,Cambria Math,Times New Roman,serif}.source4-inline-equation{color:#173c63;font-size:18px;font-weight:650;line-height:1.3}.source4-inline-equation sub,.source4-inline-equation sup,.source4-display-equation sub,.source4-display-equation sup{font-size:.72em}.overline{text-decoration:overline;text-decoration-thickness:1px}.action-packet-flow-v2{grid-template-columns:minmax(190px,.72fr) 28px minmax(430px,1.55fr) 28px minmax(310px,1.06fr);align-items:stretch;gap:8px;display:grid}.action-packet-flow-v2>i,.source4-context-flow-v2>i,.source4-reconstruction-route>i{color:var(--blue);font:800 26px/1 var(--font-geist-mono), monospace;text-align:center;align-self:center;font-style:normal}.action-packet-flow-v2 article,.action-channel-stack-v2 article{border:1px solid var(--line-dark);background:var(--white);min-width:0;padding:13px 15px}.action-packet-flow-v2>article{border-top:6px solid var(--red)}.action-packet-flow-v2>.action-packet-output{border-top-color:var(--green);background:#edf5f1}.action-packet-flow-v2 article>span,.action-channel-stack-v2 article>span,.source4-context-flow-v2 article>span,.source4-reconstruction-route article>span,.source4-gradient-scale-v2 article>span,.source4-objective-schedule article>span,.source4-runtime-grid article>span,.source4-scope-strip article>span{color:var(--red);font:750 13.5px/1.2 var(--font-geist-mono), monospace;display:block}.action-packet-flow-v2 article>b,.action-channel-stack-v2 article>b{color:var(--navy);margin-top:7px;font-size:19px;line-height:1.18;display:block}.action-packet-flow-v2 article>p,.action-channel-stack-v2 article>p{color:#405569;margin:7px 0 0;font-size:15.5px;line-height:1.32}.action-channel-stack-v2{grid-template-rows:repeat(2,minmax(0,1fr));gap:6px;display:grid}.action-channel-stack-v2 article{border-left:5px solid var(--amber);padding-block:9px}.action-channel-stack-v2 article:last-child{border-left-color:var(--blue)}.action-channel-stack-v2 article>span{color:var(--amber)}.action-channel-stack-v2 article:last-child>span{color:var(--blue)}.action-channel-stack-v2 article>b{margin-top:4px;font-size:16.5px}.action-channel-stack-v2 article>p{margin-top:4px;font-size:15px;line-height:1.27}.action-packet-output .source4-inline-equation{margin-top:12px;font-size:20px}.action-vae-pretrain-strip{background:#fbf5e8;border:1px solid #cfb97d;grid-template-columns:220px minmax(0,1fr);align-items:center;gap:16px;margin-top:8px;padding:9px 13px;display:grid}.action-vae-pretrain-strip>b{color:#765311;font-size:16.5px}.action-vae-pretrain-strip .source4-inline-equation{color:#493c21;font-size:15.5px;line-height:1.28}.candidate-action-distance-v2{grid-template-columns:minmax(420px,.9fr) minmax(620px,1.4fr);gap:9px;margin-top:8px;display:grid}.candidate-reader-route{border-left:6px solid var(--blue);min-width:0;color:var(--navy);text-align:center;background:#eaf1f7;grid-template-columns:minmax(110px,.9fr) 20px minmax(165px,1.3fr) 20px minmax(95px,.75fr);align-items:center;gap:5px;padding:10px 12px;display:grid}.candidate-reader-route>span,.candidate-reader-route>b,.candidate-reader-route>strong{font-size:15.5px;line-height:1.22}.candidate-reader-route>i{color:var(--blue);font:800 20px/1 var(--font-geist-mono), monospace;font-style:normal}.candidate-reader-route>strong{color:#ad451e}.source4-display-equation{border:2px solid var(--navy);background:var(--white);min-width:0;color:var(--navy);grid-template-columns:auto 25px minmax(0,1fr);align-items:center;column-gap:8px;padding:11px 15px;display:grid}.source4-display-equation>span{font-size:21px;font-weight:650;line-height:1.27}.source4-display-equation>span:first-child{white-space:nowrap;font-size:24px;font-weight:700}.source4-display-equation>i{text-align:center;font-size:23px;font-style:normal;font-weight:700}.source4-display-equation>small{color:#556879;font-family:var(--font-geist-sans), Arial, sans-serif;grid-column:1/-1;margin-top:6px;font-size:15px;line-height:1.28}.action-distance-equation{background:#f8fafb;border-width:1px;border-color:#9db1c3}.action-distance-equation>span{font-size:18px}.action-distance-equation>span:first-child{font-size:20px}.action-control-row-v2{grid-template-columns:repeat(3,minmax(0,1fr));gap:8px;margin-top:8px;display:grid}.action-control-row-v2 article{border:1px solid var(--line-dark);background:var(--white);border-left:5px solid #7c8790;grid-template-columns:86px minmax(0,1fr);align-items:baseline;gap:3px 11px;padding:8px 12px;display:grid}.action-control-row-v2 .action-control-correct{border-left-color:var(--red);background:#fff1e8}.action-control-row-v2 b{color:var(--navy);font-size:17px}.action-control-row-v2 span{color:#173e67;font:650 18px/1.2 STIX Two Math,Cambria Math,serif}.action-control-row-v2 small{color:#667583;grid-column:2;font-size:14.5px}.action-primary-equation{background:#fff8f2;border-color:#b94820;margin-top:8px}.action-primary-equation>span{font-size:22px}.source4-context-flow-v2{grid-template-columns:minmax(280px,.9fr) 28px minmax(300px,.95fr) 28px minmax(440px,1.35fr);align-items:stretch;gap:9px;display:grid}.source4-context-flow-v2 article,.source4-reconstruction-route article{border:1px solid var(--line-dark);border-top:6px solid var(--green);background:var(--white);min-width:0;padding:13px 15px}.source4-context-flow-v2 article:nth-of-type(2){border-top-color:var(--blue)}.source4-context-flow-v2 .source4-token-read{border-top-color:var(--red)}.source4-context-flow-v2 article>span{color:var(--green)}.source4-context-flow-v2 article:nth-of-type(2)>span{color:var(--blue)}.source4-context-flow-v2 .source4-token-read>span{color:var(--red)}.source4-context-flow-v2 article>b{color:var(--navy);margin-top:6px;font-size:18px;line-height:1.2;display:block}.source4-context-flow-v2 article>p{color:#526576;margin:3px 0 0;font-size:15px;line-height:1.28}.source4-context-flow-v2 article>strong{color:var(--red);margin:4px 0 -2px;font-size:20px;display:block}.source4-context-flow-v2 article .source4-inline-equation{margin-top:10px;font-size:16px}.source4-token-read>div{text-align:center;grid-template-columns:1fr 22px 1fr 22px 1.2fr;align-items:center;gap:6px;margin-top:9px;display:grid}.source4-token-read>div b{border:1px solid var(--line);color:var(--navy);background:#f2f5f7;padding:10px 7px;font-size:15.5px;line-height:1.2}.source4-token-read>div strong{color:var(--red);font-size:20px}.source4-reconstruction-route{grid-template-columns:minmax(0,1fr) 28px minmax(0,1fr) 28px minmax(0,1.05fr);gap:9px;margin-top:10px;display:grid}.source4-reconstruction-route article{border-top-width:4px;padding-block:10px}.source4-reconstruction-route article:nth-of-type(2){border-top-color:var(--blue)}.source4-reconstruction-route article:nth-of-type(3){border-top-color:var(--amber)}.source4-reconstruction-route article>span{color:var(--green)}.source4-reconstruction-route article>b{color:var(--navy);margin-top:5px;font-size:17px;display:block}.source4-reconstruction-route article>p{color:#536677;margin:5px 0 0;font-size:15px;line-height:1.28}.source4-loss-equation{border-color:var(--green);background:#f4f9f6;margin-top:10px}.source4-gradient-scale-v2{grid-template-columns:1fr 1fr .82fr;gap:9px;margin-top:10px;display:grid}.source4-gradient-scale-v2 article,.source4-gradient-scale-v2 aside{border:1px solid var(--line-dark);background:var(--white);min-width:0;padding:11px 14px}.source4-gradient-scale-v2 article>span{color:var(--blue)}.source4-gradient-scale-v2 article .source4-inline-equation{margin-top:7px;font-size:19px}.source4-gradient-scale-v2 article>p{color:#536677;margin:5px 0 0;font-size:15px;line-height:1.27}.source4-gradient-scale-v2 aside{border-left:6px solid var(--green);background:#edf5f1;grid-template-columns:90px 1fr;align-content:center;gap:7px 9px;display:grid}.source4-gradient-scale-v2 aside b{color:var(--green);font-size:16px}.source4-gradient-scale-v2 aside span{color:#40586a;font-size:15px;line-height:1.24}.source4-objective-schedule{grid-template-columns:repeat(3,minmax(0,1fr));gap:9px;display:grid}.source4-objective-schedule article{border:1px solid var(--line-dark);border-top:6px solid var(--blue);background:var(--white);grid-template-columns:1fr auto;gap:5px 12px;padding:11px 14px;display:grid}.source4-objective-schedule .source4-objective-primary{border-top-color:var(--red);background:#fff3ec}.source4-objective-schedule article:last-child{border-top-color:var(--green);background:#eef6f2}.source4-objective-schedule article>span{color:var(--blue)}.source4-objective-schedule .source4-objective-primary>span{color:var(--red)}.source4-objective-schedule article:last-child>span{color:var(--green)}.source4-objective-schedule article>b{color:var(--navy);grid-area:1/2/span 2;font:700 25px/1.05 STIX Two Math,Cambria Math,serif}.source4-objective-schedule article>p{color:#4d6274;margin:0;font-size:15px;line-height:1.27}.vj-critic-equation{border-color:var(--blue);background:#f2f6fa;margin-top:9px}.vj-critic-equation>span:nth-of-type(2){font-size:18px}.source4-fraction{vertical-align:middle;text-align:center;grid-template-rows:auto auto;margin:0 5px;display:inline-grid}.source4-fraction>span:first-child{border-bottom:1.5px solid;padding:0 5px 3px}.source4-fraction>span:last-child{padding-top:2px}.total-costate-equation{border-color:var(--red);background:#fff7f2;margin-top:9px}.total-costate-equation>span:nth-of-type(2){font-size:22px}.source4-runtime-grid{grid-template-columns:repeat(2,minmax(0,1fr));gap:9px;margin-top:9px;display:grid}.source4-runtime-grid article{border:1px solid var(--line-dark);border-left:6px solid var(--blue);background:var(--white);padding:10px 14px}.source4-runtime-grid article:last-child{border-left-color:var(--amber);background:#fbf6ea}.source4-runtime-grid article>span{color:var(--blue)}.source4-runtime-grid article:last-child>span{color:var(--amber)}.source4-runtime-grid article>b{color:var(--navy);margin-top:5px;font-size:17px;line-height:1.18;display:block}.source4-runtime-grid article>p{color:#4d6173;margin:5px 0 0;font-size:15px;line-height:1.26}.source4-scope-strip{border:1px solid var(--line-dark);background:var(--line-dark);grid-template-columns:repeat(4,minmax(0,1fr));gap:1px;margin-top:9px;display:grid}.source4-scope-strip article{background:var(--white);min-width:0;padding:9px 11px}.source4-scope-strip article>span{color:var(--red)}.source4-scope-strip article>b{color:var(--navy);margin-top:4px;font-size:16px;line-height:1.18;display:block}.source4-scope-strip article>p{color:#586a79;margin:4px 0 0;font-size:14.5px;line-height:1.24}@media screen and (width<=1000px){.action-packet-flow-v2,.source4-context-flow-v2,.source4-reconstruction-route{grid-template-columns:1fr}.action-packet-flow-v2>i,.source4-context-flow-v2>i,.source4-reconstruction-route>i{transform:rotate(90deg)}.candidate-action-distance-v2,.source4-gradient-scale-v2,.source4-runtime-grid{grid-template-columns:1fr}.source4-scope-strip{grid-template-columns:repeat(2,minmax(0,1fr))}}@media screen and (width<=650px){.action-vae-pretrain-strip,.action-control-row-v2,.source4-objective-schedule,.source4-scope-strip,.candidate-reader-route,.source4-token-read>div{grid-template-columns:1fr}.candidate-reader-route>i,.source4-token-read>div strong{transform:rotate(90deg)}.source4-display-equation{grid-template-columns:1fr;gap:5px}.source4-display-equation>i{display:none}.action-control-row-v2 article{grid-template-columns:82px minmax(0,1fr)}}@media screen and (width>=1001px) and (height<=760px){.action-packet-flow-v2 article,.source4-context-flow-v2 article{padding-block:8px}.action-packet-flow-v2 article>p,.action-channel-stack-v2 article>p,.source4-context-flow-v2 article>p{font-size:14px}.action-channel-stack-v2 article>b{font-size:15.5px}.action-vae-pretrain-strip{margin-top:6px;padding-block:6px}.candidate-action-distance-v2,.action-control-row-v2,.action-primary-equation,.source4-reconstruction-route,.source4-loss-equation,.source4-gradient-scale-v2,.vj-critic-equation,.total-costate-equation,.source4-runtime-grid,.source4-scope-strip{margin-top:6px}.source4-display-equation{padding-block:7px}.source4-display-equation>span{font-size:18px}.source4-display-equation>span:first-child{font-size:21px}.source4-display-equation>small{margin-top:3px;font-size:14px}.source4-reconstruction-route article,.source4-gradient-scale-v2 article,.source4-gradient-scale-v2 aside,.source4-objective-schedule article,.source4-runtime-grid article,.source4-scope-strip article{padding-block:7px}.source4-reconstruction-route article>p,.source4-gradient-scale-v2 article>p,.source4-objective-schedule article>p,.source4-runtime-grid article>p,.source4-scope-strip article>p{font-size:14px}}@media print{.action-packet-flow-v2 article,.action-vae-pretrain-strip,.candidate-action-distance-v2,.action-control-row-v2 article,.source4-context-flow-v2 article,.source4-reconstruction-route article,.source4-gradient-scale-v2>*,.source4-objective-schedule article,.source4-runtime-grid article,.source4-scope-strip article,.source4-display-equation{break-inside:avoid}}:root{--font-geist-sans:"Inter", "Helvetica Neue", Arial, sans-serif;--font-geist-mono:"SFMono-Regular", Consolas, monospace}[id^=paper-],[id^=omni-],[id^=real-],[id^=synthetic-],#further-reading{scroll-margin-top:0}.p3-columns{grid-template-columns:repeat(3,minmax(0,1fr));gap:25px;display:grid}.p3-columns article{border-top:3px solid var(--navy);padding-top:15px}.p3-columns h3{color:var(--navy);margin:8px 0 10px;font-size:clamp(21px,1.75vw,27px);line-height:1.2}.p3-columns p,.p3-body{color:var(--muted);margin:8px 0;font-size:clamp(16px,1.18vw,19px);line-height:1.5}.p3-kicker{color:var(--blue);font:600 12px var(--font-geist-mono),monospace;letter-spacing:.07em}.p3-paper-figure{background:#fff;margin:0 0 22px;display:block}.p3-paper-figure img{width:100%;height:auto;display:block}.p3-dgp-notes{margin-top:auto}.p3-citation{color:var(--muted);margin:auto 0 0;padding-top:15px;font-size:12px;line-height:1.6}.p3-citation a,.p3-provenance a{color:inherit;text-underline-offset:3px}.p3-equation{border-left:4px solid var(--blue);background:#edf2f6;margin-bottom:18px;padding:18px 22px;overflow-x:auto}.p3-equation>span{font:600 11px var(--font-geist-mono),monospace;color:var(--blue);letter-spacing:.08em;margin-bottom:10px;display:block}.p3-equation-image{max-width:100%;display:block}.p3-equation-image img{width:100%;height:auto;display:block}.p3-inline-math{max-width:none;margin:0;display:inline-block}.p3-theorem .p3-inline-math,.p3-inference .p3-inline-math{filter:brightness(0)invert()}.p3-equation-adapter-update{width:min(100%,1120px);margin:0 auto}.p3-equation-temporal-observations{width:min(100%,520px)}.p3-equation-anchor-loss{width:min(100%,620px);margin:0 auto}.p3-anchor-loss{margin-top:20px}.p3-equation-behavior-similarity{width:min(100%,390px);margin-bottom:16px}.p3-equation-behavior-loss{width:min(100%,560px)}@media screen and (width<=650px){.p3-equation-adapter-update{width:900px;max-width:none}.p3-equation-temporal-observations{width:440px;max-width:none}.p3-equation-anchor-loss{width:470px;max-width:none}.p3-equation-behavior-similarity{width:350px;max-width:none}.p3-equation-behavior-loss{width:460px;max-width:none}}.p3-equation-anchor-views{width:min(100%,880px);margin:0 auto}.p3-equation-anchor-identification{width:min(100%,1060px);margin:10px 0}.p3-theorem .p3-equation-image img{filter:brightness(0)invert()}#paper-identification .slide-heading{margin-bottom:16px}#paper-identification .p3-original-views{margin-bottom:12px;padding-top:12px;padding-bottom:12px}#paper-identification .p3-original-views>span{margin-bottom:6px}#paper-identification .p3-premises{padding:18px 22px}#paper-identification .p3-premises ol{font-size:17px}#paper-identification .p3-premises li{margin-bottom:9px}#paper-identification .p3-theorem{margin-top:12px;padding:16px 25px}@media screen and (width>=1001px) and (height<=800px){#paper-identification .slide-inner{padding-top:60px;padding-bottom:15px}#paper-identification .slide-heading{margin-bottom:8px;padding-bottom:10px}#paper-identification h2{font-size:36px}#paper-identification .subtitle{font-size:16px}#paper-identification .p3-original-views{margin-bottom:12px;padding:5px 18px}#paper-identification .p3-original-views>span{margin-bottom:3px}#paper-identification .p3-equation-anchor-views{width:720px}#paper-identification .p3-equation-anchor-objective{width:480px;max-width:100%}#paper-identification .p3-premises{padding:12px 18px}#paper-identification .p3-premises h3{margin-bottom:10px;font-size:21px}#paper-identification .p3-premises ol{font-size:15px;line-height:1.4}#paper-identification .p3-premises li{margin-bottom:6px}#paper-identification .p3-premises>p{margin-bottom:0;padding-top:8px;font-size:12px}#paper-identification .p3-equation-anchor-identification{width:880px;margin:4px 0}#paper-identification .p3-theorem{margin-top:12px;padding:8px 20px}#paper-identification .p3-theorem p{font-size:14px}#paper-identification .p3-citation{padding-top:8px}}@media screen and (width<=650px){#paper-identification .p3-original-views,#paper-identification .p3-theorem{overflow-x:auto}#paper-identification .p3-equation-anchor-views{width:650px;max-width:none}#paper-identification .p3-equation-anchor-identification{width:720px;max-width:none}#paper-identification .p3-equation-anchor-objective{width:470px;max-width:none}}.p3-theory-layout{grid-template-columns:1.1fr 1fr;gap:30px;display:grid}.p3-premises{border:1px solid var(--line);background:#fff;padding:22px 26px}.p3-premises h3,.p3-subhead{color:var(--navy);margin:0 0 15px;font-size:25px}.p3-premises ol{color:var(--ink);margin:0;padding-left:21px;font-size:18px;line-height:1.5}.p3-premises li{margin-bottom:14px;padding-left:5px}.p3-premises>p{color:var(--muted);border-top:1px solid var(--line);padding-top:12px;font-size:14px;line-height:1.5}.p3-theorem{background:var(--navy);color:#fff;margin-top:23px;padding:21px 25px}.p3-theorem>span{font:12px var(--font-geist-mono),monospace;color:#f1bf7c}.p3-theorem strong{margin:12px 0;font:28px Cambria Math,Georgia,serif;display:block}.p3-theorem p{color:#d3dfeb;margin:0;font-size:16px;line-height:1.5}.p3-temporal-columns,.p3-training-columns{grid-template-columns:1fr 1fr;gap:40px}.p3-trajectory{width:100%;max-height:245px}.p3-mini-table{margin:24px 0;overflow-x:auto}.p3-mini-table table,.p3-benchmark table{border-collapse:collapse;text-align:right;width:100%}.p3-mini-table caption{text-align:left;margin-bottom:12px;font-size:13px;font-weight:600}.p3-mini-table th,.p3-mini-table td{border-bottom:1px solid var(--line);padding:12px 8px;font-size:13px}.p3-mini-table th:first-child{text-align:left}.p3-note{background:#f5eee1;border-left:3px solid #b87930;margin:20px 0;padding:15px 20px}.p3-note b{color:var(--navy);font-size:17px}.p3-note p{color:var(--muted);margin:6px 0 0;font-size:16px;line-height:1.5}.p3-method-layout{grid-template-columns:1.4fr 1fr;align-items:center;gap:30px;display:grid}.p3-method-layout .p3-paper-figure{margin:0}.p3-method-layout .p3-equation{margin:22px 0 0}.p3-step{gap:18px;margin-bottom:21px;display:flex}.p3-step>b{color:#bc783a;font:28px var(--font-geist-mono),monospace}.p3-step h3{color:var(--navy);margin:0 0 8px;font-size:21px}.p3-step p{color:var(--muted);margin:0;font-size:16px;line-height:1.5}.p3-condition-flow{grid-template-columns:1fr auto 1fr auto 1fr;align-items:center;gap:20px;margin-bottom:26px;display:grid}.p3-condition-flow article{background:#fcf0e5;border-top:4px solid #bd783a;min-height:155px;padding:25px 22px}.p3-condition-flow .p3-teal{background:#e9f2f1;border-color:#4b8e89}.p3-condition-flow .p3-condition-result{border-color:var(--navy);background:#edf2f6}.p3-condition-flow span{font:11px var(--font-geist-mono),monospace;color:var(--muted)}.p3-condition-flow strong{color:var(--navy);margin:13px 0;font-size:24px;display:block}.p3-condition-flow p{color:var(--muted);margin:0;font-size:15px}.p3-condition-flow>b{color:var(--muted);font-size:27px}.p3-control-tags{flex-wrap:wrap;gap:8px;margin-bottom:16px;display:flex}.p3-control-tags span{color:#765253;background:#f5e9e9;padding:7px 9px;font-size:13px}.p3-control-tags span:first-child{color:#2f6a52;background:#e0ede5}.p3-inference{background:var(--navy);color:#fff;padding:28px 30px}.p3-inference h3{margin:0 0 13px;font-size:26px}.p3-inference p,.p3-inference li{color:#d3dfeb;font-size:17px;line-height:1.55}.p3-inference ol{padding-left:22px}.p3-inference li{margin-bottom:12px}.p3-inference-rule{background:#fff4;height:1px;margin:26px 0}.p3-collection-grid{flex:1;grid-template-columns:repeat(3,minmax(0,1fr));align-items:center;gap:24px;display:grid}.p3-collection-grid a{color:inherit;border-top:1px solid #fff6;padding:25px 12px 30px 0;text-decoration:none}.p3-collection-grid a:hover{border-color:#f1bf7c}.p3-collection-grid span,.p3-conclusion span{font:13px var(--font-geist-mono),monospace;color:#f1bf7c}.p3-collection-grid strong{font-size:110px;font-weight:400;line-height:1.3;display:block}.p3-collection-grid h3{margin:0 0 17px;font-size:27px}.p3-collection-grid p{color:#c9d6e3;font-size:19px;line-height:1.6}.p3-dark-note{color:#c9d6e3;border-top:1px solid #fff3;padding:20px 0;font-size:15px;line-height:1.5}.p3-benchmark{overflow-x:auto}.p3-benchmark th,.p3-benchmark td{border-bottom:1px solid var(--line);padding:14px 15px;font-size:clamp(16px,1.3vw,20px)}.p3-benchmark thead th{color:var(--muted);border-top:2px solid var(--navy);border-bottom:2px solid var(--navy);font-size:13px;line-height:1.5}.p3-benchmark th:first-child{text-align:left;white-space:nowrap}.p3-benchmark td{font-family:var(--font-geist-mono),monospace}.p3-best-row{background:var(--navy);color:#fff;font-weight:700}.p3-reference-row{color:#6c737b;background:#eeefef}.p3-score-notes{margin-top:25px}.p3-score-notes h3{font-size:23px}.p3-comparison{margin:auto 0}.p3-video-toolbar{flex-wrap:wrap;align-items:center;gap:10px;margin-bottom:12px;display:flex}.p3-video-toolbar button,.p3-compare-select select{border:1px solid var(--line);color:var(--navy);cursor:pointer;background:#fff;border-radius:3px;padding:10px 14px;font-size:13px}.p3-video-toolbar .p3-play{background:var(--navy);color:#fff;border-color:var(--navy);min-width:132px}.p3-video-toolbar input{min-width:110px;max-width:330px;accent-color:var(--navy);flex:1}.p3-time{font:12px var(--font-geist-mono),monospace;color:var(--muted);width:100px}.p3-native{color:var(--muted);font-size:12px}.p3-video-toolbar .p3-expand{margin-left:auto}.p3-compare-select{color:var(--muted);justify-content:flex-end;align-items:center;gap:10px;margin-bottom:10px;font-size:12px;display:flex}.p3-compare-select select{padding:6px 9px}.p3-video-grid{grid-template-columns:repeat(4,minmax(0,1fr));gap:14px;display:grid}.p3-video-grid-all{grid-template-columns:repeat(3,minmax(0,1fr))}.p3-video-card{background:#fff;border:1px solid #cdd4d9;margin:0}.p3-video-card.p3-ours{border:2px solid #3d775e}.p3-video-frame{aspect-ratio:16/10;background:#101921}.p3-video-frame video{object-fit:contain;width:100%;height:100%;display:block}.p3-video-card figcaption{color:var(--navy);flex-wrap:wrap;align-items:center;gap:8px;padding:14px 12px;display:flex}.p3-video-card figcaption b{width:100%;font-size:clamp(14px,1.1vw,17px);display:block}.p3-video-card figcaption span{color:#375f50;font:12px var(--font-geist-mono),monospace}.p3-video-card figcaption a{color:var(--muted);margin-left:auto;font-size:11px;text-decoration:none}.p3-play-note{color:var(--muted);margin:12px 0;font-size:12px;line-height:1.5}.p3-readout{border-left:4px solid var(--blue);background:#edf1f3;align-items:center;gap:30px;margin:30px 0 20px;padding:20px 24px;display:flex}.p3-readout b{min-width:145px;color:var(--navy);font-size:20px}.p3-readout p{color:var(--muted);margin:0;font-size:16px;line-height:1.5}.p3-provenance{color:var(--muted);margin:auto 0 0;padding-top:15px;font-size:12px;line-height:1.6}.p3-frame-matrix{flex-direction:column;gap:8px;display:flex}.p3-frame-row{grid-template-columns:130px repeat(4,minmax(0,1fr));align-items:center;gap:10px;display:grid}.p3-frame-row>b{color:var(--navy);font-size:16px}.p3-frame-row img{width:100%;height:auto;display:block}.p3-frame-ours{border-top:2px solid #528b70;border-bottom:2px solid #528b70;padding:9px 0}.p3-frame-head{margin-bottom:6px}.p3-frame-head span{font:12px var(--font-geist-mono),monospace;text-align:center;color:var(--muted)}.p3-audit{color:var(--muted);margin:0 0 15px;font-size:13px}.p3-audit summary{cursor:pointer;padding:9px 0}.p3-audit .p3-frame-row{margin:12px 0}.p3-conclusion{grid-template-columns:repeat(3,minmax(0,1fr));gap:40px;margin:auto 0;display:grid}.p3-conclusion article{border-top:1px solid #fff5;padding:30px 0}.p3-conclusion h3{margin:22px 0;font-size:35px;line-height:1.18}.p3-conclusion p{color:#c9d6e3;font-size:20px;line-height:1.6}.p3-jump-links{flex-wrap:wrap;gap:15px;margin-top:25px;display:flex}.p3-jump-links a{color:#e1ebf4;border:1px solid #fff5;padding:10px 14px;font-size:13px;text-decoration:none}.p3-print-poster{display:none}@media screen and (width>=1001px) and (height<=800px){[id^=paper-] .slide-inner,#omni-summary .slide-inner{padding-top:65px}[id^=paper-] .slide-heading,#omni-summary .slide-heading{margin-bottom:16px}[id^=paper-] h2,#omni-summary h2{font-size:36px}.p3-paper-figure{margin-bottom:14px}#paper-dgp .p3-paper-figure{max-width:1050px;margin-left:auto;margin-right:auto}.p3-columns p,.p3-body{font-size:15px}.p3-equation{margin-bottom:12px;padding:12px 18px}.p3-premises{padding:16px 20px}.p3-premises ol{font-size:16px}.p3-premises li{margin-bottom:8px}.p3-theorem{margin-top:14px;padding:15px 22px}.p3-theorem strong{margin:7px 0;font-size:25px}.p3-step{margin-bottom:14px}.p3-step p{font-size:15px}.p3-step h3{font-size:19px}.p3-condition-flow{margin-bottom:15px}.p3-condition-flow article{min-height:125px;padding:17px}.p3-note{margin:14px 0;padding:12px 17px}.p3-note p{font-size:15px}.p3-inference{padding:22px}.p3-inference p,.p3-inference li{font-size:16px}.p3-benchmark th,.p3-benchmark td{padding:10px 12px}.p3-score-notes{margin-top:18px}.p3-frame-row{grid-template-columns:115px repeat(4,minmax(0,1fr))}.p3-readout{margin:18px 0 14px;padding:14px 20px}}@media screen and (width<=1000px){.topbar .brand-button span,.topbar .results-link{display:none}.p3-theory-layout,.p3-method-layout,.p3-temporal-columns,.p3-training-columns{grid-template-columns:1fr}.p3-method-layout .p3-paper-figure{max-width:750px}.p3-columns,.p3-collection-grid,.p3-conclusion{gap:17px}.p3-video-grid{grid-template-columns:repeat(2,minmax(0,1fr))}.p3-frame-row{grid-template-columns:90px repeat(4,minmax(0,1fr));gap:6px}.p3-frame-row>b{font-size:12px}.p3-collection-grid strong{font-size:80px}.p3-collection-grid h3{font-size:23px}.p3-collection-grid p,.p3-conclusion p{font-size:16px}.p3-conclusion h3{font-size:27px}.p3-condition-flow{gap:12px}.p3-condition-flow strong{font-size:20px}.p3-condition-flow article{padding:15px}.p3-citation{margin-top:20px}}@media screen and (width<=650px){.topbar{gap:6px;padding-left:10px;padding-right:10px}.brand-button strong{font-size:10px}.top-actions{gap:4px}.top-actions .utility-button{padding:6px;font-size:10px}.top-actions .print-button{display:none}.page-counter{margin-right:2px;font-size:10px}.p3-columns,.p3-collection-grid,.p3-conclusion{grid-template-columns:1fr}.p3-video-grid{gap:9px}.p3-video-card figcaption{padding:10px 8px}.p3-video-card figcaption b{font-size:12px}.p3-video-toolbar{gap:7px}.p3-video-toolbar button{padding:8px 10px;font-size:12px}.p3-video-toolbar .p3-play{min-width:108px}.p3-video-toolbar input{min-width:120px;max-width:none}.p3-native{display:none}.p3-video-toolbar .p3-expand{margin-left:0}.p3-readout{padding:14px;display:block}.p3-readout b{margin-bottom:8px;font-size:18px;display:block}.p3-readout p{font-size:14px}.p3-condition-flow{grid-template-columns:1fr}.p3-condition-flow>b{text-align:center}.p3-condition-flow article{min-height:auto}.p3-frame-matrix,.p3-audit{overflow-x:auto}.p3-frame-row{min-width:660px}.p3-theorem strong{font-size:24px}.p3-collection-grid a{padding:20px 0}.p3-collection-grid strong{font-size:65px}.p3-collection-grid p{margin-bottom:0}.p3-conclusion{margin-top:20px}.p3-conclusion article{padding:20px 0}}@media print{[id^=paper-] .slide-inner,[id^=omni-] .slide-inner,[id^=real-] .slide-inner,[id^=synthetic-] .slide-inner,#further-reading .slide-inner{height:auto;min-height:0;padding:9mm 11mm}.p3-video-toolbar,.p3-compare-select,.p3-play-note,.p3-audit,.p3-jump-links,.p3-video-frame video{display:none}.p3-print-poster{object-fit:contain;width:100%;height:100%;display:block}.p3-provenance,.p3-citation{padding-top:7px;font-size:7px}.p3-paper-figure{margin-bottom:12px}.p3-columns h3,.p3-step h3{font-size:16px}.p3-columns p,.p3-step p,.p3-body,.p3-premises ol,.p3-premises>p,.p3-note p,.p3-inference p,.p3-inference li{font-size:11px}.p3-equation{margin-bottom:10px;padding:9px 12px}.p3-premises{padding:12px}.p3-theorem{margin-top:12px;padding:12px 16px}.p3-theorem strong{font-size:20px}.p3-theorem p,.p3-readout p{font-size:11px}.p3-readout{margin:18px 0 10px;padding:10px 16px}.p3-readout b{font-size:16px}.p3-video-grid{grid-template-columns:repeat(4,minmax(0,1fr))}.p3-video-card figcaption{padding:9px}.p3-video-card figcaption b{font-size:11px}.p3-video-card figcaption a{display:none}.p3-frame-row{grid-template-columns:95px repeat(4,minmax(0,1fr))}.p3-frame-row>b{font-size:11px}.p3-benchmark th,.p3-benchmark td{padding:7px 10px;font-size:13px}.p3-benchmark thead th{font-size:10px}.p3-collection-grid strong{font-size:76px}.p3-collection-grid h3,.p3-conclusion h3{font-size:23px}.p3-collection-grid p,.p3-conclusion p{font-size:14px}.p3-condition-flow article{min-height:100px;padding:14px}.p3-condition-flow strong{font-size:20px}}.p3-inference h3,.p3-collection-grid h3,.p3-conclusion h3{color:#fff}@media screen and (width>=1001px){#paper-dgp .p3-paper-figure img{object-fit:contain;max-height:43vh}}@media screen and (width>=1001px) and (height<=950px){#paper-dgp .p3-columns h3{font-size:23px}#paper-dgp .p3-columns p{font-size:16px}[id^=synthetic-] .p3-frame-matrix{align-self:center;width:min(100%,1050px)}[id^=synthetic-] .p3-readout{margin:12px 0 10px;padding:12px 18px}[id^=synthetic-] .p3-readout p{font-size:15px}[id^=synthetic-] .p3-audit{margin-bottom:6px}#omni-summary .p3-benchmark th,#omni-summary .p3-benchmark td{padding-top:11px;padding-bottom:11px}}@media screen and (width<=650px){.p3-video-toolbar,.p3-compare-select,.p3-video-grid{min-width:0;max-width:100%}.p3-compare-select select{max-width:70%}.p3-theory-layout>*,.p3-method-layout>*,.p3-columns>*{min-width:0}}.p3-paper-audit{align-self:center;width:min(100%,1100px);margin:auto 0;padding:24px 0;overflow-x:auto}.p3-paper-audit table{border-collapse:collapse;width:100%;color:var(--navy)}.p3-paper-audit caption{text-align:left;padding-bottom:16px;font-size:16px;font-weight:600}.p3-paper-audit th,.p3-paper-audit td{border-bottom:1px solid var(--line);text-align:right;padding:22px 18px;font-size:clamp(16px,1.35vw,21px)}.p3-paper-audit thead th{border-top:2px solid var(--navy);border-bottom:2px solid var(--navy);padding-top:15px;padding-bottom:15px;font-size:14px}.p3-paper-audit th:first-child{text-align:left;width:37%}.p3-paper-audit td{white-space:nowrap;font-family:var(--font-geist-mono),monospace}.p3-audit-t2v{background:#e6eee9}.p3-audit-t2v td{color:#2b6249;font-weight:700}.p3-audit-tie{color:var(--muted)}@media screen and (width<=700px){.p3-paper-audit table{min-width:580px}.p3-paper-audit th,.p3-paper-audit td{padding:16px 12px;font-size:15px}.p3-paper-audit thead th{font-size:13px}}@media print{.p3-paper-audit th,.p3-paper-audit td{padding:18px 15px;font-size:18px}.p3-paper-audit thead th{font-size:13px}}.p3-comparison-eight .p3-video-grid{grid-template-columns:repeat(4,minmax(0,1fr));gap:12px}.p3-comparison-eight .p3-video-frame{aspect-ratio:16/9}.p3-comparison-eight .p3-video-card figcaption{gap:5px 8px;min-height:59px;padding:9px 11px}.p3-comparison-eight .p3-video-card figcaption b{font-size:15px}.p3-comparison-eight .p3-video-card figcaption span{font-size:11px}.p3-extra-videos{color:var(--muted);flex-wrap:wrap;gap:8px 18px;font-size:12px;display:flex}.p3-extra-videos a{color:var(--blue);text-underline-offset:3px}.p3-synthetic-comparison .p3-video-grid{grid-template-columns:repeat(3,minmax(0,1fr))}.p3-synthetic-comparison .p3-video-frame{aspect-ratio:352/192;position:relative;overflow:hidden}.p3-synthetic-comparison .p3-video-frame video,.p3-synthetic-comparison .p3-print-poster{width:186.364%;max-width:none;height:191.667%;position:absolute;top:50%;left:50%;transform:translate(-50%,-50%)}@media screen and (width>=1001px){:is([id^=omni-],[id^=real-]):has(.p3-comparison-eight) .slide-inner{height:100svh;min-height:650px;padding-top:62px;padding-bottom:20px}:is([id^=omni-],[id^=real-]):has(.p3-comparison-eight) .slide-heading{margin-bottom:13px;padding-bottom:12px}:is([id^=omni-],[id^=real-]):has(.p3-comparison-eight) h2{font-size:clamp(32px,2.8vw,43px)}:is([id^=omni-],[id^=real-]):has(.p3-comparison-eight) .subtitle{font-size:16px}.p3-comparison-eight{flex-direction:column;flex:1;min-height:0;margin:0;display:flex}.p3-comparison-eight .p3-video-grid{flex:1;grid-template-rows:repeat(2,minmax(0,1fr));min-height:0}.p3-comparison-eight .p3-video-card{flex-direction:column;min-height:0;display:flex}.p3-comparison-eight .p3-video-frame{aspect-ratio:auto;flex:1;min-height:0}.p3-comparison-eight .p3-video-card figcaption{flex-shrink:0}.p3-comparison-eight .p3-video-toolbar button{padding:8px 12px}.p3-comparison-eight .p3-play-note{margin:9px 0}}@media screen and (width>=1001px) and (height<=800px){.p3-comparison-eight .p3-video-card figcaption{min-height:51px;padding-top:7px;padding-bottom:7px}}@media screen and (width<=1000px){.p3-comparison-eight .p3-video-grid{grid-template-columns:repeat(2,minmax(0,1fr))}}@media screen and (width<=650px){.p3-comparison-eight .p3-video-card figcaption b{font-size:12px}.p3-synthetic-comparison .p3-video-grid{grid-template-columns:1fr}}@media print{.p3-comparison-eight .p3-video-grid{grid-template-columns:repeat(4,minmax(0,1fr));gap:8px}.p3-comparison-eight .p3-video-card figcaption{min-height:32px;padding:7px}.p3-comparison-eight .p3-video-card figcaption b{font-size:11px}.p3-extra-videos{display:none}}@media screen and (width>=1001px){#paper-anchor .p3-paper-figure img{object-fit:contain;max-height:calc(100svh - 445px)}}@media screen and (width>=1001px) and (height<=800px){:is(#paper-anchor,#paper-adapter,#paper-training) .slide-inner{padding-top:60px;padding-bottom:18px}:is(#paper-anchor,#paper-adapter,#paper-training) .slide-heading{margin-bottom:12px;padding-bottom:10px}:is(#paper-anchor,#paper-adapter,#paper-training) h2{font-size:36px}:is(#paper-anchor,#paper-adapter,#paper-training) .subtitle{font-size:16px}#paper-anchor .p3-anchor-loss{margin-top:12px}#paper-anchor .p3-equation-anchor-loss{width:560px}#paper-anchor .p3-step{margin-bottom:12px}#paper-adapter .p3-condition-flow article{min-height:100px;padding:14px 18px}#paper-adapter .p3-condition-flow strong{margin:8px 0;font-size:22px}#paper-adapter .p3-condition-flow{margin-bottom:12px}#paper-adapter .p3-columns h3{margin-bottom:8px;font-size:22px}#paper-adapter .p3-columns p{font-size:15px}#paper-adapter .p3-note{margin:10px 0}#paper-adapter .p3-equation-adapter-update{width:1050px}:is(#paper-anchor,#paper-adapter,#paper-training) .p3-citation{padding-top:8px}} diff --git a/projects/video-action-editing/assets/index-DP-XUnJq.js b/projects/video-action-editing/assets/index-DP-XUnJq.js new file mode 100644 index 0000000..43a49b8 --- /dev/null +++ b/projects/video-action-editing/assets/index-DP-XUnJq.js @@ -0,0 +1,9 @@ +var e=(e,t)=>()=>(t||(e((t={exports:{}}).exports,t),e=null),t.exports);(function(){let e=document.createElement(`link`).relList;if(e&&e.supports&&e.supports(`modulepreload`))return;for(let e of document.querySelectorAll(`link[rel="modulepreload"]`))n(e);new MutationObserver(e=>{for(let t of e)if(t.type===`childList`)for(let e of t.addedNodes)e.tagName===`LINK`&&e.rel===`modulepreload`&&n(e)}).observe(document,{childList:!0,subtree:!0});function t(e){let t={};return e.integrity&&(t.integrity=e.integrity),e.referrerPolicy&&(t.referrerPolicy=e.referrerPolicy),e.crossOrigin===`use-credentials`?t.credentials=`include`:e.crossOrigin===`anonymous`?t.credentials=`omit`:t.credentials=`same-origin`,t}function n(e){if(e.ep)return;e.ep=!0;let n=t(e);fetch(e.href,n)}})();var t=e((e=>{function t(e,t){var n=e.length;e.push(t);a:for(;0>>1,a=e[r];if(0>>1;ri(c,n))li(u,c)?(e[r]=u,e[l]=n,r=l):(e[r]=c,e[s]=n,r=s);else if(li(u,n))e[r]=u,e[l]=n,r=l;else break a}}return t}function i(e,t){var n=e.sortIndex-t.sortIndex;return n===0?e.id-t.id:n}if(e.unstable_now=void 0,typeof performance==`object`&&typeof performance.now==`function`){var a=performance;e.unstable_now=function(){return a.now()}}else{var o=Date,s=o.now();e.unstable_now=function(){return o.now()-s}}var c=[],l=[],u=1,d=null,f=3,p=!1,m=!1,h=!1,g=!1,_=typeof setTimeout==`function`?setTimeout:null,v=typeof clearTimeout==`function`?clearTimeout:null,y=typeof setImmediate<`u`?setImmediate:null;function b(e){for(var i=n(l);i!==null;){if(i.callback===null)r(l);else if(i.startTime<=e)r(l),i.sortIndex=i.expirationTime,t(c,i);else break;i=n(l)}}function x(e){if(h=!1,b(e),!m)if(n(c)!==null)m=!0,ee||(ee=!0,T());else{var t=n(l);t!==null&&ie(x,t.startTime-e)}}var ee=!1,S=-1,C=5,w=-1;function te(){return g?!0:!(e.unstable_now()-wt&&te());){var o=d.callback;if(typeof o==`function`){d.callback=null,f=d.priorityLevel;var s=o(d.expirationTime<=t);if(t=e.unstable_now(),typeof s==`function`){d.callback=s,b(t),i=!0;break b}d===n(c)&&r(c),b(t)}else r(c);d=n(c)}if(d!==null)i=!0;else{var u=n(l);u!==null&&ie(x,u.startTime-t),i=!1}}break a}finally{d=null,f=a,p=!1}i=void 0}}finally{i?T():ee=!1}}}var T;if(typeof y==`function`)T=function(){y(ne)};else if(typeof MessageChannel<`u`){var E=new MessageChannel,re=E.port2;E.port1.onmessage=ne,T=function(){re.postMessage(null)}}else T=function(){_(ne,0)};function ie(t,n){S=_(function(){t(e.unstable_now())},n)}e.unstable_IdlePriority=5,e.unstable_ImmediatePriority=1,e.unstable_LowPriority=4,e.unstable_NormalPriority=3,e.unstable_Profiling=null,e.unstable_UserBlockingPriority=2,e.unstable_cancelCallback=function(e){e.callback=null},e.unstable_forceFrameRate=function(e){0>e||125o?(r.sortIndex=a,t(l,r),n(c)===null&&r===n(l)&&(h?(v(S),S=-1):h=!0,ie(x,a-o))):(r.sortIndex=s,t(c,r),m||p||(m=!0,ee||(ee=!0,T()))),r},e.unstable_shouldYield=te,e.unstable_wrapCallback=function(e){var t=f;return function(){var n=f;f=t;try{return e.apply(this,arguments)}finally{f=n}}}})),n=e(((e,n)=>{n.exports=t()})),r=e((e=>{var t=Symbol.for(`react.transitional.element`),n=Symbol.for(`react.portal`),r=Symbol.for(`react.fragment`),i=Symbol.for(`react.strict_mode`),a=Symbol.for(`react.profiler`),o=Symbol.for(`react.consumer`),s=Symbol.for(`react.context`),c=Symbol.for(`react.forward_ref`),l=Symbol.for(`react.suspense`),u=Symbol.for(`react.memo`),d=Symbol.for(`react.lazy`),f=Symbol.for(`react.activity`),p=Symbol.iterator;function m(e){return typeof e!=`object`||!e?null:(e=p&&e[p]||e[`@@iterator`],typeof e==`function`?e:null)}var h={isMounted:function(){return!1},enqueueForceUpdate:function(){},enqueueReplaceState:function(){},enqueueSetState:function(){}},g=Object.assign,_={};function v(e,t,n){this.props=e,this.context=t,this.refs=_,this.updater=n||h}v.prototype.isReactComponent={},v.prototype.setState=function(e,t){if(typeof e!=`object`&&typeof e!=`function`&&e!=null)throw Error(`takes an object of state variables to update or a function which returns an object of state variables.`);this.updater.enqueueSetState(this,e,t,`setState`)},v.prototype.forceUpdate=function(e){this.updater.enqueueForceUpdate(this,e,`forceUpdate`)};function y(){}y.prototype=v.prototype;function b(e,t,n){this.props=e,this.context=t,this.refs=_,this.updater=n||h}var x=b.prototype=new y;x.constructor=b,g(x,v.prototype),x.isPureReactComponent=!0;var ee=Array.isArray;function S(){}var C={H:null,A:null,T:null,S:null},w=Object.prototype.hasOwnProperty;function te(e,n,r){var i=r.ref;return{$$typeof:t,type:e,key:n,ref:i===void 0?null:i,props:r}}function ne(e,t){return te(e.type,t,e.props)}function T(e){return typeof e==`object`&&!!e&&e.$$typeof===t}function E(e){var t={"=":`=0`,":":`=2`};return`$`+e.replace(/[=:]/g,function(e){return t[e]})}var re=/\/+/g;function ie(e,t){return typeof e==`object`&&e&&e.key!=null?E(``+e.key):t.toString(36)}function ae(e){switch(e.status){case`fulfilled`:return e.value;case`rejected`:throw e.reason;default:switch(typeof e.status==`string`?e.then(S,S):(e.status=`pending`,e.then(function(t){e.status===`pending`&&(e.status=`fulfilled`,e.value=t)},function(t){e.status===`pending`&&(e.status=`rejected`,e.reason=t)})),e.status){case`fulfilled`:return e.value;case`rejected`:throw e.reason}}throw e}function oe(e,r,i,a,o){var s=typeof e;(s===`undefined`||s===`boolean`)&&(e=null);var c=!1;if(e===null)c=!0;else switch(s){case`bigint`:case`string`:case`number`:c=!0;break;case`object`:switch(e.$$typeof){case t:case n:c=!0;break;case d:return c=e._init,oe(c(e._payload),r,i,a,o)}}if(c)return o=o(e),c=a===``?`.`+ie(e,0):a,ee(o)?(i=``,c!=null&&(i=c.replace(re,`$&/`)+`/`),oe(o,r,i,``,function(e){return e})):o!=null&&(T(o)&&(o=ne(o,i+(o.key==null||e&&e.key===o.key?``:(``+o.key).replace(re,`$&/`)+`/`)+c)),r.push(o)),1;c=0;var l=a===``?`.`:a+`:`;if(ee(e))for(var u=0;u{t.exports=r()})),a=e((e=>{var t=i();function n(e){var t=`https://react.dev/errors/`+e;if(1{function n(){if(!(typeof __REACT_DEVTOOLS_GLOBAL_HOOK__>`u`||typeof __REACT_DEVTOOLS_GLOBAL_HOOK__.checkDCE!=`function`))try{__REACT_DEVTOOLS_GLOBAL_HOOK__.checkDCE(n)}catch(e){console.error(e)}}n(),t.exports=a()})),s=e((e=>{var t=n(),r=i(),a=o();function s(e){var t=`https://react.dev/errors/`+e;if(1de||(e.current=ue[de],ue[de]=null,de--)}function A(e,t){de++,ue[de]=e.current,e.current=t}var pe=fe(null),me=fe(null),he=fe(null),ge=fe(null);function _e(e,t){switch(A(he,t),A(me,e),A(pe,null),t.nodeType){case 9:case 11:e=(e=t.documentElement)&&(e=e.namespaceURI)?Vd(e):0;break;default:if(e=t.tagName,t=t.namespaceURI)t=Vd(t),e=Hd(t,e);else switch(e){case`svg`:e=1;break;case`math`:e=2;break;default:e=0}}k(pe),A(pe,e)}function ve(){k(pe),k(me),k(he)}function ye(e){e.memoizedState!==null&&A(ge,e);var t=pe.current,n=Hd(t,e.type);t!==n&&(A(me,e),A(pe,n))}function be(e){me.current===e&&(k(pe),k(me)),ge.current===e&&(k(ge),Qf._currentValue=le)}var xe,Se;function Ce(e){if(xe===void 0)try{throw Error()}catch(e){var t=e.stack.trim().match(/\n( *(at )?)/);xe=t&&t[1]||``,Se=-1)`:-1i||c[r]!==l[i]){var u=` +`+c[r].replace(` at new `,` at `);return e.displayName&&u.includes(``)&&(u=u.replace(``,e.displayName)),u}while(1<=r&&0<=i);break}}}finally{we=!1,Error.prepareStackTrace=n}return(n=e?e.displayName||e.name:``)?Ce(n):``}function Ee(e,t){switch(e.tag){case 26:case 27:case 5:return Ce(e.type);case 16:return Ce(`Lazy`);case 13:return e.child!==t&&t!==null?Ce(`Suspense Fallback`):Ce(`Suspense`);case 19:return Ce(`SuspenseList`);case 0:case 15:return Te(e.type,!1);case 11:return Te(e.type.render,!1);case 1:return Te(e.type,!0);case 31:return Ce(`Activity`);default:return``}}function De(e){try{var t=``,n=null;do t+=Ee(e,n),n=e,e=e.return;while(e);return t}catch(e){return` +Error generating stack: `+e.message+` +`+e.stack}}var Oe=Object.prototype.hasOwnProperty,ke=t.unstable_scheduleCallback,Ae=t.unstable_cancelCallback,je=t.unstable_shouldYield,Me=t.unstable_requestPaint,Ne=t.unstable_now,Pe=t.unstable_getCurrentPriorityLevel,Fe=t.unstable_ImmediatePriority,Ie=t.unstable_UserBlockingPriority,Le=t.unstable_NormalPriority,Re=t.unstable_LowPriority,ze=t.unstable_IdlePriority,Be=t.log,Ve=t.unstable_setDisableYieldValue,He=null,Ue=null;function We(e){if(typeof Be==`function`&&Ve(e),Ue&&typeof Ue.setStrictMode==`function`)try{Ue.setStrictMode(He,e)}catch{}}var Ge=Math.clz32?Math.clz32:Je,Ke=Math.log,qe=Math.LN2;function Je(e){return e>>>=0,e===0?32:31-(Ke(e)/qe|0)|0}var Ye=256,Xe=262144,Ze=4194304;function Qe(e){var t=e&42;if(t!==0)return t;switch(e&-e){case 1:return 1;case 2:return 2;case 4:return 4;case 8:return 8;case 16:return 16;case 32:return 32;case 64:return 64;case 128:return 128;case 256:case 512:case 1024:case 2048:case 4096:case 8192:case 16384:case 32768:case 65536:case 131072:return e&261888;case 262144:case 524288:case 1048576:case 2097152:return e&3932160;case 4194304:case 8388608:case 16777216:case 33554432:return e&62914560;case 67108864:return 67108864;case 134217728:return 134217728;case 268435456:return 268435456;case 536870912:return 536870912;case 1073741824:return 0;default:return e}}function $e(e,t,n){var r=e.pendingLanes;if(r===0)return 0;var i=0,a=e.suspendedLanes,o=e.pingedLanes;e=e.warmLanes;var s=r&134217727;return s===0?(s=r&~a,s===0?o===0?n||(n=r&~e,n!==0&&(i=Qe(n))):i=Qe(o):i=Qe(s)):(r=s&~a,r===0?(o&=s,o===0?n||(n=s&~e,n!==0&&(i=Qe(n))):i=Qe(o)):i=Qe(r)),i===0?0:t!==0&&t!==i&&(t&a)===0&&(a=i&-i,n=t&-t,a>=n||a===32&&n&4194048)?t:i}function et(e,t){return(e.pendingLanes&~(e.suspendedLanes&~e.pingedLanes)&t)===0}function tt(e,t){switch(e){case 1:case 2:case 4:case 8:case 64:return t+250;case 16:case 32:case 128:case 256:case 512:case 1024:case 2048:case 4096:case 8192:case 16384:case 32768:case 65536:case 131072:case 262144:case 524288:case 1048576:case 2097152:return t+5e3;case 4194304:case 8388608:case 16777216:case 33554432:return-1;case 67108864:case 134217728:case 268435456:case 536870912:case 1073741824:return-1;default:return-1}}function nt(){var e=Ze;return Ze<<=1,!(Ze&62914560)&&(Ze=4194304),e}function rt(e){for(var t=[],n=0;31>n;n++)t.push(e);return t}function it(e,t){e.pendingLanes|=t,t!==268435456&&(e.suspendedLanes=0,e.pingedLanes=0,e.warmLanes=0)}function at(e,t,n,r,i,a){var o=e.pendingLanes;e.pendingLanes=n,e.suspendedLanes=0,e.pingedLanes=0,e.warmLanes=0,e.expiredLanes&=n,e.entangledLanes&=n,e.errorRecoveryDisabledLanes&=n,e.shellSuspendCounter=0;var s=e.entanglements,c=e.expirationTimes,l=e.hiddenUpdates;for(n=o&~n;0`u`||window.document===void 0||window.document.createElement===void 0),vn=!1;if(_n)try{var yn={};Object.defineProperty(yn,`passive`,{get:function(){vn=!0}}),window.addEventListener(`test`,yn,yn),window.removeEventListener(`test`,yn,yn)}catch{vn=!1}var bn=null,xn=null,Sn=null;function Cn(){if(Sn)return Sn;var e,t=xn,n=t.length,r,i=`value`in bn?bn.value:bn.textContent,a=i.length;for(e=0;e=tr),ir=` `,ar=!1;function or(e,t){switch(e){case`keyup`:return $n.indexOf(t.keyCode)!==-1;case`keydown`:return t.keyCode!==229;case`keypress`:case`mousedown`:case`focusout`:return!0;default:return!1}}function sr(e){return e=e.detail,typeof e==`object`&&`data`in e?e.data:null}var cr=!1;function lr(e,t){switch(e){case`compositionend`:return sr(t);case`keypress`:return t.which===32?(ar=!0,ir):null;case`textInput`:return e=t.data,e===ir&&ar?null:e;default:return null}}function ur(e,t){if(cr)return e===`compositionend`||!er&&or(e,t)?(e=Cn(),Sn=xn=bn=null,cr=!1,e):null;switch(e){case`paste`:return null;case`keypress`:if(!(t.ctrlKey||t.altKey||t.metaKey)||t.ctrlKey&&t.altKey){if(t.char&&1=t)return{node:n,offset:t-e};e=r}a:{for(;n;){if(n.nextSibling){n=n.nextSibling;break a}n=n.parentNode}n=void 0}n=Mr(n)}}function Pr(e,t){return e&&t?e===t?!0:e&&e.nodeType===3?!1:t&&t.nodeType===3?Pr(e,t.parentNode):`contains`in e?e.contains(t):e.compareDocumentPosition?!!(e.compareDocumentPosition(t)&16):!1:!1}function Fr(e){e=e!=null&&e.ownerDocument!=null&&e.ownerDocument.defaultView!=null?e.ownerDocument.defaultView:window;for(var t=Wt(e.document);t instanceof e.HTMLIFrameElement;){try{var n=typeof t.contentWindow.location.href==`string`}catch{n=!1}if(n)e=t.contentWindow;else break;t=Wt(e.document)}return t}function Ir(e){var t=e&&e.nodeName&&e.nodeName.toLowerCase();return t&&(t===`input`&&(e.type===`text`||e.type===`search`||e.type===`tel`||e.type===`url`||e.type===`password`)||t===`textarea`||e.contentEditable===`true`)}var Lr=_n&&`documentMode`in document&&11>=document.documentMode,Rr=null,zr=null,Br=null,Vr=!1;function Hr(e,t,n){var r=n.window===n?n.document:n.nodeType===9?n:n.ownerDocument;Vr||Rr==null||Rr!==Wt(r)||(r=Rr,`selectionStart`in r&&Ir(r)?r={start:r.selectionStart,end:r.selectionEnd}:(r=(r.ownerDocument&&r.ownerDocument.defaultView||window).getSelection(),r={anchorNode:r.anchorNode,anchorOffset:r.anchorOffset,focusNode:r.focusNode,focusOffset:r.focusOffset}),Br&&jr(Br,r)||(Br=r,r=Ed(zr,`onSelect`),0>=o,i-=o,Pi=1<<32-Ge(t)+i|n<h?(g=d,d=null):g=d.sibling;var _=p(i,d,s[h],c);if(_===null){d===null&&(d=g);break}e&&d&&_.alternate===null&&t(i,d),o=a(_,o,h),u===null?l=_:u.sibling=_,u=_,d=g}if(h===s.length)return n(i,d),M&&Ii(i,h),l;if(d===null){for(;hg?(_=h,h=null):_=h.sibling;var y=p(i,h,v.value,l);if(y===null){h===null&&(h=_);break}e&&h&&y.alternate===null&&t(i,h),o=a(y,o,g),d===null?u=y:d.sibling=y,d=y,h=_}if(v.done)return n(i,h),M&&Ii(i,g),u;if(h===null){for(;!v.done;g++,v=c.next())v=f(i,v.value,l),v!==null&&(o=a(v,o,g),d===null?u=v:d.sibling=v,d=v);return M&&Ii(i,g),u}for(h=r(h);!v.done;g++,v=c.next())v=m(h,i,g,v.value,l),v!==null&&(e&&v.alternate!==null&&h.delete(v.key===null?g:v.key),o=a(v,o,g),d===null?u=v:d.sibling=v,d=v);return e&&h.forEach(function(e){return t(i,e)}),M&&Ii(i,g),u}function b(e,r,a,c){if(typeof a==`object`&&a&&a.type===y&&a.key===null&&(a=a.props.children),typeof a==`object`&&a){switch(a.$$typeof){case _:a:{for(var l=a.key;r!==null;){if(r.key===l){if(l=a.type,l===y){if(r.tag===7){n(e,r.sibling),c=i(r,a.props.children),c.return=e,e=c;break a}}else if(r.elementType===l||typeof l==`object`&&l&&l.$$typeof===T&&Pa(l)===r.type){n(e,r.sibling),c=i(r,a.props),Va(c,a),c.return=e,e=c;break a}n(e,r);break}else t(e,r);r=r.sibling}a.type===y?(c=xi(a.props.children,e.mode,c,a.key),c.return=e,e=c):(c=bi(a.type,a.key,a.props,null,e.mode,c),Va(c,a),c.return=e,e=c)}return o(e);case v:a:{for(l=a.key;r!==null;){if(r.key===l)if(r.tag===4&&r.stateNode.containerInfo===a.containerInfo&&r.stateNode.implementation===a.implementation){n(e,r.sibling),c=i(r,a.children||[]),c.return=e,e=c;break a}else{n(e,r);break}else t(e,r);r=r.sibling}c=wi(a,e.mode,c),c.return=e,e=c}return o(e);case T:return a=Pa(a),b(e,r,a,c)}if(ce(a))return h(e,r,a,c);if(ae(a)){if(l=ae(a),typeof l!=`function`)throw Error(s(150));return a=l.call(a),g(e,r,a,c)}if(typeof a.then==`function`)return b(e,r,Ba(a),c);if(a.$$typeof===S)return b(e,r,la(e,a),c);Ha(e,a)}return typeof a==`string`&&a!==``||typeof a==`number`||typeof a==`bigint`?(a=``+a,r!==null&&r.tag===6?(n(e,r.sibling),c=i(r,a),c.return=e,e=c):(n(e,r),c=Si(a,e.mode,c),c.return=e,e=c),o(e)):n(e,r)}return function(e,t,n,r){try{za=0;var i=b(e,t,n,r);return Ra=null,i}catch(t){if(t===Oa||t===Aa)throw t;var a=gi(29,t,null,e.mode);return a.lanes=r,a.return=e,a}}}var Wa=Ua(!0),Ga=Ua(!1),Ka=!1;function qa(e){e.updateQueue={baseState:e.memoizedState,firstBaseUpdate:null,lastBaseUpdate:null,shared:{pending:null,lanes:0,hiddenCallbacks:null},callbacks:null}}function Ja(e,t){e=e.updateQueue,t.updateQueue===e&&(t.updateQueue={baseState:e.baseState,firstBaseUpdate:e.firstBaseUpdate,lastBaseUpdate:e.lastBaseUpdate,shared:e.shared,callbacks:null})}function Ya(e){return{lane:e,tag:0,payload:null,callback:null,next:null}}function Xa(e,t,n){var r=e.updateQueue;if(r===null)return null;if(r=r.shared,W&2){var i=r.pending;return i===null?t.next=t:(t.next=i.next,i.next=t),r.pending=t,t=pi(e),fi(e,null,n),t}return li(e,r,t,n),pi(e)}function Za(e,t,n){if(t=t.updateQueue,t!==null&&(t=t.shared,n&4194048)){var r=t.lanes;r&=e.pendingLanes,n|=r,t.lanes=n,st(e,n)}}function Qa(e,t){var n=e.updateQueue,r=e.alternate;if(r!==null&&(r=r.updateQueue,n===r)){var i=null,a=null;if(n=n.firstBaseUpdate,n!==null){do{var o={lane:n.lane,tag:n.tag,payload:n.payload,callback:null,next:null};a===null?i=a=o:a=a.next=o,n=n.next}while(n!==null);a===null?i=a=t:a=a.next=t}else i=a=t;n={baseState:r.baseState,firstBaseUpdate:i,lastBaseUpdate:a,shared:r.shared,callbacks:r.callbacks},e.updateQueue=n;return}e=n.lastBaseUpdate,e===null?n.firstBaseUpdate=t:e.next=t,n.lastBaseUpdate=t}var $a=!1;function eo(){if($a){var e=ya;if(e!==null)throw e}}function to(e,t,n,r){$a=!1;var i=e.updateQueue;Ka=!1;var a=i.firstBaseUpdate,o=i.lastBaseUpdate,s=i.shared.pending;if(s!==null){i.shared.pending=null;var c=s,l=c.next;c.next=null,o===null?a=l:o.next=l,o=c;var u=e.alternate;u!==null&&(u=u.updateQueue,s=u.lastBaseUpdate,s!==o&&(s===null?u.firstBaseUpdate=l:s.next=l,u.lastBaseUpdate=c))}if(a!==null){var d=i.baseState;o=0,u=l=c=null,s=a;do{var f=s.lane&-536870913,p=f!==s.lane;if(p?(q&f)===f:(r&f)===f){f!==0&&f===va&&($a=!0),u!==null&&(u=u.next={lane:0,tag:s.tag,payload:s.payload,callback:null,next:null});a:{var m=e,g=s;f=t;var _=n;switch(g.tag){case 1:if(m=g.payload,typeof m==`function`){d=m.call(_,d,f);break a}d=m;break a;case 3:m.flags=m.flags&-65537|128;case 0:if(m=g.payload,f=typeof m==`function`?m.call(_,d,f):m,f==null)break a;d=h({},d,f);break a;case 2:Ka=!0}}f=s.callback,f!==null&&(e.flags|=64,p&&(e.flags|=8192),p=i.callbacks,p===null?i.callbacks=[f]:p.push(f))}else p={lane:f,tag:s.tag,payload:s.payload,callback:s.callback,next:null},u===null?(l=u=p,c=d):u=u.next=p,o|=f;if(s=s.next,s===null){if(s=i.shared.pending,s===null)break;p=s,s=p.next,p.next=null,i.lastBaseUpdate=p,i.shared.pending=null}}while(1);u===null&&(c=d),i.baseState=c,i.firstBaseUpdate=l,i.lastBaseUpdate=u,a===null&&(i.shared.lanes=0),Kl|=o,e.lanes=o,e.memoizedState=d}}function no(e,t){if(typeof e!=`function`)throw Error(s(191,e));e.call(t)}function ro(e,t){var n=e.callbacks;if(n!==null)for(e.callbacks=null,e=0;ea?a:8;var o=D.T,s={};D.T=s,Rs(e,!1,t,n);try{var c=i(),l=D.S;l!==null&&l(s,c),typeof c==`object`&&c&&typeof c.then==`function`?Ls(e,t,Sa(c,r),pu(e)):Ls(e,t,r,pu(e))}catch(n){Ls(e,t,{then:function(){},status:`rejected`,reason:n},pu())}finally{O.p=a,o!==null&&s.types!==null&&(o.types=s.types),D.T=o}}function Ds(){}function Os(e,t,n,r){if(e.tag!==5)throw Error(s(476));var i=ks(e).queue;Es(e,i,t,le,n===null?Ds:function(){return As(e),n(r)})}function ks(e){var t=e.memoizedState;if(t!==null)return t;t={memoizedState:le,baseState:le,baseQueue:null,queue:{pending:null,lanes:0,dispatch:null,lastRenderedReducer:zo,lastRenderedState:le},next:null};var n={};return t.next={memoizedState:n,baseState:n,baseQueue:null,queue:{pending:null,lanes:0,dispatch:null,lastRenderedReducer:zo,lastRenderedState:n},next:null},e.memoizedState=t,e=e.alternate,e!==null&&(e.memoizedState=t),t}function As(e){var t=ks(e);t.next===null&&(t=e.alternate.memoizedState),Ls(e,t.next.queue,{},pu())}function js(){return ca(Qf)}function Ms(){return z().memoizedState}function Ns(){return z().memoizedState}function Ps(e){for(var t=e.return;t!==null;){switch(t.tag){case 24:case 3:var n=pu();e=Ya(n);var r=Xa(t,e,n);r!==null&&(hu(r,t,n),Za(r,t,n)),t={cache:ma()},e.payload=t;return}t=t.return}}function Fs(e,t,n){var r=pu();n={lane:r,revertLane:0,gesture:null,action:n,hasEagerState:!1,eagerState:null,next:null},zs(e)?Bs(t,n):(n=ui(e,t,n,r),n!==null&&(hu(n,e,r),Vs(n,t,r)))}function Is(e,t,n){Ls(e,t,n,pu())}function Ls(e,t,n,r){var i={lane:r,revertLane:0,gesture:null,action:n,hasEagerState:!1,eagerState:null,next:null};if(zs(e))Bs(t,i);else{var a=e.alternate;if(e.lanes===0&&(a===null||a.lanes===0)&&(a=t.lastRenderedReducer,a!==null))try{var o=t.lastRenderedState,s=a(o,n);if(i.hasEagerState=!0,i.eagerState=s,Ar(s,o))return li(e,t,i,0),G===null&&ci(),!1}catch{}if(n=ui(e,t,i,r),n!==null)return hu(n,e,r),Vs(n,t,r),!0}return!1}function Rs(e,t,n,r){if(r={lane:2,revertLane:dd(),gesture:null,action:r,hasEagerState:!1,eagerState:null,next:null},zs(e)){if(t)throw Error(s(479))}else t=ui(e,n,r,2),t!==null&&hu(t,e,2)}function zs(e){var t=e.alternate;return e===F||t!==null&&t===F}function Bs(e,t){bo=yo=!0;var n=e.pending;n===null?t.next=t:(t.next=n.next,n.next=t),e.pending=t}function Vs(e,t,n){if(n&4194048){var r=t.lanes;r&=e.pendingLanes,n|=r,t.lanes=n,st(e,n)}}var Hs={readContext:ca,use:Lo,useCallback:R,useContext:R,useEffect:R,useImperativeHandle:R,useLayoutEffect:R,useInsertionEffect:R,useMemo:R,useReducer:R,useRef:R,useState:R,useDebugValue:R,useDeferredValue:R,useTransition:R,useSyncExternalStore:R,useId:R,useHostTransitionStatus:R,useFormState:R,useActionState:R,useOptimistic:R,useMemoCache:R,useCacheRefresh:R};Hs.useEffectEvent=R;var Us={readContext:ca,use:Lo,useCallback:function(e,t){return Po().memoizedState=[e,t===void 0?null:t],e},useContext:ca,useEffect:ps,useImperativeHandle:function(e,t,n){n=n==null?null:n.concat([e]),ds(4194308,4,ys.bind(null,t,e),n)},useLayoutEffect:function(e,t){return ds(4194308,4,e,t)},useInsertionEffect:function(e,t){ds(4,2,e,t)},useMemo:function(e,t){var n=Po();t=t===void 0?null:t;var r=e();if(xo){We(!0);try{e()}finally{We(!1)}}return n.memoizedState=[r,t],r},useReducer:function(e,t,n){var r=Po();if(n!==void 0){var i=n(t);if(xo){We(!0);try{n(t)}finally{We(!1)}}}else i=t;return r.memoizedState=r.baseState=i,e={pending:null,lanes:0,dispatch:null,lastRenderedReducer:e,lastRenderedState:i},r.queue=e,e=e.dispatch=Fs.bind(null,F,e),[r.memoizedState,e]},useRef:function(e){var t=Po();return e={current:e},t.memoizedState=e},useState:function(e){e=Yo(e);var t=e.queue,n=Is.bind(null,F,t);return t.dispatch=n,[e.memoizedState,n]},useDebugValue:xs,useDeferredValue:function(e,t){return ws(Po(),e,t)},useTransition:function(){var e=Yo(!1);return e=Es.bind(null,F,e.queue,!0,!1),Po().memoizedState=e,[!1,e]},useSyncExternalStore:function(e,t,n){var r=F,i=Po();if(M){if(n===void 0)throw Error(s(407));n=n()}else{if(n=t(),G===null)throw Error(s(349));q&127||Wo(r,t,n)}i.memoizedState=n;var a={value:n,getSnapshot:t};return i.queue=a,ps(Ko.bind(null,r,a,e),[e]),r.flags|=2048,ls(9,{destroy:void 0},Go.bind(null,r,a,n,t),null),n},useId:function(){var e=Po(),t=G.identifierPrefix;if(M){var n=Fi,r=Pi;n=(r&~(1<<32-Ge(r)-1)).toString(32)+n,t=`_`+t+`R_`+n,n=So++,0<\/script>`,a=a.removeChild(a.firstChild);break;case`select`:a=typeof r.is==`string`?o.createElement(`select`,{is:r.is}):o.createElement(`select`),r.multiple?a.multiple=!0:r.size&&(a.size=r.size);break;default:a=typeof r.is==`string`?o.createElement(i,{is:r.is}):o.createElement(i)}}a[mt]=t,a[ht]=r;a:for(o=t.child;o!==null;){if(o.tag===5||o.tag===6)a.appendChild(o.stateNode);else if(o.tag!==4&&o.tag!==27&&o.child!==null){o.child.return=o,o=o.child;continue}if(o===t)break a;for(;o.sibling===null;){if(o.return===null||o.return===t)break a;o=o.return}o.sibling.return=o.return,o=o.sibling}t.stateNode=a;a:switch(Pd(a,i,r),i){case`button`:case`input`:case`select`:case`textarea`:r=!!r.autoFocus;break a;case`img`:r=!0;break a;default:r=!1}r&&Ic(t)}}return V(t),Lc(t,t.type,e===null?null:e.memoizedProps,t.pendingProps,n),null;case 6:if(e&&t.stateNode!=null)e.memoizedProps!==r&&Ic(t);else{if(typeof r!=`string`&&t.stateNode===null)throw Error(s(166));if(e=he.current,Ji(t)){if(e=t.stateNode,n=t.memoizedProps,r=null,i=Vi,i!==null)switch(i.tag){case 27:case 5:r=i.memoizedProps}e[mt]=t,e=!!(e.nodeValue===n||r!==null&&!0===r.suppressHydrationWarning||Md(e.nodeValue,n)),e||Gi(t,!0)}else e=Bd(e).createTextNode(r),e[mt]=t,t.stateNode=e}return V(t),null;case 31:if(n=t.memoizedState,e===null||e.memoizedState!==null){if(r=Ji(t),n!==null){if(e===null){if(!r)throw Error(s(318));if(e=t.memoizedState,e=e===null?null:e.dehydrated,!e)throw Error(s(557));e[mt]=t}else Yi(),!(t.flags&128)&&(t.memoizedState=null),t.flags|=4;V(t),e=!1}else n=Xi(),e!==null&&e.memoizedState!==null&&(e.memoizedState.hydrationErrors=n),e=!0;if(!e)return t.flags&256?(go(t),t):(go(t),null);if(t.flags&128)throw Error(s(558))}return V(t),null;case 13:if(r=t.memoizedState,e===null||e.memoizedState!==null&&e.memoizedState.dehydrated!==null){if(i=Ji(t),r!==null&&r.dehydrated!==null){if(e===null){if(!i)throw Error(s(318));if(i=t.memoizedState,i=i===null?null:i.dehydrated,!i)throw Error(s(317));i[mt]=t}else Yi(),!(t.flags&128)&&(t.memoizedState=null),t.flags|=4;V(t),i=!1}else i=Xi(),e!==null&&e.memoizedState!==null&&(e.memoizedState.hydrationErrors=i),i=!0;if(!i)return t.flags&256?(go(t),t):(go(t),null)}return go(t),t.flags&128?(t.lanes=n,t):(n=r!==null,e=e!==null&&e.memoizedState!==null,n&&(r=t.child,i=null,r.alternate!==null&&r.alternate.memoizedState!==null&&r.alternate.memoizedState.cachePool!==null&&(i=r.alternate.memoizedState.cachePool.pool),a=null,r.memoizedState!==null&&r.memoizedState.cachePool!==null&&(a=r.memoizedState.cachePool.pool),a!==i&&(r.flags|=2048)),n!==e&&n&&(t.child.flags|=8192),zc(t,t.updateQueue),V(t),null);case 4:return ve(),e===null&&Sd(t.stateNode.containerInfo),V(t),null;case 10:return na(t.type),V(t),null;case 19:if(k(P),r=t.memoizedState,r===null)return V(t),null;if(i=(t.flags&128)!=0,a=r.rendering,a===null)if(i)Bc(r,!1);else{if(Y!==0||e!==null&&e.flags&128)for(e=t.child;e!==null;){if(a=_o(e),a!==null){for(t.flags|=128,Bc(r,!1),e=a.updateQueue,t.updateQueue=e,zc(t,e),t.subtreeFlags=0,e=n,n=t.child;n!==null;)yi(n,e),n=n.sibling;return A(P,P.current&1|2),M&&Ii(t,r.treeForkCount),t.child}e=e.sibling}r.tail!==null&&Ne()>nu&&(t.flags|=128,i=!0,Bc(r,!1),t.lanes=4194304)}else{if(!i)if(e=_o(a),e!==null){if(t.flags|=128,i=!0,e=e.updateQueue,t.updateQueue=e,zc(t,e),Bc(r,!0),r.tail===null&&r.tailMode===`hidden`&&!a.alternate&&!M)return V(t),null}else 2*Ne()-r.renderingStartTime>nu&&n!==536870912&&(t.flags|=128,i=!0,Bc(r,!1),t.lanes=4194304);r.isBackwards?(a.sibling=t.child,t.child=a):(e=r.last,e===null?t.child=a:e.sibling=a,r.last=a)}return r.tail===null?(V(t),null):(e=r.tail,r.rendering=e,r.tail=e.sibling,r.renderingStartTime=Ne(),e.sibling=null,n=P.current,A(P,i?n&1|2:n&1),M&&Ii(t,r.treeForkCount),e);case 22:case 23:return go(t),co(),r=t.memoizedState!==null,e===null?r&&(t.flags|=8192):e.memoizedState!==null!==r&&(t.flags|=8192),r?n&536870912&&!(t.flags&128)&&(V(t),t.subtreeFlags&6&&(t.flags|=8192)):V(t),n=t.updateQueue,n!==null&&zc(t,n.retryQueue),n=null,e!==null&&e.memoizedState!==null&&e.memoizedState.cachePool!==null&&(n=e.memoizedState.cachePool.pool),r=null,t.memoizedState!==null&&t.memoizedState.cachePool!==null&&(r=t.memoizedState.cachePool.pool),r!==n&&(t.flags|=2048),e!==null&&k(wa),null;case 24:return n=null,e!==null&&(n=e.memoizedState.cache),t.memoizedState.cache!==n&&(t.flags|=2048),na(N),V(t),null;case 25:return null;case 30:return null}throw Error(s(156,t.tag))}function Hc(e,t){switch(zi(t),t.tag){case 1:return e=t.flags,e&65536?(t.flags=e&-65537|128,t):null;case 3:return na(N),ve(),e=t.flags,e&65536&&!(e&128)?(t.flags=e&-65537|128,t):null;case 26:case 27:case 5:return be(t),null;case 31:if(t.memoizedState!==null){if(go(t),t.alternate===null)throw Error(s(340));Yi()}return e=t.flags,e&65536?(t.flags=e&-65537|128,t):null;case 13:if(go(t),e=t.memoizedState,e!==null&&e.dehydrated!==null){if(t.alternate===null)throw Error(s(340));Yi()}return e=t.flags,e&65536?(t.flags=e&-65537|128,t):null;case 19:return k(P),null;case 4:return ve(),null;case 10:return na(t.type),null;case 22:case 23:return go(t),co(),e!==null&&k(wa),e=t.flags,e&65536?(t.flags=e&-65537|128,t):null;case 24:return na(N),null;case 25:return null;default:return null}}function Uc(e,t){switch(zi(t),t.tag){case 3:na(N),ve();break;case 26:case 27:case 5:be(t);break;case 4:ve();break;case 31:t.memoizedState!==null&&go(t);break;case 13:go(t);break;case 19:k(P);break;case 10:na(t.type);break;case 22:case 23:go(t),co(),e!==null&&k(wa);break;case 24:na(N)}}function Wc(e,t){try{var n=t.updateQueue,r=n===null?null:n.lastEffect;if(r!==null){var i=r.next;n=i;do{if((n.tag&e)===e){r=void 0;var a=n.create,o=n.inst;r=a(),o.destroy=r}n=n.next}while(n!==i)}}catch(e){Z(t,t.return,e)}}function Gc(e,t,n){try{var r=t.updateQueue,i=r===null?null:r.lastEffect;if(i!==null){var a=i.next;r=a;do{if((r.tag&e)===e){var o=r.inst,s=o.destroy;if(s!==void 0){o.destroy=void 0,i=t;var c=n,l=s;try{l()}catch(e){Z(i,c,e)}}}r=r.next}while(r!==a)}}catch(e){Z(t,t.return,e)}}function Kc(e){var t=e.updateQueue;if(t!==null){var n=e.stateNode;try{ro(t,n)}catch(t){Z(e,e.return,t)}}}function qc(e,t,n){n.props=Xs(e.type,e.memoizedProps),n.state=e.memoizedState;try{n.componentWillUnmount()}catch(n){Z(e,t,n)}}function Jc(e,t){try{var n=e.ref;if(n!==null){switch(e.tag){case 26:case 27:case 5:var r=e.stateNode;break;case 30:r=e.stateNode;break;default:r=e.stateNode}typeof n==`function`?e.refCleanup=n(r):n.current=r}}catch(n){Z(e,t,n)}}function Yc(e,t){var n=e.ref,r=e.refCleanup;if(n!==null)if(typeof r==`function`)try{r()}catch(n){Z(e,t,n)}finally{e.refCleanup=null,e=e.alternate,e!=null&&(e.refCleanup=null)}else if(typeof n==`function`)try{n(null)}catch(n){Z(e,t,n)}else n.current=null}function Xc(e){var t=e.type,n=e.memoizedProps,r=e.stateNode;try{a:switch(t){case`button`:case`input`:case`select`:case`textarea`:n.autoFocus&&r.focus();break a;case`img`:n.src?r.src=n.src:n.srcSet&&(r.srcset=n.srcSet)}}catch(t){Z(e,e.return,t)}}function Zc(e,t,n){try{var r=e.stateNode;Fd(r,e.type,n,t),r[ht]=t}catch(t){Z(e,e.return,t)}}function Qc(e){return e.tag===5||e.tag===3||e.tag===26||e.tag===27&&Zd(e.type)||e.tag===4}function $c(e){a:for(;;){for(;e.sibling===null;){if(e.return===null||Qc(e.return))return null;e=e.return}for(e.sibling.return=e.return,e=e.sibling;e.tag!==5&&e.tag!==6&&e.tag!==18;){if(e.tag===27&&Zd(e.type)||e.flags&2||e.child===null||e.tag===4)continue a;e.child.return=e,e=e.child}if(!(e.flags&2))return e.stateNode}}function el(e,t,n){var r=e.tag;if(r===5||r===6)e=e.stateNode,t?(n.nodeType===9?n.body:n.nodeName===`HTML`?n.ownerDocument.body:n).insertBefore(e,t):(t=n.nodeType===9?n.body:n.nodeName===`HTML`?n.ownerDocument.body:n,t.appendChild(e),n=n._reactRootContainer,n!=null||t.onclick!==null||(t.onclick=cn));else if(r!==4&&(r===27&&Zd(e.type)&&(n=e.stateNode,t=null),e=e.child,e!==null))for(el(e,t,n),e=e.sibling;e!==null;)el(e,t,n),e=e.sibling}function tl(e,t,n){var r=e.tag;if(r===5||r===6)e=e.stateNode,t?n.insertBefore(e,t):n.appendChild(e);else if(r!==4&&(r===27&&Zd(e.type)&&(n=e.stateNode),e=e.child,e!==null))for(tl(e,t,n),e=e.sibling;e!==null;)tl(e,t,n),e=e.sibling}function nl(e){var t=e.stateNode,n=e.memoizedProps;try{for(var r=e.type,i=t.attributes;i.length;)t.removeAttributeNode(i[0]);Pd(t,r,n),t[mt]=e,t[ht]=n}catch(t){Z(e,e.return,t)}}var rl=!1,H=!1,il=!1,al=typeof WeakSet==`function`?WeakSet:Set,ol=null;function sl(e,t){if(e=e.containerInfo,Rd=sp,e=Fr(e),Ir(e)){if(`selectionStart`in e)var n={start:e.selectionStart,end:e.selectionEnd};else a:{n=(n=e.ownerDocument)&&n.defaultView||window;var r=n.getSelection&&n.getSelection();if(r&&r.rangeCount!==0){n=r.anchorNode;var i=r.anchorOffset,a=r.focusNode;r=r.focusOffset;try{n.nodeType,a.nodeType}catch{n=null;break a}var o=0,c=-1,l=-1,u=0,d=0,f=e,p=null;b:for(;;){for(var m;f!==n||i!==0&&f.nodeType!==3||(c=o+i),f!==a||r!==0&&f.nodeType!==3||(l=o+r),f.nodeType===3&&(o+=f.nodeValue.length),(m=f.firstChild)!==null;)p=f,f=m;for(;;){if(f===e)break b;if(p===n&&++u===i&&(c=o),p===a&&++d===r&&(l=o),(m=f.nextSibling)!==null)break;f=p,p=f.parentNode}f=m}n=c===-1||l===-1?null:{start:c,end:l}}else n=null}n||={start:0,end:0}}else n=null;for(zd={focusedElem:e,selectionRange:n},sp=!1,ol=t;ol!==null;)if(t=ol,e=t.child,t.subtreeFlags&1028&&e!==null)e.return=t,ol=e;else for(;ol!==null;){switch(t=ol,a=t.alternate,e=t.flags,t.tag){case 0:if(e&4&&(e=t.updateQueue,e=e===null?null:e.events,e!==null))for(n=0;n title`))),Pd(a,r,n),a[mt]=e,Dt(a),r=a;break a;case`link`:var o=Vf(`link`,`href`,i).get(r+(n.href||``));if(o){for(var c=0;cg&&(o=g,g=h,h=o);var _=Nr(s,h),v=Nr(s,g);if(_&&v&&(p.rangeCount!==1||p.anchorNode!==_.node||p.anchorOffset!==_.offset||p.focusNode!==v.node||p.focusOffset!==v.offset)){var y=d.createRange();y.setStart(_.node,_.offset),p.removeAllRanges(),h>g?(p.addRange(y),p.extend(v.node,v.offset)):(y.setEnd(v.node,v.offset),p.addRange(y))}}}}for(d=[],p=s;p=p.parentNode;)p.nodeType===1&&d.push({element:p,left:p.scrollLeft,top:p.scrollTop});for(typeof s.focus==`function`&&s.focus(),s=0;sn?32:n,D.T=null,n=lu,lu=null;var a=au,o=su;if(X=0,ou=au=null,su=0,W&6)throw Error(s(331));var c=W;if(W|=4,Il(a.current),Ol(a,a.current,o,n),W=c,id(0,!1),Ue&&typeof Ue.onPostCommitFiberRoot==`function`)try{Ue.onPostCommitFiberRoot(He,a)}catch{}return!0}finally{O.p=i,D.T=r,Vu(e,t)}}function Wu(e,t,n){t=Ei(n,t),t=nc(e.stateNode,t,2),e=Xa(e,t,2),e!==null&&(it(e,2),rd(e))}function Z(e,t,n){if(e.tag===3)Wu(e,e,n);else for(;t!==null;){if(t.tag===3){Wu(t,e,n);break}else if(t.tag===1){var r=t.stateNode;if(typeof t.type.getDerivedStateFromError==`function`||typeof r.componentDidCatch==`function`&&(iu===null||!iu.has(r))){e=Ei(n,e),n=rc(2),r=Xa(t,n,2),r!==null&&(ic(n,r,t,e),it(r,2),rd(r));break}}t=t.return}}function Gu(e,t,n){var r=e.pingCache;if(r===null){r=e.pingCache=new Bl;var i=new Set;r.set(t,i)}else i=r.get(t),i===void 0&&(i=new Set,r.set(t,i));i.has(n)||(Wl=!0,i.add(n),e=Ku.bind(null,e,t,n),t.then(e,e))}function Ku(e,t,n){var r=e.pingCache;r!==null&&r.delete(t),e.pingedLanes|=e.suspendedLanes&n,e.warmLanes&=~n,G===e&&(q&n)===n&&(Y===4||Y===3&&(q&62914560)===q&&300>Ne()-eu?!(W&2)&&Su(e,0):Jl|=n,Xl===q&&(Xl=0)),rd(e)}function qu(e,t){t===0&&(t=nt()),e=di(e,t),e!==null&&(it(e,t),rd(e))}function Ju(e){var t=e.memoizedState,n=0;t!==null&&(n=t.retryLane),qu(e,n)}function Yu(e,t){var n=0;switch(e.tag){case 31:case 13:var r=e.stateNode,i=e.memoizedState;i!==null&&(n=i.retryLane);break;case 19:r=e.stateNode;break;case 22:r=e.stateNode._retryCache;break;default:throw Error(s(314))}r!==null&&r.delete(t),qu(e,n)}function Xu(e,t){return ke(e,t)}var Zu=null,Qu=null,$u=!1,ed=!1,td=!1,nd=0;function rd(e){e!==Qu&&e.next===null&&(Qu===null?Zu=Qu=e:Qu=Qu.next=e),ed=!0,$u||($u=!0,ud())}function id(e,t){if(!td&&ed){td=!0;do for(var n=!1,r=Zu;r!==null;){if(!t)if(e!==0){var i=r.pendingLanes;if(i===0)var a=0;else{var o=r.suspendedLanes,s=r.pingedLanes;a=(1<<31-Ge(42|e)+1)-1,a&=i&~(o&~s),a=a&201326741?a&201326741|1:a?a|2:0}a!==0&&(n=!0,ld(r,a))}else a=q,a=$e(r,r===G?a:0,r.cancelPendingCommit!==null||r.timeoutHandle!==-1),!(a&3)||et(r,a)||(n=!0,ld(r,a));r=r.next}while(n);td=!1}}function ad(){od()}function od(){ed=$u=!1;var e=0;nd!==0&&Gd()&&(e=nd);for(var t=Ne(),n=null,r=Zu;r!==null;){var i=r.next,a=sd(r,t);a===0?(r.next=null,n===null?Zu=i:n.next=i,i===null&&(Qu=n)):(n=r,(e!==0||a&3)&&(ed=!0)),r=i}X!==0&&X!==5||id(e,!1),nd!==0&&(nd=0)}function sd(e,t){for(var n=e.suspendedLanes,r=e.pingedLanes,i=e.expirationTimes,a=e.pendingLanes&-62914561;0s)break;var u=c.transferSize,d=c.initiatorType;u&&Id(d)&&(c=c.responseEnd,o+=u*(c`u`?null:document;function xf(e,t,n){var r=bf;if(r&&typeof t==`string`&&t){var i=Kt(t);i=`link[rel="`+e+`"][href="`+i+`"]`,typeof n==`string`&&(i+=`[crossorigin="`+n+`"]`),hf.has(i)||(hf.add(i),e={rel:e,crossOrigin:n,href:t},r.querySelector(i)===null&&(t=r.createElement(`link`),Pd(t,`link`,e),Dt(t),r.head.appendChild(t)))}}function Sf(e){_f.D(e),xf(`dns-prefetch`,e,null)}function Cf(e,t){_f.C(e,t),xf(`preconnect`,e,t)}function wf(e,t,n){_f.L(e,t,n);var r=bf;if(r&&e&&t){var i=`link[rel="preload"][as="`+Kt(t)+`"]`;t===`image`&&n&&n.imageSrcSet?(i+=`[imagesrcset="`+Kt(n.imageSrcSet)+`"]`,typeof n.imageSizes==`string`&&(i+=`[imagesizes="`+Kt(n.imageSizes)+`"]`)):i+=`[href="`+Kt(e)+`"]`;var a=i;switch(t){case`style`:a=Af(e);break;case`script`:a=Pf(e)}mf.has(a)||(e=h({rel:`preload`,href:t===`image`&&n&&n.imageSrcSet?void 0:e,as:t},n),mf.set(a,e),r.querySelector(i)!==null||t===`style`&&r.querySelector(jf(a))||t===`script`&&r.querySelector(Ff(a))||(t=r.createElement(`link`),Pd(t,`link`,e),Dt(t),r.head.appendChild(t)))}}function Tf(e,t){_f.m(e,t);var n=bf;if(n&&e){var r=t&&typeof t.as==`string`?t.as:`script`,i=`link[rel="modulepreload"][as="`+Kt(r)+`"][href="`+Kt(e)+`"]`,a=i;switch(r){case`audioworklet`:case`paintworklet`:case`serviceworker`:case`sharedworker`:case`worker`:case`script`:a=Pf(e)}if(!mf.has(a)&&(e=h({rel:`modulepreload`,href:e},t),mf.set(a,e),n.querySelector(i)===null)){switch(r){case`audioworklet`:case`paintworklet`:case`serviceworker`:case`sharedworker`:case`worker`:case`script`:if(n.querySelector(Ff(a)))return}r=n.createElement(`link`),Pd(r,`link`,e),Dt(r),n.head.appendChild(r)}}}function Ef(e,t,n){_f.S(e,t,n);var r=bf;if(r&&e){var i=Et(r).hoistableStyles,a=Af(e);t||=`default`;var o=i.get(a);if(!o){var s={loading:0,preload:null};if(o=r.querySelector(jf(a)))s.loading=5;else{e=h({rel:`stylesheet`,href:e,"data-precedence":t},n),(n=mf.get(a))&&Rf(e,n);var c=o=r.createElement(`link`);Dt(c),Pd(c,`link`,e),c._p=new Promise(function(e,t){c.onload=e,c.onerror=t}),c.addEventListener(`load`,function(){s.loading|=1}),c.addEventListener(`error`,function(){s.loading|=2}),s.loading|=4,Lf(o,t,r)}o={type:`stylesheet`,instance:o,count:1,state:s},i.set(a,o)}}}function Df(e,t){_f.X(e,t);var n=bf;if(n&&e){var r=Et(n).hoistableScripts,i=Pf(e),a=r.get(i);a||(a=n.querySelector(Ff(i)),a||(e=h({src:e,async:!0},t),(t=mf.get(i))&&zf(e,t),a=n.createElement(`script`),Dt(a),Pd(a,`link`,e),n.head.appendChild(a)),a={type:`script`,instance:a,count:1,state:null},r.set(i,a))}}function Of(e,t){_f.M(e,t);var n=bf;if(n&&e){var r=Et(n).hoistableScripts,i=Pf(e),a=r.get(i);a||(a=n.querySelector(Ff(i)),a||(e=h({src:e,async:!0,type:`module`},t),(t=mf.get(i))&&zf(e,t),a=n.createElement(`script`),Dt(a),Pd(a,`link`,e),n.head.appendChild(a)),a={type:`script`,instance:a,count:1,state:null},r.set(i,a))}}function kf(e,t,n,r){var i=(i=he.current)?gf(i):null;if(!i)throw Error(s(446));switch(e){case`meta`:case`title`:return null;case`style`:return typeof n.precedence==`string`&&typeof n.href==`string`?(t=Af(n.href),n=Et(i).hoistableStyles,r=n.get(t),r||(r={type:`style`,instance:null,count:0,state:null},n.set(t,r)),r):{type:`void`,instance:null,count:0,state:null};case`link`:if(n.rel===`stylesheet`&&typeof n.href==`string`&&typeof n.precedence==`string`){e=Af(n.href);var a=Et(i).hoistableStyles,o=a.get(e);if(o||(i=i.ownerDocument||i,o={type:`stylesheet`,instance:null,count:0,state:{loading:0,preload:null}},a.set(e,o),(a=i.querySelector(jf(e)))&&!a._p&&(o.instance=a,o.state.loading=5),mf.has(e)||(n={rel:`preload`,as:`style`,href:n.href,crossOrigin:n.crossOrigin,integrity:n.integrity,media:n.media,hrefLang:n.hrefLang,referrerPolicy:n.referrerPolicy},mf.set(e,n),a||Nf(i,e,n,o.state))),t&&r===null)throw Error(s(528,``));return o}if(t&&r!==null)throw Error(s(529,``));return null;case`script`:return t=n.async,n=n.src,typeof n==`string`&&t&&typeof t!=`function`&&typeof t!=`symbol`?(t=Pf(n),n=Et(i).hoistableScripts,r=n.get(t),r||(r={type:`script`,instance:null,count:0,state:null},n.set(t,r)),r):{type:`void`,instance:null,count:0,state:null};default:throw Error(s(444,e))}}function Af(e){return`href="`+Kt(e)+`"`}function jf(e){return`link[rel="stylesheet"][`+e+`]`}function Mf(e){return h({},e,{"data-precedence":e.precedence,precedence:null})}function Nf(e,t,n,r){e.querySelector(`link[rel="preload"][as="style"][`+t+`]`)?r.loading=1:(t=e.createElement(`link`),r.preload=t,t.addEventListener(`load`,function(){return r.loading|=1}),t.addEventListener(`error`,function(){return r.loading|=2}),Pd(t,`link`,n),Dt(t),e.head.appendChild(t))}function Pf(e){return`[src="`+Kt(e)+`"]`}function Ff(e){return`script[async]`+e}function If(e,t,n){if(t.count++,t.instance===null)switch(t.type){case`style`:var r=e.querySelector(`style[data-href~="`+Kt(n.href)+`"]`);if(r)return t.instance=r,Dt(r),r;var i=h({},n,{"data-href":n.href,"data-precedence":n.precedence,href:null,precedence:null});return r=(e.ownerDocument||e).createElement(`style`),Dt(r),Pd(r,`style`,i),Lf(r,n.precedence,e),t.instance=r;case`stylesheet`:i=Af(n.href);var a=e.querySelector(jf(i));if(a)return t.state.loading|=4,t.instance=a,Dt(a),a;r=Mf(n),(i=mf.get(i))&&Rf(r,i),a=(e.ownerDocument||e).createElement(`link`),Dt(a);var o=a;return o._p=new Promise(function(e,t){o.onload=e,o.onerror=t}),Pd(a,`link`,r),t.state.loading|=4,Lf(a,n.precedence,e),t.instance=a;case`script`:return a=Pf(n.src),(i=e.querySelector(Ff(a)))?(t.instance=i,Dt(i),i):(r=n,(i=mf.get(a))&&(r=h({},n),zf(r,i)),e=e.ownerDocument||e,i=e.createElement(`script`),Dt(i),Pd(i,`link`,r),e.head.appendChild(i),t.instance=i);case`void`:return null;default:throw Error(s(443,t.type))}else t.type===`stylesheet`&&!(t.state.loading&4)&&(r=t.instance,t.state.loading|=4,Lf(r,n.precedence,e));return t.instance}function Lf(e,t,n){for(var r=n.querySelectorAll(`link[rel="stylesheet"][data-precedence],style[data-precedence]`),i=r.length?r[r.length-1]:null,a=i,o=0;o title`):null)}function Uf(e,t,n){if(n===1||t.itemProp!=null)return!1;switch(e){case`meta`:case`title`:return!0;case`style`:if(typeof t.precedence!=`string`||typeof t.href!=`string`||t.href===``)break;return!0;case`link`:if(typeof t.rel!=`string`||typeof t.href!=`string`||t.href===``||t.onLoad||t.onError)break;switch(t.rel){case`stylesheet`:return e=t.disabled,typeof t.precedence==`string`&&e==null;default:return!0}case`script`:if(t.async&&typeof t.async!=`function`&&typeof t.async!=`symbol`&&!t.onLoad&&!t.onError&&t.src&&typeof t.src==`string`)return!0}return!1}function Wf(e){return!(e.type===`stylesheet`&&!(e.state.loading&3))}function Gf(e,t,n,r){if(n.type===`stylesheet`&&(typeof r.media!=`string`||!1!==matchMedia(r.media).matches)&&!(n.state.loading&4)){if(n.instance===null){var i=Af(r.href),a=t.querySelector(jf(i));if(a){t=a._p,typeof t==`object`&&t&&typeof t.then==`function`&&(e.count++,e=Jf.bind(e),t.then(e,e)),n.state.loading|=4,n.instance=a,Dt(a);return}a=t.ownerDocument||t,r=Mf(r),(i=mf.get(i))&&Rf(r,i),a=a.createElement(`link`),Dt(a);var o=a;o._p=new Promise(function(e,t){o.onload=e,o.onerror=t}),Pd(a,`link`,r),n.instance=a}e.stylesheets===null&&(e.stylesheets=new Map),e.stylesheets.set(n,t),(t=n.state.preload)&&!(n.state.loading&3)&&(e.count++,n=Jf.bind(e),t.addEventListener(`load`,n),t.addEventListener(`error`,n))}}var Kf=0;function qf(e,t){return e.stylesheets&&e.count===0&&Xf(e,e.stylesheets),0Kf?50:800)+t);return e.unsuspend=n,function(){e.unsuspend=null,clearTimeout(r),clearTimeout(i)}}:null}function Jf(){if(this.count--,this.count===0&&(this.imgCount===0||!this.waitingForImages)){if(this.stylesheets)Xf(this,this.stylesheets);else if(this.unsuspend){var e=this.unsuspend;this.unsuspend=null,e()}}}var Yf=null;function Xf(e,t){e.stylesheets=null,e.unsuspend!==null&&(e.count++,Yf=new Map,t.forEach(Zf,e),Yf=null,Jf.call(e))}function Zf(e,t){if(!(t.state.loading&4)){var n=Yf.get(e);if(n)var r=n.get(null);else{n=new Map,Yf.set(e,n);for(var i=e.querySelectorAll(`link[data-precedence],style[data-precedence]`),a=0;a{function n(){if(!(typeof __REACT_DEVTOOLS_GLOBAL_HOOK__>`u`||typeof __REACT_DEVTOOLS_GLOBAL_HOOK__.checkDCE!=`function`))try{__REACT_DEVTOOLS_GLOBAL_HOOK__.checkDCE(n)}catch(e){console.error(e)}}n(),t.exports=s()})),l=i(),u=c(),d={omni:[{id:`omni-2`,caseId:`Te_Motion_deletion_01`,title:`Delete the flying kiss`,instruction:`Delete the action of the girl giving a flying kiss, while maintaining the continuity of the video naturally.`,category:`Motion deletion`,videos:[{id:`source`,label:`Source`,src:`./qualitative/omni/media/Te_Motion_deletion_01/source.mp4`},{id:`zebra`,label:`Ours`,src:`./qualitative/omni/media/Te_Motion_deletion_01/zebra.mp4`,score:100},{id:`frozen_bernini`,label:`Frozen Bernini · 1.3B`,src:`./qualitative/omni/media/Te_Motion_deletion_01/frozen_bernini.mp4`,score:52.2},{id:`omnivideo2_official_1p3b`,label:`OmniVideo2 · 1.3B`,src:`./qualitative/omni/media/Te_Motion_deletion_01/omnivideo2_official_1p3b.mp4`,score:32},{id:`lucy_edit_1p1_dev_5b`,label:`Lucy Edit · 5B`,src:`./qualitative/omni/media/Te_Motion_deletion_01/lucy_edit_1p1_dev_5b.mp4`,score:0},{id:`vace_wan21_1p3b_fullframe`,label:`VACE · 1.3B`,src:`./qualitative/omni/media/Te_Motion_deletion_01/vace_wan21_1p3b_fullframe.mp4`,score:0},{id:`liveedit_wan21_1p3b`,label:`LiveEdit · 1.3B`,src:`./qualitative/omni/media/Te_Motion_deletion_01/liveedit_wan21_1p3b.mp4`,score:0},{id:`kiwi_edit_5b_instruct_only`,label:`Kiwi-Edit · 5B`,src:`./qualitative/omni/media/Te_Motion_deletion_01/kiwi_edit_5b_instruct_only.mp4`,score:0},{id:`reco_ori_wan21_1p3b`,label:`ReCo · 1.3B + LoRA`,src:`./qualitative/omni/media/Te_Motion_deletion_01/reco_ori_wan21_1p3b.mp4`,score:0}],track:`generated demonstration`,note:`Selected from 200 cases by Zebra score, then margin over the strongest baseline. Qwen3-VL-32B, 12 ordered frames; automated scores, not official Gemini scores.`},{id:`omni-5`,caseId:`Te_Facial_expression_change_06`,title:`Make the man laugh happily`,instruction:`Make the man laugh happily.`,category:`Facial expression change`,videos:[{id:`source`,label:`Source`,src:`./qualitative/omni/media/Te_Facial_expression_change_06/source.mp4`},{id:`zebra`,label:`Ours`,src:`./qualitative/omni/media/Te_Facial_expression_change_06/zebra.mp4`,score:100},{id:`frozen_bernini`,label:`Frozen Bernini · 1.3B`,src:`./qualitative/omni/media/Te_Facial_expression_change_06/frozen_bernini.mp4`,score:86},{id:`omnivideo2_official_1p3b`,label:`OmniVideo2 · 1.3B`,src:`./qualitative/omni/media/Te_Facial_expression_change_06/omnivideo2_official_1p3b.mp4`,score:86},{id:`lucy_edit_1p1_dev_5b`,label:`Lucy Edit · 5B`,src:`./qualitative/omni/media/Te_Facial_expression_change_06/lucy_edit_1p1_dev_5b.mp4`,score:0},{id:`vace_wan21_1p3b_fullframe`,label:`VACE · 1.3B`,src:`./qualitative/omni/media/Te_Facial_expression_change_06/vace_wan21_1p3b_fullframe.mp4`,score:0},{id:`liveedit_wan21_1p3b`,label:`LiveEdit · 1.3B`,src:`./qualitative/omni/media/Te_Facial_expression_change_06/liveedit_wan21_1p3b.mp4`,score:30.8},{id:`kiwi_edit_5b_instruct_only`,label:`Kiwi-Edit · 5B`,src:`./qualitative/omni/media/Te_Facial_expression_change_06/kiwi_edit_5b_instruct_only.mp4`,score:0},{id:`reco_ori_wan21_1p3b`,label:`ReCo · 1.3B + LoRA`,src:`./qualitative/omni/media/Te_Facial_expression_change_06/reco_ori_wan21_1p3b.mp4`,score:0}],track:`generated demonstration`,note:`Selected from 200 cases by Zebra score, then margin over the strongest baseline. Qwen3-VL-32B, 12 ordered frames; automated scores, not official Gemini scores.`}],real:[{id:`real-15_mev_d045859258943df0`,caseId:`mev_d045859258943df0`,title:`Holding a camera → Looking through it`,instruction:`Edit the action so that the woman raises her silver camera with both hands, bringing it up to her eye to look through the viewfinder.`,videos:[{id:`source`,label:`Source`,src:`./qualitative/real/15_mev_d045859258943df0/source.mp4`},{id:`mev160_fm_only_u160`,label:`Ours`,src:`./qualitative/real/15_mev_d045859258943df0/mev160_fm_only_u160.mp4`},{id:`frozen_bernini`,label:`Frozen Bernini · 1.3B`,src:`./qualitative/real/15_mev_d045859258943df0/frozen_bernini.mp4`},{id:`real_target`,label:`Real target · reference`,src:`./qualitative/real/15_mev_d045859258943df0/real_target.mp4`},{id:`omnivideo2_official_1p3b`,label:`OmniVideo2 · 1.3B`,src:`./qualitative/real/15_mev_d045859258943df0/omnivideo2_official_1p3b.mp4`},{id:`lucy_edit_1p1_dev_5b`,label:`Lucy Edit · 5B`,src:`./qualitative/real/15_mev_d045859258943df0/lucy_edit_1p1_dev_5b.mp4`},{id:`vace_wan21_1p3b_fullframe`,label:`VACE · 1.3B`,src:`./qualitative/real/15_mev_d045859258943df0/vace_wan21_1p3b_fullframe.mp4`},{id:`liveedit_wan21_1p3b`,label:`LiveEdit · 1.3B`,src:`./qualitative/real/15_mev_d045859258943df0/liveedit_wan21_1p3b.mp4`},{id:`kiwi_edit_5b_instruct_only`,label:`Kiwi-Edit · 5B`,src:`./qualitative/real/15_mev_d045859258943df0/kiwi_edit_5b_instruct_only.mp4`},{id:`reco_ori_wan21_1p3b`,label:`ReCo · 1.3B + LoRA`,src:`./qualitative/real/15_mev_d045859258943df0/reco_ori_wan21_1p3b.mp4`}],track:`FM strong supervision · u160`,note:`Paired-real-target flow-matching variant; retained as labeled in the manuscript figure provenance.`},{id:`real-20_mev_059fef481bb29b38`,caseId:`mev_059fef481bb29b38`,title:`Static shot → Camera cranes up`,instruction:`Edit the action so that the camera cranes up, moving away from the couple and revealing a wide view of the sunlit forest and valley.`,videos:[{id:`source`,label:`Source`,src:`./qualitative/real/20_mev_059fef481bb29b38/source.mp4`},{id:`mev160_fm_only_u160`,label:`Ours`,src:`./qualitative/real/20_mev_059fef481bb29b38/mev160_fm_only_u160.mp4`},{id:`frozen_bernini`,label:`Frozen Bernini · 1.3B`,src:`./qualitative/real/20_mev_059fef481bb29b38/frozen_bernini.mp4`},{id:`real_target`,label:`Real target · reference`,src:`./qualitative/real/20_mev_059fef481bb29b38/real_target.mp4`},{id:`omnivideo2_official_1p3b`,label:`OmniVideo2 · 1.3B`,src:`./qualitative/real/20_mev_059fef481bb29b38/omnivideo2_official_1p3b.mp4`},{id:`lucy_edit_1p1_dev_5b`,label:`Lucy Edit · 5B`,src:`./qualitative/real/20_mev_059fef481bb29b38/lucy_edit_1p1_dev_5b.mp4`},{id:`vace_wan21_1p3b_fullframe`,label:`VACE · 1.3B`,src:`./qualitative/real/20_mev_059fef481bb29b38/vace_wan21_1p3b_fullframe.mp4`},{id:`liveedit_wan21_1p3b`,label:`LiveEdit · 1.3B`,src:`./qualitative/real/20_mev_059fef481bb29b38/liveedit_wan21_1p3b.mp4`},{id:`kiwi_edit_5b_instruct_only`,label:`Kiwi-Edit · 5B`,src:`./qualitative/real/20_mev_059fef481bb29b38/kiwi_edit_5b_instruct_only.mp4`},{id:`reco_ori_wan21_1p3b`,label:`ReCo · 1.3B + LoRA`,src:`./qualitative/real/20_mev_059fef481bb29b38/reco_ori_wan21_1p3b.mp4`}],track:`FM strong supervision · u160`,note:`Paired-real-target flow-matching variant; retained as labeled in the manuscript figure provenance.`},{id:`real-32_mev_a35540d41c3d7989`,caseId:`mev_a35540d41c3d7989`,title:`Posing → Walking out of frame`,instruction:`Edit the action so that the smiling woman in a bikini walks from left to right past the camera by a pool, exiting the frame.`,videos:[{id:`source`,label:`Source`,src:`./qualitative/real/32_mev_a35540d41c3d7989/source.mp4`},{id:`mev160_fm_only_u160`,label:`Ours`,src:`./qualitative/real/32_mev_a35540d41c3d7989/mev160_fm_only_u160.mp4`},{id:`frozen_bernini`,label:`Frozen Bernini · 1.3B`,src:`./qualitative/real/32_mev_a35540d41c3d7989/frozen_bernini.mp4`},{id:`real_target`,label:`Real target · reference`,src:`./qualitative/real/32_mev_a35540d41c3d7989/real_target.mp4`},{id:`omnivideo2_official_1p3b`,label:`OmniVideo2 · 1.3B`,src:`./qualitative/real/32_mev_a35540d41c3d7989/omnivideo2_official_1p3b.mp4`},{id:`lucy_edit_1p1_dev_5b`,label:`Lucy Edit · 5B`,src:`./qualitative/real/32_mev_a35540d41c3d7989/lucy_edit_1p1_dev_5b.mp4`},{id:`vace_wan21_1p3b_fullframe`,label:`VACE · 1.3B`,src:`./qualitative/real/32_mev_a35540d41c3d7989/vace_wan21_1p3b_fullframe.mp4`},{id:`liveedit_wan21_1p3b`,label:`LiveEdit · 1.3B`,src:`./qualitative/real/32_mev_a35540d41c3d7989/liveedit_wan21_1p3b.mp4`},{id:`kiwi_edit_5b_instruct_only`,label:`Kiwi-Edit · 5B`,src:`./qualitative/real/32_mev_a35540d41c3d7989/kiwi_edit_5b_instruct_only.mp4`},{id:`reco_ori_wan21_1p3b`,label:`ReCo · 1.3B + LoRA`,src:`./qualitative/real/32_mev_a35540d41c3d7989/reco_ori_wan21_1p3b.mp4`}],track:`FM strong supervision · u160`,note:`Paired-real-target flow-matching variant; retained as labeled in the manuscript figure provenance.`},{id:`real-34_mev_f308ebe4cd1b3b79`,caseId:`mev_f308ebe4cd1b3b79`,title:`Watching → Helping draw`,instruction:`Edit the action so that the mother helps her young daughter draw with colored pencils in a sketchbook at a wooden table.`,videos:[{id:`source`,label:`Source`,src:`./qualitative/real/34_mev_f308ebe4cd1b3b79/source.mp4`},{id:`mev160_fm_only_u160`,label:`Ours`,src:`./qualitative/real/34_mev_f308ebe4cd1b3b79/mev160_fm_only_u160.mp4`},{id:`frozen_bernini`,label:`Frozen Bernini · 1.3B`,src:`./qualitative/real/34_mev_f308ebe4cd1b3b79/frozen_bernini.mp4`},{id:`real_target`,label:`Real target · reference`,src:`./qualitative/real/34_mev_f308ebe4cd1b3b79/real_target.mp4`},{id:`omnivideo2_official_1p3b`,label:`OmniVideo2 · 1.3B`,src:`./qualitative/real/34_mev_f308ebe4cd1b3b79/omnivideo2_official_1p3b.mp4`},{id:`lucy_edit_1p1_dev_5b`,label:`Lucy Edit · 5B`,src:`./qualitative/real/34_mev_f308ebe4cd1b3b79/lucy_edit_1p1_dev_5b.mp4`},{id:`vace_wan21_1p3b_fullframe`,label:`VACE · 1.3B`,src:`./qualitative/real/34_mev_f308ebe4cd1b3b79/vace_wan21_1p3b_fullframe.mp4`},{id:`liveedit_wan21_1p3b`,label:`LiveEdit · 1.3B`,src:`./qualitative/real/34_mev_f308ebe4cd1b3b79/liveedit_wan21_1p3b.mp4`},{id:`kiwi_edit_5b_instruct_only`,label:`Kiwi-Edit · 5B`,src:`./qualitative/real/34_mev_f308ebe4cd1b3b79/kiwi_edit_5b_instruct_only.mp4`},{id:`reco_ori_wan21_1p3b`,label:`ReCo · 1.3B + LoRA`,src:`./qualitative/real/34_mev_f308ebe4cd1b3b79/reco_ori_wan21_1p3b.mp4`}],track:`FM strong supervision · u160`,note:`Paired-real-target flow-matching variant; retained as labeled in the manuscript figure provenance.`},{id:`real-35_mev_1e9a413e9af09b7d`,caseId:`mev_1e9a413e9af09b7d`,title:`Typing → Stretching the back`,instruction:`Edit the action so that the woman working on a laptop at her desk suddenly experiences back pain and tries to stretch it out.`,videos:[{id:`source`,label:`Source`,src:`./qualitative/real/35_mev_1e9a413e9af09b7d/source.mp4`},{id:`mev160_fm_only_u160`,label:`Ours`,src:`./qualitative/real/35_mev_1e9a413e9af09b7d/mev160_fm_only_u160.mp4`},{id:`frozen_bernini`,label:`Frozen Bernini · 1.3B`,src:`./qualitative/real/35_mev_1e9a413e9af09b7d/frozen_bernini.mp4`},{id:`real_target`,label:`Real target · reference`,src:`./qualitative/real/35_mev_1e9a413e9af09b7d/real_target.mp4`},{id:`omnivideo2_official_1p3b`,label:`OmniVideo2 · 1.3B`,src:`./qualitative/real/35_mev_1e9a413e9af09b7d/omnivideo2_official_1p3b.mp4`},{id:`lucy_edit_1p1_dev_5b`,label:`Lucy Edit · 5B`,src:`./qualitative/real/35_mev_1e9a413e9af09b7d/lucy_edit_1p1_dev_5b.mp4`},{id:`vace_wan21_1p3b_fullframe`,label:`VACE · 1.3B`,src:`./qualitative/real/35_mev_1e9a413e9af09b7d/vace_wan21_1p3b_fullframe.mp4`},{id:`liveedit_wan21_1p3b`,label:`LiveEdit · 1.3B`,src:`./qualitative/real/35_mev_1e9a413e9af09b7d/liveedit_wan21_1p3b.mp4`},{id:`kiwi_edit_5b_instruct_only`,label:`Kiwi-Edit · 5B`,src:`./qualitative/real/35_mev_1e9a413e9af09b7d/kiwi_edit_5b_instruct_only.mp4`},{id:`reco_ori_wan21_1p3b`,label:`ReCo · 1.3B + LoRA`,src:`./qualitative/real/35_mev_1e9a413e9af09b7d/reco_ori_wan21_1p3b.mp4`}],track:`FM strong supervision · u160`,note:`Paired-real-target flow-matching variant; retained as labeled in the manuscript figure provenance.`},{id:`real-39_mev_c314f469fbaeb749`,caseId:`mev_c314f469fbaeb749`,title:`Using a phone → Drinking from a mug`,instruction:`Edit the action so that the man wearing glasses looks at his smartphone and takes a drink from a white mug while sitting at his desk.`,videos:[{id:`source`,label:`Source`,src:`./qualitative/real/39_mev_c314f469fbaeb749/source.mp4`},{id:`mev160_fm_only_u160`,label:`Ours`,src:`./qualitative/real/39_mev_c314f469fbaeb749/mev160_fm_only_u160.mp4`},{id:`frozen_bernini`,label:`Frozen Bernini · 1.3B`,src:`./qualitative/real/39_mev_c314f469fbaeb749/frozen_bernini.mp4`},{id:`real_target`,label:`Real target · reference`,src:`./qualitative/real/39_mev_c314f469fbaeb749/real_target.mp4`},{id:`omnivideo2_official_1p3b`,label:`OmniVideo2 · 1.3B`,src:`./qualitative/real/39_mev_c314f469fbaeb749/omnivideo2_official_1p3b.mp4`},{id:`lucy_edit_1p1_dev_5b`,label:`Lucy Edit · 5B`,src:`./qualitative/real/39_mev_c314f469fbaeb749/lucy_edit_1p1_dev_5b.mp4`},{id:`vace_wan21_1p3b_fullframe`,label:`VACE · 1.3B`,src:`./qualitative/real/39_mev_c314f469fbaeb749/vace_wan21_1p3b_fullframe.mp4`},{id:`liveedit_wan21_1p3b`,label:`LiveEdit · 1.3B`,src:`./qualitative/real/39_mev_c314f469fbaeb749/liveedit_wan21_1p3b.mp4`},{id:`kiwi_edit_5b_instruct_only`,label:`Kiwi-Edit · 5B`,src:`./qualitative/real/39_mev_c314f469fbaeb749/kiwi_edit_5b_instruct_only.mp4`},{id:`reco_ori_wan21_1p3b`,label:`ReCo · 1.3B + LoRA`,src:`./qualitative/real/39_mev_c314f469fbaeb749/reco_ori_wan21_1p3b.mp4`}],track:`FM strong supervision · u160`,note:`Paired-real-target flow-matching variant; retained as labeled in the manuscript figure provenance.`}],synthetic:[{id:`synthetic-c399`,title:`Push forward → Push right`,caseId:`C399_E0_P2_OWN_update000001_train04`,rows:[{id:`source`,label:`Source`,frames:[`./qualitative/synthetic/c399/source/frame_000000_crop_352x192.png`,`./qualitative/synthetic/c399/source/frame_000027_crop_352x192.png`,`./qualitative/synthetic/c399/source/frame_000053_crop_352x192.png`,`./qualitative/synthetic/c399/source/frame_000080_crop_352x192.png`]},{id:`reference`,label:`Reference`,frames:[`./qualitative/synthetic/c399/reference/frame_000000_crop_352x192.png`,`./qualitative/synthetic/c399/reference/frame_000027_crop_352x192.png`,`./qualitative/synthetic/c399/reference/frame_000053_crop_352x192.png`,`./qualitative/synthetic/c399/reference/frame_000080_crop_352x192.png`]},{id:`ours`,label:`Ours`,frames:[`./qualitative/synthetic/c399/ours/frame_000000_crop_352x192.png`,`./qualitative/synthetic/c399/ours/frame_000027_crop_352x192.png`,`./qualitative/synthetic/c399/ours/frame_000053_crop_352x192.png`,`./qualitative/synthetic/c399/ours/frame_000080_crop_352x192.png`]},{id:`expected`,label:`Expected · audit only`,frames:[`./qualitative/synthetic/c399/expected/frame_000000_crop_352x192.png`,`./qualitative/synthetic/c399/expected/frame_000027_crop_352x192.png`,`./qualitative/synthetic/c399/expected/frame_000053_crop_352x192.png`,`./qualitative/synthetic/c399/expected/frame_000080_crop_352x192.png`]}],audit:[{id:`01_Source`,label:`Archived source record`,frames:[`./qualitative/synthetic/c399/01_Source/frame_000000_crop_352x192.png`,`./qualitative/synthetic/c399/01_Source/frame_000027_crop_352x192.png`,`./qualitative/synthetic/c399/01_Source/frame_000053_crop_352x192.png`,`./qualitative/synthetic/c399/01_Source/frame_000080_crop_352x192.png`]},{id:`05_Learned_Reconstruction`,label:`Archived self-reconstruction`,frames:[`./qualitative/synthetic/c399/05_Learned_Reconstruction/frame_000000_crop_352x192.png`,`./qualitative/synthetic/c399/05_Learned_Reconstruction/frame_000027_crop_352x192.png`,`./qualitative/synthetic/c399/05_Learned_Reconstruction/frame_000053_crop_352x192.png`,`./qualitative/synthetic/c399/05_Learned_Reconstruction/frame_000080_crop_352x192.png`]}],videos:[{id:`source`,label:`Source`,src:`./qualitative/synthetic/c399/source.mp4`},{id:`reference`,label:`Reference`,src:`./qualitative/synthetic/c399/reference.mp4`},{id:`ours`,label:`Ours`,src:`./qualitative/synthetic/c399/ours.mp4`}]},{id:`synthetic-c523`,title:`Push forward-left → Push back-right`,caseId:`C523_OWN_update000007_A1_向后右4`,rows:[{id:`source`,label:`Source`,frames:[`./qualitative/synthetic/c523/source/frame_000000_crop_352x192.png`,`./qualitative/synthetic/c523/source/frame_000027_crop_352x192.png`,`./qualitative/synthetic/c523/source/frame_000053_crop_352x192.png`,`./qualitative/synthetic/c523/source/frame_000080_crop_352x192.png`]},{id:`reference`,label:`Reference`,frames:[`./qualitative/synthetic/c523/reference/frame_000000_crop_352x192.png`,`./qualitative/synthetic/c523/reference/frame_000027_crop_352x192.png`,`./qualitative/synthetic/c523/reference/frame_000053_crop_352x192.png`,`./qualitative/synthetic/c523/reference/frame_000080_crop_352x192.png`]},{id:`ours`,label:`Ours`,frames:[`./qualitative/synthetic/c523/ours/frame_000000_crop_352x192.png`,`./qualitative/synthetic/c523/ours/frame_000027_crop_352x192.png`,`./qualitative/synthetic/c523/ours/frame_000053_crop_352x192.png`,`./qualitative/synthetic/c523/ours/frame_000080_crop_352x192.png`]},{id:`expected`,label:`Expected · audit only`,frames:[`./qualitative/synthetic/c523/expected/frame_000000_crop_352x192.png`,`./qualitative/synthetic/c523/expected/frame_000027_crop_352x192.png`,`./qualitative/synthetic/c523/expected/frame_000053_crop_352x192.png`,`./qualitative/synthetic/c523/expected/frame_000080_crop_352x192.png`]}],audit:[{id:`01_Source`,label:`Archived source record`,frames:[`./qualitative/synthetic/c523/01_Source/frame_000000_crop_352x192.png`,`./qualitative/synthetic/c523/01_Source/frame_000027_crop_352x192.png`,`./qualitative/synthetic/c523/01_Source/frame_000053_crop_352x192.png`,`./qualitative/synthetic/c523/01_Source/frame_000080_crop_352x192.png`]},{id:`05_Learned_Reconstruction`,label:`Archived self-reconstruction`,frames:[`./qualitative/synthetic/c523/05_Learned_Reconstruction/frame_000000_crop_352x192.png`,`./qualitative/synthetic/c523/05_Learned_Reconstruction/frame_000027_crop_352x192.png`,`./qualitative/synthetic/c523/05_Learned_Reconstruction/frame_000053_crop_352x192.png`,`./qualitative/synthetic/c523/05_Learned_Reconstruction/frame_000080_crop_352x192.png`]}],videos:[{id:`source`,label:`Source`,src:`./qualitative/synthetic/c523/source.mp4`},{id:`reference`,label:`Reference`,src:`./qualitative/synthetic/c523/reference.mp4`},{id:`ours`,label:`Ours`,src:`./qualitative/synthetic/c523/ours.mp4`}]}]},f=JSON.parse(`[{"name":"anchor-views","source":"./paper/source/2_theory.tex","source_sha256":"cea2d74371d5ebc780faf1715c3ed386bbc5263309f84754389b2057df4f35d7","extraction":"equation","selector":"eq:controlled-anchor-views","body":"V=g_{\\\\mathrm{ctrl}}(\\\\mathbf z^{\\\\mathrm c},\\\\mathcal F_T(\\\\mathbf w)),\\\\qquad\\n V^+=g_{\\\\mathrm{ctrl}}(\\\\mathbf z^{\\\\mathrm c+},\\\\mathcal F_T(\\\\mathbf w)).","inline":false,"single_line":true,"latex":"./paper/equations/anchor-views.tex","svg":"./paper/equations/anchor-views.svg","svg_sha256":"dc739ae5d698fd321f344453458481ed2ce371307a83d50b4a4e7d13e108496e","label":"eq:controlled-anchor-views"},{"name":"anchor-objective","source":"./paper/source/2_theory.tex","source_sha256":"cea2d74371d5ebc780faf1715c3ed386bbc5263309f84754389b2057df4f35d7","extraction":"equation","selector":"eq:anchor-objective","body":"\\\\begin{aligned}\\n \\\\mathcal J(E_{\\\\mathrm a},P)\\n ={}&\\\\lambda\\\\,\\\\underbrace{\\\\E\\\\|E_{\\\\mathrm a}(V)-E_{\\\\mathrm a}(V^+)\\\\|^2}_{\\\\mathcal L_{\\\\mathrm{inv}}}\\\\\\\\\\n &+\\\\underbrace{\\\\E\\\\|P(E_{\\\\mathrm a}(V))-\\\\varphi(V^+)\\\\|_{\\\\mathcal H_k}^2}_{\\\\mathcal L_{\\\\mathrm{pred}}},\\n \\\\qquad\\\\lambda>0 .\\n \\\\end{aligned}","inline":false,"single_line":false,"latex":"./paper/equations/anchor-objective.tex","svg":"./paper/equations/anchor-objective.svg","svg_sha256":"11d777ce785478829a7a7a4b73428b6f3c217d5dda22cd22e7645930283796fa","label":"eq:anchor-objective"},{"name":"anchor-identification","source":"./paper/source/2_theory.tex","source_sha256":"cea2d74371d5ebc780faf1715c3ed386bbc5263309f84754389b2057df4f35d7","extraction":"equation","selector":"eq:anchor-identification","body":"E_{\\\\mathrm a}(V)=h_{\\\\mathrm a}(\\\\mathbf z^{\\\\mathrm a}),\\\\qquad\\n P(h_{\\\\mathrm a}(\\\\mathbf z^{\\\\mathrm a}))=\\\\mu_k(\\\\mathbf z^{\\\\mathrm a})\\n \\\\quad\\\\text{almost surely},","inline":false,"single_line":true,"latex":"./paper/equations/anchor-identification.tex","svg":"./paper/equations/anchor-identification.svg","svg_sha256":"b2ed758116dc9d6b8b95933f859daf7893acc7ed5c59972cd96c740adf7f8e5d","label":"eq:anchor-identification"},{"name":"temporal-observations","source":"./paper/source/2_theory.tex","source_sha256":"cea2d74371d5ebc780faf1715c3ed386bbc5263309f84754389b2057df4f35d7","extraction":"display","selector":"p_t=p_0+t v_0+\\\\tfrac12t^2u","body":"p_t=p_0+t v_0+\\\\tfrac12t^2u,\\\\qquad \\\\mathbf x_t=\\\\rho(c,p_t),","inline":false,"single_line":true,"latex":"./paper/equations/temporal-observations.tex","svg":"./paper/equations/temporal-observations.svg","svg_sha256":"8a377fe29884d789124c2d6deb4df7d14e17a0d1ed40a7aecb8297a0c8603e6a"},{"name":"anchor-loss","source":"./paper/source/3_method.tex","source_sha256":"5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c","extraction":"equation","selector":"eq:method-anchor-loss","body":"\\\\mathcal L_{\\\\mathrm{anchor}}\\n =\\\\lambda_{\\\\mathrm{obs}}\\\\mathcal L_{\\\\mathrm{obs}}\\n +\\\\lambda_{\\\\mathrm{view}}\\\\mathcal L_{\\\\mathrm{view}}\\n +\\\\mathcal L_{\\\\mathrm{reg}}.","inline":false,"single_line":true,"latex":"./paper/equations/anchor-loss.tex","svg":"./paper/equations/anchor-loss.svg","svg_sha256":"0ea8b09e8b5afb187bb769a5f427dbcef00ae3d15a70bd4a6d26cdb360c22b82","label":"eq:method-anchor-loss"},{"name":"adapter-update","source":"./paper/source/3_method.tex","source_sha256":"5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c","extraction":"equation","selector":"eq:method-adapter","body":"\\\\Delta \\\\mathbf u=\\\\alpha_k \\\\mathbf W_{\\\\mathrm{up}}\\\\!\\\\left[\\n (\\\\mathbf W_u \\\\mathbf u)\\\\odot\\\\tanh(\\\\mathbf W_k \\\\mathbf k)\\n +(\\\\mathbf W_k \\\\mathbf k)\\\\odot\\\\bigl(\\\\mathbf 1+\\\\tanh(\\\\mathbf W_b \\\\mathbf b)\\\\bigr)\\\\right].","inline":false,"single_line":true,"latex":"./paper/equations/adapter-update.tex","svg":"./paper/equations/adapter-update.svg","svg_sha256":"8645a29c0f488e8219dd53deecaba8a0e90d4a29aa6ca28bb3a87411e0260550","label":"eq:method-adapter"},{"name":"behavior-similarity","source":"./paper/source/3_method.tex","source_sha256":"5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c","extraction":"inline","selector":"\\\\gamma_{j,k}=\\\\operatorname{sim}(e_{\\\\mathrm J}(\\\\widehat V_{0\\\\mid k}),e_{\\\\mathrm J}(V_j))","body":"\\\\gamma_{j,k}=\\\\operatorname{sim}(e_{\\\\mathrm J}(\\\\widehat V_{0\\\\mid k}),e_{\\\\mathrm J}(V_j))","inline":false,"single_line":true,"latex":"./paper/equations/behavior-similarity.tex","svg":"./paper/equations/behavior-similarity.svg","svg_sha256":"e431339494a4833e08b41719a8d0df9e8d6bf0affc02f626488cf430c3c64123"},{"name":"behavior-loss","source":"./paper/source/3_method.tex","source_sha256":"5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c","extraction":"equation","selector":"eq:method-behavior-loss","body":"\\\\ell_{\\\\mathrm{act},k}=1-\\\\gamma_{+,k}\\n -\\\\lambda_{\\\\mathrm{disc}}\\\\log\\n \\\\frac{\\\\exp(\\\\gamma_{+,k}/\\\\tau)}\\n {\\\\sum_{j\\\\in\\\\mathcal K}\\\\exp(\\\\gamma_{j,k}/\\\\tau)}","inline":false,"single_line":true,"latex":"./paper/equations/behavior-loss.tex","svg":"./paper/equations/behavior-loss.svg","svg_sha256":"3fc4bb8343f4bfaeb9d2c000f827ad8843235ef1327f6729a7529e0da914a04b","label":"eq:method-behavior-loss"},{"name":"multiplicative-map","source":"./paper/source/appendix_e_synthetic_protocol.tex","source_sha256":"4a28dec0bbbd86de384ff2471c30d3f3e2e188855eb650553520f7a698127dad","extraction":"inline","selector":"\\\\rho(c,p)=(cp,c)","body":"\\\\rho(c,p)=(cp,c)","inline":true,"single_line":true,"latex":"./paper/equations/multiplicative-map.tex","svg":"./paper/equations/multiplicative-map.svg","svg_sha256":"82bf133a32ea4ef69d5d5bc90ebb593fe2bb86309e7545ff73bfa6a0d31a3ce2","width_em":6.5993,"height_em":0.75,"depth_em":0.25},{"name":"zero-conditional-mean","source":"./paper/source/appendix_e_synthetic_protocol.tex","source_sha256":"4a28dec0bbbd86de384ff2471c30d3f3e2e188855eb650553520f7a698127dad","extraction":"inline","selector":"\\\\E[V\\\\mid\\\\mathbf z^{\\\\mathrm a}]=\\\\mathbf 0","body":"\\\\E[V\\\\mid\\\\mathbf z^{\\\\mathrm a}]=\\\\mathbf 0","inline":true,"single_line":true,"latex":"./paper/equations/zero-conditional-mean.tex","svg":"./paper/equations/zero-conditional-mean.svg","svg_sha256":"49d98decb307591099d1c5e646fa0e6356ee5f05a2d98fd3ba127d1ab5e5d795","width_em":5.72914,"height_em":0.75,"depth_em":0.25},{"name":"content-code","source":"./paper/source/2_theory.tex","source_sha256":"cea2d74371d5ebc780faf1715c3ed386bbc5263309f84754389b2057df4f35d7","extraction":"inline","selector":"\\\\mathbf z^{\\\\mathrm c}","body":"\\\\mathbf z^{\\\\mathrm c}","inline":true,"single_line":true,"latex":"./paper/equations/content-code.tex","svg":"./paper/equations/content-code.svg","svg_sha256":"860f090a6343d40afb8aad52269a00f967e374cca2173ee6fd319bc554f31b50","width_em":0.91667,"height_em":0.66428,"depth_em":0.0},{"name":"action-trajectory","source":"./paper/source/2_theory.tex","source_sha256":"cea2d74371d5ebc780faf1715c3ed386bbc5263309f84754389b2057df4f35d7","extraction":"fragment","selector":"\\\\mathbf z^{\\\\mathrm a}_{0:T}","body":"\\\\mathbf z^{\\\\mathrm a}_{0:T}","inline":true,"single_line":true,"latex":"./paper/equations/action-trajectory.tex","svg":"./paper/equations/action-trajectory.svg","svg_sha256":"9757c94d72829e4c42d310b809c1ee9efb6a07d1535c581f14bb5399014ea8e9","width_em":1.76608,"height_em":0.66428,"depth_em":0.27543},{"name":"action-regime","source":"./paper/source/2_theory.tex","source_sha256":"cea2d74371d5ebc780faf1715c3ed386bbc5263309f84754389b2057df4f35d7","extraction":"inline","selector":"u","body":"u","inline":true,"single_line":true,"latex":"./paper/equations/action-regime.tex","svg":"./paper/equations/action-regime.svg","svg_sha256":"0c9f2dc8308bdcd5be55a457f7f94837efc09d16511ddb2103954d8b8fbbf15a","width_em":0.57246,"height_em":0.43055,"depth_em":0.0},{"name":"identification-map","source":"./paper/source/2_theory.tex","source_sha256":"cea2d74371d5ebc780faf1715c3ed386bbc5263309f84754389b2057df4f35d7","extraction":"inline","selector":"h_{\\\\mathrm a}","body":"h_{\\\\mathrm a}","inline":true,"single_line":true,"latex":"./paper/equations/identification-map.tex","svg":"./paper/equations/identification-map.svg","svg_sha256":"9d7de8f8db084c9bd4efcc4f32b85d5f930d6f01237fd12b1747b130f70bb51b","width_em":1.02477,"height_em":0.69444,"depth_em":0.15},{"name":"kernel-mean","source":"./paper/source/2_theory.tex","source_sha256":"cea2d74371d5ebc780faf1715c3ed386bbc5263309f84754389b2057df4f35d7","extraction":"fragment","selector":"\\\\mu_k","body":"\\\\mu_k","inline":true,"single_line":true,"latex":"./paper/equations/kernel-mean.tex","svg":"./paper/equations/kernel-mean.svg","svg_sha256":"9f14a2e57615009e6fdd597069463d058832c58403f546f24ef25980b8a640a6","width_em":1.09457,"height_em":0.43055,"depth_em":0.19444},{"name":"demonstration-video","source":"./paper/source/3_method.tex","source_sha256":"5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c","extraction":"inline","selector":"V_{\\\\mathrm r}","body":"V_{\\\\mathrm r}","inline":true,"single_line":true,"latex":"./paper/equations/demonstration-video.tex","svg":"./paper/equations/demonstration-video.svg","svg_sha256":"2c79e2497e6a249486e9308da253a796d8650d5b12e00955eb416284c1edfcd0","width_em":0.94583,"height_em":0.68333,"depth_em":0.15},{"name":"action-condition","source":"./paper/source/3_method.tex","source_sha256":"5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c","extraction":"fragment","selector":"\\\\mathbf K(V_{\\\\mathrm r})","body":"\\\\mathbf K(V_{\\\\mathrm r})","inline":true,"single_line":true,"latex":"./paper/equations/action-condition.tex","svg":"./paper/equations/action-condition.svg","svg_sha256":"37062d3c825580b40956b7a46912e7e4a00c1e8434ee0102be0464429aa586f3","width_em":2.625,"height_em":0.75,"depth_em":0.25},{"name":"action-packet","source":"./paper/source/3_method.tex","source_sha256":"5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c","extraction":"inline","selector":"\\\\mathbf K","body":"\\\\mathbf K","inline":true,"single_line":true,"latex":"./paper/equations/action-packet.tex","svg":"./paper/equations/action-packet.svg","svg_sha256":"8d4a716fdb5d52503f43ceef63577d5500d944b5f23a1c725c0dcf1f891127de","width_em":0.90138,"height_em":0.68611,"depth_em":0.0},{"name":"generated-token","source":"./paper/source/3_method.tex","source_sha256":"5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c","extraction":"inline","selector":"\\\\mathbf u","body":"\\\\mathbf u","inline":true,"single_line":true,"latex":"./paper/equations/generated-token.tex","svg":"./paper/equations/generated-token.svg","svg_sha256":"8fe941b5fa7f85a06309001efa7e74452fbf883a95c618d84ed2e20a324d2989","width_em":0.63888,"height_em":0.44444,"depth_em":0.0},{"name":"source-context","source":"./paper/source/3_method.tex","source_sha256":"5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c","extraction":"inline","selector":"\\\\mathbf b","body":"\\\\mathbf b","inline":true,"single_line":true,"latex":"./paper/equations/source-context.tex","svg":"./paper/equations/source-context.svg","svg_sha256":"bbe0b3972c9a3ba28bff05a7983378cf5c8c4bb670804f43788dd8f641381b08","width_em":0.63888,"height_em":0.69444,"depth_em":0.0},{"name":"sampling-gate","source":"./paper/source/3_method.tex","source_sha256":"5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c","extraction":"inline","selector":"\\\\alpha_k","body":"\\\\alpha_k","inline":true,"single_line":true,"latex":"./paper/equations/sampling-gate.tex","svg":"./paper/equations/sampling-gate.svg","svg_sha256":"1f5f2559e0a3445cd88a3525eaa8389056e2372090a8ea1d980502b061d2afd4","width_em":1.13172,"height_em":0.43055,"depth_em":0.15},{"name":"action-margin","source":"./paper/source/appendix_b_unified_observations.tex","source_sha256":"95a7866b782ff54a2a6c0c1bfbdfe0f1c59eb0dfcb2fc6af4e72ace1a857337b","extraction":"inline","selector":"m_{\\\\mathrm{act}}","body":"m_{\\\\mathrm{act}}","inline":true,"single_line":true,"latex":"./paper/equations/action-margin.tex","svg":"./paper/equations/action-margin.svg","svg_sha256":"e21aac7853ff1dd9736f96d0ecbcc711d3c67b5a312b9a78d30fc15bf6bc6c27","width_em":1.99469,"height_em":0.43055,"depth_em":0.15},{"name":"r-squared","source":"./paper/source/appendix_e_synthetic_protocol.tex","source_sha256":"4a28dec0bbbd86de384ff2471c30d3f3e2e188855eb650553520f7a698127dad","extraction":"inline","selector":"R^2","body":"R^2","inline":true,"single_line":true,"latex":"./paper/equations/r-squared.tex","svg":"./paper/equations/r-squared.svg","svg_sha256":"63cbbee88673c779f5921f5b31bd90d2431ec8ac8519a8ed046a1fd823159575","width_em":1.21563,"height_em":0.814,"depth_em":0.0},{"name":"midpoint-position","source":"./paper/source/appendix_e_synthetic_protocol.tex","source_sha256":"4a28dec0bbbd86de384ff2471c30d3f3e2e188855eb650553520f7a698127dad","extraction":"inline","selector":"p","body":"p","inline":true,"single_line":true,"latex":"./paper/equations/midpoint-position.tex","svg":"./paper/equations/midpoint-position.svg","svg_sha256":"47d675d737b942475834c217d7d3cd9a794c9bb85ce8773fe339789ef271c568","width_em":0.50313,"height_em":0.43055,"depth_em":0.19444},{"name":"velocity","source":"./paper/source/appendix_e_synthetic_protocol.tex","source_sha256":"4a28dec0bbbd86de384ff2471c30d3f3e2e188855eb650553520f7a698127dad","extraction":"inline","selector":"v","body":"v","inline":true,"single_line":true,"latex":"./paper/equations/velocity.tex","svg":"./paper/equations/velocity.svg","svg_sha256":"ad5d5b38263b131822c61bc43116c70dfa0dcbd6ab8f727795ec14917e9bd67b","width_em":0.5206,"height_em":0.43055,"depth_em":0.0},{"name":"three-frames","source":"./paper/source/appendix_e_synthetic_protocol.tex","source_sha256":"4a28dec0bbbd86de384ff2471c30d3f3e2e188855eb650553520f7a698127dad","extraction":"inline","selector":"T=3","body":"T=3","inline":true,"single_line":true,"latex":"./paper/equations/three-frames.tex","svg":"./paper/equations/three-frames.svg","svg_sha256":"dea0511da14cb6ae10810722650d641ac869aac227eb6a98f3a5e77781f812fc","width_em":2.55659,"height_em":0.68333,"depth_em":0.0}]`),p=e((e=>{var t=Symbol.for(`react.transitional.element`),n=Symbol.for(`react.fragment`);function r(e,n,r){var i=null;if(r!==void 0&&(i=``+r),n.key!==void 0&&(i=``+n.key),`key`in n)for(var a in r={},n)a!==`key`&&(r[a]=n[a]);else r=n;return n=r.ref,{$$typeof:t,type:e,key:i,ref:n===void 0?null:n,props:r}}e.Fragment=n,e.jsx=r,e.jsxs=r})),m=e(((e,t)=>{t.exports=p()}))();function h({name:e,alt:t}){return(0,m.jsx)(`a`,{className:`p3-equation-image p3-equation-${e}`,href:`./paper/equations/${e}.svg`,target:`_blank`,rel:`noreferrer`,title:`Open the original LaTeX equation at full size`,children:(0,m.jsx)(`img`,{src:`./paper/equations/${e}.svg`,alt:t})})}function g({name:e,alt:t}){let n=f.find(t=>t.name===e);if(!n?.inline)throw Error(`Unknown inline paper notation: ${e}`);let r=n.height_em+n.depth_em;return(0,m.jsx)(m.Fragment,{children:(0,m.jsx)(`img`,{className:`p3-inline-math`,src:n.svg,alt:t,style:{width:`${n.width_em}em`,height:`${r}em`,verticalAlign:`${-n.depth_em}em`}})})}var _=[[`paper-dgp`,`Data Generating Process: Content × Action`],[`paper-identification`,`When Does an Action Anchor Identify Action?`],[`paper-temporal`,`Why the Ordered Video Matters`],[`paper-anchor`,`Learning Action Anchors from Demonstrations`],[`paper-adapter`,`Source-Conditioned Action Injection`],[`paper-training`,`Train on Behavior; Preserve Source Content`],[`omni-summary`,`OmniEdit-Bench Temporal: Paper Results`],...d.omni.map(e=>[e.id,`OmniBench · ${e.title}`]),...d.synthetic.map(e=>[e.id,`Synthetic · ${e.title}`]),...d.real.map(e=>[e.id,`Real · ${e.title}`]),[`further-reading`,`From the Paper to the Evidence`]],v=`action-editing:sync-start`;function y({children:e,file:t=`2_theory.tex`}){return(0,m.jsxs)(`p`,{className:`p3-citation`,children:[e,` `,(0,m.jsx)(`a`,{href:`./paper/source/${t}`,target:`_blank`,rel:`noreferrer`,children:`Manuscript source ↗`})]})}function b({name:e,alt:t,className:n=``}){return(0,m.jsx)(`a`,{className:`p3-paper-figure ${n}`,href:`./paper/${e}.pdf`,target:`_blank`,rel:`noreferrer`,title:`Open original paper figure`,children:(0,m.jsx)(`img`,{src:`./paper/${e}.png`,alt:t,loading:`lazy`})})}function x({item:e,synthetic:t=!1}){let[n,r]=(0,l.useState)(!1),[i,a]=(0,l.useState)(0),[o,s]=(0,l.useState)(0),c=(0,l.useRef)(null),u=(0,l.useRef)(null),d=(0,l.useRef)(0),f=(0,l.useRef)(0),p=t?[`source`,`reference`,`ours`]:[`source`,`omnivideo2_official_1p3b`,`lucy_edit_1p1_dev_5b`,`vace_wan21_1p3b_fullframe`,`liveedit_wan21_1p3b`,`kiwi_edit_5b_instruct_only`,`reco_ori_wan21_1p3b`,`zebra`,`mev160_fm_only_u160`],h=p.flatMap(t=>e.videos.filter(e=>e.id===t)),g=e.videos.filter(e=>!p.includes(e.id)),_=(0,l.useCallback)(()=>Array.from(c.current?.querySelectorAll(`video`)??[]),[]),y=(0,l.useCallback)(()=>{f.current++,u.current!==null&&cancelAnimationFrame(u.current),u.current=null,_().forEach(e=>e.pause()),r(!1)},[_]);(0,l.useEffect)(()=>{let t=t=>{t.detail!==e.id&&y()};window.addEventListener(v,t);let n=new IntersectionObserver(e=>{e[0].isIntersecting||y()},{threshold:0});return c.current&&n.observe(c.current),()=>{n.disconnect(),window.removeEventListener(v,t),y()}},[e.id,y]);let b=async()=>{y();let t=f.current;window.dispatchEvent(new CustomEvent(v,{detail:e.id}));let n=_(),i=o&&d.current>=o-.05?0:d.current;if(d.current=i,n.forEach(e=>{e.playbackRate=1,e.readyState&&(e.currentTime=Math.min(i,Math.max(0,e.duration-.001)))}),await Promise.all(n.map(e=>e.play().catch(()=>void 0))),t!==f.current){n.forEach(e=>e.pause());return}let c=Math.max(0,...n.map(e=>Number.isFinite(e.duration)?e.duration:0));if(!c)return;s(c),r(!0);let l=performance.now(),p=()=>{if(t!==f.current)return;let e=Math.min(c,i+(performance.now()-l)/1e3);d.current=e,a(e),n.forEach(t=>{Number.isFinite(t.duration)&&(e>=t.duration?(t.pause(),Math.abs(t.currentTime-t.duration)>.06&&(t.currentTime=Math.max(0,t.duration-.001))):Math.abs(t.currentTime-e)>.18&&t.readyState>=2&&(t.currentTime=e))}),e>=c?y():u.current=requestAnimationFrame(p)};u.current=requestAnimationFrame(p)},x=e=>{y(),d.current=e,a(e),_().forEach(t=>{t.readyState&&(t.currentTime=Math.min(e,Math.max(0,t.duration-.001)))})};return(0,m.jsxs)(`div`,{className:`p3-comparison ${t?`p3-synthetic-comparison`:`p3-comparison-eight`}`,ref:c,children:[(0,m.jsxs)(`div`,{className:`p3-video-toolbar`,children:[(0,m.jsx)(`button`,{className:`p3-play`,onClick:()=>n?y():void b(),children:n?`Pause all`:`Play together`}),(0,m.jsx)(`button`,{onClick:()=>{x(0)},children:`↺ Restart`}),(0,m.jsx)(`input`,{type:`range`,"aria-label":`${e.title} playback position`,min:0,max:o||1,step:.01,value:i,onChange:e=>x(Number(e.target.value))}),(0,m.jsxs)(`span`,{className:`p3-time`,children:[i.toFixed(1),` / `,o.toFixed(1),` s`]}),(0,m.jsx)(`span`,{className:`p3-native`,children:`1× native speed`})]}),(0,m.jsx)(`div`,{className:`p3-video-grid`,children:h.map(t=>(0,m.jsxs)(`figure`,{className:`p3-video-card${[`ours`,`zebra`,`mev160_fm_only_u160`].includes(t.id)?` p3-ours`:``}`,children:[(0,m.jsxs)(`div`,{className:`p3-video-frame`,children:[(0,m.jsx)(`video`,{src:t.src,poster:t.src.replace(/\.mp4$/,`.jpg`),muted:!0,playsInline:!0,preload:`none`,"aria-label":`${e.title}: ${t.label}`,onLoadedMetadata:()=>s(Math.max(0,..._().map(e=>Number.isFinite(e.duration)?e.duration:0)))}),(0,m.jsx)(`img`,{className:`p3-print-poster`,src:t.src.replace(/\.mp4$/,`.jpg`),alt:``})]}),(0,m.jsxs)(`figcaption`,{children:[(0,m.jsx)(`b`,{children:t.label}),t.score!==void 0&&(0,m.jsxs)(`span`,{children:[`Score `,t.score.toFixed(1)]}),(0,m.jsx)(`a`,{href:t.src,target:`_blank`,rel:`noreferrer`,"aria-label":`Open ${t.label} full video`,children:`Open video ↗`})]})]},t.id))}),(0,m.jsx)(`p`,{className:`p3-play-note`,children:`Clips start together at their original speed. Shorter clips hold their last frame; use the full video link for individual controls.`}),g.length>0&&(0,m.jsxs)(`div`,{className:`p3-extra-videos`,children:[(0,m.jsx)(`span`,{children:`Additional videos`}),g.map(e=>(0,m.jsxs)(`a`,{href:e.src,target:`_blank`,rel:`noreferrer`,children:[e.label,` ↗`]},e.id))]})]})}function ee({item:e,Slide:t,collection:n}){return(0,m.jsxs)(t,{id:e.id,section:`QUALITATIVE · ${n}`,title:e.title,subtitle:e.instruction,children:[(0,m.jsx)(x,{item:e}),n!==`OMNIBENCH`&&(0,m.jsxs)(`p`,{className:`p3-provenance`,children:[e.note,` `,(0,m.jsx)(`a`,{href:`./qualitative/manifest.json`,target:`_blank`,rel:`noreferrer`,children:`Asset provenance ↗`})]})]})}function S({row:e}){return(0,m.jsxs)(`div`,{className:`p3-frame-row p3-frame-${e.id}`,children:[(0,m.jsx)(`b`,{children:e.label}),e.frames.map((t,n)=>(0,m.jsx)(`a`,{href:t,target:`_blank`,rel:`noreferrer`,children:(0,m.jsx)(`img`,{src:t,loading:`lazy`,alt:`${e.label}, frame ${[0,27,53,80][n]}`})},t))]})}function C({Slide:e}){return(0,m.jsxs)(m.Fragment,{children:[(0,m.jsxs)(e,{id:`paper-dgp`,section:`PAPER UPDATE · 01 / 06 · DATA GENERATING PROCESS`,title:`Data Generating Process: Content × Action`,subtitle:`VADD: Video Action Editing via Demonstrations and Disentanglement`,children:[(0,m.jsx)(b,{name:`data_generating_process`,alt:`Controlled dynamical process and a two-by-two content-action recombination diagram`}),(0,m.jsxs)(`div`,{className:`p3-columns p3-dgp-notes`,children:[(0,m.jsxs)(`article`,{children:[(0,m.jsx)(`span`,{className:`p3-kicker`,children:`GENERATE`}),(0,m.jsx)(`h3`,{children:`Roll out an ordered trajectory`}),(0,m.jsxs)(`p`,{children:[`Content `,(0,m.jsx)(g,{name:`content-code`,alt:`z^c`}),` is independent of the initial state, action regime `,(0,m.jsx)(g,{name:`action-regime`,alt:`u`}),`, and innovations. The renderer combines content with the full realized trajectory `,(0,m.jsx)(g,{name:`action-trajectory`,alt:`z^a_{0:T}`}),`.`]})]}),(0,m.jsxs)(`article`,{children:[(0,m.jsx)(`span`,{className:`p3-kicker`,children:`EDIT`}),(0,m.jsx)(`h3`,{children:`Recombine content and action`}),(0,m.jsx)(`p`,{children:`Preserve source content; transfer the demonstration’s trajectory, including its initial state and timing, within a fixed physical context.`})]}),(0,m.jsxs)(`article`,{children:[(0,m.jsx)(`span`,{className:`p3-kicker`,children:`SIMULATE`}),(0,m.jsx)(`h3`,{children:`MuJoCo supplies controlled views`}),(0,m.jsx)(`p`,{children:`Replay physical motion under two block appearances. Physics evolves the objects; a fixed camera and lighting render each clip.`})]})]}),(0,m.jsx)(y,{children:`§2.1 + Appendix D · The strict controlled model fixes physical context; real consecutive-event clips approximate this coupling.`})]}),(0,m.jsxs)(e,{id:`paper-identification`,section:`PAPER UPDATE · 02 / 06 · IDENTIFIABILITY`,title:`When Does an Action Anchor Identify Action?`,subtitle:`The positive pair shares the entire realized trajectory, not only the action label.`,children:[(0,m.jsxs)(`div`,{className:`p3-equation p3-original-views`,children:[(0,m.jsx)(`span`,{children:`ACTION-PRESERVING VIEWS`}),(0,m.jsx)(h,{name:`anchor-views`,alt:`V = g_ctrl(z^c, F_T(w)), V⁺ = g_ctrl(z^{c+}, F_T(w)). Both views share the full realized trajectory.`})]}),(0,m.jsxs)(`div`,{className:`p3-theory-layout`,children:[(0,m.jsxs)(`div`,{children:[(0,m.jsxs)(`div`,{className:`p3-equation`,children:[(0,m.jsx)(`span`,{children:`POPULATION OBJECTIVE`}),(0,m.jsx)(h,{name:`anchor-objective`,alt:`J(E_a, P) = λ E‖E_a(V) − E_a(V⁺)‖² + E‖P(E_a(V)) − φ(V⁺)‖²_H_k, λ > 0. The two terms are labeled L_inv and L_pred.`})]}),(0,m.jsxs)(`p`,{className:`p3-body`,children:[`Agreement removes appearance variation. Prediction of a `,(0,m.jsx)(`b`,{children:`characteristic kernel embedding`}),` retains differences between action-conditional video distributions.`]})]}),(0,m.jsxs)(`div`,{className:`p3-premises`,children:[(0,m.jsx)(`h3`,{children:`Conditions for the theorem`}),(0,m.jsxs)(`ol`,{children:[(0,m.jsxs)(`li`,{children:[(0,m.jsx)(`b`,{children:`Regularity:`}),` compact supports and continuous dynamics / rendering.`]}),(0,m.jsxs)(`li`,{children:[(0,m.jsx)(`b`,{children:`Appearance variation:`}),` independent, full-support content resampling, independent of the shared trajectory.`]}),(0,m.jsxs)(`li`,{children:[(0,m.jsx)(`b`,{children:`Temporal observability:`}),` distinct trajectories cannot produce the same ordered video under supported content choices.`]})]}),(0,m.jsx)(`p`,{children:`Optimize over continuous encoders, finite-risk predictors, and a code dimension admitting continuous injective trajectory coordinates.`})]})]}),(0,m.jsxs)(`div`,{className:`p3-theorem`,children:[(0,m.jsx)(`span`,{children:`AT EVERY POPULATION GLOBAL OPTIMUM`}),(0,m.jsx)(h,{name:`anchor-identification`,alt:`E_a(V) = h_a(z^a), P(h_a(z^a)) = μ_k(z^a), almost surely.`}),(0,m.jsxs)(`p`,{children:[(0,m.jsx)(g,{name:`identification-map`,alt:`h_a`}),` is injective on a full-measure action subset; `,(0,m.jsx)(g,{name:`kernel-mean`,alt:`μ_k`}),` is the action-conditional kernel mean embedding. Individual semantic coordinates are not fixed.`]})]}),(0,m.jsxs)(y,{children:[`§2.2 · Original manuscript equations. `,(0,m.jsx)(`a`,{href:`./paper/equations/anchor-objective.tex`,target:`_blank`,rel:`noreferrer`,children:`LaTeX source ↗`}),` · Finite-data optimization and real-video patch views are outside this guarantee.`]})]}),(0,m.jsxs)(e,{id:`paper-temporal`,section:`PAPER UPDATE · 03 / 06 · TEMPORAL INFORMATION`,title:`Why the Ordered Video Matters`,subtitle:`Three observations identify position, velocity, and acceleration; two can remain ambiguous.`,children:[(0,m.jsxs)(`div`,{className:`p3-columns p3-temporal-columns`,children:[(0,m.jsxs)(`div`,{children:[(0,m.jsxs)(`div`,{className:`p3-equation`,children:[(0,m.jsx)(`span`,{children:`NONLINEAR OBSERVATIONS`}),(0,m.jsx)(h,{name:`temporal-observations`,alt:`p_t = p_0 + t v_0 + ½ t² u, x_t = ρ(c, p_t).`})]}),(0,m.jsxs)(`svg`,{className:`p3-trajectory`,viewBox:`0 0 560 250`,role:`img`,"aria-label":`Two trajectories have the same endpoint observations but different middle positions`,children:[(0,m.jsx)(`path`,{d:`M50 15V215H530`,fill:`none`,stroke:`#9ca8b1`,strokeWidth:`1.5`}),(0,m.jsx)(`path`,{d:`M70 195 L285 115 L500 35`,fill:`none`,stroke:`#28699a`,strokeWidth:`4`}),(0,m.jsx)(`path`,{d:`M70 195 Q285 190 500 35`,fill:`none`,stroke:`#bd6e32`,strokeWidth:`4`}),(0,m.jsx)(`path`,{d:`M285 35V213`,fill:`none`,stroke:`#bbc4cb`,strokeDasharray:`5 5`}),(0,m.jsxs)(`g`,{fill:`#102b4e`,children:[(0,m.jsx)(`circle`,{cx:`70`,cy:`195`,r:`6`}),(0,m.jsx)(`circle`,{cx:`500`,cy:`35`,r:`6`})]}),(0,m.jsx)(`circle`,{cx:`285`,cy:`115`,r:`6`,fill:`#28699a`}),(0,m.jsx)(`circle`,{cx:`285`,cy:`152.5`,r:`6`,fill:`#bd6e32`}),(0,m.jsxs)(`g`,{fontSize:`15`,fill:`#526373`,children:[(0,m.jsx)(`text`,{x:`70`,y:`238`,textAnchor:`middle`,children:`First`}),(0,m.jsx)(`text`,{x:`285`,y:`238`,textAnchor:`middle`,children:`Middle`}),(0,m.jsx)(`text`,{x:`500`,y:`238`,textAnchor:`middle`,children:`Last`}),(0,m.jsx)(`text`,{x:`80`,y:`32`,children:`Same endpoints, different acceleration`})]})]}),(0,m.jsxs)(`p`,{className:`p3-body`,children:[`Temporal observability concerns the `,(0,m.jsx)(`b`,{children:`whole ordered clip`}),`. A single frame need not reveal the full action state.`]})]}),(0,m.jsxs)(`div`,{children:[(0,m.jsx)(`h3`,{className:`p3-subhead`,children:`Why ordinary mean prediction can fail`}),(0,m.jsxs)(`p`,{className:`p3-body`,children:[`The multiplicative map `,(0,m.jsx)(g,{name:`multiplicative-map`,alt:`ρ(c,p) = (cp,c)`}),` with symmetric nonzero content is invertible, yet `,(0,m.jsx)(g,{name:`zero-conditional-mean`,alt:`E[V | z^a] = 0`}),`. Predicting this mean can erase all action differences.`]}),(0,m.jsx)(`div`,{className:`p3-mini-table`,children:(0,m.jsxs)(`table`,{children:[(0,m.jsxs)(`caption`,{children:[`Manuscript numerical check · `,(0,m.jsx)(g,{name:`three-frames`,alt:`T = 3`})]}),(0,m.jsx)(`thead`,{children:(0,m.jsxs)(`tr`,{children:[(0,m.jsx)(`th`,{children:`Mixing / objective`}),(0,m.jsxs)(`th`,{children:[(0,m.jsx)(g,{name:`midpoint-position`,alt:`p`}),` `,(0,m.jsx)(g,{name:`r-squared`,alt:`R²`})]}),(0,m.jsxs)(`th`,{children:[(0,m.jsx)(g,{name:`velocity`,alt:`v`}),` `,(0,m.jsx)(g,{name:`r-squared`,alt:`R²`})]}),(0,m.jsxs)(`th`,{children:[(0,m.jsx)(g,{name:`action-regime`,alt:`u`}),` `,(0,m.jsx)(g,{name:`r-squared`,alt:`R²`})]}),(0,m.jsxs)(`th`,{children:[`Content `,(0,m.jsx)(g,{name:`r-squared`,alt:`R²`})]})]})}),(0,m.jsxs)(`tbody`,{children:[(0,m.jsxs)(`tr`,{children:[(0,m.jsx)(`th`,{children:`Shear · agreement + kernel`}),(0,m.jsx)(`td`,{children:`1.00`}),(0,m.jsx)(`td`,{children:`1.00`}),(0,m.jsx)(`td`,{children:`0.97`}),(0,m.jsx)(`td`,{children:`0.00`})]}),(0,m.jsxs)(`tr`,{children:[(0,m.jsx)(`th`,{children:`Multiplicative · same objective`}),(0,m.jsx)(`td`,{children:`1.00`}),(0,m.jsx)(`td`,{children:`1.00`}),(0,m.jsx)(`td`,{children:`1.00`}),(0,m.jsx)(`td`,{children:`0.00`})]})]})]})}),(0,m.jsxs)(`div`,{className:`p3-note`,children:[(0,m.jsx)(`b`,{children:`When feature means suffice`}),(0,m.jsx)(`p`,{children:`In the additive-feature corollary, action differences must survive outside the appearance-variation subspace. Ordinary feature prediction then retains action.`})]})]})]}),(0,m.jsxs)(y,{file:`appendix_e_synthetic_protocol.tex`,children:[`§2.3 + Appendix E · `,(0,m.jsx)(g,{name:`r-squared`,alt:`R²`}),` values are three-seed means from the paper’s numerical experiment, separate from rendered-video examples.`]})]}),(0,m.jsxs)(e,{id:`paper-anchor`,section:`PAPER UPDATE · 04 / 06 · REPRESENTATION LEARNING`,title:`Learning Action Anchors from Demonstrations`,subtitle:`A temporal model keeps ordered dynamics across spatial views of the same demonstration.`,children:[(0,m.jsxs)(`div`,{className:`p3-method-layout`,children:[(0,m.jsx)(b,{name:`vadd_method_overview_anchor`,alt:`Paper VADD architecture: action anchor training, condition K, source-conditioned adapters, and behavior supervision`}),(0,m.jsxs)(`div`,{children:[(0,m.jsxs)(`div`,{className:`p3-step`,children:[(0,m.jsx)(`b`,{children:`01`}),(0,m.jsxs)(`div`,{children:[(0,m.jsx)(`h3`,{children:`Observe dynamic features`}),(0,m.jsx)(`p`,{children:`Frozen features → temporal centering, signed changes, and local change magnitudes. Alternating patches supply two views.`})]})]}),(0,m.jsxs)(`div`,{className:`p3-step`,children:[(0,m.jsx)(`b`,{children:`02`}),(0,m.jsxs)(`div`,{children:[(0,m.jsx)(`h3`,{children:`Encode an action sequence`}),(0,m.jsx)(`p`,{children:`A bidirectional GRU predicts Gaussian posteriors. Their means are the action anchors; a recurrent, history-conditioned prior regularizes them.`})]})]}),(0,m.jsxs)(`div`,{className:`p3-step`,children:[(0,m.jsx)(`b`,{children:`03`}),(0,m.jsxs)(`div`,{children:[(0,m.jsx)(`h3`,{children:`Retain information and order`}),(0,m.jsx)(`p`,{children:`SmoothL1 dynamic reconstruction + view consistency + KL / temporal regularization and reverse, shuffle, repeated-frame controls.`})]})]})]})]}),(0,m.jsxs)(`div`,{className:`p3-equation p3-anchor-loss`,children:[(0,m.jsx)(`span`,{children:`ACTION-ANCHOR OBJECTIVE`}),(0,m.jsx)(h,{name:`anchor-loss`,alt:`L_anchor = λ_obs L_obs + λ_view L_view + L_reg.`})]}),(0,m.jsx)(y,{file:`3_method.tex`,children:`§3.1 · Same-scene patch views and mean-target SmoothL1 are practical surrogates for the population criterion. The prior is a temporal inductive bias.`})]}),(0,m.jsxs)(e,{id:`paper-adapter`,section:`PAPER UPDATE · 05 / 06 · EDITOR`,title:`Source-Conditioned Action Injection`,subtitle:`Action specifies the motion; the source provides the appearance and spatial context in which it is executed.`,children:[(0,m.jsxs)(`div`,{className:`p3-condition-flow`,children:[(0,m.jsxs)(`article`,{children:[(0,m.jsxs)(`span`,{children:[`DEMONSTRATION `,(0,m.jsx)(g,{name:`demonstration-video`,alt:`V_r`})]}),(0,m.jsx)(`strong`,{children:`Normalized anchor`}),(0,m.jsx)(`p`,{children:`learned ordered action`})]}),(0,m.jsx)(`b`,{children:`+`}),(0,m.jsxs)(`article`,{className:`p3-teal`,children:[(0,m.jsxs)(`span`,{children:[`DEMONSTRATION `,(0,m.jsx)(g,{name:`demonstration-video`,alt:`V_r`})]}),(0,m.jsx)(`strong`,{children:`Compressed V-JEPA2`}),(0,m.jsx)(`p`,{children:`complementary behavior features`})]}),(0,m.jsx)(`b`,{children:`→`}),(0,m.jsxs)(`article`,{className:`p3-condition-result`,children:[(0,m.jsx)(`span`,{children:`DETACHED CONDITION`}),(0,m.jsx)(`strong`,{children:(0,m.jsx)(g,{name:`action-condition`,alt:`K(V_r)`})}),(0,m.jsx)(`p`,{children:`phase-aligned feature concatenation`})]})]}),(0,m.jsxs)(`div`,{className:`p3-equation`,children:[(0,m.jsx)(`span`,{children:`SOURCE-CONDITIONED LOW-RANK UPDATE`}),(0,m.jsx)(h,{name:`adapter-update`,alt:`Δu = α_k W_up [(W_u u) ⊙ tanh(W_k k) + (W_k k) ⊙ (1 + tanh(W_b b))].`})]}),(0,m.jsxs)(`div`,{className:`p3-columns`,children:[(0,m.jsxs)(`article`,{children:[(0,m.jsxs)(`span`,{className:`p3-kicker`,children:[`GENERATED STATE · `,(0,m.jsx)(g,{name:`generated-token`,alt:`u`})]}),(0,m.jsx)(`h3`,{children:`Adapt to the current token`}),(0,m.jsx)(`p`,{children:`The first term couples the demonstrated action to the current generated state.`})]}),(0,m.jsxs)(`article`,{children:[(0,m.jsxs)(`span`,{className:`p3-kicker`,children:[`SOURCE CONTEXT · `,(0,m.jsx)(g,{name:`source-context`,alt:`b`})]}),(0,m.jsx)(`h3`,{children:`Bind the action to the source`}),(0,m.jsx)(`p`,{children:`The second term modulates the action using spatial context from independently encoded source frames.`})]}),(0,m.jsxs)(`article`,{children:[(0,m.jsxs)(`span`,{className:`p3-kicker`,children:[`SAMPLING GATE · `,(0,m.jsx)(g,{name:`sampling-gate`,alt:`α_k`})]}),(0,m.jsx)(`h3`,{children:`Inject early, refine later`}),(0,m.jsx)(`p`,{children:`Adapters act on visual self-attention value / output projections during the first 8 of 40 sampling steps.`})]})]}),(0,m.jsxs)(`div`,{className:`p3-note`,children:[(0,m.jsx)(`b`,{children:`Scope of the theory`}),(0,m.jsxs)(`p`,{children:[`The identified object is the learned mean code. Normalization can discard offsets and scale; the augmented packet `,(0,m.jsx)(g,{name:`action-packet`,alt:`K`}),` also includes V-JEPA2 features.`]})]}),(0,m.jsx)(y,{file:`3_method.tex`,children:`§3.2 + Appendix D · Frozen backbone and representation model; trainable residual adapters.`})]}),(0,m.jsxs)(e,{id:`paper-training`,section:`PAPER UPDATE · 06 / 06 · TRAINING & INFERENCE`,title:`Train on Behavior; Preserve Source Content`,subtitle:`Supervise the decoded clean prediction with ordered behavior and source-preservation signals.`,children:[(0,m.jsxs)(`div`,{className:`p3-columns p3-training-columns`,children:[(0,m.jsxs)(`div`,{children:[(0,m.jsxs)(`div`,{className:`p3-equation p3-behavior-equations`,children:[(0,m.jsx)(`span`,{children:`ORDERED BEHAVIOR READER`}),(0,m.jsx)(h,{name:`behavior-similarity`,alt:`γ_{j,k} = sim(e_J(V̂_{0|k}), e_J(V_j)).`}),(0,m.jsx)(h,{name:`behavior-loss`,alt:`ℓ_act,k = 1 − γ_{+,k} − λ_disc log [exp(γ_{+,k}/τ) / Σ_{j∈K} exp(γ_{j,k}/τ)].`})]}),(0,m.jsxs)(`div`,{className:`p3-control-tags`,children:[(0,m.jsx)(`span`,{children:`+ Demonstration`}),(0,m.jsx)(`span`,{children:`− Source`}),(0,m.jsx)(`span`,{children:`− Reversed`}),(0,m.jsx)(`span`,{children:`− Shuffled`})]}),(0,m.jsx)(`p`,{className:`p3-body`,children:`The frozen V-JEPA2 reader differentiates through generated videos. Demonstration and control descriptors are detached.`}),(0,m.jsxs)(`div`,{className:`p3-note`,children:[(0,m.jsx)(`b`,{children:`Source preservation`}),(0,m.jsx)(`p`,{children:`Compare patch sets and appearance statistics. Remove the gradient component opposing behavior, then cap preservation RMS at ¼ of the behavior-gradient RMS without amplifying it.`})]})]}),(0,m.jsxs)(`div`,{className:`p3-inference`,children:[(0,m.jsx)(`h3`,{children:`Training`}),(0,m.jsx)(`p`,{children:`1,508 real source–target pairs; real-target and offline-generated demonstrations at 3:1. Action-code warm-up precedes behavior supervision.`}),(0,m.jsx)(`div`,{className:`p3-inference-rule`}),(0,m.jsx)(`h3`,{children:`Inference on OmniBench`}),(0,m.jsxs)(`ol`,{children:[(0,m.jsxs)(`li`,{children:[(0,m.jsx)(`b`,{children:`Source + instruction`}),` → Qwen3-VL rewrites a T2V prompt.`]}),(0,m.jsxs)(`li`,{children:[(0,m.jsx)(`b`,{children:`Frozen Bernini`}),` generates the demonstration.`]}),(0,m.jsxs)(`li`,{children:[(0,m.jsxs)(`b`,{children:[`Extract `,(0,m.jsx)(g,{name:`action-packet`,alt:`K`}),` once`]}),` and run the conditional sampler.`]})]}),(0,m.jsx)(`p`,{children:`No real target is read; inference needs neither behavior-reader gradients nor per-example optimization.`})]})]}),(0,m.jsx)(y,{file:`3_method.tex`,children:`§3.3 + §4.1 / Appendix D · Warm-up followed by behavior supervision; inference uses a self-generated demonstration.`})]}),(0,m.jsxs)(e,{id:`omni-summary`,section:`EXPERIMENTS · QUANTITATIVE CONTEXT`,title:`OmniEdit-Bench Temporal: Paper Results`,subtitle:`Accuracy-gated scores from the manuscript · 0–100, higher is better · category counts in parentheses`,children:[(0,m.jsx)(`div`,{className:`p3-benchmark`,children:(0,m.jsxs)(`table`,{children:[(0,m.jsx)(`thead`,{children:(0,m.jsxs)(`tr`,{children:[(0,m.jsx)(`th`,{children:`Method`}),(0,m.jsxs)(`th`,{children:[`Motion semantic`,(0,m.jsx)(`br`,{}),`(30)`]}),(0,m.jsxs)(`th`,{children:[`Motion attribute`,(0,m.jsx)(`br`,{}),`(50)`]}),(0,m.jsxs)(`th`,{children:[`Temporal composition`,(0,m.jsx)(`br`,{}),`(70)`]}),(0,m.jsxs)(`th`,{children:[`Action`,(0,m.jsx)(`br`,{}),`(150)`]}),(0,m.jsxs)(`th`,{children:[`Camera`,(0,m.jsx)(`br`,{}),`(50)`]}),(0,m.jsxs)(`th`,{children:[`All`,(0,m.jsx)(`br`,{}),`(200)`]})]})}),(0,m.jsx)(`tbody`,{children:[[`VACE`,6.8,7.54,11.48,9.23,8,8.92],[`ReCo`,5.59,3.14,6.46,5.18,16.43,7.99],[`OmniVideo2`,32.58,13.15,12.64,16.8,14.77,16.29],[`Kiwi-Edit`,29.31,21.7,19.31,22.11,15.39,20.43],[`LiveEdit`,18.8,13.92,10.79,13.44,7.32,11.91],[`Bernini · frozen`,31.36,21.54,13.46,19.73,42.99,25.55],[`VADD · ours`,34.93,24.96,17.64,23.54,46.16,29.19],[`Direct-FM · reference`,38.23,14.56,15.85,19.9,25.82,21.38]].map((e,t)=>(0,m.jsxs)(`tr`,{className:t===6?`p3-best-row`:t===7?`p3-reference-row`:``,children:[(0,m.jsx)(`th`,{children:e[0]}),e.slice(1).map((e,t)=>(0,m.jsx)(`td`,{children:Number(e).toFixed(2)},t))]},String(e[0])))})]})}),(0,m.jsxs)(`div`,{className:`p3-columns p3-score-notes`,children:[(0,m.jsxs)(`article`,{children:[(0,m.jsx)(`span`,{className:`p3-kicker`,children:`ACTION`}),(0,m.jsx)(`h3`,{children:`+3.81 over Bernini`}),(0,m.jsx)(`p`,{children:`23.54 vs. 19.73 across 150 non-camera cases.`})]}),(0,m.jsxs)(`article`,{children:[(0,m.jsx)(`span`,{className:`p3-kicker`,children:`ALL TEMPORAL`}),(0,m.jsx)(`h3`,{children:`+3.64 over Bernini`}),(0,m.jsx)(`p`,{children:`29.19 vs. 25.55 across all 200 cases.`})]}),(0,m.jsxs)(`article`,{children:[(0,m.jsx)(`span`,{className:`p3-kicker`,children:`READING THE NEXT TWO CASES`}),(0,m.jsx)(`h3`,{children:`Selected qualitative examples`}),(0,m.jsx)(`p`,{children:`High-score cases are a showcase; the table summarizes the complete evaluation.`})]})]}),(0,m.jsx)(y,{file:`4_experiments.tex`,children:`§4, Omni Temporal table · Direct-FM is a paired-target reference and is not ranked. The following archive scores use Qwen3-VL-32B / 12 frames.`})]}),d.omni.map(t=>(0,m.jsx)(ee,{item:t,Slide:e,collection:`OMNIBENCH`},t.id)),d.synthetic.map(t=>(0,m.jsxs)(e,{id:t.id,section:`QUALITATIVE · SYNTHETIC`,title:t.title,subtitle:`Keep the source block appearance while following the demonstrated trajectory.`,children:[(0,m.jsx)(x,{item:t,synthetic:!0}),(0,m.jsxs)(`div`,{className:`p3-readout`,children:[(0,m.jsx)(`b`,{children:`Appearance × trajectory`}),(0,m.jsx)(`p`,{children:`Preserve source colors while following the reference motion. Compare the approach, direction changes, and final placement at 1× speed.`})]}),(0,m.jsxs)(`details`,{className:`p3-audit`,children:[(0,m.jsx)(`summary`,{children:`View sampled frames and audit records`}),(0,m.jsxs)(`div`,{className:`p3-frame-row p3-frame-head`,children:[(0,m.jsx)(`b`,{children:`Time →`}),[0,27,53,80].map(e=>(0,m.jsxs)(`span`,{children:[`Frame `,e]},e))]}),t.rows.map(e=>(0,m.jsx)(S,{row:e},e.id)),t.audit.map(e=>(0,m.jsx)(S,{row:e},e.id))]}),(0,m.jsxs)(`p`,{className:`p3-provenance`,children:[`Uses the manuscript’s author-confirmed `,(0,m.jsx)(`code`,{children:`my/source`}),` pairing. The paper’s provenance note records the older source archive as incorrect. Expected frames are audit-only. `,(0,m.jsx)(`a`,{href:`./paper/source/synthetic_qualitative_v1.html`,target:`_blank`,rel:`noreferrer`,children:`Pairing record ↗`})]})]},t.id)),d.real.map(t=>(0,m.jsx)(ee,{item:t,Slide:e,collection:`REAL`},t.id)),(0,m.jsxs)(e,{id:`further-reading`,section:`VADD · DISCUSSION`,title:`From the Paper to the Evidence`,subtitle:`A controlled theory, a practical editor, and visible motion transfer.`,tone:`navy`,children:[(0,m.jsxs)(`div`,{className:`p3-conclusion`,children:[(0,m.jsxs)(`article`,{children:[(0,m.jsx)(`span`,{children:`THEORY`}),(0,m.jsx)(`h3`,{children:`Invariance + information retention`}),(0,m.jsx)(`p`,{children:`Independent appearance resampling and temporal observability identify the action block at population optimum.`})]}),(0,m.jsxs)(`article`,{children:[(0,m.jsx)(`span`,{children:`METHOD`}),(0,m.jsx)(`h3`,{children:`Demonstrate, encode, execute`}),(0,m.jsx)(`p`,{children:`Learn ordered action anchors, couple them to the source through early adapters, and supervise decoded behavior alongside preservation.`})]}),(0,m.jsxs)(`article`,{children:[(0,m.jsx)(`span`,{children:`EVIDENCE`}),(0,m.jsx)(`h3`,{children:`Keep the experimental tracks explicit`}),(0,m.jsx)(`p`,{children:`Controlled synthetic outputs, generated-reference Zebra, and the FM variant supply complementary qualitative evidence.`})]})]}),(0,m.jsxs)(`div`,{className:`p3-jump-links`,children:[(0,m.jsx)(`a`,{href:`#paper-dgp`,children:`Paper update ↑`}),(0,m.jsx)(`a`,{href:`#omni-summary`,children:`Experiments ↑`}),(0,m.jsx)(`a`,{href:`#cover`,children:`Motivation ↑`}),(0,m.jsx)(`a`,{href:`./qualitative/omni/index.html`,target:`_blank`,rel:`noreferrer`,children:`Full Omni gallery ↗`})]})]})]})}var w=[[`cover`,`Video Action Editing`],[`motivation`,`Change What Happens—Preserve Who and What`],[`local-action-recovery`,`Recover Action Capability from Demonstrations`],[`gap16-a`,`Failure Mode 1 — The Requested Event Never Starts`],[`gap16-late-endpoint`,`A Late Target-Like Endpoint Is Not an Edit`],[`gap16-b`,`Failure Mode 1b — Source Motion Is Replayed Before the Edit`],[`gap-vjepa2-evidence`,`Self-Generated Demonstrations vs. Edited Outputs`],..._],te={established:`Established evidence`,component:`Component evidence`,provisional:`Provisional design`,nogo:`No-go / blocked`};function ne({kind:e}){return(0,m.jsx)(`span`,{className:`evidence-badge evidence-${e}`,children:te[e]})}function T({id:e,section:t,title:n,subtitle:r,children:i,tone:a=`paper`}){let o=w.findIndex(([t])=>t===e);return(0,m.jsx)(`section`,{className:`slide slide-${a}`,id:e,"aria-label":`Slide ${o+1}: ${w[o][1]}`,children:(0,m.jsxs)(`div`,{className:`slide-inner`,children:[(0,m.jsxs)(`header`,{className:`slide-heading`,children:[(0,m.jsxs)(`div`,{children:[(0,m.jsx)(`p`,{className:`section-label`,children:t}),e===`cover`?(0,m.jsx)(`h1`,{children:n}):(0,m.jsx)(`h2`,{children:n}),r&&(0,m.jsx)(`p`,{className:`subtitle`,children:r})]}),(0,m.jsx)(`span`,{className:`slide-number`,children:String(o+1).padStart(2,`0`)})]}),(0,m.jsx)(`div`,{className:`slide-content`,children:i})]})})}function E({src:e,label:t,note:n,compact:r=!1,aspect:i=`wide`,controls:a=!1}){let o=e.replace(/\.mp4$/,`.jpg`);return(0,m.jsxs)(`figure`,{className:`experiment-media experiment-media-${i}${i===`portraitTwoThree`||i===`portraitThirteenEighteen`?` experiment-media-portrait`:``}${r?` experiment-media-compact`:``}`,children:[(0,m.jsxs)(`div`,{className:`experiment-media-frame`,children:[(0,m.jsx)(`video`,{src:e,poster:o,muted:!0,loop:!0,playsInline:!0,preload:`metadata`,controls:a,"aria-label":t}),(0,m.jsx)(`img`,{className:`experiment-print-poster`,src:o,alt:``,"aria-hidden":`true`})]}),(0,m.jsxs)(`figcaption`,{children:[(0,m.jsx)(`b`,{children:t}),n&&(0,m.jsx)(`span`,{children:n})]})]})}var re=`action-editing:sync-start`;function ie({label:e,compact:t=!1,lockTimeline:n=!0,singleControl:r=!1,className:i=``,children:a}){let o=(0,l.useRef)(null),s=(0,l.useRef)(null),c=(0,l.useRef)(0),u=(0,l.useId)(),[d,f]=(0,l.useState)(!1),p=(0,l.useCallback)(()=>Array.from(o.current?.querySelectorAll(`video`)??[]),[]),h=(0,l.useCallback)(()=>{s.current!==null&&(cancelAnimationFrame(s.current),s.current=null)},[]),g=(0,l.useCallback)(()=>{c.current+=1,h(),p().forEach(e=>e.pause()),f(!1)},[p,h]),_=(0,l.useCallback)(e=>{h();let t=()=>{if(e!==c.current)return;let n=p(),r=n[0];if(!r||r.paused||r.ended){g();return}n.slice(1).forEach(e=>{if(e.playbackRate=r.playbackRate,Math.abs(e.currentTime-r.currentTime)>.045)try{e.currentTime=r.currentTime}catch{}e.paused&&!e.ended&&e.play().catch(()=>void 0)}),s.current=requestAnimationFrame(t)};s.current=requestAnimationFrame(t)},[p,g,h]),v=(0,l.useCallback)(async e=>{let t=p();if(t.length===0)return;let r=c.current+1;c.current=r,window.dispatchEvent(new CustomEvent(re,{detail:u})),h();let i=t[0],a=e||!n||i.ended?0:i.currentTime;t.forEach(e=>{e.pause(),e.muted=!0;try{e.currentTime=Number.isFinite(a)?a:0}catch{}});let o=await Promise.all(t.map(e=>e.play().then(()=>!0).catch(()=>!1)));if(r!==c.current||!o[0]){g();return}f(!0),n&&_(r)},[p,u,n,g,_,h]);return(0,l.useEffect)(()=>{let e=e=>{e.detail!==u&&g()};return window.addEventListener(re,e),()=>window.removeEventListener(re,e)},[u,g]),(0,l.useEffect)(()=>{let e=o.current;if(!e)return;let t=new IntersectionObserver(([e])=>{(!e.isIntersecting||e.intersectionRatio<.05)&&g()},{threshold:.05});return t.observe(e),()=>t.disconnect()},[g]),(0,l.useEffect)(()=>()=>{c.current+=1,h(),p().forEach(e=>e.pause())},[p,h]),(0,m.jsxs)(`div`,{className:`experiment-sync-group${t?` compact-sync-group`:``}${i?` ${i}`:``}`,ref:o,role:`group`,"aria-label":`${e} ${n?`synchronized`:`simultaneous`} playback`,children:[(0,m.jsxs)(`div`,{className:`experiment-syncbar`,children:[(0,m.jsx)(`div`,{className:`experiment-sync-copy`,children:(0,m.jsx)(`strong`,{children:e})}),(0,m.jsxs)(`div`,{className:`experiment-sync-actions`,role:`group`,"aria-label":`Playback controls for ${e}`,children:[(0,m.jsx)(`button`,{type:`button`,className:`experiment-sync-button${d?` active`:``}`,"aria-pressed":d,onClick:()=>d?g():void v(!n),children:d?`Pause all`:n?`Play together`:`Play all from start`}),!r&&(0,m.jsx)(`button`,{type:`button`,className:`experiment-sync-button secondary`,onClick:()=>void v(!0),children:`Restart together`})]})]}),a]})}function ae(){let[e,t]=(0,l.useState)(0),[n,r]=(0,l.useState)(!1),i=(0,l.useRef)(null),a=(0,l.useCallback)(e=>{let n=Math.max(0,Math.min(w.length-1,e));document.getElementById(w[n][0])?.scrollIntoView({block:`start`}),t(n),window.history.replaceState(null,``,`#${w[n][0]}`),r(!1)},[]);return(0,l.useEffect)(()=>{let e=w.map(([e])=>document.getElementById(e)).filter(e=>!!e),n=new Map,r=new IntersectionObserver(e=>{e.forEach(e=>n.set(e.target.id,e.isIntersecting?e.intersectionRatio:0)),t(w.reduce((e,[t],r)=>(n.get(t)??0)>(n.get(w[e][0])??0)?r:e,0))},{threshold:[0,.25,.5,.75]});return e.forEach(e=>r.observe(e)),()=>r.disconnect()},[]),(0,l.useEffect)(()=>{let t=t=>{if(t.key===`Escape`){r(!1);return}let n=t.target;n&&[`A`,`BUTTON`,`VIDEO`,`INPUT`,`SELECT`,`TEXTAREA`].includes(n.tagName)||([`ArrowRight`,`ArrowDown`,`PageDown`,` `].includes(t.key)?(t.preventDefault(),a(e+1)):[`ArrowLeft`,`ArrowUp`,`PageUp`].includes(t.key)?(t.preventDefault(),a(e-1)):t.key===`Home`?(t.preventDefault(),a(0)):t.key===`End`&&(t.preventDefault(),a(w.length-1)))};return window.addEventListener(`keydown`,t),()=>window.removeEventListener(`keydown`,t)},[e,a]),(0,l.useEffect)(()=>{if(!n)return;let e=document.activeElement;return i.current?.focus(),()=>e?.focus()},[n]),(0,m.jsxs)(`main`,{className:`deck`,children:[(0,m.jsx)(`div`,{className:`progress`,"aria-hidden":`true`,children:(0,m.jsx)(`span`,{style:{width:`${(e+1)/w.length*100}%`}})}),(0,m.jsxs)(`header`,{className:`topbar`,children:[(0,m.jsxs)(`button`,{className:`brand-button`,onClick:()=>a(0),"aria-label":`Go to title slide`,children:[(0,m.jsx)(`strong`,{children:`VADD · ACTION EDITING`}),(0,m.jsx)(`span`,{children:`Paper & experimental update`})]}),(0,m.jsxs)(`div`,{className:`top-actions`,children:[(0,m.jsxs)(`span`,{className:`page-counter`,"aria-live":`polite`,children:[String(e+1).padStart(2,`0`),` / `,w.length]}),(0,m.jsx)(`a`,{className:`utility-button results-link`,href:`./large-fair12/index.html`,target:`_blank`,rel:`noopener noreferrer`,title:`Shared-caption generation and editing results`,children:`14B comparison`}),(0,m.jsx)(`button`,{className:`utility-button`,onClick:()=>a(w.findIndex(([e])=>e===`paper-dgp`)),children:`Theory & method`}),(0,m.jsx)(`button`,{className:`utility-button`,onClick:()=>a(w.findIndex(([e])=>e===`omni-summary`)),children:`Results`}),(0,m.jsx)(`button`,{className:`utility-button print-button`,onClick:()=>window.print(),children:`Print / PDF`}),(0,m.jsx)(`button`,{className:`utility-button utility-primary`,onClick:()=>r(!0),"aria-expanded":n,"aria-controls":`deck-navigation`,children:`Contents`})]})]}),n&&(0,m.jsxs)(`aside`,{id:`deck-navigation`,className:`nav-drawer`,role:`dialog`,"aria-modal":`true`,"aria-labelledby":`navigation-title`,children:[(0,m.jsx)(`button`,{className:`drawer-scrim`,onClick:()=>r(!1),"aria-label":`Close contents`}),(0,m.jsxs)(`nav`,{className:`drawer-panel`,"aria-label":`Slide contents`,children:[(0,m.jsxs)(`div`,{className:`drawer-head`,children:[(0,m.jsxs)(`strong`,{id:`navigation-title`,children:[`Contents · `,w.length,` slides`]}),(0,m.jsx)(`button`,{ref:i,onClick:()=>r(!1),"aria-label":`Close contents`,children:`×`})]}),(0,m.jsx)(`ol`,{children:w.map(([t,n],r)=>(0,m.jsx)(`li`,{children:(0,m.jsxs)(`button`,{className:e===r?`active`:``,onClick:()=>a(r),children:[(0,m.jsx)(`span`,{children:String(r+1).padStart(2,`0`)}),n]})},t))})]})]}),(0,m.jsx)(T,{id:`cover`,section:`PEIYUAN ZHU · VIDEO ACTION EDITING`,title:(0,m.jsxs)(m.Fragment,{children:[`Action Editing`,(0,m.jsx)(`br`,{}),(0,m.jsx)(`em`,{children:`VADD`})]}),subtitle:`VADD · Data generation, identifiable action anchors, and qualitative evidence`,tone:`navy`,children:(0,m.jsxs)(`div`,{className:`cover-grid progress-cover-grid`,children:[(0,m.jsxs)(`div`,{className:`cover-thesis`,children:[(0,m.jsx)(`p`,{className:`lead`,children:`Change the requested action while preserving source content that the edit does not target.`}),(0,m.jsxs)(`div`,{className:`status-strip`,children:[(0,m.jsxs)(`span`,{className:`status-established`,children:[(0,m.jsx)(`b`,{children:`THEORY`}),` invariance and action information`]}),(0,m.jsxs)(`span`,{className:`status-nogo`,children:[(0,m.jsx)(`b`,{children:`METHOD`}),` source-conditioned action adapters`]}),(0,m.jsxs)(`span`,{className:`status-partial`,children:[(0,m.jsx)(`b`,{children:`INFERENCE`}),` self-generated demonstrations`]})]}),(0,m.jsx)(`p`,{className:`scope-note`,children:`VADD learns action anchors from demonstrations and trains an editor to execute them under source conditioning. The data-generating process, identification result, method, and video evidence follow.`})]}),(0,m.jsxs)(`div`,{className:`cover-agenda`,children:[(0,m.jsxs)(`div`,{children:[(0,m.jsx)(`span`,{children:`I`}),(0,m.jsx)(`strong`,{children:`Motivation`})]}),(0,m.jsxs)(`div`,{children:[(0,m.jsx)(`span`,{children:`II`}),(0,m.jsx)(`strong`,{children:`Identifiable action anchors`})]}),(0,m.jsxs)(`div`,{children:[(0,m.jsx)(`span`,{children:`III`}),(0,m.jsx)(`strong`,{children:`VADD editor`})]}),(0,m.jsxs)(`div`,{children:[(0,m.jsx)(`span`,{children:`IV`}),(0,m.jsx)(`strong`,{children:`Qualitative results`})]})]})]})}),(0,m.jsxs)(T,{id:`motivation`,section:`I · MOTIVATION`,title:`Change What Happens—Preserve Who and What`,subtitle:`An action edit is valid only when the requested event occurs with the source-owned subjects and objects.`,children:[(0,m.jsxs)(`div`,{className:`failure-mode-grid`,children:[(0,m.jsxs)(`article`,{className:`failure-mode-card failure-no-edit`,children:[(0,m.jsx)(`span`,{children:`FM-1 · NO EDIT`}),(0,m.jsx)(`h3`,{children:`The requested event never starts`}),(0,m.jsx)(`p`,{children:`The model is unresponsive: the source action continues, or the edit arrives only after the incompatible source event has already been replayed.`})]}),(0,m.jsxs)(`article`,{className:`failure-mode-card failure-inventory`,children:[(0,m.jsx)(`span`,{children:`FM-2 · INVENTORY / INTERACTION`}),(0,m.jsx)(`h3`,{children:`The object appears on demand`}),(0,m.jsx)(`p`,{children:`A manipulated object materializes, disappears, or bypasses the intended physical relation instead of remaining the same source-owned instance.`})]}),(0,m.jsxs)(`article`,{className:`failure-mode-card failure-identity`,children:[(0,m.jsx)(`span`,{children:`FM-3 · SUBJECT / ROLE REPLACEMENT`}),(0,m.jsx)(`h3`,{children:`The interaction uses the wrong identity`}),(0,m.jsx)(`p`,{children:`Motion occurs, but the original actor or patient is replaced, re-rendered, or rebound. Plausible interaction cannot compensate for subject-preservation failure.`})]})]}),(0,m.jsxs)(`div`,{className:`progress-conclusion negative failure-gate-conclusion`,children:[(0,m.jsx)(`b`,{children:`Non-compensatory gates`}),(0,m.jsx)(`p`,{children:`Action response, same-instance continuity, interaction topology, and subject preservation must all pass.`})]})]}),(0,m.jsx)(T,{id:`local-action-recovery`,section:`I · MOTIVATION · SELF-GENERATED DEMONSTRATIONS`,title:`Recover Action Capability from Demonstrations`,subtitle:`Self-generated anchors reveal missing action mechanics; the editor should add only their source-faithful counterparts.`,tone:`gray`,children:(0,m.jsxs)(`div`,{className:`local-recovery-layout`,children:[(0,m.jsxs)(`figure`,{className:`local-recovery-figure`,children:[(0,m.jsx)(`div`,{className:`local-recovery-frame`,children:(0,m.jsx)(`img`,{src:`./paper/action_support_recovery.svg`,alt:`Original VADD manuscript diagram: self-generated demonstrations guide recovery of missing action capability under source preservation.`})}),(0,m.jsxs)(`figcaption`,{children:[(0,m.jsx)(`b`,{children:`Conceptual support-space view.`}),` Shapes encode capability-set relations only; their area, distance, and anchor count do not represent probability mass.`]})]}),(0,m.jsxs)(`div`,{className:`local-recovery-copy`,children:[(0,m.jsx)(ne,{kind:`provisional`}),(0,m.jsxs)(`article`,{children:[(0,m.jsx)(`span`,{children:`01 · BASE EVIDENCE`}),(0,m.jsx)(`h3`,{children:`Generation competence ≠ editing competence`}),(0,m.jsx)(`p`,{children:`Orange anchors show that frozen T2V can generate an action mode that source-conditioned editing may still miss.`})]}),(0,m.jsxs)(`article`,{children:[(0,m.jsx)(`span`,{children:`02 · TRANSFER RULE`}),(0,m.jsx)(`h3`,{children:`The anchor is evidence—not the target`}),(0,m.jsx)(`p`,{children:`Its actor, objects, scene, and camera may differ. Only qualified event mechanics can transfer.`})]}),(0,m.jsxs)(`article`,{children:[(0,m.jsx)(`span`,{children:`03 · LOCAL ADDITION`}),(0,m.jsx)(`h3`,{children:`Recover the source-faithful counterpart`}),(0,m.jsx)(`p`,{children:`The recovered action must express the requested behavior while preserving source-owned identity, inventory, background, and unrelated motion.`})]})]})]})}),(0,m.jsxs)(T,{id:`gap16-a`,section:`I · MOTIVATION · DIRECT FAILURE EVIDENCE`,title:`Failure Mode 1 — The Requested Event Never Starts`,subtitle:`Source-conditioned output can preserve source motion even when an action-only anchor makes the requested edit explicit.`,tone:`gray`,children:[(0,m.jsx)(ne,{kind:`established`}),(0,m.jsxs)(`div`,{className:`progress-case-stack`,children:[(0,m.jsx)(ie,{compact:!0,label:`Jellyfish drift → bell contraction`,children:(0,m.jsxs)(`div`,{className:`progress-case-row`,children:[(0,m.jsxs)(`div`,{className:`progress-case-copy`,children:[(0,m.jsx)(`span`,{children:`REQUESTED EVENT NEVER STARTS`}),(0,m.jsx)(`h3`,{children:`Jellyfish drift → bell contraction`}),(0,m.jsx)(`p`,{children:`Real target contracts into a ring and the anchor demonstrates strong bell-shape change. Frozen keeps the source jellyfish rounded and drifting; contraction never begins.`})]}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/10af6c651dbc/source.mp4`,label:`Source · rounded drift`}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/10af6c651dbc/real-target.mp4`,label:`Real target · contracts to ring`}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/10af6c651dbc/anchor.mp4`,label:`T2V anchor · motion evidence`}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/10af6c651dbc/frozen.mp4`,label:`Frozen base · rounded drift persists`})]})}),(0,m.jsx)(ie,{compact:!0,label:`Ordinary phone use → playful selfie`,children:(0,m.jsxs)(`div`,{className:`progress-case-row`,children:[(0,m.jsxs)(`div`,{className:`progress-case-copy`,children:[(0,m.jsx)(`span`,{children:`REQUESTED EVENT NEVER STARTS`}),(0,m.jsx)(`h3`,{children:`Playful selfie`}),(0,m.jsx)(`p`,{children:`Target and anchor lift the phone and add tongue/wink behavior; frozen continues ordinary phone use.`})]}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/7fa338474c75/source.mp4`,label:`Source`}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/7fa338474c75/real-target.mp4`,label:`Real target`}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/7fa338474c75/anchor.mp4`,label:`T2V anchor`}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/7fa338474c75/frozen.mp4`,label:`Frozen base`})]})})]}),(0,m.jsxs)(`div`,{className:`progress-conclusion negative compact-conclusion`,children:[(0,m.jsx)(`b`,{children:`Direct evidence for FM-1`}),(0,m.jsx)(`p`,{children:`Bell contraction and the playful selfie exist in the target and action-anchor branches, but neither requested transition starts reliably in frozen source-conditioned editing.`})]})]}),(0,m.jsxs)(T,{id:`gap16-late-endpoint`,section:`I · MOTIVATION · FULL-SEQUENCE EVIDENCE`,title:`A Late Target-Like Endpoint Is Not an Edit`,subtitle:`Frozen may reach part of the requested endpoint only after replaying most of the incompatible source sequence.`,tone:`gray`,children:[(0,m.jsx)(ne,{kind:`established`}),(0,m.jsxs)(`div`,{className:`progress-case-stack`,children:[(0,m.jsx)(ie,{compact:!0,label:`Dance in place → full scarf spin`,children:(0,m.jsxs)(`div`,{className:`progress-case-row`,children:[(0,m.jsxs)(`div`,{className:`progress-case-copy`,children:[(0,m.jsx)(`span`,{children:`DELAYED EDIT`}),(0,m.jsx)(`h3`,{children:`The spin arrives after the dance`}),(0,m.jsx)(`p`,{children:`Frozen replays source-like in-place scarf motion for most of the clip, then begins a late turn. A late spin does not replace the earlier source event.`})]}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/81533c9e56ec/source.mp4`,label:`Source · dances in place`}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/81533c9e56ec/real-target.mp4`,label:`Real target · full spin`}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/81533c9e56ec/anchor.mp4`,label:`T2V anchor · spin evidence`}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/81533c9e56ec/frozen.mp4`,label:`Frozen base · late turn`})]})}),(0,m.jsx)(ie,{compact:!0,label:`One-arm face cover → eye rub and two-hand cover`,children:(0,m.jsxs)(`div`,{className:`progress-case-row`,children:[(0,m.jsxs)(`div`,{className:`progress-case-copy`,children:[(0,m.jsx)(`span`,{children:`DELAYED EDIT`}),(0,m.jsx)(`h3`,{children:`The second hand arrives at the end`}),(0,m.jsx)(`p`,{children:`Frozen holds the source one-arm cover through most of the sequence, then adds the second hand late. Ordered eye-rubbing motion remains absent.`})]}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/d977ce147d80/source.mp4`,label:`Source · one-arm cover`}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/d977ce147d80/real-target.mp4`,label:`Real target · rub then cover`}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/d977ce147d80/anchor.mp4`,label:`T2V anchor · motion evidence`}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/d977ce147d80/frozen.mp4`,label:`Frozen base · late two-hand cover`})]})})]}),(0,m.jsxs)(`div`,{className:`progress-conclusion negative compact-conclusion`,children:[(0,m.jsx)(`b`,{children:`Onset and order are non-compensatory`}),(0,m.jsx)(`p`,{children:`Sparse endpoint frames can look compliant while the full video remains source-driven. Later target similarity cannot erase an incompatible event that already occurred.`})]})]}),(0,m.jsxs)(T,{id:`gap16-b`,section:`I · MOTIVATION · MANUAL FAILURE EVIDENCE`,title:`Failure Mode 1b — Source Motion Is Replayed Before the Edit`,subtitle:`A delayed or partial response is still failure when the incompatible source event has already occurred.`,children:[(0,m.jsx)(ne,{kind:`established`}),(0,m.jsxs)(`div`,{className:`progress-case-stack`,children:[(0,m.jsx)(ie,{compact:!0,label:`Turn and place the bottle on the treadmill`,children:(0,m.jsxs)(`div`,{className:`progress-case-row`,children:[(0,m.jsxs)(`div`,{className:`progress-case-copy`,children:[(0,m.jsx)(`span`,{children:`SOURCE MOTION IS REPLAYED`}),(0,m.jsx)(`h3`,{children:`Bottle placement`}),(0,m.jsx)(`p`,{children:`Target and anchor turn and place the bottle; frozen keeps holding it and facing forward.`})]}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/840b214afead/source.mp4`,label:`Source`}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/840b214afead/real-target.mp4`,label:`Real target`}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/840b214afead/anchor.mp4`,label:`T2V anchor`}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/840b214afead/frozen.mp4`,label:`Frozen base`})]})}),(0,m.jsx)(ie,{compact:!0,label:`Bow → stand upright and clap`,children:(0,m.jsxs)(`div`,{className:`progress-case-row`,children:[(0,m.jsxs)(`div`,{className:`progress-case-copy`,children:[(0,m.jsx)(`span`,{children:`SOURCE MOTION IS REPLAYED`}),(0,m.jsx)(`h3`,{children:`Bow → clap`}),(0,m.jsx)(`p`,{children:`Frozen first inherits the complete bow, then only partially brings the hands together near the end.`})]}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/d908552fb691/source.mp4`,label:`Source`}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/d908552fb691/real-target.mp4`,label:`Real target`}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/d908552fb691/anchor.mp4`,label:`T2V anchor`}),(0,m.jsx)(E,{compact:!0,src:`./evidence/gap16/d908552fb691/frozen.mp4`,label:`Frozen base`})]})})]}),(0,m.jsxs)(`div`,{className:`progress-conclusion negative compact-conclusion`,children:[(0,m.jsx)(`b`,{children:`Source-motion leakage`}),(0,m.jsx)(`p`,{children:`These frozen-editor examples retain the original source action. Check action execution together with subject and scene preservation.`})]})]}),(0,m.jsx)(T,{id:`gap-vjepa2-evidence`,section:`I · MOTIVATION · PAPER AUDIT`,title:`Self-Generated Demonstrations vs. Edited Outputs`,subtitle:`128 source–target pairs · frozen Bernini-R 1.3B`,children:(0,m.jsx)(`div`,{className:`p3-paper-audit`,children:(0,m.jsxs)(`table`,{"aria-label":`Self-generated demonstrations versus edited outputs on 128 pairs`,children:[(0,m.jsx)(`caption`,{children:`Ordered V-JEPA2 action margin and pairwise preference`}),(0,m.jsx)(`thead`,{children:(0,m.jsxs)(`tr`,{children:[(0,m.jsx)(`th`,{scope:`col`,children:`Candidate`}),(0,m.jsxs)(`th`,{scope:`col`,children:[`Mean `,(0,m.jsx)(g,{name:`action-margin`,alt:`m_act`})]}),(0,m.jsx)(`th`,{scope:`col`,children:`Metric preferred`}),(0,m.jsx)(`th`,{scope:`col`,children:`Human preferred`})]})}),(0,m.jsxs)(`tbody`,{children:[(0,m.jsxs)(`tr`,{className:`p3-audit-t2v`,children:[(0,m.jsx)(`th`,{scope:`row`,children:`Self-generated T2V`}),(0,m.jsx)(`td`,{children:`−0.01031`}),(0,m.jsx)(`td`,{children:`125 / 128`}),(0,m.jsx)(`td`,{children:`114 / 128`})]}),(0,m.jsxs)(`tr`,{children:[(0,m.jsx)(`th`,{scope:`row`,children:`Source-conditioned edit`}),(0,m.jsx)(`td`,{children:`−0.14660`}),(0,m.jsx)(`td`,{children:`3 / 128`}),(0,m.jsx)(`td`,{children:`12 / 128`})]}),(0,m.jsxs)(`tr`,{className:`p3-audit-tie`,children:[(0,m.jsx)(`th`,{scope:`row`,children:`Tie`}),(0,m.jsx)(`td`,{children:`—`}),(0,m.jsx)(`td`,{children:`0 / 128`}),(0,m.jsx)(`td`,{children:`2 / 128`})]})]})]})})}),(0,m.jsx)(C,{Slide:T}),(0,m.jsxs)(`div`,{className:`bottom-controls`,"aria-label":`Slide controls`,children:[(0,m.jsx)(`button`,{onClick:()=>a(e-1),disabled:e===0,"aria-label":`Previous slide`,children:`←`}),(0,m.jsx)(`button`,{onClick:()=>a(e+1),disabled:e===w.length-1,"aria-label":`Next slide`,children:`→`})]})]})}(0,u.hydrateRoot)(document.getElementById(`root`),(0,m.jsx)(ae,{})),requestAnimationFrame(()=>requestAnimationFrame(()=>{let e=decodeURIComponent(location.hash.slice(1));e&&document.getElementById(e)?.scrollIntoView({block:`start`})})); \ No newline at end of file diff --git a/projects/video-action-editing/evidence/gap16/0be6494dfac3/anchor.jpg b/projects/video-action-editing/evidence/gap16/0be6494dfac3/anchor.jpg new file mode 100644 index 0000000..ba2a726 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/0be6494dfac3/anchor.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/0be6494dfac3/anchor.mp4 b/projects/video-action-editing/evidence/gap16/0be6494dfac3/anchor.mp4 new file mode 100644 index 0000000..5d2c396 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/0be6494dfac3/anchor.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/0be6494dfac3/frozen.jpg b/projects/video-action-editing/evidence/gap16/0be6494dfac3/frozen.jpg new file mode 100644 index 0000000..41a4b03 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/0be6494dfac3/frozen.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/0be6494dfac3/frozen.mp4 b/projects/video-action-editing/evidence/gap16/0be6494dfac3/frozen.mp4 new file mode 100644 index 0000000..9627eed Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/0be6494dfac3/frozen.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/0be6494dfac3/real-target.jpg b/projects/video-action-editing/evidence/gap16/0be6494dfac3/real-target.jpg new file mode 100644 index 0000000..7bb12cf Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/0be6494dfac3/real-target.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/0be6494dfac3/real-target.mp4 b/projects/video-action-editing/evidence/gap16/0be6494dfac3/real-target.mp4 new file mode 100644 index 0000000..e0f134f Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/0be6494dfac3/real-target.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/0be6494dfac3/source.jpg b/projects/video-action-editing/evidence/gap16/0be6494dfac3/source.jpg new file mode 100644 index 0000000..e02360d Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/0be6494dfac3/source.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/0be6494dfac3/source.mp4 b/projects/video-action-editing/evidence/gap16/0be6494dfac3/source.mp4 new file mode 100644 index 0000000..9e01bb2 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/0be6494dfac3/source.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/10af6c651dbc/anchor.jpg b/projects/video-action-editing/evidence/gap16/10af6c651dbc/anchor.jpg new file mode 100644 index 0000000..2743f20 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/10af6c651dbc/anchor.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/10af6c651dbc/anchor.mp4 b/projects/video-action-editing/evidence/gap16/10af6c651dbc/anchor.mp4 new file mode 100644 index 0000000..cec1148 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/10af6c651dbc/anchor.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/10af6c651dbc/frozen.jpg b/projects/video-action-editing/evidence/gap16/10af6c651dbc/frozen.jpg new file mode 100644 index 0000000..dcb50ab Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/10af6c651dbc/frozen.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/10af6c651dbc/frozen.mp4 b/projects/video-action-editing/evidence/gap16/10af6c651dbc/frozen.mp4 new file mode 100644 index 0000000..e3ec4aa Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/10af6c651dbc/frozen.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/10af6c651dbc/real-target.jpg b/projects/video-action-editing/evidence/gap16/10af6c651dbc/real-target.jpg new file mode 100644 index 0000000..785e17a Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/10af6c651dbc/real-target.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/10af6c651dbc/real-target.mp4 b/projects/video-action-editing/evidence/gap16/10af6c651dbc/real-target.mp4 new file mode 100644 index 0000000..24ddf89 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/10af6c651dbc/real-target.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/10af6c651dbc/source.jpg b/projects/video-action-editing/evidence/gap16/10af6c651dbc/source.jpg new file mode 100644 index 0000000..e5fd68b Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/10af6c651dbc/source.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/10af6c651dbc/source.mp4 b/projects/video-action-editing/evidence/gap16/10af6c651dbc/source.mp4 new file mode 100644 index 0000000..c64c2cb Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/10af6c651dbc/source.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/7fa338474c75/anchor.jpg b/projects/video-action-editing/evidence/gap16/7fa338474c75/anchor.jpg new file mode 100644 index 0000000..a305dbe Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/7fa338474c75/anchor.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/7fa338474c75/anchor.mp4 b/projects/video-action-editing/evidence/gap16/7fa338474c75/anchor.mp4 new file mode 100644 index 0000000..777b17d Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/7fa338474c75/anchor.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/7fa338474c75/frozen.jpg b/projects/video-action-editing/evidence/gap16/7fa338474c75/frozen.jpg new file mode 100644 index 0000000..eb71d43 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/7fa338474c75/frozen.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/7fa338474c75/frozen.mp4 b/projects/video-action-editing/evidence/gap16/7fa338474c75/frozen.mp4 new file mode 100644 index 0000000..3f469a5 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/7fa338474c75/frozen.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/7fa338474c75/real-target.jpg b/projects/video-action-editing/evidence/gap16/7fa338474c75/real-target.jpg new file mode 100644 index 0000000..181cfaf Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/7fa338474c75/real-target.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/7fa338474c75/real-target.mp4 b/projects/video-action-editing/evidence/gap16/7fa338474c75/real-target.mp4 new file mode 100644 index 0000000..73868df Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/7fa338474c75/real-target.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/7fa338474c75/source.jpg b/projects/video-action-editing/evidence/gap16/7fa338474c75/source.jpg new file mode 100644 index 0000000..da6a93c Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/7fa338474c75/source.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/7fa338474c75/source.mp4 b/projects/video-action-editing/evidence/gap16/7fa338474c75/source.mp4 new file mode 100644 index 0000000..2467c76 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/7fa338474c75/source.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/81533c9e56ec/anchor.jpg b/projects/video-action-editing/evidence/gap16/81533c9e56ec/anchor.jpg new file mode 100644 index 0000000..8b327fb Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/81533c9e56ec/anchor.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/81533c9e56ec/anchor.mp4 b/projects/video-action-editing/evidence/gap16/81533c9e56ec/anchor.mp4 new file mode 100644 index 0000000..98cb000 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/81533c9e56ec/anchor.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/81533c9e56ec/frozen.jpg b/projects/video-action-editing/evidence/gap16/81533c9e56ec/frozen.jpg new file mode 100644 index 0000000..9714a82 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/81533c9e56ec/frozen.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/81533c9e56ec/frozen.mp4 b/projects/video-action-editing/evidence/gap16/81533c9e56ec/frozen.mp4 new file mode 100644 index 0000000..c4a04a5 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/81533c9e56ec/frozen.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/81533c9e56ec/real-target.jpg b/projects/video-action-editing/evidence/gap16/81533c9e56ec/real-target.jpg new file mode 100644 index 0000000..e372f7c Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/81533c9e56ec/real-target.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/81533c9e56ec/real-target.mp4 b/projects/video-action-editing/evidence/gap16/81533c9e56ec/real-target.mp4 new file mode 100644 index 0000000..a1e4e29 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/81533c9e56ec/real-target.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/81533c9e56ec/source.jpg b/projects/video-action-editing/evidence/gap16/81533c9e56ec/source.jpg new file mode 100644 index 0000000..d2e0ab8 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/81533c9e56ec/source.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/81533c9e56ec/source.mp4 b/projects/video-action-editing/evidence/gap16/81533c9e56ec/source.mp4 new file mode 100644 index 0000000..69704d8 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/81533c9e56ec/source.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/840b214afead/anchor.jpg b/projects/video-action-editing/evidence/gap16/840b214afead/anchor.jpg new file mode 100644 index 0000000..f12260b Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/840b214afead/anchor.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/840b214afead/anchor.mp4 b/projects/video-action-editing/evidence/gap16/840b214afead/anchor.mp4 new file mode 100644 index 0000000..807c6e7 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/840b214afead/anchor.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/840b214afead/frozen.jpg b/projects/video-action-editing/evidence/gap16/840b214afead/frozen.jpg new file mode 100644 index 0000000..534287e Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/840b214afead/frozen.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/840b214afead/frozen.mp4 b/projects/video-action-editing/evidence/gap16/840b214afead/frozen.mp4 new file mode 100644 index 0000000..a4e89d0 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/840b214afead/frozen.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/840b214afead/real-target.jpg b/projects/video-action-editing/evidence/gap16/840b214afead/real-target.jpg new file mode 100644 index 0000000..5e9834d Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/840b214afead/real-target.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/840b214afead/real-target.mp4 b/projects/video-action-editing/evidence/gap16/840b214afead/real-target.mp4 new file mode 100644 index 0000000..c4ba3ab Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/840b214afead/real-target.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/840b214afead/source.jpg b/projects/video-action-editing/evidence/gap16/840b214afead/source.jpg new file mode 100644 index 0000000..81e4afe Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/840b214afead/source.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/840b214afead/source.mp4 b/projects/video-action-editing/evidence/gap16/840b214afead/source.mp4 new file mode 100644 index 0000000..3b77543 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/840b214afead/source.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/d908552fb691/anchor.jpg b/projects/video-action-editing/evidence/gap16/d908552fb691/anchor.jpg new file mode 100644 index 0000000..77a49a0 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/d908552fb691/anchor.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/d908552fb691/anchor.mp4 b/projects/video-action-editing/evidence/gap16/d908552fb691/anchor.mp4 new file mode 100644 index 0000000..e25dc09 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/d908552fb691/anchor.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/d908552fb691/frozen.jpg b/projects/video-action-editing/evidence/gap16/d908552fb691/frozen.jpg new file mode 100644 index 0000000..22d82e5 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/d908552fb691/frozen.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/d908552fb691/frozen.mp4 b/projects/video-action-editing/evidence/gap16/d908552fb691/frozen.mp4 new file mode 100644 index 0000000..47f1fd4 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/d908552fb691/frozen.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/d908552fb691/real-target.jpg b/projects/video-action-editing/evidence/gap16/d908552fb691/real-target.jpg new file mode 100644 index 0000000..d906f49 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/d908552fb691/real-target.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/d908552fb691/real-target.mp4 b/projects/video-action-editing/evidence/gap16/d908552fb691/real-target.mp4 new file mode 100644 index 0000000..d2d1d22 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/d908552fb691/real-target.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/d908552fb691/source.jpg b/projects/video-action-editing/evidence/gap16/d908552fb691/source.jpg new file mode 100644 index 0000000..8cf92b0 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/d908552fb691/source.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/d908552fb691/source.mp4 b/projects/video-action-editing/evidence/gap16/d908552fb691/source.mp4 new file mode 100644 index 0000000..dfb0284 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/d908552fb691/source.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/d977ce147d80/anchor.jpg b/projects/video-action-editing/evidence/gap16/d977ce147d80/anchor.jpg new file mode 100644 index 0000000..8889ce4 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/d977ce147d80/anchor.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/d977ce147d80/anchor.mp4 b/projects/video-action-editing/evidence/gap16/d977ce147d80/anchor.mp4 new file mode 100644 index 0000000..ad2cb0d Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/d977ce147d80/anchor.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/d977ce147d80/frozen.jpg b/projects/video-action-editing/evidence/gap16/d977ce147d80/frozen.jpg new file mode 100644 index 0000000..ff3840f Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/d977ce147d80/frozen.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/d977ce147d80/frozen.mp4 b/projects/video-action-editing/evidence/gap16/d977ce147d80/frozen.mp4 new file mode 100644 index 0000000..93ccb90 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/d977ce147d80/frozen.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/d977ce147d80/real-target.jpg b/projects/video-action-editing/evidence/gap16/d977ce147d80/real-target.jpg new file mode 100644 index 0000000..6bfe0fa Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/d977ce147d80/real-target.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/d977ce147d80/real-target.mp4 b/projects/video-action-editing/evidence/gap16/d977ce147d80/real-target.mp4 new file mode 100644 index 0000000..08f92b3 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/d977ce147d80/real-target.mp4 differ diff --git a/projects/video-action-editing/evidence/gap16/d977ce147d80/source.jpg b/projects/video-action-editing/evidence/gap16/d977ce147d80/source.jpg new file mode 100644 index 0000000..3f9e663 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/d977ce147d80/source.jpg differ diff --git a/projects/video-action-editing/evidence/gap16/d977ce147d80/source.mp4 b/projects/video-action-editing/evidence/gap16/d977ce147d80/source.mp4 new file mode 100644 index 0000000..fc79cd5 Binary files /dev/null and b/projects/video-action-editing/evidence/gap16/d977ce147d80/source.mp4 differ diff --git a/projects/video-action-editing/index.html b/projects/video-action-editing/index.html new file mode 100644 index 0000000..e87da99 --- /dev/null +++ b/projects/video-action-editing/index.html @@ -0,0 +1,3 @@ +Video Action Editing + +
01 / 2514B comparison

Action Editing
VADD

VADD · Data generation, identifiable action anchors, and qualitative evidence

01

Change the requested action while preserving source content that the edit does not target.

THEORY invariance and action informationMETHOD source-conditioned action adaptersINFERENCE self-generated demonstrations

VADD learns action anchors from demonstrations and trains an editor to execute them under source conditioning. The data-generating process, identification result, method, and video evidence follow.

IMotivation
IIIdentifiable action anchors
IIIVADD editor
IVQualitative results

Change What Happens—Preserve Who and What

An action edit is valid only when the requested event occurs with the source-owned subjects and objects.

02
FM-1 · NO EDIT

The requested event never starts

The model is unresponsive: the source action continues, or the edit arrives only after the incompatible source event has already been replayed.

FM-2 · INVENTORY / INTERACTION

The object appears on demand

A manipulated object materializes, disappears, or bypasses the intended physical relation instead of remaining the same source-owned instance.

FM-3 · SUBJECT / ROLE REPLACEMENT

The interaction uses the wrong identity

Motion occurs, but the original actor or patient is replaced, re-rendered, or rebound. Plausible interaction cannot compensate for subject-preservation failure.

Non-compensatory gates

Action response, same-instance continuity, interaction topology, and subject preservation must all pass.

Recover Action Capability from Demonstrations

Self-generated anchors reveal missing action mechanics; the editor should add only their source-faithful counterparts.

03
Original VADD manuscript diagram: self-generated demonstrations guide recovery of missing action capability under source preservation.
Conceptual support-space view. Shapes encode capability-set relations only; their area, distance, and anchor count do not represent probability mass.
Provisional design
01 · BASE EVIDENCE

Generation competence ≠ editing competence

Orange anchors show that frozen T2V can generate an action mode that source-conditioned editing may still miss.

02 · TRANSFER RULE

The anchor is evidence—not the target

Its actor, objects, scene, and camera may differ. Only qualified event mechanics can transfer.

03 · LOCAL ADDITION

Recover the source-faithful counterpart

The recovered action must express the requested behavior while preserving source-owned identity, inventory, background, and unrelated motion.

Failure Mode 1 — The Requested Event Never Starts

Source-conditioned output can preserve source motion even when an action-only anchor makes the requested edit explicit.

04
Established evidence
Jellyfish drift → bell contraction
REQUESTED EVENT NEVER STARTS

Jellyfish drift → bell contraction

Real target contracts into a ring and the anchor demonstrates strong bell-shape change. Frozen keeps the source jellyfish rounded and drifting; contraction never begins.

Source · rounded drift
Real target · contracts to ring
T2V anchor · motion evidence
Frozen base · rounded drift persists
Ordinary phone use → playful selfie
REQUESTED EVENT NEVER STARTS

Playful selfie

Target and anchor lift the phone and add tongue/wink behavior; frozen continues ordinary phone use.

Source
Real target
T2V anchor
Frozen base
Direct evidence for FM-1

Bell contraction and the playful selfie exist in the target and action-anchor branches, but neither requested transition starts reliably in frozen source-conditioned editing.

A Late Target-Like Endpoint Is Not an Edit

Frozen may reach part of the requested endpoint only after replaying most of the incompatible source sequence.

05
Established evidence
Dance in place → full scarf spin
DELAYED EDIT

The spin arrives after the dance

Frozen replays source-like in-place scarf motion for most of the clip, then begins a late turn. A late spin does not replace the earlier source event.

Source · dances in place
Real target · full spin
T2V anchor · spin evidence
Frozen base · late turn
One-arm face cover → eye rub and two-hand cover
DELAYED EDIT

The second hand arrives at the end

Frozen holds the source one-arm cover through most of the sequence, then adds the second hand late. Ordered eye-rubbing motion remains absent.

Source · one-arm cover
Real target · rub then cover
T2V anchor · motion evidence
Frozen base · late two-hand cover
Onset and order are non-compensatory

Sparse endpoint frames can look compliant while the full video remains source-driven. Later target similarity cannot erase an incompatible event that already occurred.

Failure Mode 1b — Source Motion Is Replayed Before the Edit

A delayed or partial response is still failure when the incompatible source event has already occurred.

06
Established evidence
Turn and place the bottle on the treadmill
SOURCE MOTION IS REPLAYED

Bottle placement

Target and anchor turn and place the bottle; frozen keeps holding it and facing forward.

Source
Real target
T2V anchor
Frozen base
Bow → stand upright and clap
SOURCE MOTION IS REPLAYED

Bow → clap

Frozen first inherits the complete bow, then only partially brings the hands together near the end.

Source
Real target
T2V anchor
Frozen base
Source-motion leakage

These frozen-editor examples retain the original source action. Check action execution together with subject and scene preservation.

Self-Generated Demonstrations vs. Edited Outputs

128 source–target pairs · frozen Bernini-R 1.3B

07
Ordered V-JEPA2 action margin and pairwise preference
CandidateMean m_actMetric preferredHuman preferred
Self-generated T2V−0.01031125 / 128114 / 128
Source-conditioned edit−0.146603 / 12812 / 128
Tie—0 / 1282 / 128

Data Generating Process: Content × Action

VADD: Video Action Editing via Demonstrations and Disentanglement

08
Controlled dynamical process and a two-by-two content-action recombination diagram
GENERATE

Roll out an ordered trajectory

Content z^c is independent of the initial state, action regime u, and innovations. The renderer combines content with the full realized trajectory z^a_{0:T}.

EDIT

Recombine content and action

Preserve source content; transfer the demonstration’s trajectory, including its initial state and timing, within a fixed physical context.

SIMULATE

MuJoCo supplies controlled views

Replay physical motion under two block appearances. Physics evolves the objects; a fixed camera and lighting render each clip.

§2.1 + Appendix D · The strict controlled model fixes physical context; real consecutive-event clips approximate this coupling. Manuscript source ↗

When Does an Action Anchor Identify Action?

The positive pair shares the entire realized trajectory, not only the action label.

09
ACTION-PRESERVING VIEWSV = g_ctrl(z^c, F_T(w)), V⁺ = g_ctrl(z^{c+}, F_T(w)). Both views share the full realized trajectory.
POPULATION OBJECTIVEJ(E_a, P) = λ E‖E_a(V) − E_a(V⁺)‖² + E‖P(E_a(V)) − φ(V⁺)‖²_H_k, λ > 0. The two terms are labeled L_inv and L_pred.

Agreement removes appearance variation. Prediction of a characteristic kernel embedding retains differences between action-conditional video distributions.

Conditions for the theorem

  1. Regularity: compact supports and continuous dynamics / rendering.
  2. Appearance variation: independent, full-support content resampling, independent of the shared trajectory.
  3. Temporal observability: distinct trajectories cannot produce the same ordered video under supported content choices.

Optimize over continuous encoders, finite-risk predictors, and a code dimension admitting continuous injective trajectory coordinates.

AT EVERY POPULATION GLOBAL OPTIMUME_a(V) = h_a(z^a), P(h_a(z^a)) = μ_k(z^a), almost surely.

h_a is injective on a full-measure action subset; μ_k is the action-conditional kernel mean embedding. Individual semantic coordinates are not fixed.

§2.2 · Original manuscript equations. LaTeX source ↗ · Finite-data optimization and real-video patch views are outside this guarantee. Manuscript source ↗

Why the Ordered Video Matters

Three observations identify position, velocity, and acceleration; two can remain ambiguous.

10
NONLINEAR OBSERVATIONSp_t = p_0 + t v_0 + ½ t² u, x_t = ρ(c, p_t).
FirstMiddleLastSame endpoints, different acceleration

Temporal observability concerns the whole ordered clip. A single frame need not reveal the full action state.

Why ordinary mean prediction can fail

The multiplicative map ρ(c,p) = (cp,c) with symmetric nonzero content is invertible, yet E[V | z^a] = 0. Predicting this mean can erase all action differences.

Manuscript numerical check · T = 3
Mixing / objectivep R²v R²u R²Content R²
Shear · agreement + kernel1.001.000.970.00
Multiplicative · same objective1.001.001.000.00
When feature means suffice

In the additive-feature corollary, action differences must survive outside the appearance-variation subspace. Ordinary feature prediction then retains action.

§2.3 + Appendix E · R² values are three-seed means from the paper’s numerical experiment, separate from rendered-video examples. Manuscript source ↗

Learning Action Anchors from Demonstrations

A temporal model keeps ordered dynamics across spatial views of the same demonstration.

11
Paper VADD architecture: action anchor training, condition K, source-conditioned adapters, and behavior supervision
01

Observe dynamic features

Frozen features → temporal centering, signed changes, and local change magnitudes. Alternating patches supply two views.

02

Encode an action sequence

A bidirectional GRU predicts Gaussian posteriors. Their means are the action anchors; a recurrent, history-conditioned prior regularizes them.

03

Retain information and order

SmoothL1 dynamic reconstruction + view consistency + KL / temporal regularization and reverse, shuffle, repeated-frame controls.

ACTION-ANCHOR OBJECTIVEL_anchor = λ_obs L_obs + λ_view L_view + L_reg.

§3.1 · Same-scene patch views and mean-target SmoothL1 are practical surrogates for the population criterion. The prior is a temporal inductive bias. Manuscript source ↗

Source-Conditioned Action Injection

Action specifies the motion; the source provides the appearance and spatial context in which it is executed.

12
DEMONSTRATION V_rNormalized anchor

learned ordered action

+
DEMONSTRATION V_rCompressed V-JEPA2

complementary behavior features

→
DETACHED CONDITIONK(V_r)

phase-aligned feature concatenation

SOURCE-CONDITIONED LOW-RANK UPDATEΔu = α_k W_up [(W_u u) ⊙ tanh(W_k k) + (W_k k) ⊙ (1 + tanh(W_b b))].
GENERATED STATE · u

Adapt to the current token

The first term couples the demonstrated action to the current generated state.

SOURCE CONTEXT · b

Bind the action to the source

The second term modulates the action using spatial context from independently encoded source frames.

SAMPLING GATE · α_k

Inject early, refine later

Adapters act on visual self-attention value / output projections during the first 8 of 40 sampling steps.

Scope of the theory

The identified object is the learned mean code. Normalization can discard offsets and scale; the augmented packet K also includes V-JEPA2 features.

§3.2 + Appendix D · Frozen backbone and representation model; trainable residual adapters. Manuscript source ↗

Train on Behavior; Preserve Source Content

Supervise the decoded clean prediction with ordered behavior and source-preservation signals.

13
ORDERED BEHAVIOR READERγ_{j,k} = sim(e_J(V̂_{0|k}), e_J(V_j)).ℓ_act,k = 1 − γ_{+,k} − λ_disc log [exp(γ_{+,k}/τ) / Σ_{j∈K} exp(γ_{j,k}/τ)].
+ Demonstration− Source− Reversed− Shuffled

The frozen V-JEPA2 reader differentiates through generated videos. Demonstration and control descriptors are detached.

Source preservation

Compare patch sets and appearance statistics. Remove the gradient component opposing behavior, then cap preservation RMS at ¼ of the behavior-gradient RMS without amplifying it.

Training

1,508 real source–target pairs; real-target and offline-generated demonstrations at 3:1. Action-code warm-up precedes behavior supervision.

Inference on OmniBench

  1. Source + instruction → Qwen3-VL rewrites a T2V prompt.
  2. Frozen Bernini generates the demonstration.
  3. Extract K once and run the conditional sampler.

No real target is read; inference needs neither behavior-reader gradients nor per-example optimization.

§3.3 + §4.1 / Appendix D · Warm-up followed by behavior supervision; inference uses a self-generated demonstration. Manuscript source ↗

OmniEdit-Bench Temporal: Paper Results

Accuracy-gated scores from the manuscript · 0–100, higher is better · category counts in parentheses

14
MethodMotion semantic
(30)
Motion attribute
(50)
Temporal composition
(70)
Action
(150)
Camera
(50)
All
(200)
VACE6.807.5411.489.238.008.92
ReCo5.593.146.465.1816.437.99
OmniVideo232.5813.1512.6416.8014.7716.29
Kiwi-Edit29.3121.7019.3122.1115.3920.43
LiveEdit18.8013.9210.7913.447.3211.91
Bernini · frozen31.3621.5413.4619.7342.9925.55
VADD · ours34.9324.9617.6423.5446.1629.19
Direct-FM · reference38.2314.5615.8519.9025.8221.38
ACTION

+3.81 over Bernini

23.54 vs. 19.73 across 150 non-camera cases.

ALL TEMPORAL

+3.64 over Bernini

29.19 vs. 25.55 across all 200 cases.

READING THE NEXT TWO CASES

Selected qualitative examples

High-score cases are a showcase; the table summarizes the complete evaluation.

§4, Omni Temporal table · Direct-FM is a paired-target reference and is not ranked. The following archive scores use Qwen3-VL-32B / 12 frames. Manuscript source ↗

Delete the flying kiss

Delete the action of the girl giving a flying kiss, while maintaining the continuity of the video naturally.

15
0.0 / 0.0 s1× native speed
SourceOpen video ↗
OmniVideo2 · 1.3BScore 32.0Open video ↗
Lucy Edit · 5BScore 0.0Open video ↗
VACE · 1.3BScore 0.0Open video ↗
LiveEdit · 1.3BScore 0.0Open video ↗
Kiwi-Edit · 5BScore 0.0Open video ↗
ReCo · 1.3B + LoRAScore 0.0Open video ↗
OursScore 100.0Open video ↗

Clips start together at their original speed. Shorter clips hold their last frame; use the full video link for individual controls.

Make the man laugh happily

Make the man laugh happily.

16
0.0 / 0.0 s1× native speed
SourceOpen video ↗
OmniVideo2 · 1.3BScore 86.0Open video ↗
Lucy Edit · 5BScore 0.0Open video ↗
VACE · 1.3BScore 0.0Open video ↗
LiveEdit · 1.3BScore 30.8Open video ↗
Kiwi-Edit · 5BScore 0.0Open video ↗
ReCo · 1.3B + LoRAScore 0.0Open video ↗
OursScore 100.0Open video ↗

Clips start together at their original speed. Shorter clips hold their last frame; use the full video link for individual controls.

Push forward → Push right

Keep the source block appearance while following the demonstrated trajectory.

17
0.0 / 0.0 s1× native speed

Clips start together at their original speed. Shorter clips hold their last frame; use the full video link for individual controls.

Appearance × trajectory

Preserve source colors while following the reference motion. Compare the approach, direction changes, and final placement at 1× speed.

View sampled frames and audit records
Time →Frame 0Frame 27Frame 53Frame 80
SourceSource, frame 0Source, frame 27Source, frame 53Source, frame 80
ReferenceReference, frame 0Reference, frame 27Reference, frame 53Reference, frame 80
OursOurs, frame 0Ours, frame 27Ours, frame 53Ours, frame 80
Expected · audit onlyExpected · audit only, frame 0Expected · audit only, frame 27Expected · audit only, frame 53Expected · audit only, frame 80
Archived source recordArchived source record, frame 0Archived source record, frame 27Archived source record, frame 53Archived source record, frame 80
Archived self-reconstructionArchived self-reconstruction, frame 0Archived self-reconstruction, frame 27Archived self-reconstruction, frame 53Archived self-reconstruction, frame 80

Uses the manuscript’s author-confirmed my/source pairing. The paper’s provenance note records the older source archive as incorrect. Expected frames are audit-only. Pairing record ↗

Push forward-left → Push back-right

Keep the source block appearance while following the demonstrated trajectory.

18
0.0 / 0.0 s1× native speed

Clips start together at their original speed. Shorter clips hold their last frame; use the full video link for individual controls.

Appearance × trajectory

Preserve source colors while following the reference motion. Compare the approach, direction changes, and final placement at 1× speed.

View sampled frames and audit records
Time →Frame 0Frame 27Frame 53Frame 80
SourceSource, frame 0Source, frame 27Source, frame 53Source, frame 80
ReferenceReference, frame 0Reference, frame 27Reference, frame 53Reference, frame 80
OursOurs, frame 0Ours, frame 27Ours, frame 53Ours, frame 80
Expected · audit onlyExpected · audit only, frame 0Expected · audit only, frame 27Expected · audit only, frame 53Expected · audit only, frame 80
Archived source recordArchived source record, frame 0Archived source record, frame 27Archived source record, frame 53Archived source record, frame 80
Archived self-reconstructionArchived self-reconstruction, frame 0Archived self-reconstruction, frame 27Archived self-reconstruction, frame 53Archived self-reconstruction, frame 80

Uses the manuscript’s author-confirmed my/source pairing. The paper’s provenance note records the older source archive as incorrect. Expected frames are audit-only. Pairing record ↗

Holding a camera → Looking through it

Edit the action so that the woman raises her silver camera with both hands, bringing it up to her eye to look through the viewfinder.

19
0.0 / 0.0 s1× native speed
SourceOpen video ↗
OmniVideo2 · 1.3BOpen video ↗
Lucy Edit · 5BOpen video ↗
VACE · 1.3BOpen video ↗
LiveEdit · 1.3BOpen video ↗
Kiwi-Edit · 5BOpen video ↗
ReCo · 1.3B + LoRAOpen video ↗
OursOpen video ↗

Clips start together at their original speed. Shorter clips hold their last frame; use the full video link for individual controls.

Paired-real-target flow-matching variant; retained as labeled in the manuscript figure provenance. Asset provenance ↗

Static shot → Camera cranes up

Edit the action so that the camera cranes up, moving away from the couple and revealing a wide view of the sunlit forest and valley.

20
0.0 / 0.0 s1× native speed
SourceOpen video ↗
OmniVideo2 · 1.3BOpen video ↗
Lucy Edit · 5BOpen video ↗
VACE · 1.3BOpen video ↗
LiveEdit · 1.3BOpen video ↗
Kiwi-Edit · 5BOpen video ↗
ReCo · 1.3B + LoRAOpen video ↗
OursOpen video ↗

Clips start together at their original speed. Shorter clips hold their last frame; use the full video link for individual controls.

Paired-real-target flow-matching variant; retained as labeled in the manuscript figure provenance. Asset provenance ↗

Posing → Walking out of frame

Edit the action so that the smiling woman in a bikini walks from left to right past the camera by a pool, exiting the frame.

21
0.0 / 0.0 s1× native speed
SourceOpen video ↗
OmniVideo2 · 1.3BOpen video ↗
Lucy Edit · 5BOpen video ↗
VACE · 1.3BOpen video ↗
LiveEdit · 1.3BOpen video ↗
Kiwi-Edit · 5BOpen video ↗
ReCo · 1.3B + LoRAOpen video ↗
OursOpen video ↗

Clips start together at their original speed. Shorter clips hold their last frame; use the full video link for individual controls.

Paired-real-target flow-matching variant; retained as labeled in the manuscript figure provenance. Asset provenance ↗

Watching → Helping draw

Edit the action so that the mother helps her young daughter draw with colored pencils in a sketchbook at a wooden table.

22
0.0 / 0.0 s1× native speed
SourceOpen video ↗
OmniVideo2 · 1.3BOpen video ↗
Lucy Edit · 5BOpen video ↗
VACE · 1.3BOpen video ↗
LiveEdit · 1.3BOpen video ↗
Kiwi-Edit · 5BOpen video ↗
ReCo · 1.3B + LoRAOpen video ↗
OursOpen video ↗

Clips start together at their original speed. Shorter clips hold their last frame; use the full video link for individual controls.

Paired-real-target flow-matching variant; retained as labeled in the manuscript figure provenance. Asset provenance ↗

Typing → Stretching the back

Edit the action so that the woman working on a laptop at her desk suddenly experiences back pain and tries to stretch it out.

23
0.0 / 0.0 s1× native speed
SourceOpen video ↗
OmniVideo2 · 1.3BOpen video ↗
Lucy Edit · 5BOpen video ↗
VACE · 1.3BOpen video ↗
LiveEdit · 1.3BOpen video ↗
Kiwi-Edit · 5BOpen video ↗
ReCo · 1.3B + LoRAOpen video ↗
OursOpen video ↗

Clips start together at their original speed. Shorter clips hold their last frame; use the full video link for individual controls.

Paired-real-target flow-matching variant; retained as labeled in the manuscript figure provenance. Asset provenance ↗

Using a phone → Drinking from a mug

Edit the action so that the man wearing glasses looks at his smartphone and takes a drink from a white mug while sitting at his desk.

24
0.0 / 0.0 s1× native speed
SourceOpen video ↗
OmniVideo2 · 1.3BOpen video ↗
Lucy Edit · 5BOpen video ↗
VACE · 1.3BOpen video ↗
LiveEdit · 1.3BOpen video ↗
Kiwi-Edit · 5BOpen video ↗
ReCo · 1.3B + LoRAOpen video ↗
OursOpen video ↗

Clips start together at their original speed. Shorter clips hold their last frame; use the full video link for individual controls.

Paired-real-target flow-matching variant; retained as labeled in the manuscript figure provenance. Asset provenance ↗

From the Paper to the Evidence

A controlled theory, a practical editor, and visible motion transfer.

25
THEORY

Invariance + information retention

Independent appearance resampling and temporal observability identify the action block at population optimum.

METHOD

Demonstrate, encode, execute

Learn ordered action anchors, couple them to the source through early adapters, and supervise decoded behavior alongside preservation.

EVIDENCE

Keep the experimental tracks explicit

Controlled synthetic outputs, generated-reference Zebra, and the FM variant supply complementary qualitative evidence.

\ No newline at end of file diff --git a/projects/video-action-editing/large-fair12/index.html b/projects/video-action-editing/large-fair12/index.html new file mode 100644 index 0000000..df18f96 --- /dev/null +++ b/projects/video-action-editing/large-fair12/index.html @@ -0,0 +1,15 @@ +Bernini-R 14B / OmniVideo2-A14B · 固定 caption 对比

Bernini-R 14B / OmniVideo2-A14B · 固定 caption 对比

Bernini-R 14B · T2V 12/12 · OmniVideo2-A14B · T2V 12/12 · Bernini-R 14B · RV2V 12/12 · OmniVideo2-A14B · V2V 12/12

T2V 使用相同的最终目标描述、seed、81 帧、25 fps、40 步;Omni 的 Qwen 自由扩写已关闭,只提取既定文本的特征。Bernini 保留原生任务前缀。相同 caption 正文不代表不同模型的特征或采样器相同。

编辑分支同样使用该目标描述与相同源视频。Bernini RV2V 另取源视频第 0/27/53/80 帧作原生参考;Omni 保留原生视觉条件与双份文本上下文。Real target 仅供观察,完整目标片段已统一到 3.24 秒以同步播放。

比较条件与原生差异

共同条件:相同最终 caption 正文、逐例 seed、81 帧、25 fps、40 步;编辑使用同一源视频。T2V 均为 832×480。

Bernini 保留固定任务前缀和原生 RV2V 参考帧;编辑输出为 832×464。Omni 保留原生源视觉条件和双文本上下文;编辑输出为 832×480。两边引导方式不同,UniPC 有效 flow shift 分别为 3 和 5。本页控制 caption 一致,其余原生差异如实保留。

所有结果原样展示。视频文件有效不代表目标动作成功。

12 例固定输入与 caption 清单
1.3B 旧 caption 流程对比本批运行记录

提杠铃 · Barbell lift

Editing instruction:Edit the action so that the woman in a home gym lifts a barbell from the floor to her waist.

Source
Real target
Bernini-R 14B · T2V
实际文本与运行记录
OmniVideo2-A14B · T2V
实际文本与运行记录
Bernini-R 14B · RV2V
实际文本与运行记录
OmniVideo2-A14B · V2V
实际文本与运行记录

两模型共用的最终 caption 正文(无扩写):
The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.

fb7725c351ba · seed 2026081901 · caption SHA-256: b3337cc9b01e086c7969770d68fc6c6572e454e5fe1be64f770a6b7e1e30500d

狗转头 · Dog head turn

Editing instruction:Edit the action so that the dog turns its head further to the right while sitting in the grass.

Source
Real target
Bernini-R 14B · T2V
实际文本与运行记录
OmniVideo2-A14B · T2V
实际文本与运行记录
Bernini-R 14B · RV2V
实际文本与运行记录
OmniVideo2-A14B · V2V
实际文本与运行记录

两模型共用的最终 caption 正文(无扩写):
The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.

3fadbe0c2961 · seed 2026081902 · caption SHA-256: aaeb58cbd788e3a815962e6289b1853ca09f2ef13c69d98a1af484e67f9da178

长椅上写字 · Write in notebook

Editing instruction:Edit the action so that the young woman sitting on a park bench thoughtfully writes in her notebook with a pen.

Source
Real target
Bernini-R 14B · T2V
实际文本与运行记录
OmniVideo2-A14B · T2V
实际文本与运行记录
Bernini-R 14B · RV2V
实际文本与运行记录
OmniVideo2-A14B · V2V
实际文本与运行记录

两模型共用的最终 caption 正文(无扩写):
The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.

7077cfb160cf · seed 2026081904 · caption SHA-256: 0acdffedc18b04d2c2bef7d0a4e4e51544b75d4dd1f904e080d9e0490be24fb1

转身倚车 · Turn and lean on car

Editing instruction:Edit the action so that the woman in a black leather jacket and red pants turns and leans back against the hood of the black car.

Source
Real target
Bernini-R 14B · T2V
实际文本与运行记录
OmniVideo2-A14B · T2V
实际文本与运行记录
Bernini-R 14B · RV2V
实际文本与运行记录
OmniVideo2-A14B · V2V
实际文本与运行记录

两模型共用的最终 caption 正文(无扩写):
The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.

7e488525099e · seed 2026081906 · caption SHA-256: ed6115b291eb39710054250e5a6fd3e51f92ed3675fe1af1c5b45617396c3082

闭眼尝汤 · Taste from ladle

Editing instruction:Edit the action so that the woman in an apron closes her eyes as she tastes from a metal ladle.

Source
Real target
Bernini-R 14B · T2V
实际文本与运行记录
OmniVideo2-A14B · T2V
实际文本与运行记录
Bernini-R 14B · RV2V
实际文本与运行记录
OmniVideo2-A14B · V2V
实际文本与运行记录

两模型共用的最终 caption 正文(无扩写):
The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.

d5221a1b69d5 · seed 2026081907 · caption SHA-256: 043306a7c3eff9ad7a50db5bbf0d3b4a2d6dec27fb8c5b5f6a316382992bc71b

放下手机后翻身睡觉 · Put phone away and sleep

Editing instruction:Edit the action so that the man in bed puts his smartphone on the nightstand and turns over to go to sleep.

Source
Real target
Bernini-R 14B · T2V
实际文本与运行记录
OmniVideo2-A14B · T2V
实际文本与运行记录
Bernini-R 14B · RV2V
实际文本与运行记录
OmniVideo2-A14B · V2V
实际文本与运行记录

两模型共用的最终 caption 正文(无扩写):
The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.

40712e1341dc · seed 2026081911 · caption SHA-256: 24857d19e619899acd653ea104c6a5b68b895cdd4b5cc3637df661f694521907

Jellyfish contraction

Editing instruction:Edit the action so that the jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water.

Source
Real target
Bernini-R 14B · T2V
实际文本与运行记录
OmniVideo2-A14B · T2V
实际文本与运行记录
Bernini-R 14B · RV2V
实际文本与运行记录
OmniVideo2-A14B · V2V
实际文本与运行记录

两模型共用的最终 caption 正文(无扩写):
The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.

10af6c651dbc · seed 2026081910 · caption SHA-256: 790782c54c3fea6d88d28f9129501ef060ebc863cd6ead101f7a12563d43e383

Playful selfie

Editing instruction:Edit the action so that the woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking.

Source
Real target
Bernini-R 14B · T2V
实际文本与运行记录
OmniVideo2-A14B · T2V
实际文本与运行记录
Bernini-R 14B · RV2V
实际文本与运行记录
OmniVideo2-A14B · V2V
实际文本与运行记录

两模型共用的最终 caption 正文(无扩写):
The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.

7fa338474c75 · seed 2026081900 · caption SHA-256: f7d22ce2d98ed6adff42d53192e7204016d9035165349de21317c756823ac96e

Scarf spin

Editing instruction:Edit the action so that the woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf.

Source
Real target
Bernini-R 14B · T2V
实际文本与运行记录
OmniVideo2-A14B · T2V
实际文本与运行记录
Bernini-R 14B · RV2V
实际文本与运行记录
OmniVideo2-A14B · V2V
实际文本与运行记录

两模型共用的最终 caption 正文(无扩写):
The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.

81533c9e56ec · seed 2026081915 · caption SHA-256: f6e77c2c4c9a431ed92369c65484776cb036d47a4d72c6a19e11d2a4d5b09579

Rub eyes then cover face

Editing instruction:Edit the action so that the man lying on the couch rubs his tired eyes and covers his face with both hands.

Source
Real target
Bernini-R 14B · T2V
实际文本与运行记录
OmniVideo2-A14B · T2V
实际文本与运行记录
Bernini-R 14B · RV2V
实际文本与运行记录
OmniVideo2-A14B · V2V
实际文本与运行记录

两模型共用的最终 caption 正文(无扩写):
The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.

d977ce147d80 · seed 2026081905 · caption SHA-256: a217f2a0d32d07e58d5c5781d12d401ed7a08f25d9286ea9f0bee5c25677e960

Place bottle on treadmill

Editing instruction:Edit the action so that the woman turns her head to the left and places her water bottle onto the treadmill.

Source
Real target
Bernini-R 14B · T2V
实际文本与运行记录
OmniVideo2-A14B · T2V
实际文本与运行记录
Bernini-R 14B · RV2V
实际文本与运行记录
OmniVideo2-A14B · V2V
实际文本与运行记录

两模型共用的最终 caption 正文(无扩写):
The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.

840b214afead · seed 2026081913 · caption SHA-256: fe3b668a66485813f97192ae443c497bc34efcc6edbd10bbdf8af1724af85247

Bow to clap

Editing instruction:Edit the action so that the woman in a taekwondo uniform stands in profile and claps her hands together in front of her.

Source
Real target
Bernini-R 14B · T2V
实际文本与运行记录
OmniVideo2-A14B · T2V
实际文本与运行记录
Bernini-R 14B · RV2V
实际文本与运行记录
OmniVideo2-A14B · V2V
实际文本与运行记录

两模型共用的最终 caption 正文(无扩写):
The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.

d908552fb691 · seed 2026081903 · caption SHA-256: 025f04cb7e601915763666a56d60e01f88ed30d6efa85a172c0cf38eff834896
\ No newline at end of file diff --git a/projects/video-action-editing/large-fair12/inputs.json b/projects/video-action-editing/large-fair12/inputs.json new file mode 100644 index 0000000..027c230 --- /dev/null +++ b/projects/video-action-editing/large-fair12/inputs.json @@ -0,0 +1,162 @@ +{ + "schema_version": "large-fair12-fixed-caption-v1", + "models": [ + "ByteDance/Bernini-R-Diffusers", + "Fudan-FUXI/OmniVideo2-A14B" + ], + "arms": [ + "t2v", + "editing" + ], + "caption_policy": "Shared final body, target action verbatim followed by manually reviewed static identity/scene context. No automatic caption generation or rewriting. Native fixed task prefixes and feature extraction retained and recorded.", + "caption_context_source": "Existing MEV metadata reviewed to remove non-target actions; no target video passed to inference.", + "frames": 81, + "fps": 25, + "steps": 40, + "cases": [ + { + "index": 0, + "case_id": "10af6c651dbc", + "name": "Jellyfish contraction", + "seed": 2026081910, + "original_instruction": "Edit the action so that the jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water.", + "target_action_caption": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water.", + "caption": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "caption_sha256": "790782c54c3fea6d88d28f9129501ef060ebc863cd6ead101f7a12563d43e383", + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/10af6c651dbc/source-exact81.mp4", + "source_sha256": "ea86ef53e403f1cc602594cc3623a2fb66fb9b2f65c1461ef2bf62bee82a35fb" + }, + { + "index": 1, + "case_id": "7fa338474c75", + "name": "Playful selfie", + "seed": 2026081900, + "original_instruction": "Edit the action so that the woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking.", + "target_action_caption": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking.", + "caption": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "caption_sha256": "f7d22ce2d98ed6adff42d53192e7204016d9035165349de21317c756823ac96e", + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7fa338474c75/source-exact81.mp4", + "source_sha256": "4278c748fa1fdd54d908c366a781df33d3e4eb1acc1c2b7bd3492659c66a9840" + }, + { + "index": 2, + "case_id": "81533c9e56ec", + "name": "Scarf spin", + "seed": 2026081915, + "original_instruction": "Edit the action so that the woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf.", + "target_action_caption": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf.", + "caption": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "caption_sha256": "f6e77c2c4c9a431ed92369c65484776cb036d47a4d72c6a19e11d2a4d5b09579", + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/81533c9e56ec/source-exact81.mp4", + "source_sha256": "6daa80d3ac407b01f842ce6fa611b3ec6c421851525f0845779143c4577e0b19" + }, + { + "index": 3, + "case_id": "d977ce147d80", + "name": "Rub eyes then cover face", + "seed": 2026081905, + "original_instruction": "Edit the action so that the man lying on the couch rubs his tired eyes and covers his face with both hands.", + "target_action_caption": "The man lying on the couch rubs his tired eyes and covers his face with both hands.", + "caption": "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "caption_sha256": "a217f2a0d32d07e58d5c5781d12d401ed7a08f25d9286ea9f0bee5c25677e960", + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d977ce147d80/source-exact81.mp4", + "source_sha256": "e2a056e1af423be25a5beb4b75d1145fbacd625e3316a8e64b6031e75739f80d" + }, + { + "index": 4, + "case_id": "840b214afead", + "name": "Place bottle on treadmill", + "seed": 2026081913, + "original_instruction": "Edit the action so that the woman turns her head to the left and places her water bottle onto the treadmill.", + "target_action_caption": "The woman turns her head to the left and places her water bottle onto the treadmill.", + "caption": "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "caption_sha256": "fe3b668a66485813f97192ae443c497bc34efcc6edbd10bbdf8af1724af85247", + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/840b214afead/source-exact81.mp4", + "source_sha256": "a6e42a447d7fef26b073878c551a631afd6371987910a332e51e4a9e4dfb4646" + }, + { + "index": 5, + "case_id": "d908552fb691", + "name": "Bow to clap", + "seed": 2026081903, + "original_instruction": "Edit the action so that the woman in a taekwondo uniform stands in profile and claps her hands together in front of her.", + "target_action_caption": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her.", + "caption": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "caption_sha256": "025f04cb7e601915763666a56d60e01f88ed30d6efa85a172c0cf38eff834896", + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d908552fb691/source-exact81.mp4", + "source_sha256": "56e1faa78c02c32d6da71354e8434241c8e9a4c334da4ac8aa4415148b6230bb" + }, + { + "index": 6, + "case_id": "fb7725c351ba", + "name": "提杠铃 · Barbell lift", + "seed": 2026081901, + "original_instruction": "Edit the action so that the woman in a home gym lifts a barbell from the floor to her waist.", + "target_action_caption": "The woman in a home gym lifts a barbell from the floor to her waist.", + "caption": "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "caption_sha256": "b3337cc9b01e086c7969770d68fc6c6572e454e5fe1be64f770a6b7e1e30500d", + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/fb7725c351ba/source-exact81.mp4", + "source_sha256": "479ee891773dfffc3299149103ee2ef37f4bb63f213b1c4c7cbd5391ebd4704a" + }, + { + "index": 7, + "case_id": "3fadbe0c2961", + "name": "狗转头 · Dog head turn", + "seed": 2026081902, + "original_instruction": "Edit the action so that the dog turns its head further to the right while sitting in the grass.", + "target_action_caption": "The dog turns its head further to the right while sitting in the grass.", + "caption": "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "caption_sha256": "aaeb58cbd788e3a815962e6289b1853ca09f2ef13c69d98a1af484e67f9da178", + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/3fadbe0c2961/source-exact81.mp4", + "source_sha256": "99170f8a711a3d5a3e930a995561646ac557366cf92f5ded7ac13c6a986f8364" + }, + { + "index": 8, + "case_id": "7077cfb160cf", + "name": "长椅上写字 · Write in notebook", + "seed": 2026081904, + "original_instruction": "Edit the action so that the young woman sitting on a park bench thoughtfully writes in her notebook with a pen.", + "target_action_caption": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen.", + "caption": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "caption_sha256": "0acdffedc18b04d2c2bef7d0a4e4e51544b75d4dd1f904e080d9e0490be24fb1", + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7077cfb160cf/source-exact81.mp4", + "source_sha256": "cef4c183b459c8aad72cdc81f3e6b2766a36fc22156bf382dd36c29cec6d5aa9" + }, + { + "index": 9, + "case_id": "7e488525099e", + "name": "转身倚车 · Turn and lean on car", + "seed": 2026081906, + "original_instruction": "Edit the action so that the woman in a black leather jacket and red pants turns and leans back against the hood of the black car.", + "target_action_caption": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car.", + "caption": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "caption_sha256": "ed6115b291eb39710054250e5a6fd3e51f92ed3675fe1af1c5b45617396c3082", + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7e488525099e/source-exact81.mp4", + "source_sha256": "1f3cec72bef55b67c15ebfc063252cce867ea128594a225db61688ff961b35d4" + }, + { + "index": 10, + "case_id": "d5221a1b69d5", + "name": "闭眼尝汤 · Taste from ladle", + "seed": 2026081907, + "original_instruction": "Edit the action so that the woman in an apron closes her eyes as she tastes from a metal ladle.", + "target_action_caption": "The woman in an apron closes her eyes as she tastes from a metal ladle.", + "caption": "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "caption_sha256": "043306a7c3eff9ad7a50db5bbf0d3b4a2d6dec27fb8c5b5f6a316382992bc71b", + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d5221a1b69d5/source-exact81.mp4", + "source_sha256": "fdd1b3df4b94449dc59cd04d03deb769fb2cf6c4c2d7b87221e2b3a6b5557d14" + }, + { + "index": 11, + "case_id": "40712e1341dc", + "name": "放下手机后翻身睡觉 · Put phone away and sleep", + "seed": 2026081911, + "original_instruction": "Edit the action so that the man in bed puts his smartphone on the nightstand and turns over to go to sleep.", + "target_action_caption": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep.", + "caption": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "caption_sha256": "24857d19e619899acd653ea104c6a5b68b895cdd4b5cc3637df661f694521907", + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/40712e1341dc/source-exact81.mp4", + "source_sha256": "654e997c46a6f78a2ad78359b713767aefe61a6cc732b5be4527720323349f69" + } + ] +} diff --git a/projects/video-action-editing/large-fair12/results/10af6c651dbc/bernini_editing.jpg b/projects/video-action-editing/large-fair12/results/10af6c651dbc/bernini_editing.jpg new file mode 100644 index 0000000..216f07c Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/10af6c651dbc/bernini_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/10af6c651dbc/bernini_editing.json b/projects/video-action-editing/large-fair12/results/10af6c651dbc/bernini_editing.json new file mode 100644 index 0000000..fc251ef --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/10af6c651dbc/bernini_editing.json @@ -0,0 +1,109 @@ +{ + "status": "complete", + "case_id": "10af6c651dbc", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "caption_sha256": "790782c54c3fea6d88d28f9129501ef060ebc863cd6ead101f7a12563d43e383", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 104, + "prompt_truncated": false, + "seed": 2026081910, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/10af6c651dbc/source-exact81.mp4", + "source_sha256": "ea86ef53e403f1cc602594cc3623a2fb66fb9b2f65c1461ef2bf62bee82a35fb", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_max", + "sigma_min", + "shift_terminal" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "82c8810cd7546c2d6ea80743c3c90d4a926e37f5099790e2b6acf5fc19c77510", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:36:06.353806+00:00", + "elapsed_seconds": 1623.09, + "job": "214745", + "hostname": "auh7-1b-gpu-282", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/10af6c651dbc/bernini_editing.mp4 b/projects/video-action-editing/large-fair12/results/10af6c651dbc/bernini_editing.mp4 new file mode 100644 index 0000000..f2a0d05 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/10af6c651dbc/bernini_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/10af6c651dbc/bernini_t2v.jpg b/projects/video-action-editing/large-fair12/results/10af6c651dbc/bernini_t2v.jpg new file mode 100644 index 0000000..32acb1a Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/10af6c651dbc/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/10af6c651dbc/bernini_t2v.json b/projects/video-action-editing/large-fair12/results/10af6c651dbc/bernini_t2v.json new file mode 100644 index 0000000..c645768 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/10af6c651dbc/bernini_t2v.json @@ -0,0 +1,104 @@ +{ + "status": "complete", + "case_id": "10af6c651dbc", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "caption_sha256": "790782c54c3fea6d88d28f9129501ef060ebc863cd6ead101f7a12563d43e383", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 65, + "prompt_truncated": false, + "seed": 2026081910, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "shift_terminal", + "sigma_min", + "sigma_max" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "99c080cb8ebc719e47354dbc79ba641c7ffcc30c355bbafd05335903314ba8d8", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:04:25.056432+00:00", + "elapsed_seconds": 579.95, + "job": "214700", + "hostname": "auh7-1b-gpu-282", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/10af6c651dbc/bernini_t2v.mp4 b/projects/video-action-editing/large-fair12/results/10af6c651dbc/bernini_t2v.mp4 new file mode 100644 index 0000000..eb5b331 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/10af6c651dbc/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/10af6c651dbc/omni_editing.jpg b/projects/video-action-editing/large-fair12/results/10af6c651dbc/omni_editing.jpg new file mode 100644 index 0000000..a899257 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/10af6c651dbc/omni_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/10af6c651dbc/omni_editing.json b/projects/video-action-editing/large-fair12/results/10af6c651dbc/omni_editing.json new file mode 100644 index 0000000..b1c5777 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/10af6c651dbc/omni_editing.json @@ -0,0 +1,72 @@ +{ + "status": "complete", + "case_id": "10af6c651dbc", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "caption_sha256": "790782c54c3fea6d88d28f9129501ef060ebc863cd6ead101f7a12563d43e383", + "actual_t5_text": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "10af6c651dbc", + "arm": "editing", + "caption": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "caption_sha256": "790782c54c3fea6d88d28f9129501ef060ebc863cd6ead101f7a12563d43e383", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/10af6c651dbc/source-exact81.mp4", + "source_sha256": "ea86ef53e403f1cc602594cc3623a2fb66fb9b2f65c1461ef2bf62bee82a35fb", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 74, + 2048 + ], + "feature_sha256": "31d5a8e438020fe75f1d26e7ad419c5e28ba4983c9e49203dd1a52efd9017d75" + }, + "t5_text_inputs": [ + "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081910, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/10af6c651dbc/source-exact81.mp4", + "source_sha256": "ea86ef53e403f1cc602594cc3623a2fb66fb9b2f65c1461ef2bf62bee82a35fb", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "d7a3b42e059c8ac6133f96b2fc4664509d504c9f821f45cc24d9d99acb151d44", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:56:21.408682+00:00", + "elapsed_seconds": 921.01, + "job": "214733", + "hostname": "auh7-1b-gpu-320", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/10af6c651dbc/omni_editing.mp4 b/projects/video-action-editing/large-fair12/results/10af6c651dbc/omni_editing.mp4 new file mode 100644 index 0000000..99cfa78 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/10af6c651dbc/omni_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/10af6c651dbc/omni_t2v.jpg b/projects/video-action-editing/large-fair12/results/10af6c651dbc/omni_t2v.jpg new file mode 100644 index 0000000..3f7572e Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/10af6c651dbc/omni_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/10af6c651dbc/omni_t2v.json b/projects/video-action-editing/large-fair12/results/10af6c651dbc/omni_t2v.json new file mode 100644 index 0000000..08ef732 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/10af6c651dbc/omni_t2v.json @@ -0,0 +1,66 @@ +{ + "status": "complete", + "case_id": "10af6c651dbc", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "caption_sha256": "790782c54c3fea6d88d28f9129501ef060ebc863cd6ead101f7a12563d43e383", + "actual_t5_text": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "10af6c651dbc", + "arm": "t2v", + "caption": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "caption_sha256": "790782c54c3fea6d88d28f9129501ef060ebc863cd6ead101f7a12563d43e383", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 47, + 2048 + ], + "feature_sha256": "b1d9193dbd160064ceb99196242d2707a2f74e510993302982dac03e6b713c01" + }, + "t5_text_inputs": [ + "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081910, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "1d1edd0eef41ff1fcde1a1bd662fdb47694a3b9ed60e458e83e842af441f9eb6", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:18:02.505227+00:00", + "elapsed_seconds": 608.46, + "job": "214721", + "hostname": "auh7-1b-gpu-312", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/10af6c651dbc/omni_t2v.mp4 b/projects/video-action-editing/large-fair12/results/10af6c651dbc/omni_t2v.mp4 new file mode 100644 index 0000000..fa25e1d Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/10af6c651dbc/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/3fadbe0c2961/bernini_editing.jpg b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/bernini_editing.jpg new file mode 100644 index 0000000..7b22911 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/bernini_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/3fadbe0c2961/bernini_editing.json b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/bernini_editing.json new file mode 100644 index 0000000..3c2fd57 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/bernini_editing.json @@ -0,0 +1,109 @@ +{ + "status": "complete", + "case_id": "3fadbe0c2961", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "caption_sha256": "aaeb58cbd788e3a815962e6289b1853ca09f2ef13c69d98a1af484e67f9da178", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 102, + "prompt_truncated": false, + "seed": 2026081902, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/3fadbe0c2961/source-exact81.mp4", + "source_sha256": "99170f8a711a3d5a3e930a995561646ac557366cf92f5ded7ac13c6a986f8364", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_min", + "sigma_max", + "shift_terminal" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "59ddf05fd48e62dffbc27aac5a721cb7198c40d526c06479056695547d9cf48f", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:49:23.038345+00:00", + "elapsed_seconds": 1621.77, + "job": "214751", + "hostname": "auh7-1b-gpu-307", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/3fadbe0c2961/bernini_editing.mp4 b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/bernini_editing.mp4 new file mode 100644 index 0000000..f25eb23 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/bernini_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/3fadbe0c2961/bernini_t2v.jpg b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/bernini_t2v.jpg new file mode 100644 index 0000000..46f6315 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/3fadbe0c2961/bernini_t2v.json b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/bernini_t2v.json new file mode 100644 index 0000000..2938bca --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/bernini_t2v.json @@ -0,0 +1,104 @@ +{ + "status": "complete", + "case_id": "3fadbe0c2961", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "caption_sha256": "aaeb58cbd788e3a815962e6289b1853ca09f2ef13c69d98a1af484e67f9da178", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 63, + "prompt_truncated": false, + "seed": 2026081902, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "shift_terminal", + "sigma_min", + "sigma_max" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "dc894ddffe1960fa0a845b2bbf03c37162d8b496e887ef535bed5cbf2ace9616", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:45:29.419504+00:00", + "elapsed_seconds": 706.21, + "job": "214706", + "hostname": "auh7-1b-gpu-269", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/3fadbe0c2961/bernini_t2v.mp4 b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/bernini_t2v.mp4 new file mode 100644 index 0000000..aad94a1 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/3fadbe0c2961/omni_editing.jpg b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/omni_editing.jpg new file mode 100644 index 0000000..385ab6c Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/omni_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/3fadbe0c2961/omni_editing.json b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/omni_editing.json new file mode 100644 index 0000000..585ccaa --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/omni_editing.json @@ -0,0 +1,72 @@ +{ + "status": "complete", + "case_id": "3fadbe0c2961", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "caption_sha256": "aaeb58cbd788e3a815962e6289b1853ca09f2ef13c69d98a1af484e67f9da178", + "actual_t5_text": "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "3fadbe0c2961", + "arm": "editing", + "caption": "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "caption_sha256": "aaeb58cbd788e3a815962e6289b1853ca09f2ef13c69d98a1af484e67f9da178", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/3fadbe0c2961/source-exact81.mp4", + "source_sha256": "99170f8a711a3d5a3e930a995561646ac557366cf92f5ded7ac13c6a986f8364", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 78, + 2048 + ], + "feature_sha256": "5607250394671775f7a81e3929b7e9ff08652121e7def64d0a370240e1f6e2ce" + }, + "t5_text_inputs": [ + "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081902, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/3fadbe0c2961/source-exact81.mp4", + "source_sha256": "99170f8a711a3d5a3e930a995561646ac557366cf92f5ded7ac13c6a986f8364", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "87aa2a665e5c451327950cf7eaa217e0f10ba00a2dac3f85af22489eb046501b", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:07:32.501671+00:00", + "elapsed_seconds": 637.79, + "job": "214739", + "hostname": "auh7-1b-gpu-282", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/3fadbe0c2961/omni_editing.mp4 b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/omni_editing.mp4 new file mode 100644 index 0000000..f524ffe Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/omni_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/3fadbe0c2961/omni_t2v.jpg b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/omni_t2v.jpg new file mode 100644 index 0000000..bbf38da Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/omni_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/3fadbe0c2961/omni_t2v.json b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/omni_t2v.json new file mode 100644 index 0000000..d884a57 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/omni_t2v.json @@ -0,0 +1,66 @@ +{ + "status": "complete", + "case_id": "3fadbe0c2961", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "caption_sha256": "aaeb58cbd788e3a815962e6289b1853ca09f2ef13c69d98a1af484e67f9da178", + "actual_t5_text": "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "3fadbe0c2961", + "arm": "t2v", + "caption": "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "caption_sha256": "aaeb58cbd788e3a815962e6289b1853ca09f2ef13c69d98a1af484e67f9da178", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 51, + 2048 + ], + "feature_sha256": "13a1edc8e7db94239ea6c6049d5691001949d9c95c3900fb5bbfd9298401f18a" + }, + "t5_text_inputs": [ + "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081902, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "e92d7a1bcddf3582e33dbd1b93244e9a12de37a18ea27ffff2088f026e3584ec", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:35:53.507686+00:00", + "elapsed_seconds": 637.05, + "job": "214727", + "hostname": "auh7-1b-gpu-307", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/3fadbe0c2961/omni_t2v.mp4 b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/omni_t2v.mp4 new file mode 100644 index 0000000..65c4b34 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/3fadbe0c2961/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/40712e1341dc/bernini_editing.jpg b/projects/video-action-editing/large-fair12/results/40712e1341dc/bernini_editing.jpg new file mode 100644 index 0000000..88b19c1 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/40712e1341dc/bernini_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/40712e1341dc/bernini_editing.json b/projects/video-action-editing/large-fair12/results/40712e1341dc/bernini_editing.json new file mode 100644 index 0000000..69ce857 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/40712e1341dc/bernini_editing.json @@ -0,0 +1,109 @@ +{ + "status": "complete", + "case_id": "40712e1341dc", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "caption_sha256": "24857d19e619899acd653ea104c6a5b68b895cdd4b5cc3637df661f694521907", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 113, + "prompt_truncated": false, + "seed": 2026081911, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/40712e1341dc/source-exact81.mp4", + "source_sha256": "654e997c46a6f78a2ad78359b713767aefe61a6cc732b5be4527720323349f69", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "shift_terminal", + "sigma_max", + "sigma_min" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "d6b8387a8f977f88fec1fa6f16ef0ad0ae9c22554a74bb661014ad6260532037", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T22:30:33.960692+00:00", + "elapsed_seconds": 1605.68, + "job": "214755", + "hostname": "auh7-1b-gpu-283", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/40712e1341dc/bernini_editing.mp4 b/projects/video-action-editing/large-fair12/results/40712e1341dc/bernini_editing.mp4 new file mode 100644 index 0000000..97b0c82 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/40712e1341dc/bernini_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/40712e1341dc/bernini_t2v.jpg b/projects/video-action-editing/large-fair12/results/40712e1341dc/bernini_t2v.jpg new file mode 100644 index 0000000..d0408e2 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/40712e1341dc/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/40712e1341dc/bernini_t2v.json b/projects/video-action-editing/large-fair12/results/40712e1341dc/bernini_t2v.json new file mode 100644 index 0000000..9fb1449 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/40712e1341dc/bernini_t2v.json @@ -0,0 +1,104 @@ +{ + "status": "complete", + "case_id": "40712e1341dc", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "caption_sha256": "24857d19e619899acd653ea104c6a5b68b895cdd4b5cc3637df661f694521907", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 74, + "prompt_truncated": false, + "seed": 2026081911, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_min", + "sigma_max", + "shift_terminal" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "ac158010a45d2c746774740d9a513440d29ac8d82604895d75b41c73e1461eef", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:45:13.322144+00:00", + "elapsed_seconds": 482.84, + "job": "214710", + "hostname": "auh7-1b-gpu-283", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/40712e1341dc/bernini_t2v.mp4 b/projects/video-action-editing/large-fair12/results/40712e1341dc/bernini_t2v.mp4 new file mode 100644 index 0000000..268a24c Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/40712e1341dc/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/40712e1341dc/omni_editing.jpg b/projects/video-action-editing/large-fair12/results/40712e1341dc/omni_editing.jpg new file mode 100644 index 0000000..2fdb075 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/40712e1341dc/omni_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/40712e1341dc/omni_editing.json b/projects/video-action-editing/large-fair12/results/40712e1341dc/omni_editing.json new file mode 100644 index 0000000..6de9c88 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/40712e1341dc/omni_editing.json @@ -0,0 +1,72 @@ +{ + "status": "complete", + "case_id": "40712e1341dc", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "caption_sha256": "24857d19e619899acd653ea104c6a5b68b895cdd4b5cc3637df661f694521907", + "actual_t5_text": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "40712e1341dc", + "arm": "editing", + "caption": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "caption_sha256": "24857d19e619899acd653ea104c6a5b68b895cdd4b5cc3637df661f694521907", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/40712e1341dc/source-exact81.mp4", + "source_sha256": "654e997c46a6f78a2ad78359b713767aefe61a6cc732b5be4527720323349f69", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 88, + 2048 + ], + "feature_sha256": "17f26bdae837dadcbf1c11b139c2c9ba8cbaa805f2f35c4fff16b1a5a0a45f67" + }, + "t5_text_inputs": [ + "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081911, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/40712e1341dc/source-exact81.mp4", + "source_sha256": "654e997c46a6f78a2ad78359b713767aefe61a6cc732b5be4527720323349f69", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "271248625a365fabc0664f1e5f3cfadd94ad2179e17a2efa261b9d5926d3765b", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:20:56.467352+00:00", + "elapsed_seconds": 646.24, + "job": "214743", + "hostname": "auh7-1b-gpu-307", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/40712e1341dc/omni_editing.mp4 b/projects/video-action-editing/large-fair12/results/40712e1341dc/omni_editing.mp4 new file mode 100644 index 0000000..5f5cff0 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/40712e1341dc/omni_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/40712e1341dc/omni_t2v.jpg b/projects/video-action-editing/large-fair12/results/40712e1341dc/omni_t2v.jpg new file mode 100644 index 0000000..86764ce Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/40712e1341dc/omni_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/40712e1341dc/omni_t2v.json b/projects/video-action-editing/large-fair12/results/40712e1341dc/omni_t2v.json new file mode 100644 index 0000000..9abf792 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/40712e1341dc/omni_t2v.json @@ -0,0 +1,66 @@ +{ + "status": "complete", + "case_id": "40712e1341dc", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "caption_sha256": "24857d19e619899acd653ea104c6a5b68b895cdd4b5cc3637df661f694521907", + "actual_t5_text": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "40712e1341dc", + "arm": "t2v", + "caption": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "caption_sha256": "24857d19e619899acd653ea104c6a5b68b895cdd4b5cc3637df661f694521907", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 61, + 2048 + ], + "feature_sha256": "f953db0ef97435bed85eb46eb0a25136e1775f7d4342e1a435a9ed189580145c" + }, + "t5_text_inputs": [ + "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081911, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "9dafe547fd5b649dccbf097319e9f41141518721416a7a75534548dbf4f138e3", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T22:26:43.210982+00:00", + "elapsed_seconds": 958.87, + "job": "214756", + "hostname": "auh7-1b-gpu-210", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/40712e1341dc/omni_t2v.mp4 b/projects/video-action-editing/large-fair12/results/40712e1341dc/omni_t2v.mp4 new file mode 100644 index 0000000..6e2b258 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/40712e1341dc/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/7077cfb160cf/bernini_editing.jpg b/projects/video-action-editing/large-fair12/results/7077cfb160cf/bernini_editing.jpg new file mode 100644 index 0000000..05bb617 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7077cfb160cf/bernini_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/7077cfb160cf/bernini_editing.json b/projects/video-action-editing/large-fair12/results/7077cfb160cf/bernini_editing.json new file mode 100644 index 0000000..eec2b61 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/7077cfb160cf/bernini_editing.json @@ -0,0 +1,109 @@ +{ + "status": "complete", + "case_id": "7077cfb160cf", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "caption_sha256": "0acdffedc18b04d2c2bef7d0a4e4e51544b75d4dd1f904e080d9e0490be24fb1", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 107, + "prompt_truncated": false, + "seed": 2026081904, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7077cfb160cf/source-exact81.mp4", + "source_sha256": "cef4c183b459c8aad72cdc81f3e6b2766a36fc22156bf382dd36c29cec6d5aa9", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_max", + "sigma_min", + "shift_terminal" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "2b0371a6e0660520daf895823f2f74b556503b075578fe2dca02f5c398bd23e7", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T22:05:32.304246+00:00", + "elapsed_seconds": 2298.97, + "job": "214752", + "hostname": "auh7-1b-gpu-210", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/7077cfb160cf/bernini_editing.mp4 b/projects/video-action-editing/large-fair12/results/7077cfb160cf/bernini_editing.mp4 new file mode 100644 index 0000000..6d43d11 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7077cfb160cf/bernini_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/7077cfb160cf/bernini_t2v.jpg b/projects/video-action-editing/large-fair12/results/7077cfb160cf/bernini_t2v.jpg new file mode 100644 index 0000000..5e021da Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7077cfb160cf/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/7077cfb160cf/bernini_t2v.json b/projects/video-action-editing/large-fair12/results/7077cfb160cf/bernini_t2v.json new file mode 100644 index 0000000..cf5fe81 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/7077cfb160cf/bernini_t2v.json @@ -0,0 +1,104 @@ +{ + "status": "complete", + "case_id": "7077cfb160cf", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "caption_sha256": "0acdffedc18b04d2c2bef7d0a4e4e51544b75d4dd1f904e080d9e0490be24fb1", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 68, + "prompt_truncated": false, + "seed": 2026081904, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_min", + "shift_terminal", + "sigma_max" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "eaf121f7e20fa7dc7aa6d4d127b00180cb92fee67e1fdea5ff2fbc7b9be7d997", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T22:19:58.997189+00:00", + "elapsed_seconds": 705.61, + "job": "214757", + "hostname": "auh7-1b-gpu-269", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/7077cfb160cf/bernini_t2v.mp4 b/projects/video-action-editing/large-fair12/results/7077cfb160cf/bernini_t2v.mp4 new file mode 100644 index 0000000..9e698ff Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7077cfb160cf/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/7077cfb160cf/omni_editing.jpg b/projects/video-action-editing/large-fair12/results/7077cfb160cf/omni_editing.jpg new file mode 100644 index 0000000..7c08f9b Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7077cfb160cf/omni_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/7077cfb160cf/omni_editing.json b/projects/video-action-editing/large-fair12/results/7077cfb160cf/omni_editing.json new file mode 100644 index 0000000..62093d0 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/7077cfb160cf/omni_editing.json @@ -0,0 +1,72 @@ +{ + "status": "complete", + "case_id": "7077cfb160cf", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "caption_sha256": "0acdffedc18b04d2c2bef7d0a4e4e51544b75d4dd1f904e080d9e0490be24fb1", + "actual_t5_text": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "7077cfb160cf", + "arm": "editing", + "caption": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "caption_sha256": "0acdffedc18b04d2c2bef7d0a4e4e51544b75d4dd1f904e080d9e0490be24fb1", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7077cfb160cf/source-exact81.mp4", + "source_sha256": "cef4c183b459c8aad72cdc81f3e6b2766a36fc22156bf382dd36c29cec6d5aa9", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 80, + 2048 + ], + "feature_sha256": "70de5d8bbce06459f31e50438e02db4aae638a7c14eec75b64875ee09eb289cb" + }, + "t5_text_inputs": [ + "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081904, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7077cfb160cf/source-exact81.mp4", + "source_sha256": "cef4c183b459c8aad72cdc81f3e6b2766a36fc22156bf382dd36c29cec6d5aa9", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "3b158d997abb43e583b01b618a280bb0938570e81b73116ce351f2cb255e96af", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:08:05.180195+00:00", + "elapsed_seconds": 649.79, + "job": "214740", + "hostname": "auh7-1b-gpu-313", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/7077cfb160cf/omni_editing.mp4 b/projects/video-action-editing/large-fair12/results/7077cfb160cf/omni_editing.mp4 new file mode 100644 index 0000000..287a44e Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7077cfb160cf/omni_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/7077cfb160cf/omni_t2v.jpg b/projects/video-action-editing/large-fair12/results/7077cfb160cf/omni_t2v.jpg new file mode 100644 index 0000000..55d7703 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7077cfb160cf/omni_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/7077cfb160cf/omni_t2v.json b/projects/video-action-editing/large-fair12/results/7077cfb160cf/omni_t2v.json new file mode 100644 index 0000000..580be72 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/7077cfb160cf/omni_t2v.json @@ -0,0 +1,66 @@ +{ + "status": "complete", + "case_id": "7077cfb160cf", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "caption_sha256": "0acdffedc18b04d2c2bef7d0a4e4e51544b75d4dd1f904e080d9e0490be24fb1", + "actual_t5_text": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "7077cfb160cf", + "arm": "t2v", + "caption": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "caption_sha256": "0acdffedc18b04d2c2bef7d0a4e4e51544b75d4dd1f904e080d9e0490be24fb1", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 53, + 2048 + ], + "feature_sha256": "863e64e016115388d775caa7fd1a8be61270b967361152418dfda43d47ba5cc6" + }, + "t5_text_inputs": [ + "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081904, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "cfce2698573f7b20a42686a08059ff6d39d7053cafcf4731fddab4d174c804ae", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:35:38.009473+00:00", + "elapsed_seconds": 599.71, + "job": "214728", + "hostname": "auh7-1b-gpu-283", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/7077cfb160cf/omni_t2v.mp4 b/projects/video-action-editing/large-fair12/results/7077cfb160cf/omni_t2v.mp4 new file mode 100644 index 0000000..d7c25db Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7077cfb160cf/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/7e488525099e/bernini_editing.jpg b/projects/video-action-editing/large-fair12/results/7e488525099e/bernini_editing.jpg new file mode 100644 index 0000000..2064391 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7e488525099e/bernini_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/7e488525099e/bernini_editing.json b/projects/video-action-editing/large-fair12/results/7e488525099e/bernini_editing.json new file mode 100644 index 0000000..3d4e1b6 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/7e488525099e/bernini_editing.json @@ -0,0 +1,109 @@ +{ + "status": "complete", + "case_id": "7e488525099e", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "caption_sha256": "ed6115b291eb39710054250e5a6fd3e51f92ed3675fe1af1c5b45617396c3082", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 97, + "prompt_truncated": false, + "seed": 2026081906, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7e488525099e/source-exact81.mp4", + "source_sha256": "1f3cec72bef55b67c15ebfc063252cce867ea128594a225db61688ff961b35d4", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "shift_terminal", + "sigma_min", + "sigma_max" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "9829080372e3351bb3375d787615f72cc4a10be693f382edd9d36fae37079d0e", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T22:38:14.312525+00:00", + "elapsed_seconds": 2268.32, + "job": "214753", + "hostname": "auh7-1b-gpu-221", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/7e488525099e/bernini_editing.mp4 b/projects/video-action-editing/large-fair12/results/7e488525099e/bernini_editing.mp4 new file mode 100644 index 0000000..b551660 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7e488525099e/bernini_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/7e488525099e/bernini_t2v.jpg b/projects/video-action-editing/large-fair12/results/7e488525099e/bernini_t2v.jpg new file mode 100644 index 0000000..6c5be54 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7e488525099e/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/7e488525099e/bernini_t2v.json b/projects/video-action-editing/large-fair12/results/7e488525099e/bernini_t2v.json new file mode 100644 index 0000000..47ebb9b --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/7e488525099e/bernini_t2v.json @@ -0,0 +1,104 @@ +{ + "status": "complete", + "case_id": "7e488525099e", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "caption_sha256": "ed6115b291eb39710054250e5a6fd3e51f92ed3675fe1af1c5b45617396c3082", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 58, + "prompt_truncated": false, + "seed": 2026081906, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_max", + "sigma_min", + "shift_terminal" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "4d3b693a341087b216eba42bc9933ed61efbead441536c78638dfd4e5cca9145", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T22:17:05.780853+00:00", + "elapsed_seconds": 519.14, + "job": "214758", + "hostname": "auh7-1b-gpu-312", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/7e488525099e/bernini_t2v.mp4 b/projects/video-action-editing/large-fair12/results/7e488525099e/bernini_t2v.mp4 new file mode 100644 index 0000000..aeffef0 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7e488525099e/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/7e488525099e/omni_editing.jpg b/projects/video-action-editing/large-fair12/results/7e488525099e/omni_editing.jpg new file mode 100644 index 0000000..e97f08d Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7e488525099e/omni_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/7e488525099e/omni_editing.json b/projects/video-action-editing/large-fair12/results/7e488525099e/omni_editing.json new file mode 100644 index 0000000..76b5c5a --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/7e488525099e/omni_editing.json @@ -0,0 +1,72 @@ +{ + "status": "complete", + "case_id": "7e488525099e", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "caption_sha256": "ed6115b291eb39710054250e5a6fd3e51f92ed3675fe1af1c5b45617396c3082", + "actual_t5_text": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "7e488525099e", + "arm": "editing", + "caption": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "caption_sha256": "ed6115b291eb39710054250e5a6fd3e51f92ed3675fe1af1c5b45617396c3082", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7e488525099e/source-exact81.mp4", + "source_sha256": "1f3cec72bef55b67c15ebfc063252cce867ea128594a225db61688ff961b35d4", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 71, + 2048 + ], + "feature_sha256": "a34cbe81e1903e91618292d5ab323f49478f88c4638de853db8d3bb4475d4242" + }, + "t5_text_inputs": [ + "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081906, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7e488525099e/source-exact81.mp4", + "source_sha256": "1f3cec72bef55b67c15ebfc063252cce867ea128594a225db61688ff961b35d4", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "19321c8236ea55c3ce3006817c0c8316f9313bc193729e4ba6dd1651f445d5fc", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:15:57.054117+00:00", + "elapsed_seconds": 886.52, + "job": "214741", + "hostname": "auh7-1b-gpu-320", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/7e488525099e/omni_editing.mp4 b/projects/video-action-editing/large-fair12/results/7e488525099e/omni_editing.mp4 new file mode 100644 index 0000000..00c0ea0 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7e488525099e/omni_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/7e488525099e/omni_t2v.jpg b/projects/video-action-editing/large-fair12/results/7e488525099e/omni_t2v.jpg new file mode 100644 index 0000000..5c0c9c4 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7e488525099e/omni_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/7e488525099e/omni_t2v.json b/projects/video-action-editing/large-fair12/results/7e488525099e/omni_t2v.json new file mode 100644 index 0000000..11c925c --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/7e488525099e/omni_t2v.json @@ -0,0 +1,66 @@ +{ + "status": "complete", + "case_id": "7e488525099e", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "caption_sha256": "ed6115b291eb39710054250e5a6fd3e51f92ed3675fe1af1c5b45617396c3082", + "actual_t5_text": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "7e488525099e", + "arm": "t2v", + "caption": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "caption_sha256": "ed6115b291eb39710054250e5a6fd3e51f92ed3675fe1af1c5b45617396c3082", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 44, + 2048 + ], + "feature_sha256": "9f6d9a9afe61984fcb7355e65810471e2b4b623b73134d18a47daa0936b86b83" + }, + "t5_text_inputs": [ + "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081906, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "5d79f8d88fc14bccd0336603594e03abcc72413534b835b37698aed74b1bc7cf", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:36:39.023949+00:00", + "elapsed_seconds": 615.52, + "job": "214729", + "hostname": "auh7-1b-gpu-313", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/7e488525099e/omni_t2v.mp4 b/projects/video-action-editing/large-fair12/results/7e488525099e/omni_t2v.mp4 new file mode 100644 index 0000000..73a9231 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7e488525099e/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/7fa338474c75/bernini_editing.jpg b/projects/video-action-editing/large-fair12/results/7fa338474c75/bernini_editing.jpg new file mode 100644 index 0000000..aedc14f Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7fa338474c75/bernini_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/7fa338474c75/bernini_editing.json b/projects/video-action-editing/large-fair12/results/7fa338474c75/bernini_editing.json new file mode 100644 index 0000000..390d580 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/7fa338474c75/bernini_editing.json @@ -0,0 +1,109 @@ +{ + "status": "complete", + "case_id": "7fa338474c75", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "caption_sha256": "f7d22ce2d98ed6adff42d53192e7204016d9035165349de21317c756823ac96e", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 100, + "prompt_truncated": false, + "seed": 2026081900, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7fa338474c75/source-exact81.mp4", + "source_sha256": "4278c748fa1fdd54d908c366a781df33d3e4eb1acc1c2b7bd3492659c66a9840", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_min", + "sigma_max", + "shift_terminal" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "d80fbfb74a6ab3aed91b258c759a2eb21e37b66c82513742590b0e512e0f49f4", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:36:39.558813+00:00", + "elapsed_seconds": 1623.02, + "job": "214746", + "hostname": "auh7-1b-gpu-313", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/7fa338474c75/bernini_editing.mp4 b/projects/video-action-editing/large-fair12/results/7fa338474c75/bernini_editing.mp4 new file mode 100644 index 0000000..679313d Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7fa338474c75/bernini_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/7fa338474c75/bernini_t2v.jpg b/projects/video-action-editing/large-fair12/results/7fa338474c75/bernini_t2v.jpg new file mode 100644 index 0000000..d58e97f Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7fa338474c75/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/7fa338474c75/bernini_t2v.json b/projects/video-action-editing/large-fair12/results/7fa338474c75/bernini_t2v.json new file mode 100644 index 0000000..b48c761 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/7fa338474c75/bernini_t2v.json @@ -0,0 +1,104 @@ +{ + "status": "complete", + "case_id": "7fa338474c75", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "caption_sha256": "f7d22ce2d98ed6adff42d53192e7204016d9035165349de21317c756823ac96e", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 61, + "prompt_truncated": false, + "seed": 2026081900, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "shift_terminal", + "sigma_max", + "sigma_min" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "9f68a732503e5d11d4b94ee86ea61175d555092ffc539b69615faf0e050a083d", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:03:56.015342+00:00", + "elapsed_seconds": 558.77, + "job": "214701", + "hostname": "auh7-1b-gpu-283", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/7fa338474c75/bernini_t2v.mp4 b/projects/video-action-editing/large-fair12/results/7fa338474c75/bernini_t2v.mp4 new file mode 100644 index 0000000..6f9ab7e Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7fa338474c75/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/7fa338474c75/omni_editing.jpg b/projects/video-action-editing/large-fair12/results/7fa338474c75/omni_editing.jpg new file mode 100644 index 0000000..025caa3 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7fa338474c75/omni_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/7fa338474c75/omni_editing.json b/projects/video-action-editing/large-fair12/results/7fa338474c75/omni_editing.json new file mode 100644 index 0000000..499483e --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/7fa338474c75/omni_editing.json @@ -0,0 +1,72 @@ +{ + "status": "complete", + "case_id": "7fa338474c75", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "caption_sha256": "f7d22ce2d98ed6adff42d53192e7204016d9035165349de21317c756823ac96e", + "actual_t5_text": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "7fa338474c75", + "arm": "editing", + "caption": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "caption_sha256": "f7d22ce2d98ed6adff42d53192e7204016d9035165349de21317c756823ac96e", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7fa338474c75/source-exact81.mp4", + "source_sha256": "4278c748fa1fdd54d908c366a781df33d3e4eb1acc1c2b7bd3492659c66a9840", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 73, + 2048 + ], + "feature_sha256": "dc6a8fcf6aace395826a95d45c233eabfd1bbacf9f833e8de912e13129a059d8" + }, + "t5_text_inputs": [ + "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081900, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7fa338474c75/source-exact81.mp4", + "source_sha256": "4278c748fa1fdd54d908c366a781df33d3e4eb1acc1c2b7bd3492659c66a9840", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "e4267370c4b549bba46b2c14020f9fff2a725e1b4c90379041ab73bbeb59e8be", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:51:53.409740+00:00", + "elapsed_seconds": 636.88, + "job": "214734", + "hostname": "auh7-1b-gpu-282", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/7fa338474c75/omni_editing.mp4 b/projects/video-action-editing/large-fair12/results/7fa338474c75/omni_editing.mp4 new file mode 100644 index 0000000..edab628 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7fa338474c75/omni_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/7fa338474c75/omni_t2v.jpg b/projects/video-action-editing/large-fair12/results/7fa338474c75/omni_t2v.jpg new file mode 100644 index 0000000..93528c7 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7fa338474c75/omni_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/7fa338474c75/omni_t2v.json b/projects/video-action-editing/large-fair12/results/7fa338474c75/omni_t2v.json new file mode 100644 index 0000000..08480a1 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/7fa338474c75/omni_t2v.json @@ -0,0 +1,66 @@ +{ + "status": "complete", + "case_id": "7fa338474c75", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "caption_sha256": "f7d22ce2d98ed6adff42d53192e7204016d9035165349de21317c756823ac96e", + "actual_t5_text": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "7fa338474c75", + "arm": "t2v", + "caption": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "caption_sha256": "f7d22ce2d98ed6adff42d53192e7204016d9035165349de21317c756823ac96e", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 46, + 2048 + ], + "feature_sha256": "d54fddcf16850d14dc9dfb71b863ba619646a35c90cd4dd2d62419a2adda477a" + }, + "t5_text_inputs": [ + "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081900, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "0c6b53c4bae5fa1c7275fb71f5197c6312876d3813ae35b9c4db361712d3c65f", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:20:46.292401+00:00", + "elapsed_seconds": 595.85, + "job": "214722", + "hostname": "auh7-1b-gpu-283", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/7fa338474c75/omni_t2v.mp4 b/projects/video-action-editing/large-fair12/results/7fa338474c75/omni_t2v.mp4 new file mode 100644 index 0000000..9a584bb Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/7fa338474c75/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/81533c9e56ec/bernini_editing.jpg b/projects/video-action-editing/large-fair12/results/81533c9e56ec/bernini_editing.jpg new file mode 100644 index 0000000..59614bf Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/81533c9e56ec/bernini_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/81533c9e56ec/bernini_editing.json b/projects/video-action-editing/large-fair12/results/81533c9e56ec/bernini_editing.json new file mode 100644 index 0000000..ec1434d --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/81533c9e56ec/bernini_editing.json @@ -0,0 +1,109 @@ +{ + "status": "complete", + "case_id": "81533c9e56ec", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "caption_sha256": "f6e77c2c4c9a431ed92369c65484776cb036d47a4d72c6a19e11d2a4d5b09579", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 104, + "prompt_truncated": false, + "seed": 2026081915, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/81533c9e56ec/source-exact81.mp4", + "source_sha256": "6daa80d3ac407b01f842ce6fa611b3ec6c421851525f0845779143c4577e0b19", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "shift_terminal", + "sigma_min", + "sigma_max" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "6568610950f2753ca3d4c6812018131d53241cb7921236502d6b4d4946380dd9", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:47:28.810955+00:00", + "elapsed_seconds": 2245.25, + "job": "214747", + "hostname": "auh7-1b-gpu-206", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/81533c9e56ec/bernini_editing.mp4 b/projects/video-action-editing/large-fair12/results/81533c9e56ec/bernini_editing.mp4 new file mode 100644 index 0000000..d004ac6 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/81533c9e56ec/bernini_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/81533c9e56ec/bernini_t2v.jpg b/projects/video-action-editing/large-fair12/results/81533c9e56ec/bernini_t2v.jpg new file mode 100644 index 0000000..c713c0d Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/81533c9e56ec/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/81533c9e56ec/bernini_t2v.json b/projects/video-action-editing/large-fair12/results/81533c9e56ec/bernini_t2v.json new file mode 100644 index 0000000..659e9c7 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/81533c9e56ec/bernini_t2v.json @@ -0,0 +1,104 @@ +{ + "status": "complete", + "case_id": "81533c9e56ec", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "caption_sha256": "f6e77c2c4c9a431ed92369c65484776cb036d47a4d72c6a19e11d2a4d5b09579", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 65, + "prompt_truncated": false, + "seed": 2026081915, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_min", + "sigma_max", + "shift_terminal" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "d7a3869e2f1e3f30b90495f183234d1dcd56b5566c27678ac94669f243f45be8", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:03:06.079836+00:00", + "elapsed_seconds": 499.76, + "job": "214702", + "hostname": "auh7-1b-gpu-312", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/81533c9e56ec/bernini_t2v.mp4 b/projects/video-action-editing/large-fair12/results/81533c9e56ec/bernini_t2v.mp4 new file mode 100644 index 0000000..f7dc9d2 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/81533c9e56ec/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/81533c9e56ec/omni_editing.jpg b/projects/video-action-editing/large-fair12/results/81533c9e56ec/omni_editing.jpg new file mode 100644 index 0000000..619992c Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/81533c9e56ec/omni_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/81533c9e56ec/omni_editing.json b/projects/video-action-editing/large-fair12/results/81533c9e56ec/omni_editing.json new file mode 100644 index 0000000..d62cae6 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/81533c9e56ec/omni_editing.json @@ -0,0 +1,72 @@ +{ + "status": "complete", + "case_id": "81533c9e56ec", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "caption_sha256": "f6e77c2c4c9a431ed92369c65484776cb036d47a4d72c6a19e11d2a4d5b09579", + "actual_t5_text": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "81533c9e56ec", + "arm": "editing", + "caption": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "caption_sha256": "f6e77c2c4c9a431ed92369c65484776cb036d47a4d72c6a19e11d2a4d5b09579", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/81533c9e56ec/source-exact81.mp4", + "source_sha256": "6daa80d3ac407b01f842ce6fa611b3ec6c421851525f0845779143c4577e0b19", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 76, + 2048 + ], + "feature_sha256": "09cbf7460835b917d1811c9612fb73eb0bd7c7ad17b988a8093c86702c180100" + }, + "t5_text_inputs": [ + "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081915, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/81533c9e56ec/source-exact81.mp4", + "source_sha256": "6daa80d3ac407b01f842ce6fa611b3ec6c421851525f0845779143c4577e0b19", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "d156e96a7fb7d91ea4a5e0159841362af432c9fed0b20882a8d508796398f671", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:52:22.199956+00:00", + "elapsed_seconds": 650.56, + "job": "214735", + "hostname": "auh7-1b-gpu-313", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/81533c9e56ec/omni_editing.mp4 b/projects/video-action-editing/large-fair12/results/81533c9e56ec/omni_editing.mp4 new file mode 100644 index 0000000..8b2d9f1 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/81533c9e56ec/omni_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/81533c9e56ec/omni_t2v.jpg b/projects/video-action-editing/large-fair12/results/81533c9e56ec/omni_t2v.jpg new file mode 100644 index 0000000..466eaff Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/81533c9e56ec/omni_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/81533c9e56ec/omni_t2v.json b/projects/video-action-editing/large-fair12/results/81533c9e56ec/omni_t2v.json new file mode 100644 index 0000000..3bde35f --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/81533c9e56ec/omni_t2v.json @@ -0,0 +1,66 @@ +{ + "status": "complete", + "case_id": "81533c9e56ec", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "caption_sha256": "f6e77c2c4c9a431ed92369c65484776cb036d47a4d72c6a19e11d2a4d5b09579", + "actual_t5_text": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "81533c9e56ec", + "arm": "t2v", + "caption": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "caption_sha256": "f6e77c2c4c9a431ed92369c65484776cb036d47a4d72c6a19e11d2a4d5b09579", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 49, + 2048 + ], + "feature_sha256": "55500ce71d10d808501849ae5c122f61dbff99b38bd16dd415fb146d599a62c3" + }, + "t5_text_inputs": [ + "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081915, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "a78f02ecb3aaa875cec8a133397227a526d4ea0e8dadf0a79bb3d7f8478f49e2", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:21:31.826216+00:00", + "elapsed_seconds": 612.01, + "job": "214723", + "hostname": "auh7-1b-gpu-313", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/81533c9e56ec/omni_t2v.mp4 b/projects/video-action-editing/large-fair12/results/81533c9e56ec/omni_t2v.mp4 new file mode 100644 index 0000000..cc30267 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/81533c9e56ec/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/840b214afead/bernini_editing.jpg b/projects/video-action-editing/large-fair12/results/840b214afead/bernini_editing.jpg new file mode 100644 index 0000000..731d6e7 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/840b214afead/bernini_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/840b214afead/bernini_editing.json b/projects/video-action-editing/large-fair12/results/840b214afead/bernini_editing.json new file mode 100644 index 0000000..8a423b1 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/840b214afead/bernini_editing.json @@ -0,0 +1,109 @@ +{ + "status": "complete", + "case_id": "840b214afead", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "caption_sha256": "fe3b668a66485813f97192ae443c497bc34efcc6edbd10bbdf8af1724af85247", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 110, + "prompt_truncated": false, + "seed": 2026081913, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/840b214afead/source-exact81.mp4", + "source_sha256": "a6e42a447d7fef26b073878c551a631afd6371987910a332e51e4a9e4dfb4646", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_min", + "sigma_max", + "shift_terminal" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "aa4f8096577b9224c04eadfefb1581272b7a1355a9a730939813296ef15d39a2", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:59:20.369231+00:00", + "elapsed_seconds": 2401.86, + "job": "214749", + "hostname": "auh7-1b-gpu-320", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/840b214afead/bernini_editing.mp4 b/projects/video-action-editing/large-fair12/results/840b214afead/bernini_editing.mp4 new file mode 100644 index 0000000..bc48556 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/840b214afead/bernini_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/840b214afead/bernini_t2v.jpg b/projects/video-action-editing/large-fair12/results/840b214afead/bernini_t2v.jpg new file mode 100644 index 0000000..cbad62f Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/840b214afead/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/840b214afead/bernini_t2v.json b/projects/video-action-editing/large-fair12/results/840b214afead/bernini_t2v.json new file mode 100644 index 0000000..d738a93 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/840b214afead/bernini_t2v.json @@ -0,0 +1,104 @@ +{ + "status": "complete", + "case_id": "840b214afead", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "caption_sha256": "fe3b668a66485813f97192ae443c497bc34efcc6edbd10bbdf8af1724af85247", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 71, + "prompt_truncated": false, + "seed": 2026081913, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_max", + "sigma_min", + "shift_terminal" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "88c0e40f239232c6cbb95be01496886f9100f26023b357bc13dd26715e4155cb", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:49:44.701325+00:00", + "elapsed_seconds": 545.02, + "job": "214704", + "hostname": "auh7-1b-gpu-307", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/840b214afead/bernini_t2v.mp4 b/projects/video-action-editing/large-fair12/results/840b214afead/bernini_t2v.mp4 new file mode 100644 index 0000000..c15dde8 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/840b214afead/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/840b214afead/omni_editing.jpg b/projects/video-action-editing/large-fair12/results/840b214afead/omni_editing.jpg new file mode 100644 index 0000000..87cbb9f Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/840b214afead/omni_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/840b214afead/omni_editing.json b/projects/video-action-editing/large-fair12/results/840b214afead/omni_editing.json new file mode 100644 index 0000000..be7e659 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/840b214afead/omni_editing.json @@ -0,0 +1,72 @@ +{ + "status": "complete", + "case_id": "840b214afead", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "caption_sha256": "fe3b668a66485813f97192ae443c497bc34efcc6edbd10bbdf8af1724af85247", + "actual_t5_text": "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "840b214afead", + "arm": "editing", + "caption": "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "caption_sha256": "fe3b668a66485813f97192ae443c497bc34efcc6edbd10bbdf8af1724af85247", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/840b214afead/source-exact81.mp4", + "source_sha256": "a6e42a447d7fef26b073878c551a631afd6371987910a332e51e4a9e4dfb4646", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 81, + 2048 + ], + "feature_sha256": "8d2079d5bd9b6692dfeb7a739b208a4eaf19cf1aca8b431b9a99ec76318349d8" + }, + "t5_text_inputs": [ + "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081913, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/840b214afead/source-exact81.mp4", + "source_sha256": "a6e42a447d7fef26b073878c551a631afd6371987910a332e51e4a9e4dfb4646", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "8e7370fc84142be3daa707d6ffc7ff82556f7167a6fe14ed26ce5112d574f625", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:08:46.895702+00:00", + "elapsed_seconds": 974.76, + "job": "214737", + "hostname": "auh7-1b-gpu-206", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/840b214afead/omni_editing.mp4 b/projects/video-action-editing/large-fair12/results/840b214afead/omni_editing.mp4 new file mode 100644 index 0000000..fe04236 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/840b214afead/omni_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/840b214afead/omni_t2v.jpg b/projects/video-action-editing/large-fair12/results/840b214afead/omni_t2v.jpg new file mode 100644 index 0000000..e95202a Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/840b214afead/omni_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/840b214afead/omni_t2v.json b/projects/video-action-editing/large-fair12/results/840b214afead/omni_t2v.json new file mode 100644 index 0000000..75dbc9b --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/840b214afead/omni_t2v.json @@ -0,0 +1,66 @@ +{ + "status": "complete", + "case_id": "840b214afead", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "caption_sha256": "fe3b668a66485813f97192ae443c497bc34efcc6edbd10bbdf8af1724af85247", + "actual_t5_text": "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "840b214afead", + "arm": "t2v", + "caption": "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "caption_sha256": "fe3b668a66485813f97192ae443c497bc34efcc6edbd10bbdf8af1724af85247", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 54, + 2048 + ], + "feature_sha256": "dd48866a02a17042eef8b6cbde060576c10deaf6137ee965388861edfd103d7a" + }, + "t5_text_inputs": [ + "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081913, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "86baea5251e3c110b691d72b25cfb9405e3039affbbaf8e921c7e9169101b1c2", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:36:13.591878+00:00", + "elapsed_seconds": 1029.69, + "job": "214725", + "hostname": "auh7-1b-gpu-320", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/840b214afead/omni_t2v.mp4 b/projects/video-action-editing/large-fair12/results/840b214afead/omni_t2v.mp4 new file mode 100644 index 0000000..17b4c85 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/840b214afead/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/d5221a1b69d5/bernini_editing.jpg b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/bernini_editing.jpg new file mode 100644 index 0000000..d0a6bae Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/bernini_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/d5221a1b69d5/bernini_editing.json b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/bernini_editing.json new file mode 100644 index 0000000..9a2077e --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/bernini_editing.json @@ -0,0 +1,109 @@ +{ + "status": "complete", + "case_id": "d5221a1b69d5", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "caption_sha256": "043306a7c3eff9ad7a50db5bbf0d3b4a2d6dec27fb8c5b5f6a316382992bc71b", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 92, + "prompt_truncated": false, + "seed": 2026081907, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d5221a1b69d5/source-exact81.mp4", + "source_sha256": "fdd1b3df4b94449dc59cd04d03deb769fb2cf6c4c2d7b87221e2b3a6b5557d14", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_max", + "shift_terminal", + "sigma_min" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "9cdbd07566d899630c7d460876abe733604cb04d284adf01842a9716a5db4ec3", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T22:38:07.139056+00:00", + "elapsed_seconds": 2248.64, + "job": "214754", + "hostname": "auh7-1b-gpu-320", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/d5221a1b69d5/bernini_editing.mp4 b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/bernini_editing.mp4 new file mode 100644 index 0000000..dfb4744 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/bernini_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/d5221a1b69d5/bernini_t2v.jpg b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/bernini_t2v.jpg new file mode 100644 index 0000000..0975b64 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/d5221a1b69d5/bernini_t2v.json b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/bernini_t2v.json new file mode 100644 index 0000000..911214c --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/bernini_t2v.json @@ -0,0 +1,104 @@ +{ + "status": "complete", + "case_id": "d5221a1b69d5", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "caption_sha256": "043306a7c3eff9ad7a50db5bbf0d3b4a2d6dec27fb8c5b5f6a316382992bc71b", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 53, + "prompt_truncated": false, + "seed": 2026081907, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "shift_terminal", + "sigma_min", + "sigma_max" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "28120017a5e122b3f72956b9c2b16b20aae762baa4e88b9bab605ed03fff7c40", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:42:17.028942+00:00", + "elapsed_seconds": 483.92, + "job": "214709", + "hostname": "auh7-1b-gpu-312", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/d5221a1b69d5/bernini_t2v.mp4 b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/bernini_t2v.mp4 new file mode 100644 index 0000000..dc54b5a Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/d5221a1b69d5/omni_editing.jpg b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/omni_editing.jpg new file mode 100644 index 0000000..e293a8a Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/omni_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/d5221a1b69d5/omni_editing.json b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/omni_editing.json new file mode 100644 index 0000000..d54db7e --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/omni_editing.json @@ -0,0 +1,72 @@ +{ + "status": "complete", + "case_id": "d5221a1b69d5", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "caption_sha256": "043306a7c3eff9ad7a50db5bbf0d3b4a2d6dec27fb8c5b5f6a316382992bc71b", + "actual_t5_text": "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "d5221a1b69d5", + "arm": "editing", + "caption": "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "caption_sha256": "043306a7c3eff9ad7a50db5bbf0d3b4a2d6dec27fb8c5b5f6a316382992bc71b", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d5221a1b69d5/source-exact81.mp4", + "source_sha256": "fdd1b3df4b94449dc59cd04d03deb769fb2cf6c4c2d7b87221e2b3a6b5557d14", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 67, + 2048 + ], + "feature_sha256": "c34f3a4e8b0058cf7a7f941082a5266c00ee63aea17fccbbdec08c7d9905eddb" + }, + "t5_text_inputs": [ + "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081907, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d5221a1b69d5/source-exact81.mp4", + "source_sha256": "fdd1b3df4b94449dc59cd04d03deb769fb2cf6c4c2d7b87221e2b3a6b5557d14", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "a1e43492995e5fefe7ace547ce6f62cb6fe363ae29ad365f7144f36f7bf4e900", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:23:04.739246+00:00", + "elapsed_seconds": 963.54, + "job": "214742", + "hostname": "auh7-1b-gpu-210", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/d5221a1b69d5/omni_editing.mp4 b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/omni_editing.mp4 new file mode 100644 index 0000000..50efe36 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/omni_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/d5221a1b69d5/omni_t2v.jpg b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/omni_t2v.jpg new file mode 100644 index 0000000..be49b6d Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/omni_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/d5221a1b69d5/omni_t2v.json b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/omni_t2v.json new file mode 100644 index 0000000..da9e1a5 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/omni_t2v.json @@ -0,0 +1,66 @@ +{ + "status": "complete", + "case_id": "d5221a1b69d5", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "caption_sha256": "043306a7c3eff9ad7a50db5bbf0d3b4a2d6dec27fb8c5b5f6a316382992bc71b", + "actual_t5_text": "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "d5221a1b69d5", + "arm": "t2v", + "caption": "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "caption_sha256": "043306a7c3eff9ad7a50db5bbf0d3b4a2d6dec27fb8c5b5f6a316382992bc71b", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 40, + 2048 + ], + "feature_sha256": "32fb5857a4b6f85b7d8f9028089619067c830e83ddb787da525a2475cfdcbf7c" + }, + "t5_text_inputs": [ + "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081907, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "9ee4d254b5c2d579d3a9adcdc9d1057d7a8ef0afe1860f8a785db66d2cedd8ab", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:36:30.235433+00:00", + "elapsed_seconds": 603.1, + "job": "214730", + "hostname": "auh7-1b-gpu-282", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/d5221a1b69d5/omni_t2v.mp4 b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/omni_t2v.mp4 new file mode 100644 index 0000000..f6cbcf2 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d5221a1b69d5/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/d908552fb691/bernini_editing.jpg b/projects/video-action-editing/large-fair12/results/d908552fb691/bernini_editing.jpg new file mode 100644 index 0000000..d10e71d Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d908552fb691/bernini_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/d908552fb691/bernini_editing.json b/projects/video-action-editing/large-fair12/results/d908552fb691/bernini_editing.json new file mode 100644 index 0000000..505234b --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/d908552fb691/bernini_editing.json @@ -0,0 +1,109 @@ +{ + "status": "complete", + "case_id": "d908552fb691", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "caption_sha256": "025f04cb7e601915763666a56d60e01f88ed30d6efa85a172c0cf38eff834896", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 99, + "prompt_truncated": false, + "seed": 2026081903, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d908552fb691/source-exact81.mp4", + "source_sha256": "56e1faa78c02c32d6da71354e8434241c8e9a4c334da4ac8aa4415148b6230bb", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_max", + "shift_terminal", + "sigma_min" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "f164b04e01c335a49aca4f94494b87bd5ff2253a61f7d158fa2ddd00ade9967b", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:59:03.774298+00:00", + "elapsed_seconds": 2250.01, + "job": "214750", + "hostname": "auh7-1b-gpu-221", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/d908552fb691/bernini_editing.mp4 b/projects/video-action-editing/large-fair12/results/d908552fb691/bernini_editing.mp4 new file mode 100644 index 0000000..489a8f3 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d908552fb691/bernini_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/d908552fb691/bernini_t2v.jpg b/projects/video-action-editing/large-fair12/results/d908552fb691/bernini_t2v.jpg new file mode 100644 index 0000000..4315027 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d908552fb691/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/d908552fb691/bernini_t2v.json b/projects/video-action-editing/large-fair12/results/d908552fb691/bernini_t2v.json new file mode 100644 index 0000000..4e97f48 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/d908552fb691/bernini_t2v.json @@ -0,0 +1,104 @@ +{ + "status": "complete", + "case_id": "d908552fb691", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "caption_sha256": "025f04cb7e601915763666a56d60e01f88ed30d6efa85a172c0cf38eff834896", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 60, + "prompt_truncated": false, + "seed": 2026081903, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_max", + "shift_terminal", + "sigma_min" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "4316ede62030399da548d0b2b136333c622705fe1395b948ab7d60eca68430ce", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:45:46.786299+00:00", + "elapsed_seconds": 730.83, + "job": "214705", + "hostname": "auh7-1b-gpu-206", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/d908552fb691/bernini_t2v.mp4 b/projects/video-action-editing/large-fair12/results/d908552fb691/bernini_t2v.mp4 new file mode 100644 index 0000000..5886c73 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d908552fb691/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/d908552fb691/omni_editing.jpg b/projects/video-action-editing/large-fair12/results/d908552fb691/omni_editing.jpg new file mode 100644 index 0000000..7a3cfb4 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d908552fb691/omni_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/d908552fb691/omni_editing.json b/projects/video-action-editing/large-fair12/results/d908552fb691/omni_editing.json new file mode 100644 index 0000000..1d5328c --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/d908552fb691/omni_editing.json @@ -0,0 +1,72 @@ +{ + "status": "complete", + "case_id": "d908552fb691", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "caption_sha256": "025f04cb7e601915763666a56d60e01f88ed30d6efa85a172c0cf38eff834896", + "actual_t5_text": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "d908552fb691", + "arm": "editing", + "caption": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "caption_sha256": "025f04cb7e601915763666a56d60e01f88ed30d6efa85a172c0cf38eff834896", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d908552fb691/source-exact81.mp4", + "source_sha256": "56e1faa78c02c32d6da71354e8434241c8e9a4c334da4ac8aa4415148b6230bb", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 78, + 2048 + ], + "feature_sha256": "114740c8405aa14069531f4ff749cc0da9706f5fe07cf087a02f9e11bbdbc19c" + }, + "t5_text_inputs": [ + "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081903, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d908552fb691/source-exact81.mp4", + "source_sha256": "56e1faa78c02c32d6da71354e8434241c8e9a4c334da4ac8aa4415148b6230bb", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "aafdce633f1ac4a24120c74a0a75ddb3a4b8a4198e0734ce3643bf8124d8ceb2", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:05:24.214802+00:00", + "elapsed_seconds": 651.09, + "job": "214738", + "hostname": "auh7-1b-gpu-307", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/d908552fb691/omni_editing.mp4 b/projects/video-action-editing/large-fair12/results/d908552fb691/omni_editing.mp4 new file mode 100644 index 0000000..6f8a96f Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d908552fb691/omni_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/d908552fb691/omni_t2v.jpg b/projects/video-action-editing/large-fair12/results/d908552fb691/omni_t2v.jpg new file mode 100644 index 0000000..e28b181 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d908552fb691/omni_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/d908552fb691/omni_t2v.json b/projects/video-action-editing/large-fair12/results/d908552fb691/omni_t2v.json new file mode 100644 index 0000000..82cde1d --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/d908552fb691/omni_t2v.json @@ -0,0 +1,66 @@ +{ + "status": "complete", + "case_id": "d908552fb691", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "caption_sha256": "025f04cb7e601915763666a56d60e01f88ed30d6efa85a172c0cf38eff834896", + "actual_t5_text": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "d908552fb691", + "arm": "t2v", + "caption": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "caption_sha256": "025f04cb7e601915763666a56d60e01f88ed30d6efa85a172c0cf38eff834896", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 51, + 2048 + ], + "feature_sha256": "104ba746d40a2909261000fd07d3cefaf8f075beea1e2f6d4224a62c95937b01" + }, + "t5_text_inputs": [ + "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081903, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "7458de291881bf7e8eb7909a7dbad8fae1c01726304a6494eb637e4ba845c60b", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:32:53.829299+00:00", + "elapsed_seconds": 603.13, + "job": "214726", + "hostname": "auh7-1b-gpu-312", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/d908552fb691/omni_t2v.mp4 b/projects/video-action-editing/large-fair12/results/d908552fb691/omni_t2v.mp4 new file mode 100644 index 0000000..4b1a05f Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d908552fb691/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/d977ce147d80/bernini_editing.jpg b/projects/video-action-editing/large-fair12/results/d977ce147d80/bernini_editing.jpg new file mode 100644 index 0000000..18473e4 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d977ce147d80/bernini_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/d977ce147d80/bernini_editing.json b/projects/video-action-editing/large-fair12/results/d977ce147d80/bernini_editing.json new file mode 100644 index 0000000..dec4942 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/d977ce147d80/bernini_editing.json @@ -0,0 +1,109 @@ +{ + "status": "complete", + "case_id": "d977ce147d80", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "caption_sha256": "a217f2a0d32d07e58d5c5781d12d401ed7a08f25d9286ea9f0bee5c25677e960", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 109, + "prompt_truncated": false, + "seed": 2026081905, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d977ce147d80/source-exact81.mp4", + "source_sha256": "e2a056e1af423be25a5beb4b75d1145fbacd625e3316a8e64b6031e75739f80d", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_min", + "shift_terminal", + "sigma_max" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "24f7ac9b4d8248228c92995b84173dca81c0bae42f890f507c6fc46f9fae3a43", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:49:26.067248+00:00", + "elapsed_seconds": 2309.32, + "job": "214748", + "hostname": "auh7-1b-gpu-269", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/d977ce147d80/bernini_editing.mp4 b/projects/video-action-editing/large-fair12/results/d977ce147d80/bernini_editing.mp4 new file mode 100644 index 0000000..d7177ae Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d977ce147d80/bernini_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/d977ce147d80/bernini_t2v.jpg b/projects/video-action-editing/large-fair12/results/d977ce147d80/bernini_t2v.jpg new file mode 100644 index 0000000..fbcc542 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d977ce147d80/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/d977ce147d80/bernini_t2v.json b/projects/video-action-editing/large-fair12/results/d977ce147d80/bernini_t2v.json new file mode 100644 index 0000000..7de727b --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/d977ce147d80/bernini_t2v.json @@ -0,0 +1,104 @@ +{ + "status": "complete", + "case_id": "d977ce147d80", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "caption_sha256": "a217f2a0d32d07e58d5c5781d12d401ed7a08f25d9286ea9f0bee5c25677e960", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 70, + "prompt_truncated": false, + "seed": 2026081905, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_max", + "shift_terminal", + "sigma_min" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "bad7436ab05bc9d57e503b271ad88b897e1a1ee4db3d8c43c940ce83c37cbf1e", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:04:24.410554+00:00", + "elapsed_seconds": 578.94, + "job": "214703", + "hostname": "auh7-1b-gpu-313", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" +} diff --git a/projects/video-action-editing/large-fair12/results/d977ce147d80/bernini_t2v.mp4 b/projects/video-action-editing/large-fair12/results/d977ce147d80/bernini_t2v.mp4 new file mode 100644 index 0000000..dc3da37 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d977ce147d80/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/d977ce147d80/omni_editing.jpg b/projects/video-action-editing/large-fair12/results/d977ce147d80/omni_editing.jpg new file mode 100644 index 0000000..187016e Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d977ce147d80/omni_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/d977ce147d80/omni_editing.json b/projects/video-action-editing/large-fair12/results/d977ce147d80/omni_editing.json new file mode 100644 index 0000000..8035da6 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/d977ce147d80/omni_editing.json @@ -0,0 +1,72 @@ +{ + "status": "complete", + "case_id": "d977ce147d80", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "caption_sha256": "a217f2a0d32d07e58d5c5781d12d401ed7a08f25d9286ea9f0bee5c25677e960", + "actual_t5_text": "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "d977ce147d80", + "arm": "editing", + "caption": "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "caption_sha256": "a217f2a0d32d07e58d5c5781d12d401ed7a08f25d9286ea9f0bee5c25677e960", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d977ce147d80/source-exact81.mp4", + "source_sha256": "e2a056e1af423be25a5beb4b75d1145fbacd625e3316a8e64b6031e75739f80d", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 83, + 2048 + ], + "feature_sha256": "a9f5554f6eb78289b924250b313712b58c925a9b0599cc70399b9a099117334c" + }, + "t5_text_inputs": [ + "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081905, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d977ce147d80/source-exact81.mp4", + "source_sha256": "e2a056e1af423be25a5beb4b75d1145fbacd625e3316a8e64b6031e75739f80d", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "1ecb531ea6b3a35432fabcb94944940f4a199b8b14067578cf2378b5ab32c23d", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:09:38.268251+00:00", + "elapsed_seconds": 1047.39, + "job": "214736", + "hostname": "auh7-1b-gpu-269", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/d977ce147d80/omni_editing.mp4 b/projects/video-action-editing/large-fair12/results/d977ce147d80/omni_editing.mp4 new file mode 100644 index 0000000..30e9016 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d977ce147d80/omni_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/d977ce147d80/omni_t2v.jpg b/projects/video-action-editing/large-fair12/results/d977ce147d80/omni_t2v.jpg new file mode 100644 index 0000000..b3991b8 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d977ce147d80/omni_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/d977ce147d80/omni_t2v.json b/projects/video-action-editing/large-fair12/results/d977ce147d80/omni_t2v.json new file mode 100644 index 0000000..094c169 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/d977ce147d80/omni_t2v.json @@ -0,0 +1,66 @@ +{ + "status": "complete", + "case_id": "d977ce147d80", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "caption_sha256": "a217f2a0d32d07e58d5c5781d12d401ed7a08f25d9286ea9f0bee5c25677e960", + "actual_t5_text": "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "d977ce147d80", + "arm": "t2v", + "caption": "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "caption_sha256": "a217f2a0d32d07e58d5c5781d12d401ed7a08f25d9286ea9f0bee5c25677e960", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 56, + 2048 + ], + "feature_sha256": "f578112393aca285a045449d97541a449320571490c0012b73a7d22c73d52bdd" + }, + "t5_text_inputs": [ + "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081905, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "802cb826e1a39c7a3e2adcb35e2e2288439bc8acfaa86ec6c68dd450b95601f6", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:21:34.897069+00:00", + "elapsed_seconds": 599.87, + "job": "214724", + "hostname": "auh7-1b-gpu-282", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/d977ce147d80/omni_t2v.mp4 b/projects/video-action-editing/large-fair12/results/d977ce147d80/omni_t2v.mp4 new file mode 100644 index 0000000..7f2f3d3 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/d977ce147d80/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/fb7725c351ba/bernini_editing.jpg b/projects/video-action-editing/large-fair12/results/fb7725c351ba/bernini_editing.jpg new file mode 100644 index 0000000..837e0fc Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/fb7725c351ba/bernini_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/fb7725c351ba/bernini_editing.json b/projects/video-action-editing/large-fair12/results/fb7725c351ba/bernini_editing.json new file mode 100644 index 0000000..7eb3aa7 --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/fb7725c351ba/bernini_editing.json @@ -0,0 +1,109 @@ +{ + "status": "complete", + "case_id": "fb7725c351ba", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "caption_sha256": "b3337cc9b01e086c7969770d68fc6c6572e454e5fe1be64f770a6b7e1e30500d", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 107, + "prompt_truncated": false, + "seed": 2026081901, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/fb7725c351ba/source-exact81.mp4", + "source_sha256": "479ee891773dfffc3299149103ee2ef37f4bb63f213b1c4c7cbd5391ebd4704a", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "shift_terminal", + "sigma_min", + "sigma_max" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "6b544f44db85d07a6f1792758ccb4d4ff2f2482cdf42348661ddf06c33f79575", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:22:14.144770+00:00", + "elapsed_seconds": 2187.05, + "job": "214692", + "hostname": "auh7-1b-gpu-289", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "3b0d2856c6329312cd3627b4df0028cafb7902121d323ef0cdd46ea580f4a200" +} diff --git a/projects/video-action-editing/large-fair12/results/fb7725c351ba/bernini_editing.mp4 b/projects/video-action-editing/large-fair12/results/fb7725c351ba/bernini_editing.mp4 new file mode 100644 index 0000000..3277f2a Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/fb7725c351ba/bernini_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/fb7725c351ba/bernini_t2v.jpg b/projects/video-action-editing/large-fair12/results/fb7725c351ba/bernini_t2v.jpg new file mode 100644 index 0000000..5f79590 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/fb7725c351ba/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/fb7725c351ba/bernini_t2v.json b/projects/video-action-editing/large-fair12/results/fb7725c351ba/bernini_t2v.json new file mode 100644 index 0000000..df9892d --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/fb7725c351ba/bernini_t2v.json @@ -0,0 +1,77 @@ +{ + "status": "complete", + "case_id": "fb7725c351ba", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "caption_sha256": "b3337cc9b01e086c7969770d68fc6c6572e454e5fe1be64f770a6b7e1e30500d", + "prompt_rewriting": false, + "seed": 2026081901, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": null, + "expert_usage_assertion_passed": true, + "prompt_capture_assertion_passed": true, + "full_decode_passed": true, + "output": { + "sha256": "cb9a41e6af23c63dfcc99430a4c56ba498e97dca5a0f29f3777d6dc47fb5dc32", + "width": 832, + "height": 480, + "avg_frame_rate": "25/1", + "nb_read_frames": "81" + }, + "elapsed_seconds": null, + "completed_utc": "2026-09-23T19:40:28.952388+00:00", + "job": "214649", + "hostname": "auh7-1b-gpu-255", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "cf5e73c03b21c57f4ca93a4bfbdd3f6935a35fa3f9e8687736845df1712c49f6", + "receipt_recovery": { + "reason": "Generated video was valid; unsupported compute-node ffprobe wrapper arguments stopped post-processing.", + "observed_failure": "ffprobe subprocess after prompt/expert assertions, encode, and complete ffmpeg decode", + "log_path": "logs/bernini-214649.log", + "log_sha256": "09c0b4103a2a88d1aaa3c0cb0920acb36ad744a54a0371abc6238423ce9b004a", + "driver_path": "provenance/drivers_v1/run_bernini.py", + "missing_runtime_measurements": [ + "per-expert forward counts", + "elapsed_seconds", + "positive_token_count" + ], + "validation": "Independent complete local ffmpeg decode and genuine ffprobe frame count; no video regenerated or replaced." + }, + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "source_reference_frames": [], + "prompt_truncated": false, + "positive_token_count": null, + "positive_token_count_assertion_passed": true, + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ] +} diff --git a/projects/video-action-editing/large-fair12/results/fb7725c351ba/bernini_t2v.mp4 b/projects/video-action-editing/large-fair12/results/fb7725c351ba/bernini_t2v.mp4 new file mode 100644 index 0000000..f297c46 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/fb7725c351ba/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/fb7725c351ba/omni_editing.jpg b/projects/video-action-editing/large-fair12/results/fb7725c351ba/omni_editing.jpg new file mode 100644 index 0000000..407bc09 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/fb7725c351ba/omni_editing.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/fb7725c351ba/omni_editing.json b/projects/video-action-editing/large-fair12/results/fb7725c351ba/omni_editing.json new file mode 100644 index 0000000..2d1884a --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/fb7725c351ba/omni_editing.json @@ -0,0 +1,72 @@ +{ + "status": "complete", + "case_id": "fb7725c351ba", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "caption_sha256": "b3337cc9b01e086c7969770d68fc6c6572e454e5fe1be64f770a6b7e1e30500d", + "actual_t5_text": "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "fb7725c351ba", + "arm": "editing", + "caption": "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "caption_sha256": "b3337cc9b01e086c7969770d68fc6c6572e454e5fe1be64f770a6b7e1e30500d", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/fb7725c351ba/source-exact81.mp4", + "source_sha256": "479ee891773dfffc3299149103ee2ef37f4bb63f213b1c4c7cbd5391ebd4704a", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 80, + 2048 + ], + "feature_sha256": "0f447b68b39d44f6134f90a6a56244778144a651f3c807fce44417faed46405a" + }, + "t5_text_inputs": [ + "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081901, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/fb7725c351ba/source-exact81.mp4", + "source_sha256": "479ee891773dfffc3299149103ee2ef37f4bb63f213b1c4c7cbd5391ebd4704a", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "e66930bf62f233054b25761f5b614ac725f044c20ac7179ecca273b7b092493f", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:14:05.087905+00:00", + "elapsed_seconds": 932.32, + "job": "214720", + "hostname": "auh7-1b-gpu-320", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" +} diff --git a/projects/video-action-editing/large-fair12/results/fb7725c351ba/omni_editing.mp4 b/projects/video-action-editing/large-fair12/results/fb7725c351ba/omni_editing.mp4 new file mode 100644 index 0000000..63de83e Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/fb7725c351ba/omni_editing.mp4 differ diff --git a/projects/video-action-editing/large-fair12/results/fb7725c351ba/omni_t2v.jpg b/projects/video-action-editing/large-fair12/results/fb7725c351ba/omni_t2v.jpg new file mode 100644 index 0000000..20dae72 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/fb7725c351ba/omni_t2v.jpg differ diff --git a/projects/video-action-editing/large-fair12/results/fb7725c351ba/omni_t2v.json b/projects/video-action-editing/large-fair12/results/fb7725c351ba/omni_t2v.json new file mode 100644 index 0000000..a5db38f --- /dev/null +++ b/projects/video-action-editing/large-fair12/results/fb7725c351ba/omni_t2v.json @@ -0,0 +1,76 @@ +{ + "status": "complete", + "case_id": "fb7725c351ba", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "caption_sha256": "b3337cc9b01e086c7969770d68fc6c6572e454e5fe1be64f770a6b7e1e30500d", + "prompt_rewriting": false, + "seed": 2026081901, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": null, + "expert_usage_assertion_passed": true, + "prompt_capture_assertion_passed": true, + "full_decode_passed": true, + "output": { + "sha256": "824308c194214741551ae419983cf4c8b2cf0690b1e50d656383ad01d16d86df", + "width": 832, + "height": 480, + "avg_frame_rate": "25/1", + "nb_read_frames": "81" + }, + "elapsed_seconds": null, + "completed_utc": "2026-09-23T19:53:48.570684+00:00", + "job": "214677", + "hostname": "auh7-1b-gpu-320", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "3e34e9031fb4622896f5ac2765f6c15fcf8740324100c341cf70fb5bb71bba7d", + "receipt_recovery": { + "reason": "Generated video was valid; unsupported compute-node ffprobe wrapper arguments stopped post-processing.", + "observed_failure": "ffprobe subprocess after prompt/expert assertions, encode, and complete ffmpeg decode", + "log_path": "logs/omni-canary2-214677.log", + "log_sha256": "7de41d5e17edbdb8498006657ad0723392a68896346d72d1856589bbcdd56635", + "driver_path": "provenance/drivers_v1/run_omni.py", + "missing_runtime_measurements": [ + "per-expert forward counts", + "elapsed_seconds", + "negative T5 text not separately persisted; its equality assertion passed" + ], + "validation": "Independent complete local ffmpeg decode and genuine ffprobe frame count; no video regenerated or replaced." + }, + "actual_t5_text": "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "qwen_features": { + "case_id": "fb7725c351ba", + "arm": "t2v", + "caption": "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "caption_sha256": "b3337cc9b01e086c7969770d68fc6c6572e454e5fe1be64f770a6b7e1e30500d", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 53, + 2048 + ], + "feature_sha256": "09257c22c470b91a506cd2f6e96df101e6f138ae2fd62cacc9851d82cd597b7c" + }, + "t5_text_inputs": [ + "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible." + ], + "positive_t5_context_copies": 1, + "visual_latent_shape": null, + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "total_forward_count_assertion": 80 +} diff --git a/projects/video-action-editing/large-fair12/results/fb7725c351ba/omni_t2v.mp4 b/projects/video-action-editing/large-fair12/results/fb7725c351ba/omni_t2v.mp4 new file mode 100644 index 0000000..c5161d5 Binary files /dev/null and b/projects/video-action-editing/large-fair12/results/fb7725c351ba/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/large-fair12/summary.json b/projects/video-action-editing/large-fair12/summary.json new file mode 100644 index 0000000..454e210 --- /dev/null +++ b/projects/video-action-editing/large-fair12/summary.json @@ -0,0 +1,4293 @@ +[ + { + "case_id": "fb7725c351ba", + "name": "提杠铃 · Barbell lift", + "caption": "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "caption_sha256": "b3337cc9b01e086c7969770d68fc6c6572e454e5fe1be64f770a6b7e1e30500d", + "outputs": [ + { + "status": "complete", + "case_id": "fb7725c351ba", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "caption_sha256": "b3337cc9b01e086c7969770d68fc6c6572e454e5fe1be64f770a6b7e1e30500d", + "prompt_rewriting": false, + "seed": 2026081901, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": null, + "expert_usage_assertion_passed": true, + "prompt_capture_assertion_passed": true, + "full_decode_passed": true, + "output": { + "sha256": "cb9a41e6af23c63dfcc99430a4c56ba498e97dca5a0f29f3777d6dc47fb5dc32", + "width": 832, + "height": 480, + "avg_frame_rate": "25/1", + "nb_read_frames": "81" + }, + "elapsed_seconds": null, + "completed_utc": "2026-09-23T19:40:28.952388+00:00", + "job": "214649", + "hostname": "auh7-1b-gpu-255", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "cf5e73c03b21c57f4ca93a4bfbdd3f6935a35fa3f9e8687736845df1712c49f6", + "receipt_recovery": { + "reason": "Generated video was valid; unsupported compute-node ffprobe wrapper arguments stopped post-processing.", + "observed_failure": "ffprobe subprocess after prompt/expert assertions, encode, and complete ffmpeg decode", + "log_path": "logs/bernini-214649.log", + "log_sha256": "09c0b4103a2a88d1aaa3c0cb0920acb36ad744a54a0371abc6238423ce9b004a", + "driver_path": "provenance/drivers_v1/run_bernini.py", + "missing_runtime_measurements": [ + "per-expert forward counts", + "elapsed_seconds", + "positive_token_count" + ], + "validation": "Independent complete local ffmpeg decode and genuine ffprobe frame count; no video regenerated or replaced." + }, + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "source_reference_frames": [], + "prompt_truncated": false, + "positive_token_count": null, + "positive_token_count_assertion_passed": true, + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ] + }, + { + "status": "complete", + "case_id": "fb7725c351ba", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "caption_sha256": "b3337cc9b01e086c7969770d68fc6c6572e454e5fe1be64f770a6b7e1e30500d", + "prompt_rewriting": false, + "seed": 2026081901, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": null, + "expert_usage_assertion_passed": true, + "prompt_capture_assertion_passed": true, + "full_decode_passed": true, + "output": { + "sha256": "824308c194214741551ae419983cf4c8b2cf0690b1e50d656383ad01d16d86df", + "width": 832, + "height": 480, + "avg_frame_rate": "25/1", + "nb_read_frames": "81" + }, + "elapsed_seconds": null, + "completed_utc": "2026-09-23T19:53:48.570684+00:00", + "job": "214677", + "hostname": "auh7-1b-gpu-320", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "3e34e9031fb4622896f5ac2765f6c15fcf8740324100c341cf70fb5bb71bba7d", + "receipt_recovery": { + "reason": "Generated video was valid; unsupported compute-node ffprobe wrapper arguments stopped post-processing.", + "observed_failure": "ffprobe subprocess after prompt/expert assertions, encode, and complete ffmpeg decode", + "log_path": "logs/omni-canary2-214677.log", + "log_sha256": "7de41d5e17edbdb8498006657ad0723392a68896346d72d1856589bbcdd56635", + "driver_path": "provenance/drivers_v1/run_omni.py", + "missing_runtime_measurements": [ + "per-expert forward counts", + "elapsed_seconds", + "negative T5 text not separately persisted; its equality assertion passed" + ], + "validation": "Independent complete local ffmpeg decode and genuine ffprobe frame count; no video regenerated or replaced." + }, + "actual_t5_text": "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "qwen_features": { + "case_id": "fb7725c351ba", + "arm": "t2v", + "caption": "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "caption_sha256": "b3337cc9b01e086c7969770d68fc6c6572e454e5fe1be64f770a6b7e1e30500d", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 53, + 2048 + ], + "feature_sha256": "09257c22c470b91a506cd2f6e96df101e6f138ae2fd62cacc9851d82cd597b7c" + }, + "t5_text_inputs": [ + "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible." + ], + "positive_t5_context_copies": 1, + "visual_latent_shape": null, + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "total_forward_count_assertion": 80 + }, + { + "status": "complete", + "case_id": "fb7725c351ba", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "caption_sha256": "b3337cc9b01e086c7969770d68fc6c6572e454e5fe1be64f770a6b7e1e30500d", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 107, + "prompt_truncated": false, + "seed": 2026081901, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/fb7725c351ba/source-exact81.mp4", + "source_sha256": "479ee891773dfffc3299149103ee2ef37f4bb63f213b1c4c7cbd5391ebd4704a", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "shift_terminal", + "sigma_min", + "sigma_max" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "6b544f44db85d07a6f1792758ccb4d4ff2f2482cdf42348661ddf06c33f79575", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:22:14.144770+00:00", + "elapsed_seconds": 2187.05, + "job": "214692", + "hostname": "auh7-1b-gpu-289", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "3b0d2856c6329312cd3627b4df0028cafb7902121d323ef0cdd46ea580f4a200" + }, + { + "status": "complete", + "case_id": "fb7725c351ba", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "caption_sha256": "b3337cc9b01e086c7969770d68fc6c6572e454e5fe1be64f770a6b7e1e30500d", + "actual_t5_text": "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "fb7725c351ba", + "arm": "editing", + "caption": "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "caption_sha256": "b3337cc9b01e086c7969770d68fc6c6572e454e5fe1be64f770a6b7e1e30500d", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/fb7725c351ba/source-exact81.mp4", + "source_sha256": "479ee891773dfffc3299149103ee2ef37f4bb63f213b1c4c7cbd5391ebd4704a", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 80, + 2048 + ], + "feature_sha256": "0f447b68b39d44f6134f90a6a56244778144a651f3c807fce44417faed46405a" + }, + "t5_text_inputs": [ + "The woman in a home gym lifts a barbell from the floor to her waist. She wears black activewear. The home gym has a tiled floor and exercise equipment. A static full-body shot keeps the woman and the barbell visible.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081901, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/fb7725c351ba/source-exact81.mp4", + "source_sha256": "479ee891773dfffc3299149103ee2ef37f4bb63f213b1c4c7cbd5391ebd4704a", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "e66930bf62f233054b25761f5b614ac725f044c20ac7179ecca273b7b092493f", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:14:05.087905+00:00", + "elapsed_seconds": 932.32, + "job": "214720", + "hostname": "auh7-1b-gpu-320", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + } + ] + }, + { + "case_id": "3fadbe0c2961", + "name": "狗转头 · Dog head turn", + "caption": "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "caption_sha256": "aaeb58cbd788e3a815962e6289b1853ca09f2ef13c69d98a1af484e67f9da178", + "outputs": [ + { + "status": "complete", + "case_id": "3fadbe0c2961", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "caption_sha256": "aaeb58cbd788e3a815962e6289b1853ca09f2ef13c69d98a1af484e67f9da178", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 63, + "prompt_truncated": false, + "seed": 2026081902, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "shift_terminal", + "sigma_min", + "sigma_max" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "dc894ddffe1960fa0a845b2bbf03c37162d8b496e887ef535bed5cbf2ace9616", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:45:29.419504+00:00", + "elapsed_seconds": 706.21, + "job": "214706", + "hostname": "auh7-1b-gpu-269", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "3fadbe0c2961", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "caption_sha256": "aaeb58cbd788e3a815962e6289b1853ca09f2ef13c69d98a1af484e67f9da178", + "actual_t5_text": "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "3fadbe0c2961", + "arm": "t2v", + "caption": "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "caption_sha256": "aaeb58cbd788e3a815962e6289b1853ca09f2ef13c69d98a1af484e67f9da178", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 51, + 2048 + ], + "feature_sha256": "13a1edc8e7db94239ea6c6049d5691001949d9c95c3900fb5bbfd9298401f18a" + }, + "t5_text_inputs": [ + "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081902, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "e92d7a1bcddf3582e33dbd1b93244e9a12de37a18ea27ffff2088f026e3584ec", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:35:53.507686+00:00", + "elapsed_seconds": 637.05, + "job": "214727", + "hostname": "auh7-1b-gpu-307", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + }, + { + "status": "complete", + "case_id": "3fadbe0c2961", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "caption_sha256": "aaeb58cbd788e3a815962e6289b1853ca09f2ef13c69d98a1af484e67f9da178", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 102, + "prompt_truncated": false, + "seed": 2026081902, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/3fadbe0c2961/source-exact81.mp4", + "source_sha256": "99170f8a711a3d5a3e930a995561646ac557366cf92f5ded7ac13c6a986f8364", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_min", + "sigma_max", + "shift_terminal" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "59ddf05fd48e62dffbc27aac5a721cb7198c40d526c06479056695547d9cf48f", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:49:23.038345+00:00", + "elapsed_seconds": 1621.77, + "job": "214751", + "hostname": "auh7-1b-gpu-307", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "3fadbe0c2961", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "caption_sha256": "aaeb58cbd788e3a815962e6289b1853ca09f2ef13c69d98a1af484e67f9da178", + "actual_t5_text": "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "3fadbe0c2961", + "arm": "editing", + "caption": "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "caption_sha256": "aaeb58cbd788e3a815962e6289b1853ca09f2ef13c69d98a1af484e67f9da178", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/3fadbe0c2961/source-exact81.mp4", + "source_sha256": "99170f8a711a3d5a3e930a995561646ac557366cf92f5ded7ac13c6a986f8364", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 78, + 2048 + ], + "feature_sha256": "5607250394671775f7a81e3929b7e9ff08652121e7def64d0a370240e1f6e2ce" + }, + "t5_text_inputs": [ + "The dog turns its head further to the right while sitting in the grass. The dog is a reddish-brown and white Pembroke Welsh Corgi in a sunny green field. The camera is stationary in a medium shot.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081902, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/3fadbe0c2961/source-exact81.mp4", + "source_sha256": "99170f8a711a3d5a3e930a995561646ac557366cf92f5ded7ac13c6a986f8364", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "87aa2a665e5c451327950cf7eaa217e0f10ba00a2dac3f85af22489eb046501b", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:07:32.501671+00:00", + "elapsed_seconds": 637.79, + "job": "214739", + "hostname": "auh7-1b-gpu-282", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + } + ] + }, + { + "case_id": "7077cfb160cf", + "name": "长椅上写字 · Write in notebook", + "caption": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "caption_sha256": "0acdffedc18b04d2c2bef7d0a4e4e51544b75d4dd1f904e080d9e0490be24fb1", + "outputs": [ + { + "status": "complete", + "case_id": "7077cfb160cf", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "caption_sha256": "0acdffedc18b04d2c2bef7d0a4e4e51544b75d4dd1f904e080d9e0490be24fb1", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 68, + "prompt_truncated": false, + "seed": 2026081904, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_min", + "shift_terminal", + "sigma_max" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "eaf121f7e20fa7dc7aa6d4d127b00180cb92fee67e1fdea5ff2fbc7b9be7d997", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T22:19:58.997189+00:00", + "elapsed_seconds": 705.61, + "job": "214757", + "hostname": "auh7-1b-gpu-269", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "7077cfb160cf", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "caption_sha256": "0acdffedc18b04d2c2bef7d0a4e4e51544b75d4dd1f904e080d9e0490be24fb1", + "actual_t5_text": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "7077cfb160cf", + "arm": "t2v", + "caption": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "caption_sha256": "0acdffedc18b04d2c2bef7d0a4e4e51544b75d4dd1f904e080d9e0490be24fb1", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 53, + 2048 + ], + "feature_sha256": "863e64e016115388d775caa7fd1a8be61270b967361152418dfda43d47ba5cc6" + }, + "t5_text_inputs": [ + "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081904, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "cfce2698573f7b20a42686a08059ff6d39d7053cafcf4731fddab4d174c804ae", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:35:38.009473+00:00", + "elapsed_seconds": 599.71, + "job": "214728", + "hostname": "auh7-1b-gpu-283", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + }, + { + "status": "complete", + "case_id": "7077cfb160cf", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "caption_sha256": "0acdffedc18b04d2c2bef7d0a4e4e51544b75d4dd1f904e080d9e0490be24fb1", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 107, + "prompt_truncated": false, + "seed": 2026081904, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7077cfb160cf/source-exact81.mp4", + "source_sha256": "cef4c183b459c8aad72cdc81f3e6b2766a36fc22156bf382dd36c29cec6d5aa9", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_max", + "sigma_min", + "shift_terminal" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "2b0371a6e0660520daf895823f2f74b556503b075578fe2dca02f5c398bd23e7", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T22:05:32.304246+00:00", + "elapsed_seconds": 2298.97, + "job": "214752", + "hostname": "auh7-1b-gpu-210", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "7077cfb160cf", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "caption_sha256": "0acdffedc18b04d2c2bef7d0a4e4e51544b75d4dd1f904e080d9e0490be24fb1", + "actual_t5_text": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "7077cfb160cf", + "arm": "editing", + "caption": "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "caption_sha256": "0acdffedc18b04d2c2bef7d0a4e4e51544b75d4dd1f904e080d9e0490be24fb1", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7077cfb160cf/source-exact81.mp4", + "source_sha256": "cef4c183b459c8aad72cdc81f3e6b2766a36fc22156bf382dd36c29cec6d5aa9", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 80, + 2048 + ], + "feature_sha256": "70de5d8bbce06459f31e50438e02db4aae638a7c14eec75b64875ee09eb289cb" + }, + "t5_text_inputs": [ + "The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. She has shoulder-length light brown hair and wears a pink shirt and blue jeans. The wooden bench is in a sunny park. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081904, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7077cfb160cf/source-exact81.mp4", + "source_sha256": "cef4c183b459c8aad72cdc81f3e6b2766a36fc22156bf382dd36c29cec6d5aa9", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "3b158d997abb43e583b01b618a280bb0938570e81b73116ce351f2cb255e96af", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:08:05.180195+00:00", + "elapsed_seconds": 649.79, + "job": "214740", + "hostname": "auh7-1b-gpu-313", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + } + ] + }, + { + "case_id": "7e488525099e", + "name": "转身倚车 · Turn and lean on car", + "caption": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "caption_sha256": "ed6115b291eb39710054250e5a6fd3e51f92ed3675fe1af1c5b45617396c3082", + "outputs": [ + { + "status": "complete", + "case_id": "7e488525099e", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "caption_sha256": "ed6115b291eb39710054250e5a6fd3e51f92ed3675fe1af1c5b45617396c3082", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 58, + "prompt_truncated": false, + "seed": 2026081906, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_max", + "sigma_min", + "shift_terminal" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "4d3b693a341087b216eba42bc9933ed61efbead441536c78638dfd4e5cca9145", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T22:17:05.780853+00:00", + "elapsed_seconds": 519.14, + "job": "214758", + "hostname": "auh7-1b-gpu-312", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "7e488525099e", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "caption_sha256": "ed6115b291eb39710054250e5a6fd3e51f92ed3675fe1af1c5b45617396c3082", + "actual_t5_text": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "7e488525099e", + "arm": "t2v", + "caption": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "caption_sha256": "ed6115b291eb39710054250e5a6fd3e51f92ed3675fe1af1c5b45617396c3082", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 44, + 2048 + ], + "feature_sha256": "9f6d9a9afe61984fcb7355e65810471e2b4b623b73134d18a47daa0936b86b83" + }, + "t5_text_inputs": [ + "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081906, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "5d79f8d88fc14bccd0336603594e03abcc72413534b835b37698aed74b1bc7cf", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:36:39.023949+00:00", + "elapsed_seconds": 615.52, + "job": "214729", + "hostname": "auh7-1b-gpu-313", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + }, + { + "status": "complete", + "case_id": "7e488525099e", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "caption_sha256": "ed6115b291eb39710054250e5a6fd3e51f92ed3675fe1af1c5b45617396c3082", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 97, + "prompt_truncated": false, + "seed": 2026081906, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7e488525099e/source-exact81.mp4", + "source_sha256": "1f3cec72bef55b67c15ebfc063252cce867ea128594a225db61688ff961b35d4", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "shift_terminal", + "sigma_min", + "sigma_max" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "9829080372e3351bb3375d787615f72cc4a10be693f382edd9d36fae37079d0e", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T22:38:14.312525+00:00", + "elapsed_seconds": 2268.32, + "job": "214753", + "hostname": "auh7-1b-gpu-221", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "7e488525099e", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "caption_sha256": "ed6115b291eb39710054250e5a6fd3e51f92ed3675fe1af1c5b45617396c3082", + "actual_t5_text": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "7e488525099e", + "arm": "editing", + "caption": "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "caption_sha256": "ed6115b291eb39710054250e5a6fd3e51f92ed3675fe1af1c5b45617396c3082", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7e488525099e/source-exact81.mp4", + "source_sha256": "1f3cec72bef55b67c15ebfc063252cce867ea128594a225db61688ff961b35d4", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 71, + 2048 + ], + "feature_sha256": "a34cbe81e1903e91618292d5ab323f49478f88c4638de853db8d3bb4475d4242" + }, + "t5_text_inputs": [ + "The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The setting is an underground parking garage with steady red lighting. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081906, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7e488525099e/source-exact81.mp4", + "source_sha256": "1f3cec72bef55b67c15ebfc063252cce867ea128594a225db61688ff961b35d4", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "19321c8236ea55c3ce3006817c0c8316f9313bc193729e4ba6dd1651f445d5fc", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:15:57.054117+00:00", + "elapsed_seconds": 886.52, + "job": "214741", + "hostname": "auh7-1b-gpu-320", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + } + ] + }, + { + "case_id": "d5221a1b69d5", + "name": "闭眼尝汤 · Taste from ladle", + "caption": "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "caption_sha256": "043306a7c3eff9ad7a50db5bbf0d3b4a2d6dec27fb8c5b5f6a316382992bc71b", + "outputs": [ + { + "status": "complete", + "case_id": "d5221a1b69d5", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "caption_sha256": "043306a7c3eff9ad7a50db5bbf0d3b4a2d6dec27fb8c5b5f6a316382992bc71b", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 53, + "prompt_truncated": false, + "seed": 2026081907, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "shift_terminal", + "sigma_min", + "sigma_max" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "28120017a5e122b3f72956b9c2b16b20aae762baa4e88b9bab605ed03fff7c40", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:42:17.028942+00:00", + "elapsed_seconds": 483.92, + "job": "214709", + "hostname": "auh7-1b-gpu-312", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "d5221a1b69d5", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "caption_sha256": "043306a7c3eff9ad7a50db5bbf0d3b4a2d6dec27fb8c5b5f6a316382992bc71b", + "actual_t5_text": "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "d5221a1b69d5", + "arm": "t2v", + "caption": "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "caption_sha256": "043306a7c3eff9ad7a50db5bbf0d3b4a2d6dec27fb8c5b5f6a316382992bc71b", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 40, + 2048 + ], + "feature_sha256": "32fb5857a4b6f85b7d8f9028089619067c830e83ddb787da525a2475cfdcbf7c" + }, + "t5_text_inputs": [ + "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081907, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "9ee4d254b5c2d579d3a9adcdc9d1057d7a8ef0afe1860f8a785db66d2cedd8ab", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:36:30.235433+00:00", + "elapsed_seconds": 603.1, + "job": "214730", + "hostname": "auh7-1b-gpu-282", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + }, + { + "status": "complete", + "case_id": "d5221a1b69d5", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "caption_sha256": "043306a7c3eff9ad7a50db5bbf0d3b4a2d6dec27fb8c5b5f6a316382992bc71b", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 92, + "prompt_truncated": false, + "seed": 2026081907, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d5221a1b69d5/source-exact81.mp4", + "source_sha256": "fdd1b3df4b94449dc59cd04d03deb769fb2cf6c4c2d7b87221e2b3a6b5557d14", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_max", + "shift_terminal", + "sigma_min" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "9cdbd07566d899630c7d460876abe733604cb04d284adf01842a9716a5db4ec3", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T22:38:07.139056+00:00", + "elapsed_seconds": 2248.64, + "job": "214754", + "hostname": "auh7-1b-gpu-320", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "d5221a1b69d5", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "caption_sha256": "043306a7c3eff9ad7a50db5bbf0d3b4a2d6dec27fb8c5b5f6a316382992bc71b", + "actual_t5_text": "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "d5221a1b69d5", + "arm": "editing", + "caption": "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "caption_sha256": "043306a7c3eff9ad7a50db5bbf0d3b4a2d6dec27fb8c5b5f6a316382992bc71b", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d5221a1b69d5/source-exact81.mp4", + "source_sha256": "fdd1b3df4b94449dc59cd04d03deb769fb2cf6c4c2d7b87221e2b3a6b5557d14", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 67, + 2048 + ], + "feature_sha256": "c34f3a4e8b0058cf7a7f941082a5266c00ee63aea17fccbbdec08c7d9905eddb" + }, + "t5_text_inputs": [ + "The woman in an apron closes her eyes as she tastes from a metal ladle. She wears a patterned apron in a modern kitchen. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081907, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d5221a1b69d5/source-exact81.mp4", + "source_sha256": "fdd1b3df4b94449dc59cd04d03deb769fb2cf6c4c2d7b87221e2b3a6b5557d14", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "a1e43492995e5fefe7ace547ce6f62cb6fe363ae29ad365f7144f36f7bf4e900", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:23:04.739246+00:00", + "elapsed_seconds": 963.54, + "job": "214742", + "hostname": "auh7-1b-gpu-210", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + } + ] + }, + { + "case_id": "40712e1341dc", + "name": "放下手机后翻身睡觉 · Put phone away and sleep", + "caption": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "caption_sha256": "24857d19e619899acd653ea104c6a5b68b895cdd4b5cc3637df661f694521907", + "outputs": [ + { + "status": "complete", + "case_id": "40712e1341dc", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "caption_sha256": "24857d19e619899acd653ea104c6a5b68b895cdd4b5cc3637df661f694521907", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 74, + "prompt_truncated": false, + "seed": 2026081911, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_min", + "sigma_max", + "shift_terminal" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "ac158010a45d2c746774740d9a513440d29ac8d82604895d75b41c73e1461eef", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:45:13.322144+00:00", + "elapsed_seconds": 482.84, + "job": "214710", + "hostname": "auh7-1b-gpu-283", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "40712e1341dc", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "caption_sha256": "24857d19e619899acd653ea104c6a5b68b895cdd4b5cc3637df661f694521907", + "actual_t5_text": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "40712e1341dc", + "arm": "t2v", + "caption": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "caption_sha256": "24857d19e619899acd653ea104c6a5b68b895cdd4b5cc3637df661f694521907", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 61, + 2048 + ], + "feature_sha256": "f953db0ef97435bed85eb46eb0a25136e1775f7d4342e1a435a9ed189580145c" + }, + "t5_text_inputs": [ + "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081911, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "9dafe547fd5b649dccbf097319e9f41141518721416a7a75534548dbf4f138e3", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T22:26:43.210982+00:00", + "elapsed_seconds": 958.87, + "job": "214756", + "hostname": "auh7-1b-gpu-210", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + }, + { + "status": "complete", + "case_id": "40712e1341dc", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "caption_sha256": "24857d19e619899acd653ea104c6a5b68b895cdd4b5cc3637df661f694521907", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 113, + "prompt_truncated": false, + "seed": 2026081911, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/40712e1341dc/source-exact81.mp4", + "source_sha256": "654e997c46a6f78a2ad78359b713767aefe61a6cc732b5be4527720323349f69", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "shift_terminal", + "sigma_max", + "sigma_min" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "d6b8387a8f977f88fec1fa6f16ef0ad0ae9c22554a74bb661014ad6260532037", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T22:30:33.960692+00:00", + "elapsed_seconds": 1605.68, + "job": "214755", + "hostname": "auh7-1b-gpu-283", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "40712e1341dc", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "caption_sha256": "24857d19e619899acd653ea104c6a5b68b895cdd4b5cc3637df661f694521907", + "actual_t5_text": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "40712e1341dc", + "arm": "editing", + "caption": "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "caption_sha256": "24857d19e619899acd653ea104c6a5b68b895cdd4b5cc3637df661f694521907", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/40712e1341dc/source-exact81.mp4", + "source_sha256": "654e997c46a6f78a2ad78359b713767aefe61a6cc732b5be4527720323349f69", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 88, + 2048 + ], + "feature_sha256": "17f26bdae837dadcbf1c11b139c2c9ba8cbaa805f2f35c4fff16b1a5a0a45f67" + }, + "t5_text_inputs": [ + "The man in bed puts his smartphone on the nightstand and turns over to go to sleep. He has dyed-blond hair, wears a pink tank top and a nose ring, and is in a dark bedroom with a nightstand beside the bed. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081911, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/40712e1341dc/source-exact81.mp4", + "source_sha256": "654e997c46a6f78a2ad78359b713767aefe61a6cc732b5be4527720323349f69", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "271248625a365fabc0664f1e5f3cfadd94ad2179e17a2efa261b9d5926d3765b", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:20:56.467352+00:00", + "elapsed_seconds": 646.24, + "job": "214743", + "hostname": "auh7-1b-gpu-307", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + } + ] + }, + { + "case_id": "10af6c651dbc", + "name": "Jellyfish contraction", + "caption": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "caption_sha256": "790782c54c3fea6d88d28f9129501ef060ebc863cd6ead101f7a12563d43e383", + "outputs": [ + { + "status": "complete", + "case_id": "10af6c651dbc", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "caption_sha256": "790782c54c3fea6d88d28f9129501ef060ebc863cd6ead101f7a12563d43e383", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 65, + "prompt_truncated": false, + "seed": 2026081910, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "shift_terminal", + "sigma_min", + "sigma_max" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "99c080cb8ebc719e47354dbc79ba641c7ffcc30c355bbafd05335903314ba8d8", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:04:25.056432+00:00", + "elapsed_seconds": 579.95, + "job": "214700", + "hostname": "auh7-1b-gpu-282", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "10af6c651dbc", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "caption_sha256": "790782c54c3fea6d88d28f9129501ef060ebc863cd6ead101f7a12563d43e383", + "actual_t5_text": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "10af6c651dbc", + "arm": "t2v", + "caption": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "caption_sha256": "790782c54c3fea6d88d28f9129501ef060ebc863cd6ead101f7a12563d43e383", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 47, + 2048 + ], + "feature_sha256": "b1d9193dbd160064ceb99196242d2707a2f74e510993302982dac03e6b713c01" + }, + "t5_text_inputs": [ + "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081910, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "1d1edd0eef41ff1fcde1a1bd662fdb47694a3b9ed60e458e83e842af441f9eb6", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:18:02.505227+00:00", + "elapsed_seconds": 608.46, + "job": "214721", + "hostname": "auh7-1b-gpu-312", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + }, + { + "status": "complete", + "case_id": "10af6c651dbc", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "caption_sha256": "790782c54c3fea6d88d28f9129501ef060ebc863cd6ead101f7a12563d43e383", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 104, + "prompt_truncated": false, + "seed": 2026081910, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/10af6c651dbc/source-exact81.mp4", + "source_sha256": "ea86ef53e403f1cc602594cc3623a2fb66fb9b2f65c1461ef2bf62bee82a35fb", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_max", + "sigma_min", + "shift_terminal" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "82c8810cd7546c2d6ea80743c3c90d4a926e37f5099790e2b6acf5fc19c77510", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:36:06.353806+00:00", + "elapsed_seconds": 1623.09, + "job": "214745", + "hostname": "auh7-1b-gpu-282", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "10af6c651dbc", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "caption_sha256": "790782c54c3fea6d88d28f9129501ef060ebc863cd6ead101f7a12563d43e383", + "actual_t5_text": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "10af6c651dbc", + "arm": "editing", + "caption": "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "caption_sha256": "790782c54c3fea6d88d28f9129501ef060ebc863cd6ead101f7a12563d43e383", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/10af6c651dbc/source-exact81.mp4", + "source_sha256": "ea86ef53e403f1cc602594cc3623a2fb66fb9b2f65c1461ef2bf62bee82a35fb", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 74, + 2048 + ], + "feature_sha256": "31d5a8e438020fe75f1d26e7ad419c5e28ba4983c9e49203dd1a52efd9017d75" + }, + "t5_text_inputs": [ + "The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. A small, translucent jellyfish with white spots is surrounded by deep blue water. The underwater camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081910, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/10af6c651dbc/source-exact81.mp4", + "source_sha256": "ea86ef53e403f1cc602594cc3623a2fb66fb9b2f65c1461ef2bf62bee82a35fb", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "d7a3b42e059c8ac6133f96b2fc4664509d504c9f821f45cc24d9d99acb151d44", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:56:21.408682+00:00", + "elapsed_seconds": 921.01, + "job": "214733", + "hostname": "auh7-1b-gpu-320", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + } + ] + }, + { + "case_id": "7fa338474c75", + "name": "Playful selfie", + "caption": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "caption_sha256": "f7d22ce2d98ed6adff42d53192e7204016d9035165349de21317c756823ac96e", + "outputs": [ + { + "status": "complete", + "case_id": "7fa338474c75", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "caption_sha256": "f7d22ce2d98ed6adff42d53192e7204016d9035165349de21317c756823ac96e", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 61, + "prompt_truncated": false, + "seed": 2026081900, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "shift_terminal", + "sigma_max", + "sigma_min" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "9f68a732503e5d11d4b94ee86ea61175d555092ffc539b69615faf0e050a083d", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:03:56.015342+00:00", + "elapsed_seconds": 558.77, + "job": "214701", + "hostname": "auh7-1b-gpu-283", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "7fa338474c75", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "caption_sha256": "f7d22ce2d98ed6adff42d53192e7204016d9035165349de21317c756823ac96e", + "actual_t5_text": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "7fa338474c75", + "arm": "t2v", + "caption": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "caption_sha256": "f7d22ce2d98ed6adff42d53192e7204016d9035165349de21317c756823ac96e", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 46, + 2048 + ], + "feature_sha256": "d54fddcf16850d14dc9dfb71b863ba619646a35c90cd4dd2d62419a2adda477a" + }, + "t5_text_inputs": [ + "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081900, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "0c6b53c4bae5fa1c7275fb71f5197c6312876d3813ae35b9c4db361712d3c65f", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:20:46.292401+00:00", + "elapsed_seconds": 595.85, + "job": "214722", + "hostname": "auh7-1b-gpu-283", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + }, + { + "status": "complete", + "case_id": "7fa338474c75", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "caption_sha256": "f7d22ce2d98ed6adff42d53192e7204016d9035165349de21317c756823ac96e", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 100, + "prompt_truncated": false, + "seed": 2026081900, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7fa338474c75/source-exact81.mp4", + "source_sha256": "4278c748fa1fdd54d908c366a781df33d3e4eb1acc1c2b7bd3492659c66a9840", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_min", + "sigma_max", + "shift_terminal" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "d80fbfb74a6ab3aed91b258c759a2eb21e37b66c82513742590b0e512e0f49f4", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:36:39.558813+00:00", + "elapsed_seconds": 1623.02, + "job": "214746", + "hostname": "auh7-1b-gpu-313", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "7fa338474c75", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "caption_sha256": "f7d22ce2d98ed6adff42d53192e7204016d9035165349de21317c756823ac96e", + "actual_t5_text": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "7fa338474c75", + "arm": "editing", + "caption": "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "caption_sha256": "f7d22ce2d98ed6adff42d53192e7204016d9035165349de21317c756823ac96e", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7fa338474c75/source-exact81.mp4", + "source_sha256": "4278c748fa1fdd54d908c366a781df33d3e4eb1acc1c2b7bd3492659c66a9840", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 73, + 2048 + ], + "feature_sha256": "dc6a8fcf6aace395826a95d45c233eabfd1bbacf9f833e8de912e13129a059d8" + }, + "t5_text_inputs": [ + "The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. She is framed in a static medium shot against a uniform green screen background.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081900, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7fa338474c75/source-exact81.mp4", + "source_sha256": "4278c748fa1fdd54d908c366a781df33d3e4eb1acc1c2b7bd3492659c66a9840", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "e4267370c4b549bba46b2c14020f9fff2a725e1b4c90379041ab73bbeb59e8be", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:51:53.409740+00:00", + "elapsed_seconds": 636.88, + "job": "214734", + "hostname": "auh7-1b-gpu-282", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + } + ] + }, + { + "case_id": "81533c9e56ec", + "name": "Scarf spin", + "caption": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "caption_sha256": "f6e77c2c4c9a431ed92369c65484776cb036d47a4d72c6a19e11d2a4d5b09579", + "outputs": [ + { + "status": "complete", + "case_id": "81533c9e56ec", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "caption_sha256": "f6e77c2c4c9a431ed92369c65484776cb036d47a4d72c6a19e11d2a4d5b09579", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 65, + "prompt_truncated": false, + "seed": 2026081915, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_min", + "sigma_max", + "shift_terminal" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "d7a3869e2f1e3f30b90495f183234d1dcd56b5566c27678ac94669f243f45be8", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:03:06.079836+00:00", + "elapsed_seconds": 499.76, + "job": "214702", + "hostname": "auh7-1b-gpu-312", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "81533c9e56ec", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "caption_sha256": "f6e77c2c4c9a431ed92369c65484776cb036d47a4d72c6a19e11d2a4d5b09579", + "actual_t5_text": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "81533c9e56ec", + "arm": "t2v", + "caption": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "caption_sha256": "f6e77c2c4c9a431ed92369c65484776cb036d47a4d72c6a19e11d2a4d5b09579", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 49, + 2048 + ], + "feature_sha256": "55500ce71d10d808501849ae5c122f61dbff99b38bd16dd415fb146d599a62c3" + }, + "t5_text_inputs": [ + "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081915, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "a78f02ecb3aaa875cec8a133397227a526d4ea0e8dadf0a79bb3d7f8478f49e2", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:21:31.826216+00:00", + "elapsed_seconds": 612.01, + "job": "214723", + "hostname": "auh7-1b-gpu-313", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + }, + { + "status": "complete", + "case_id": "81533c9e56ec", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "caption_sha256": "f6e77c2c4c9a431ed92369c65484776cb036d47a4d72c6a19e11d2a4d5b09579", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 104, + "prompt_truncated": false, + "seed": 2026081915, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/81533c9e56ec/source-exact81.mp4", + "source_sha256": "6daa80d3ac407b01f842ce6fa611b3ec6c421851525f0845779143c4577e0b19", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "shift_terminal", + "sigma_min", + "sigma_max" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "6568610950f2753ca3d4c6812018131d53241cb7921236502d6b4d4946380dd9", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:47:28.810955+00:00", + "elapsed_seconds": 2245.25, + "job": "214747", + "hostname": "auh7-1b-gpu-206", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "81533c9e56ec", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "caption_sha256": "f6e77c2c4c9a431ed92369c65484776cb036d47a4d72c6a19e11d2a4d5b09579", + "actual_t5_text": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "81533c9e56ec", + "arm": "editing", + "caption": "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "caption_sha256": "f6e77c2c4c9a431ed92369c65484776cb036d47a4d72c6a19e11d2a4d5b09579", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/81533c9e56ec/source-exact81.mp4", + "source_sha256": "6daa80d3ac407b01f842ce6fa611b3ec6c421851525f0845779143c4577e0b19", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 76, + 2048 + ], + "feature_sha256": "09cbf7460835b917d1811c9612fb73eb0bd7c7ad17b988a8093c86702c180100" + }, + "t5_text_inputs": [ + "The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. Her scarf is red and white. A flower-lined fence and a rustic wooden house form the background. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081915, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/81533c9e56ec/source-exact81.mp4", + "source_sha256": "6daa80d3ac407b01f842ce6fa611b3ec6c421851525f0845779143c4577e0b19", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "d156e96a7fb7d91ea4a5e0159841362af432c9fed0b20882a8d508796398f671", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:52:22.199956+00:00", + "elapsed_seconds": 650.56, + "job": "214735", + "hostname": "auh7-1b-gpu-313", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + } + ] + }, + { + "case_id": "d977ce147d80", + "name": "Rub eyes then cover face", + "caption": "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "caption_sha256": "a217f2a0d32d07e58d5c5781d12d401ed7a08f25d9286ea9f0bee5c25677e960", + "outputs": [ + { + "status": "complete", + "case_id": "d977ce147d80", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "caption_sha256": "a217f2a0d32d07e58d5c5781d12d401ed7a08f25d9286ea9f0bee5c25677e960", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 70, + "prompt_truncated": false, + "seed": 2026081905, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_max", + "shift_terminal", + "sigma_min" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "bad7436ab05bc9d57e503b271ad88b897e1a1ee4db3d8c43c940ce83c37cbf1e", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:04:24.410554+00:00", + "elapsed_seconds": 578.94, + "job": "214703", + "hostname": "auh7-1b-gpu-313", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "d977ce147d80", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "caption_sha256": "a217f2a0d32d07e58d5c5781d12d401ed7a08f25d9286ea9f0bee5c25677e960", + "actual_t5_text": "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "d977ce147d80", + "arm": "t2v", + "caption": "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "caption_sha256": "a217f2a0d32d07e58d5c5781d12d401ed7a08f25d9286ea9f0bee5c25677e960", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 56, + 2048 + ], + "feature_sha256": "f578112393aca285a045449d97541a449320571490c0012b73a7d22c73d52bdd" + }, + "t5_text_inputs": [ + "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081905, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "802cb826e1a39c7a3e2adcb35e2e2288439bc8acfaa86ec6c68dd450b95601f6", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:21:34.897069+00:00", + "elapsed_seconds": 599.87, + "job": "214724", + "hostname": "auh7-1b-gpu-282", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + }, + { + "status": "complete", + "case_id": "d977ce147d80", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "caption_sha256": "a217f2a0d32d07e58d5c5781d12d401ed7a08f25d9286ea9f0bee5c25677e960", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 109, + "prompt_truncated": false, + "seed": 2026081905, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d977ce147d80/source-exact81.mp4", + "source_sha256": "e2a056e1af423be25a5beb4b75d1145fbacd625e3316a8e64b6031e75739f80d", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_min", + "shift_terminal", + "sigma_max" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "24f7ac9b4d8248228c92995b84173dca81c0bae42f890f507c6fc46f9fae3a43", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:49:26.067248+00:00", + "elapsed_seconds": 2309.32, + "job": "214748", + "hostname": "auh7-1b-gpu-269", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "d977ce147d80", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "caption_sha256": "a217f2a0d32d07e58d5c5781d12d401ed7a08f25d9286ea9f0bee5c25677e960", + "actual_t5_text": "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "d977ce147d80", + "arm": "editing", + "caption": "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "caption_sha256": "a217f2a0d32d07e58d5c5781d12d401ed7a08f25d9286ea9f0bee5c25677e960", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d977ce147d80/source-exact81.mp4", + "source_sha256": "e2a056e1af423be25a5beb4b75d1145fbacd625e3316a8e64b6031e75739f80d", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 83, + 2048 + ], + "feature_sha256": "a9f5554f6eb78289b924250b313712b58c925a9b0599cc70399b9a099117334c" + }, + "t5_text_inputs": [ + "The man lying on the couch rubs his tired eyes and covers his face with both hands. He has dark skin, dreadlocks, and a gold septum ring. The couch is dark and the room is dimly lit. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081905, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d977ce147d80/source-exact81.mp4", + "source_sha256": "e2a056e1af423be25a5beb4b75d1145fbacd625e3316a8e64b6031e75739f80d", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "1ecb531ea6b3a35432fabcb94944940f4a199b8b14067578cf2378b5ab32c23d", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:09:38.268251+00:00", + "elapsed_seconds": 1047.39, + "job": "214736", + "hostname": "auh7-1b-gpu-269", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + } + ] + }, + { + "case_id": "840b214afead", + "name": "Place bottle on treadmill", + "caption": "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "caption_sha256": "fe3b668a66485813f97192ae443c497bc34efcc6edbd10bbdf8af1724af85247", + "outputs": [ + { + "status": "complete", + "case_id": "840b214afead", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "caption_sha256": "fe3b668a66485813f97192ae443c497bc34efcc6edbd10bbdf8af1724af85247", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 71, + "prompt_truncated": false, + "seed": 2026081913, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_max", + "sigma_min", + "shift_terminal" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "88c0e40f239232c6cbb95be01496886f9100f26023b357bc13dd26715e4155cb", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:49:44.701325+00:00", + "elapsed_seconds": 545.02, + "job": "214704", + "hostname": "auh7-1b-gpu-307", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "840b214afead", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "caption_sha256": "fe3b668a66485813f97192ae443c497bc34efcc6edbd10bbdf8af1724af85247", + "actual_t5_text": "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "840b214afead", + "arm": "t2v", + "caption": "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "caption_sha256": "fe3b668a66485813f97192ae443c497bc34efcc6edbd10bbdf8af1724af85247", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 54, + 2048 + ], + "feature_sha256": "dd48866a02a17042eef8b6cbde060576c10deaf6137ee965388861edfd103d7a" + }, + "t5_text_inputs": [ + "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081913, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "86baea5251e3c110b691d72b25cfb9405e3039affbbaf8e921c7e9169101b1c2", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:36:13.591878+00:00", + "elapsed_seconds": 1029.69, + "job": "214725", + "hostname": "auh7-1b-gpu-320", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + }, + { + "status": "complete", + "case_id": "840b214afead", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "caption_sha256": "fe3b668a66485813f97192ae443c497bc34efcc6edbd10bbdf8af1724af85247", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 110, + "prompt_truncated": false, + "seed": 2026081913, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/840b214afead/source-exact81.mp4", + "source_sha256": "a6e42a447d7fef26b073878c551a631afd6371987910a332e51e4a9e4dfb4646", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_min", + "sigma_max", + "shift_terminal" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "aa4f8096577b9224c04eadfefb1581272b7a1355a9a730939813296ef15d39a2", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:59:20.369231+00:00", + "elapsed_seconds": 2401.86, + "job": "214749", + "hostname": "auh7-1b-gpu-320", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "840b214afead", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "caption_sha256": "fe3b668a66485813f97192ae443c497bc34efcc6edbd10bbdf8af1724af85247", + "actual_t5_text": "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "840b214afead", + "arm": "editing", + "caption": "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "caption_sha256": "fe3b668a66485813f97192ae443c497bc34efcc6edbd10bbdf8af1724af85247", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/840b214afead/source-exact81.mp4", + "source_sha256": "a6e42a447d7fef26b073878c551a631afd6371987910a332e51e4a9e4dfb4646", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 81, + 2048 + ], + "feature_sha256": "8d2079d5bd9b6692dfeb7a739b208a4eaf19cf1aca8b431b9a99ec76318349d8" + }, + "t5_text_inputs": [ + "The woman turns her head to the left and places her water bottle onto the treadmill. She has long reddish-blonde hair and wears a mint green athletic outfit. The modern gym has blue and white striped pillars. The camera is stationary.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081913, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/840b214afead/source-exact81.mp4", + "source_sha256": "a6e42a447d7fef26b073878c551a631afd6371987910a332e51e4a9e4dfb4646", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "8e7370fc84142be3daa707d6ffc7ff82556f7167a6fe14ed26ce5112d574f625", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:08:46.895702+00:00", + "elapsed_seconds": 974.76, + "job": "214737", + "hostname": "auh7-1b-gpu-206", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + } + ] + }, + { + "case_id": "d908552fb691", + "name": "Bow to clap", + "caption": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "caption_sha256": "025f04cb7e601915763666a56d60e01f88ed30d6efa85a172c0cf38eff834896", + "outputs": [ + { + "status": "complete", + "case_id": "d908552fb691", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "t2v", + "caption": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "caption_sha256": "025f04cb7e601915763666a56d60e01f88ed30d6efa85a172c0cf38eff834896", + "actual_t5_text": "You are a helpful assistant specialized in text-to-video generation.The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "task_prefix": "You are a helpful assistant specialized in text-to-video generation.", + "native_reference_binding": "", + "prompt_rewriting": false, + "positive_token_count": 60, + "prompt_truncated": false, + "seed": 2026081903, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_max", + "shift_terminal", + "sigma_min" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 26, + 54 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "4316ede62030399da548d0b2b136333c622705fe1395b948ab7d60eca68430ce", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:45:46.786299+00:00", + "elapsed_seconds": 730.83, + "job": "214705", + "hostname": "auh7-1b-gpu-206", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "d908552fb691", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "t2v", + "caption": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "caption_sha256": "025f04cb7e601915763666a56d60e01f88ed30d6efa85a172c0cf38eff834896", + "actual_t5_text": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "d908552fb691", + "arm": "t2v", + "caption": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "caption_sha256": "025f04cb7e601915763666a56d60e01f88ed30d6efa85a172c0cf38eff834896", + "source_video_path": null, + "source_sha256": null, + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 51, + 2048 + ], + "feature_sha256": "104ba746d40a2909261000fd07d3cefaf8f075beea1e2f6d4224a62c95937b01" + }, + "t5_text_inputs": [ + "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 1, + "seed": 2026081903, + "steps": 40, + "fps": 25, + "source_video": null, + "source_sha256": null, + "real_target_used": false, + "visual_latent_shape": null, + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "7458de291881bf7e8eb7909a7dbad8fae1c01726304a6494eb637e4ba845c60b", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T20:32:53.829299+00:00", + "elapsed_seconds": 603.13, + "job": "214726", + "hostname": "auh7-1b-gpu-312", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + }, + { + "status": "complete", + "case_id": "d908552fb691", + "model": "ByteDance/Bernini-R-Diffusers", + "revision": "de8c4621d3ac75cc33efe3db8deaed2023e9ac8c", + "arm": "editing", + "caption": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "caption_sha256": "025f04cb7e601915763666a56d60e01f88ed30d6efa85a172c0cf38eff834896", + "actual_t5_text": "You are a helpful assistant specialized in video editing with reference.image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "task_prefix": "You are a helpful assistant specialized in video editing with reference.", + "native_reference_binding": "image0, image1, image2, and image3 are frames sampled from the source video. Preserve the source subject's identity, background, and camera while applying the requested new action. ", + "prompt_rewriting": false, + "positive_token_count": 99, + "prompt_truncated": false, + "seed": 2026081903, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d908552fb691/source-exact81.mp4", + "source_sha256": "56e1faa78c02c32d6da71354e8434241c8e9a4c334da4ac8aa4415148b6230bb", + "effective_scheduler_config": { + "num_train_timesteps": 1000, + "beta_start": 0.0001, + "beta_end": 0.02, + "beta_schedule": "linear", + "trained_betas": null, + "solver_order": 2, + "prediction_type": "flow_prediction", + "thresholding": false, + "dynamic_thresholding_ratio": 0.995, + "sample_max_value": 1.0, + "predict_x0": true, + "solver_type": "bh2", + "lower_order_final": true, + "disable_corrector": [], + "solver_p": null, + "use_karras_sigmas": false, + "use_exponential_sigmas": false, + "use_beta_sigmas": false, + "use_flow_sigmas": true, + "flow_shift": 3.0, + "timestep_spacing": "linspace", + "steps_offset": 0, + "final_sigmas_type": "zero", + "rescale_betas_zero_snr": false, + "use_dynamic_shifting": false, + "time_shift_type": "exponential", + "sigma_min": null, + "sigma_max": null, + "shift_terminal": null, + "_use_default_values": [ + "sigma_max", + "shift_terminal", + "sigma_min" + ], + "_class_name": "UniPCMultistepScheduler", + "_diffusers_version": "0.35.0.dev0" + }, + "source_reference_frames": [ + 0, + 27, + 53, + 80 + ], + "real_target_used": false, + "expert_parameters": [ + 14288491584, + 14288491584 + ], + "expert_forward_counts": [ + 52, + 108 + ], + "loading_info": [ + { + "subfolder": "transformer", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + }, + { + "subfolder": "transformer_2", + "info": { + "missing_keys": [], + "unexpected_keys": [], + "mismatched_keys": [], + "error_msgs": [] + } + } + ], + "output": { + "sha256": "f164b04e01c335a49aca4f94494b87bd5ff2253a61f7d158fa2ddd00ade9967b", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 464, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:59:03.774298+00:00", + "elapsed_seconds": 2250.01, + "job": "214750", + "hostname": "auh7-1b-gpu-221", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "700a4e76177713a6ba2ff7bb92d7976788b646bf153ad7154701ed422ca966d6" + }, + { + "status": "complete", + "case_id": "d908552fb691", + "model": "Fudan-FUXI/OmniVideo2-A14B", + "revision": "51160486a5498cce099bde02cbf232cd046ab4a9", + "arm": "editing", + "caption": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "caption_sha256": "025f04cb7e601915763666a56d60e01f88ed30d6efa85a172c0cf38eff834896", + "actual_t5_text": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "prompt_rewriting": false, + "qwen_features": { + "case_id": "d908552fb691", + "arm": "editing", + "caption": "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "caption_sha256": "025f04cb7e601915763666a56d60e01f88ed30d6efa85a172c0cf38eff834896", + "source_video_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d908552fb691/source-exact81.mp4", + "source_sha256": "56e1faa78c02c32d6da71354e8434241c8e9a4c334da4ac8aa4415148b6230bb", + "rewriting_enabled": false, + "autoregressive_generate_forbidden": true, + "qwen_checkpoint": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "feature_shape": [ + 78, + 2048 + ], + "feature_sha256": "114740c8405aa14069531f4ff749cc0da9706f5fe07cf087a02f9e11bbdbc19c" + }, + "t5_text_inputs": [ + "The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. Her uniform is white with a black collar. The background is black with side lighting, in a static medium shot.", + "overly vivid colors, overexposed, static, blurry and unclear details, subtitles, text overlays, stylized artwork, painting, illustration, still image, frozen frame, grayish overall tone, worst quality, low quality, JPEG compression artifacts, ugly, incomplete, extra fingers, poorly drawn hands, poorly drawn face, deformed, disfigured, malformed anatomy, distorted limbs, fused fingers, motionless frame, cluttered background, three legs, walking backward, expression drift, teeth flickering, uneven facial muscles, facial shivering" + ], + "positive_t5_context_copies": 2, + "seed": 2026081903, + "steps": 40, + "fps": 25, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d908552fb691/source-exact81.mp4", + "source_sha256": "56e1faa78c02c32d6da71354e8434241c8e9a4c334da4ac8aa4415148b6230bb", + "real_target_used": false, + "visual_latent_shape": [ + 1, + 16, + 21, + 60, + 104 + ], + "expert_parameters": [ + 14319177792, + 14319177792 + ], + "expert_forward_counts": [ + 34, + 46 + ], + "strict_checkpoint_load": true, + "max_context_length": 9216, + "context_truncation": false, + "output": { + "sha256": "aafdce633f1ac4a24120c74a0a75ddb3a4b8a4198e0734ce3643bf8124d8ceb2", + "avg_frame_rate": "25/1", + "codec_name": "h264", + "duration": "3.240000000", + "height": 480, + "nb_read_frames": "81", + "width": 832 + }, + "full_decode_passed": true, + "completed_utc": "2026-09-23T21:05:24.214802+00:00", + "elapsed_seconds": 651.09, + "job": "214738", + "hostname": "auh7-1b-gpu-307", + "inputs_sha256": "caa915bc2243c0e21f38532c0b4100e7e4078e575d5d14f54656edc91cd3a535", + "driver_sha256": "c83cf03c774b3f29f430e9442d6667e5d7d26e7813a836379620c875e83b8295" + } + ] + } +] diff --git a/projects/video-action-editing/metadata.yaml b/projects/video-action-editing/metadata.yaml new file mode 100644 index 0000000..ac48a7c --- /dev/null +++ b/projects/video-action-editing/metadata.yaml @@ -0,0 +1,14 @@ +title: "Video Action Editing" +slug: video-action-editing +status: active +summary: "VADD: Video Action Editing via Demonstrations and Disentanglement, with theory, methods, and interactive comparisons on synthetic and real videos." +leaders: + - name: Peiyuan Zhu + short_name: peiyuan + github: SoftPointer +tags: + - video-editing + - action-editing + - disentanglement +links: + demo: https://causalvideogroup.github.io/projects/video-action-editing/ diff --git a/projects/video-action-editing/omni-all12/index.html b/projects/video-action-editing/omni-all12/index.html new file mode 100644 index 0000000..230fe6d --- /dev/null +++ b/projects/video-action-editing/omni-all12/index.html @@ -0,0 +1,23 @@ + +Bernini / OmniVideo2 · T2V 与视频编辑十二例对比

Bernini / OmniVideo2 · T2V 与视频编辑十二例对比

+

Self-generated T2V 已收集 12/12;视频编辑已有 12/12。T2V 只接收文本,从噪声生成新视频;编辑分支接收 Source。两类结果在这里分别标注。

+

T2V 初始 caption 复用 Bernini 的旧拼接文本:MEV 整体描述 + 目标动作标注 + 保持约束。12 例均包含 Editing instruction 对应的目标动作。Omni 随后经过 Qwen 扩写,再送入 T5;两模型共享初始正文,但最终生成文本不同。下方可展开查看逐层文本及已发现的偏差。

+

Omni T2V:81 帧、25 fps、40 步、832×480;seed 与 Bernini 相同。当前视频保留原始运行结果。文本核对不等同于视频动作成功评估。

+

Real target 是样本配对的真实目标视频,仅用于对照。为同步比较,完整目标片段统一调整为 81 帧、25 fps(3.24 秒),播放速度可能与原片不同。

+

查看大模型:Bernini-R 14B / OmniVideo2-A14B,固定同一 caption 的生成与编辑对比

+
T2V 汇总
+

提杠铃 · Barbell lift

Editing instruction
Edit the action so that the woman in a home gym lifts a barbell from the floor to her waist.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V

文本核对:Omni 扩写把 lifts from the floor to her waist 写成 lowering ... from the floor to her waist,动作方向语义矛盾。初始整体 caption 还描述重复 deadlifts。

Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The woman in a home gym lifts a barbell from the floor to her waist.
原始整体描述 · MEV global_prompt.short_caption
A woman in black activewear performs barbell deadlifts with focused determination in a well-equipped home gym.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A woman in black activewear performs barbell deadlifts with focused determination in a well-equipped home gym. In this continuous shot, The woman in a home gym lifts a barbell from the floor to her waist. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A woman in sleek black activewear performs a series of controlled barbell deadlifts in a well-equipped home gym, her movements precise and deliberate. The camera holds a steady, medium-wide shot, capturing her full body as she stands with feet shoulder-width apart, gripping the barbell with a firm overhand hold. With focused determination etched on her face, she bends at the hips and knees, lowering the barbell smoothly from the floor to her waist, maintaining a straight back and engaged core throughout. The gym is bathed in soft, even lighting that highlights the clean, organized space—treadmills, weight racks, and resistance bands visible in the background. The scene remains consistent, with no changes in framing, camera angle, or lighting, emphasizing the continuity and rhythm of her exercise. Her breath is steady, her muscles taut, as she repeats the motion with unwavering form, the metallic clink of the barbell echoing faintly in the quiet room. The atmosphere is one of quiet intensity, underscoring her commitment and strength.
fb7725c351ba · seed 2026081901 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

狗转头 · Dog head turn

Editing instruction
Edit the action so that the dog turns its head further to the right while sitting in the grass.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V
Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The dog turns its head further to the right while sitting in the grass.
原始整体描述 · MEV global_prompt.short_caption
A happy Pembroke Welsh Corgi with a reddish-brown and white coat sits in a sunny green field, panting with its tongue out in a static medium shot.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A happy Pembroke Welsh Corgi with a reddish-brown and white coat sits in a sunny green field, panting with its tongue out in a static medium shot. In this continuous shot, The dog turns its head further to the right while sitting in the grass. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A happy Pembroke Welsh Corgi with a rich reddish-brown and white coat sits calmly in a sun-drenched green field, its short legs tucked beneath its sturdy body. The warm sunlight bathes the scene, casting soft highlights across the dog’s smooth fur and illuminating the vibrant blades of grass around it. The corgi pants gently, its pink tongue lolling out in a relaxed, joyful expression, conveying a sense of contentment and ease. The camera holds a steady, static medium shot, framing the dog from the mid-chest up, allowing full view of its expressive face and perked ears. As the moment unfolds, the dog slowly turns its head further to the right, its eyes briefly scanning the surroundings with quiet curiosity, while its body remains still. The lush green field stretches out behind it, dotted with wildflowers and bathed in golden afternoon light. The scene remains consistent throughout—same subject, same environment, same lighting, same framing—capturing a peaceful, serene moment in nature, with the corgi as the calm, cheerful centerpiece.
3fadbe0c2961 · seed 2026081902 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

长椅上写字 · Write in notebook

Editing instruction
Edit the action so that the young woman sitting on a park bench thoughtfully writes in her notebook with a pen.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V

文本核对:Omni 保留写字动作,但额外加入 occasionally pausing to glance up and around,目标指令没有要求这一动作。

Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The young woman sitting on a park bench thoughtfully writes in her notebook with a pen.
原始整体描述 · MEV global_prompt.short_caption
A young woman with shoulder-length light brown hair sits on a wooden bench in a sunny park or campus setting, writing in a notebook while dressed in a pink shirt and blue jeans.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A young woman with shoulder-length light brown hair sits on a wooden bench in a sunny park or campus setting, writing in a notebook while dressed in a pink shirt and blue jeans. In this continuous shot, The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A young woman with shoulder-length light brown hair sits calmly on a weathered wooden bench in a sun-drenched park or campus setting, the golden light of midday filtering through the leaves of nearby trees. She wears a soft pink button-up shirt and fitted blue jeans, her posture relaxed yet focused as she leans slightly forward, pen in hand, writing thoughtfully in a small notebook resting on her lap. Her brow is gently furrowed in concentration, occasionally pausing to glance up and around, as if gathering inspiration from the peaceful surroundings. The camera holds steady in a medium shot, capturing her from the waist up, with the background softly blurred to emphasize her presence—dappled sunlight dances across the grass and pavement, and the faint rustle of leaves and distant chatter of people passing by add a gentle soundtrack to the scene. The composition remains unchanged throughout, maintaining consistent framing, lighting, and perspective, creating a serene, contemplative moment frozen in time.
7077cfb160cf · seed 2026081904 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

转身倚车 · Turn and lean on car

Editing instruction
Edit the action so that the woman in a black leather jacket and red pants turns and leans back against the hood of the black car.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V

文本核对:Omni 保留转身倚车,但额外加入 red lighting pulses subtly,与初始 caption 的 lighting remain stable 不一致。

Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The woman in a black leather jacket and red pants turns and leans back against the hood of the black car.
原始整体描述 · MEV global_prompt.short_caption
A confident woman in red pants and a black leather jacket poses in front of a black Chevrolet Camaro in a moody, red-lit underground parking garage.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A confident woman in red pants and a black leather jacket poses in front of a black Chevrolet Camaro in a moody, red-lit underground parking garage. In this continuous shot, The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A confident woman stands in front of a sleek black Chevrolet Camaro in a moody, dimly lit underground parking garage, bathed in a deep, ambient red glow that casts dramatic shadows across the concrete walls and floor. She wears a form-fitting black leather jacket and vibrant red pants that contrast sharply with the dark surroundings, drawing the eye to her poised stance. The camera holds steady in a continuous, smooth shot, capturing her as she turns with deliberate grace, her movement fluid and intentional. She leans back against the curved hood of the car, her body angled slightly, one hand resting lightly on the glossy surface while the other hangs relaxed at her side. The red lighting pulses subtly, reflecting off the car’s polished paint and the woman’s jacket, enhancing the cinematic atmosphere. The scene remains tightly framed, with the Camaro’s aggressive lines and the woman’s commanding presence forming a powerful visual composition. The lighting, framing, and camera position remain consistent throughout, emphasizing the stillness and intensity of the moment, as if frozen in time.
7e488525099e · seed 2026081906 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

闭眼尝汤 · Taste from ladle

Editing instruction
Edit the action so that the woman in an apron closes her eyes as she tastes from a metal ladle.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V
Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The woman in an apron closes her eyes as she tastes from a metal ladle.
原始整体描述 · MEV global_prompt.short_caption
A young woman in a patterned apron stands in a modern kitchen, tasting food from a ladle with a satisfied expression.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A young woman in a patterned apron stands in a modern kitchen, tasting food from a ladle with a satisfied expression. In this continuous shot, The woman in an apron closes her eyes as she tastes from a metal ladle. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A young woman stands in a bright, modern kitchen, her figure centered in a steady, continuous shot. She wears a patterned apron over casual clothing, the fabric soft and slightly rumpled from use. The kitchen is sleek and well-lit, with natural light streaming through a large window, casting a warm glow across stainless steel appliances and clean white countertops. In her hand, she holds a metal ladle, its surface gleaming under the light. She lifts it slowly to her lips, her eyes closing gently as she tastes the food. Her expression softens into quiet satisfaction—lips parting slightly, a subtle smile forming as the flavor registers. The camera remains fixed, capturing the moment with unwavering focus, preserving the stillness of the scene. The lighting remains consistent, highlighting the contours of her face and the texture of the apron. The background remains unchanged—neatly arranged utensils, a pot simmering on the stove, a bowl of fresh herbs on the counter—all contributing to the calm, domestic atmosphere. The shot lingers, emphasizing the sensory experience, the quiet joy of a meal well-prepared, and the simple pleasure of tasting one’s own creation.
d5221a1b69d5 · seed 2026081907 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

放下手机后翻身睡觉 · Put phone away and sleep

Editing instruction
Edit the action so that the man in bed puts his smartphone on the nightstand and turns over to go to sleep.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V

文本核对:Omni 保留放手机再翻身的顺序,但额外加入 scrolling or typing 作为前置动作,可能占用短视频中的目标动作时长;是否实际影响执行需看视频。

Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The man in bed puts his smartphone on the nightstand and turns over to go to sleep.
原始整体描述 · MEV global_prompt.short_caption
A young man with dyed-blond hair lies in bed in a dark room, illuminated by his phone's blue light, wearing a pink tank top and a nose ring.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A young man with dyed-blond hair lies in bed in a dark room, illuminated by his phone's blue light, wearing a pink tank top and a nose ring. In this continuous shot, The man in bed puts his smartphone on the nightstand and turns over to go to sleep. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A young man with dyed-blond hair lies on his back in a dimly lit bedroom, the only source of light emanating from the cool blue glow of his smartphone screen. He wears a soft pink tank top, the fabric slightly rumpled from lying still, and a small nose ring glints faintly in the low light as he shifts his head. The room is dark, shadows pooling in the corners, with only the faint outline of a nightstand and a pillow visible. The camera holds a steady, fixed position, capturing the scene in a continuous, unbroken shot. The man’s fingers move slowly across the phone’s screen, scrolling or typing with quiet focus. After a moment, he lowers the device, places it gently on the nightstand beside him, and turns onto his side, pulling the blanket slightly higher. His breathing slows, and he settles into sleep, the blue light fading as the phone powers down. The scene remains unchanged in framing, lighting, and composition, maintaining a calm, intimate stillness throughout.
40712e1341dc · seed 2026081911 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

Jellyfish contraction

Editing instruction
Edit the action so that the jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V
Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water.
原始整体描述 · MEV global_prompt.short_caption
A small, white-spotted jellyfish drifts and pulsates gracefully in serene, deep blue water.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A small, white-spotted jellyfish drifts and pulsates gracefully in serene, deep blue water. In this continuous shot, The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A small, white-spotted jellyfish drifts effortlessly through serene, deep blue water, its translucent bell gently pulsating in rhythmic motion. The delicate, rhythmic contractions of its body propel it forward in a slow, graceful dance, each pulse creating a subtle ripple in the surrounding water. As the bell contracts, it reveals a distinct ring-like shape, a luminous outline that glows faintly against the rich, uniform blue backdrop. The white spots on its body shimmer faintly with the play of light filtering down from above, adding a soft, ethereal contrast to the deep oceanic hue. The scene remains calm and undisturbed, with no sudden movements or changes in the environment. The camera holds steady, maintaining a consistent framing that centers the jellyfish in the frame, capturing its elegant motion in a continuous, uninterrupted shot. The lighting remains soft and diffused, enhancing the tranquil, otherworldly atmosphere of the deep sea. The jellyfish continues its slow, mesmerizing journey, its form and movement unchanged, creating a peaceful and hypnotic visual experience.
10af6c651dbc · seed 2026081910 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

Playful selfie

Editing instruction
Edit the action so that the woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V
Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking.
原始整体描述 · MEV global_prompt.short_caption
A cheerful woman in a red bikini top and straw sun hat takes a playful selfie against a green screen background in a static medium shot.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A cheerful woman in a red bikini top and straw sun hat takes a playful selfie against a green screen background in a static medium shot. In this continuous shot, The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A cheerful woman stands in a static medium shot against a bright green screen background, her figure centered and clearly defined. She wears a vibrant red bikini top and a wide-brimmed straw sun hat that casts a soft shadow over her face, enhancing the playful, summery vibe. Her expression is lively and animated as she holds her smartphone at arm’s length, capturing a selfie with a mischievous grin. She sticks her tongue out slightly and winks one eye, adding a flirtatious, carefree energy to the moment. Her dark hair peeks out from under the hat, gently swaying as she shifts her weight slightly, maintaining a relaxed yet engaging posture. The lighting is even and bright, highlighting her features and the vivid colors of her outfit without casting harsh shadows. The camera remains completely still throughout, keeping the framing consistent and focused on her upper body and face. The green screen behind her is uniform and uncluttered, providing a clean, neutral backdrop that emphasizes her presence. The scene exudes a lighthearted, fun atmosphere, capturing a spontaneous and joyful moment in a single, continuous take.
7fa338474c75 · seed 2026081900 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

Scarf spin

Editing instruction
Edit the action so that the woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V

文本核对:初始整体 caption 写 vintage-style dress,目标动作写 green skirt and black shirt,服装描述不够一致;Omni 保留两种描述。旋转动作仍出现在扩写文本中。

Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf.
原始整体描述 · MEV global_prompt.short_caption
A woman in a vintage-style dress dances gracefully by a flower-lined fence in front of a rustic wooden house.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A woman in a vintage-style dress dances gracefully by a flower-lined fence in front of a rustic wooden house. In this continuous shot, The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A woman in a vintage-style dress dances gracefully by a flower-lined fence in front of a rustic wooden house, her movements fluid and deliberate under the warm, golden light of late afternoon. She wears a flowing green skirt that swirls with each turn, paired with a fitted black shirt that contrasts elegantly with the soft hues of the surrounding garden. In her hands, she holds a long, sheer scarf that billows like a ribbon in the breeze, catching the sunlight as she spins in a slow, continuous circle. The camera remains steady, capturing her in a wide, stable frame that emphasizes the harmony between her motion and the tranquil setting. The fence, draped in climbing roses and wildflowers, frames the scene with natural beauty, while the weathered wooden house in the background adds a sense of timeless charm. The lighting is soft and diffused, casting gentle shadows and enhancing the nostalgic atmosphere. Her expression is serene, eyes closed at times, as if lost in the rhythm of the moment. The entire scene unfolds in a single, unbroken shot, with no cuts or shifts in perspective, allowing the viewer to fully immerse in the grace and stillness of the moment.
81533c9e56ec · seed 2026081915 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

Rub eyes then cover face

Editing instruction
Edit the action so that the man lying on the couch rubs his tired eyes and covers his face with both hands.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V
Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The man lying on the couch rubs his tired eyes and covers his face with both hands.
原始整体描述 · MEV global_prompt.short_caption
A young man with dark skin, dreadlocks, and a gold septum ring lies on a dark couch in a dimly lit room, showing signs of distress.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A young man with dark skin, dreadlocks, and a gold septum ring lies on a dark couch in a dimly lit room, showing signs of distress. In this continuous shot, The man lying on the couch rubs his tired eyes and covers his face with both hands. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A young man with dark skin and long dreadlocks lies sprawled across a dark, plush couch in a dimly lit room, the low ambient light casting deep shadows that pool around him. A gold septum ring glints faintly as he shifts slightly, his body tense with quiet unease. The room is still and intimate, the atmosphere heavy with a sense of emotional weight. He lifts his hands slowly, rubbing his tired eyes with the heels of his palms, his fingers pressing into the sockets as if trying to push back exhaustion or pain. Then, with a slow, deliberate motion, he covers his face entirely, pressing both hands against his forehead and cheeks, his breath shallow and uneven. The camera holds steady, capturing the moment in a continuous, unbroken shot—no movement, no cut—allowing the viewer to sit with the man’s distress. The framing remains tight and consistent, focusing on his upper body and face, emphasizing the subtle tremors in his hands and the way his shoulders rise and fall with each labored breath. The lighting remains unchanged, soft and moody, highlighting the contours of his face and the texture of his hair, while the surrounding darkness absorbs all distractions, drawing attention solely to his internal struggle. The scene is quiet, almost still, yet charged with unspoken emotion.
d977ce147d80 · seed 2026081905 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

Place bottle on treadmill

Editing instruction
Edit the action so that the woman turns her head to the left and places her water bottle onto the treadmill.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V
Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The woman turns her head to the left and places her water bottle onto the treadmill.
原始整体描述 · MEV global_prompt.short_caption
A young woman with long reddish-blonde hair, wearing a mint green athletic outfit, stands on a treadmill in a modern gym with blue and white striped pillars, holding a water bottle.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A young woman with long reddish-blonde hair, wearing a mint green athletic outfit, stands on a treadmill in a modern gym with blue and white striped pillars, holding a water bottle. In this continuous shot, The woman turns her head to the left and places her water bottle onto the treadmill. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A young woman with long, sun-kissed reddish-blonde hair stands centered on a treadmill in a sleek, modern gym, her posture relaxed yet alert. She wears a form-fitting mint green athletic outfit—a moisture-wicking tank top and matching leggings—that contrasts softly against the cool-toned environment. The gym is illuminated by bright, even lighting that highlights the clean lines of the space, with blue and white striped pillars rising in the background, creating a rhythmic visual pattern that adds depth to the scene. The camera holds a steady, medium-wide shot, capturing her from the waist up, with the treadmill’s control panel and running belt clearly visible. In a smooth, continuous motion, she turns her head slightly to the left, her gaze briefly shifting toward the side of the treadmill, then lowers her right hand to place a clear water bottle with a blue cap onto the treadmill’s console. The bottle rests securely, and she remains in place, her expression calm and focused, as the scene continues without interruption. The lighting remains consistent, the framing stable, and the background elements—pillars, mirrors, and distant gym equipment—remain unchanged, emphasizing the quiet, deliberate nature of the moment.
840b214afead · seed 2026081913 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

Bow to clap

Editing instruction
Edit the action so that the woman in a taekwondo uniform stands in profile and claps her hands together in front of her.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V
Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The woman in a taekwondo uniform stands in profile and claps her hands together in front of her.
原始整体描述 · MEV global_prompt.short_caption
A woman in a white taekwondo uniform with a black collar and Adidas logo stands in profile against a black background under dramatic side lighting, captured in a static medium shot.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A woman in a white taekwondo uniform with a black collar and Adidas logo stands in profile against a black background under dramatic side lighting, captured in a static medium shot. In this continuous shot, The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A woman in a crisp white taekwondo uniform stands in profile against a deep black background, her form sharply defined by dramatic side lighting that casts a strong, sculpted shadow along her silhouette. The uniform features a black collar and a subtle Adidas logo on the chest, adding a touch of brand detail to the athletic attire. She is captured in a static medium shot, framed with precision to highlight her poised stance and the clean lines of her posture. The lighting emphasizes the contours of her body, creating a high-contrast, cinematic effect that enhances the intensity of the moment. In a smooth, continuous motion, she brings her hands together in front of her chest, clapping them once with a deliberate, controlled gesture. Her movements are precise and measured, reflecting discipline and focus. The scene remains unchanged throughout—no shifts in camera angle, lighting, or background—maintaining a consistent, composed atmosphere that centers entirely on her presence and action. The stillness of the frame contrasts with the subtle energy of her motion, creating a powerful visual statement of control and readiness.
d908552fb691 · seed 2026081903 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源
\ No newline at end of file diff --git a/projects/video-action-editing/omni-extra6/index.html b/projects/video-action-editing/omni-extra6/index.html new file mode 100644 index 0000000..346d31f --- /dev/null +++ b/projects/video-action-editing/omni-extra6/index.html @@ -0,0 +1,23 @@ + +OmniVideo2 · 追加六例对比

OmniVideo2-1.3B · 追加六例对比

+

查看全部十二例 · 查看上一批六例

6/6 编辑视频已生成。复用 Bernini 原始 81 帧源视频和逐例 seed,均为 40 步 UniPC、25 fps。 +Omni 使用原始编辑指令及自身 Qwen 规划流程,原生输出为 832×480、CFG 3;Bernini 使用原实验生成 caption 和原生 conditioning。 +这里展示完整输出供审核,采样完成不代表动作编辑成功。

新增例 1 · 提杠铃 · Barbell lift

Edit the action so that the woman in a home gym lifts a barbell from the floor to her waist.

Source · Bernini 原始输入
Bernini-R-1.3B
OmniVideo2-1.3B
fb7725c351ba · seed 2026081901 · 81 frames / 25 fps · 运行记录

新增例 2 · 狗转头 · Dog head turn

Edit the action so that the dog turns its head further to the right while sitting in the grass.

Source · Bernini 原始输入
Bernini-R-1.3B
OmniVideo2-1.3B
3fadbe0c2961 · seed 2026081902 · 81 frames / 25 fps · 运行记录

新增例 3 · 长椅上写字 · Write in notebook

Edit the action so that the young woman sitting on a park bench thoughtfully writes in her notebook with a pen.

Source · Bernini 原始输入
Bernini-R-1.3B
OmniVideo2-1.3B
7077cfb160cf · seed 2026081904 · 81 frames / 25 fps · 运行记录

新增例 4 · 转身倚车 · Turn and lean on car

Edit the action so that the woman in a black leather jacket and red pants turns and leans back against the hood of the black car.

Source · Bernini 原始输入
Bernini-R-1.3B
OmniVideo2-1.3B
7e488525099e · seed 2026081906 · 81 frames / 25 fps · 运行记录

新增例 5 · 闭眼尝汤 · Taste from ladle

Edit the action so that the woman in an apron closes her eyes as she tastes from a metal ladle.

Source · Bernini 原始输入
Bernini-R-1.3B
OmniVideo2-1.3B
d5221a1b69d5 · seed 2026081907 · 81 frames / 25 fps · 运行记录

新增例 6 · 放下手机后翻身睡觉 · Put phone away and sleep

Edit the action so that the man in bed puts his smartphone on the nightstand and turns over to go to sleep.

Source · Bernini 原始输入
Bernini-R-1.3B
OmniVideo2-1.3B
40712e1341dc · seed 2026081911 · 81 frames / 25 fps · 运行记录
+
\ No newline at end of file diff --git a/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/bernini.jpg b/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/bernini.jpg new file mode 100644 index 0000000..eb5dce6 Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/bernini.jpg differ diff --git a/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/bernini.mp4 b/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/bernini.mp4 new file mode 100644 index 0000000..4b5b2e4 Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/bernini.mp4 differ diff --git a/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/bernini_receipt.json b/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/bernini_receipt.json new file mode 100644 index 0000000..0c9931c --- /dev/null +++ b/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"0e94b25d3a005a1c1fba466437891401b4186fcfa012a82735fd9a30c43cce3c","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"71d7da6d24dd88019b8e2dbfc0274f025aaaaeec606ca658a3f8c31a4f7b101d","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"56d4cf3e697f2c1ca310581171200e937ae8d0ddbc573931d1968e70b585358a","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"0f7bf58fe1fae3e602d7ebf4826023dac24aa6ee89d498bb3c6fab0302bec51b","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"6cf432b68d741603f50739f6ef6d4060769e84c01eb8a077ab5310d5965df28f","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"4afdec2b3a8fae6fcba904e3df789f4aa6d48e11cb60762b79c80728be62f473","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"1b143a73c2c814b5e973c915edcf2526b98f27487323d1ba2751bb775f4c5a0b","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"03d5e456c3bcdd50a38f1aba843ac046b14db363294a45d9cc739c364382419c","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"c04e4d63c40dc181ae413af983a9fab4371c510452c2e759d1e7b565f77325ff","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"88a22b8c0915e0b803703869cc3c3f984b38a42ba50fa6314f2b40e2297439c6","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"94515eedaa3561dbcb7072999e37f233c23ad72c694536d4da01e71073b92dc3","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"21a5afb6de9cf9fc94c35cbedffd4eb09f9a71beb600986351741fd9eadba4be","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"b55c93057cf7c6f7053fa078a44669105d92863bd979bb1c40ce9a4a184b0087","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"2d2bad67a121496c88916f0836f6f5a64c5b349dfd8c2995cfb78e259bff09ee","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"6ea2ae31bea2c05d35ed0dfccb0eb091986304939bdd6e886f411b0b58f7ed5b","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"b7c1abda804811dbfd17180c4cd067d953f3fae3b6aae225c26a6c7e50cc4ed6","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"6ea2ae31bea2c05d35ed0dfccb0eb091986304939bdd6e886f411b0b58f7ed5b","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081902,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"b7c1abda804811dbfd17180c4cd067d953f3fae3b6aae225c26a6c7e50cc4ed6","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"2aa46249b4ff7cfa61b8b4ceac015c9da19a1fe4df741e38bb38b7b90a797477","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"b7c1abda804811dbfd17180c4cd067d953f3fae3b6aae225c26a6c7e50cc4ed6"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"6ea2ae31bea2c05d35ed0dfccb0eb091986304939bdd6e886f411b0b58f7ed5b","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"b7c1abda804811dbfd17180c4cd067d953f3fae3b6aae225c26a6c7e50cc4ed6","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"6ea2ae31bea2c05d35ed0dfccb0eb091986304939bdd6e886f411b0b58f7ed5b","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081902,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"b7c1abda804811dbfd17180c4cd067d953f3fae3b6aae225c26a6c7e50cc4ed6","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"2a2910cadcea003184cc9bff7e23a887d1f6e7a4119a225ba9e91ba989b12476","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"b7c1abda804811dbfd17180c4cd067d953f3fae3b6aae225c26a6c7e50cc4ed6"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":322,"action_prompt_utf8_sha256":"e5a7d338e43779e2faa2383a663e1b1cd80c5e99400a0119b0d3f5dfe1252623","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/3fadbe0c2961/source-exact81.mp4","source_video_sha256":"99170f8a711a3d5a3e930a995561646ac557366cf92f5ded7ac13c6a986f8364","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"d64f729b43bde4a7ab47dfb39c1f77c71b8f7aad6f950bb59cfbeed87e5e9604","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/rv2v.mp4","sha256":"12fa9f9adb2f3996849aaa8c3ea958d1c73848bbbc3c28f018377961b16a8d46","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"8c0757b7d9f565685ecf5fe45aeecb61590bad2987f58a3a2c42eedf433a8349","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/t2v.mp4","sha256":"803fc5156774d814787b26a15fd4649c4a6429a7d2ca9b8e89b352461126c924","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"99170f8a711a3d5a3e930a995561646ac557366cf92f5ded7ac13c6a986f8364","original_pre_snapshot_sha256":"99170f8a711a3d5a3e930a995561646ac557366cf92f5ded7ac13c6a986f8364","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"99170f8a711a3d5a3e930a995561646ac557366cf92f5ded7ac13c6a986f8364","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"4c8b2e4e963aa56d40d038ab70782a8e8a982d842eb80c83a112e3025f01ad34","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"63d1c47fa69475922a71a4de07757c1f9a13eefd4abdc21888e0bfd021ba4098","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"5b166d802da00ec9db2a81368d4da813f83de5cae2786b81f06bf5f477f89462","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081902,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081902,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"26f210745b68f1a3ff1b8444c86d537d622d951a185a350c3d51e7a8f0e0a126","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/launch.json b/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/launch.json new file mode 100644 index 0000000..f2d7212 --- /dev/null +++ b/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/launch.json @@ -0,0 +1,212 @@ +{ + "case": { + "index": 1, + "case_id": "3fadbe0c2961", + "name": "狗转头 · Dog head turn", + "page": null, + "bernini_manifest_ordinal": 2, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/3fadbe0c2961/source-exact81.mp4", + "instruction": "Edit the action so that the dog turns its head further to the right while sitting in the grass.", + "seed": 2026081902, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/rv2v.mp4", + "source_sha256": "99170f8a711a3d5a3e930a995561646ac557366cf92f5ded7ac13c6a986f8364" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/3fadbe0c2961/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081902", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/3fadbe0c2961/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081902 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "9198097a2126676aecf6af6e58a181c40a818aecb91c5bc850f4a5844cc1b3a3", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-198", + "job": { + "SLURM_JOB_ID": "213583", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T07:32:16.172552+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix." +} diff --git a/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/omni.jpg b/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/omni.jpg new file mode 100644 index 0000000..a8144b9 Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/omni.jpg differ diff --git a/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/omni.mp4 b/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/omni.mp4 new file mode 100644 index 0000000..309d67f Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/omni.mp4 differ diff --git a/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/receipt.json b/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/receipt.json new file mode 100644 index 0000000..660f023 --- /dev/null +++ b/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/receipt.json @@ -0,0 +1,238 @@ +{ + "status": "complete", + "case": { + "index": 1, + "case_id": "3fadbe0c2961", + "name": "狗转头 · Dog head turn", + "page": null, + "bernini_manifest_ordinal": 2, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/3fadbe0c2961/source-exact81.mp4", + "instruction": "Edit the action so that the dog turns its head further to the right while sitting in the grass.", + "seed": 2026081902, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/rv2v.mp4", + "source_sha256": "99170f8a711a3d5a3e930a995561646ac557366cf92f5ded7ac13c6a986f8364" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/3fadbe0c2961/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081902", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/3fadbe0c2961/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081902 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "9198097a2126676aecf6af6e58a181c40a818aecb91c5bc850f4a5844cc1b3a3", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-198", + "job": { + "SLURM_JOB_ID": "213583", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T07:32:16.172552+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix.", + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/3fadbe0c2961/attempt-001/log_0.log", + "rank_zero_log_sha256": "b6c773cc73ff0aaa67166e1658c1085dfb0f574c6430932447d19145ecb1a099", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8476 + ], + "max_context_len": 9216 + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/results/3fadbe0c2961/omni.mp4", + "sha256": "9b27c380ead769e767542911ff95aff9e35a84ae3d2370b8fa515a0ed9082205", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 618.31, + "completed_utc": "2026-09-23T07:42:17.808615+00:00" +} diff --git a/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/source.jpg b/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/source.jpg new file mode 100644 index 0000000..16ad17a Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/source.jpg differ diff --git a/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/source.mp4 b/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/source.mp4 new file mode 100644 index 0000000..b11bbd7 Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/3fadbe0c2961/source.mp4 differ diff --git a/projects/video-action-editing/omni-extra6/results/40712e1341dc/bernini.jpg b/projects/video-action-editing/omni-extra6/results/40712e1341dc/bernini.jpg new file mode 100644 index 0000000..220800a Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/40712e1341dc/bernini.jpg differ diff --git a/projects/video-action-editing/omni-extra6/results/40712e1341dc/bernini.mp4 b/projects/video-action-editing/omni-extra6/results/40712e1341dc/bernini.mp4 new file mode 100644 index 0000000..14c5b3d Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/40712e1341dc/bernini.mp4 differ diff --git a/projects/video-action-editing/omni-extra6/results/40712e1341dc/bernini_receipt.json b/projects/video-action-editing/omni-extra6/results/40712e1341dc/bernini_receipt.json new file mode 100644 index 0000000..089c2b5 --- /dev/null +++ b/projects/video-action-editing/omni-extra6/results/40712e1341dc/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"48c0f5010ed6e8b41d140dad22b63aaab5769acd75e26da3d381e0dfa08091d5","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"9ef3aa6493a2dab3675a566a58d9959531e0cf1bad8626f7975749ecda07f21a","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"c5c47a2b972fd914098f76ddd0861a3855edce832f8c25776f542b0c6c2f27b4","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"e3c811659c17cb43c44ac510fe3a9268fc530a5f519386e3f7de6afdbe2f6e44","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"168ad58122626b2a7861516828a7dd487584e4adbf6780821a88dc67f000ce0e","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"bec8e27e605a0471ea304d613ed80ec1de70d3a632e201c29c1ba7daf5386886","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"937d1efd5e00acc1ada41cbff8e3d326cc79aaab9672b02837536c4beb7b2965","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"1bd42ac658d35987dddd4cfbd2b9721fae63ffc3709f9c6dae7956584df73039","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"14c52b34b95baeaf1844052666c85132bb61df9d82146d6de38ebb65d24bfadf","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"0f90a1b7747980f2c82cd1bf605c6019387a2ecb06bae4336f84ff0a9c9b4624","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"b6436ff70eaea0076c99f3c4abd79175b91eed10d328f74a3c04f53d9fdf59ba","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"947f8ca8d2791443c2f23f0e040de2a70cca9ad23f2279af5f90e007ba0b1dcc","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"742bcaf673a42ecba49042671834f363825f3d2f011c2bf3fca90e995fa690f6","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"8bf4d4e4a9b68237f44017bd9c31b985fcfa6e44ccfd79250350e97a89326cd3","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"61bad558235fdfa10344a5355301adbe33a59ed3bd04585bd736f85e5f6cca40","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"28a421cb9991a4dc90b0dec671c069039fa1170741fbf3729124976306436ddf","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"61bad558235fdfa10344a5355301adbe33a59ed3bd04585bd736f85e5f6cca40","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081911,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"28a421cb9991a4dc90b0dec671c069039fa1170741fbf3729124976306436ddf","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"d8a3cc49ff663c598c89eb9b06ccba14567665c08b30989ec7d2ce82575e96f0","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"28a421cb9991a4dc90b0dec671c069039fa1170741fbf3729124976306436ddf"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"61bad558235fdfa10344a5355301adbe33a59ed3bd04585bd736f85e5f6cca40","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"28a421cb9991a4dc90b0dec671c069039fa1170741fbf3729124976306436ddf","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"61bad558235fdfa10344a5355301adbe33a59ed3bd04585bd736f85e5f6cca40","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081911,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"28a421cb9991a4dc90b0dec671c069039fa1170741fbf3729124976306436ddf","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"867c90f55a07c77c58a9d693db5834ced30b880cdeb542be0bc783b2c20a4673","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"28a421cb9991a4dc90b0dec671c069039fa1170741fbf3729124976306436ddf"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":328,"action_prompt_utf8_sha256":"e7cb0b2a1421644429ecb32cb531713267d01c95cc7ec7589a183c2cd226fd21","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/40712e1341dc/source-exact81.mp4","source_video_sha256":"654e997c46a6f78a2ad78359b713767aefe61a6cc732b5be4527720323349f69","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"29a9cd1b0eb92704934645b4d4ce2afc2e232817fbb4ba77fefbe9f4cb2e1d97","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/rv2v.mp4","sha256":"5b91b30b5632f6b95cd00198a19f90bb064f16d68d146d39eb680a8ae4169b73","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"397bac948f9549b04fa313b1a3b8fe7f649f1619118cf669accef467e0b1d3fa","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/t2v.mp4","sha256":"99ed719ef9adfa0e959e1cea5af546ba4b61d49d31119a9c28afe301d734bfac","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"654e997c46a6f78a2ad78359b713767aefe61a6cc732b5be4527720323349f69","original_pre_snapshot_sha256":"654e997c46a6f78a2ad78359b713767aefe61a6cc732b5be4527720323349f69","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"654e997c46a6f78a2ad78359b713767aefe61a6cc732b5be4527720323349f69","source_derived_bucket_hw":[368,656],"source_input_hw":[1080,1920],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"c502d6f1e4920488affe1b0aab2b87b2f27f5a75c8790bb5b3f36a2435dd8420","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"0ffd088bdfbad0beae08af0e57744a4b5c5b4b482e2e3eb4fa0bd6939ba0979c","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"efee3e3f36fedf0dbaf21a08996e77923d30ef158bb6610d30c8e1c1b8ba7b1f","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081911,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081911,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"7294dcc50d25701ed3131e5a7d3eee88e168fcd9904664d6917b057d71dc0314","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-extra6/results/40712e1341dc/launch.json b/projects/video-action-editing/omni-extra6/results/40712e1341dc/launch.json new file mode 100644 index 0000000..72e61bd --- /dev/null +++ b/projects/video-action-editing/omni-extra6/results/40712e1341dc/launch.json @@ -0,0 +1,212 @@ +{ + "case": { + "index": 5, + "case_id": "40712e1341dc", + "name": "放下手机后翻身睡觉 · Put phone away and sleep", + "page": null, + "bernini_manifest_ordinal": 11, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/40712e1341dc/source-exact81.mp4", + "instruction": "Edit the action so that the man in bed puts his smartphone on the nightstand and turns over to go to sleep.", + "seed": 2026081911, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/rv2v.mp4", + "source_sha256": "654e997c46a6f78a2ad78359b713767aefe61a6cc732b5be4527720323349f69" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/40712e1341dc/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081911", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/40712e1341dc/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081911 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "9198097a2126676aecf6af6e58a181c40a818aecb91c5bc850f4a5844cc1b3a3", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-293", + "job": { + "SLURM_JOB_ID": "213600", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T07:36:57.841663+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix." +} diff --git a/projects/video-action-editing/omni-extra6/results/40712e1341dc/omni.jpg b/projects/video-action-editing/omni-extra6/results/40712e1341dc/omni.jpg new file mode 100644 index 0000000..a0a26ff Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/40712e1341dc/omni.jpg differ diff --git a/projects/video-action-editing/omni-extra6/results/40712e1341dc/omni.mp4 b/projects/video-action-editing/omni-extra6/results/40712e1341dc/omni.mp4 new file mode 100644 index 0000000..0ab9d7a Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/40712e1341dc/omni.mp4 differ diff --git a/projects/video-action-editing/omni-extra6/results/40712e1341dc/receipt.json b/projects/video-action-editing/omni-extra6/results/40712e1341dc/receipt.json new file mode 100644 index 0000000..d1862ee --- /dev/null +++ b/projects/video-action-editing/omni-extra6/results/40712e1341dc/receipt.json @@ -0,0 +1,238 @@ +{ + "status": "complete", + "case": { + "index": 5, + "case_id": "40712e1341dc", + "name": "放下手机后翻身睡觉 · Put phone away and sleep", + "page": null, + "bernini_manifest_ordinal": 11, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/40712e1341dc/source-exact81.mp4", + "instruction": "Edit the action so that the man in bed puts his smartphone on the nightstand and turns over to go to sleep.", + "seed": 2026081911, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/rv2v.mp4", + "source_sha256": "654e997c46a6f78a2ad78359b713767aefe61a6cc732b5be4527720323349f69" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/40712e1341dc/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081911", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/40712e1341dc/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081911 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "9198097a2126676aecf6af6e58a181c40a818aecb91c5bc850f4a5844cc1b3a3", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-293", + "job": { + "SLURM_JOB_ID": "213600", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T07:36:57.841663+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix.", + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/40712e1341dc/attempt-001/log_0.log", + "rank_zero_log_sha256": "c6896c37a4caee3a23f901db8892046a0360fd72da382200da1c3ad9091650f8", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8439 + ], + "max_context_len": 9216 + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/results/40712e1341dc/omni.mp4", + "sha256": "908d11c2d178f1d1e80ef642859448bb8a610d53986e2fedc113373a09824a7e", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 587.36, + "completed_utc": "2026-09-23T07:46:27.877120+00:00" +} diff --git a/projects/video-action-editing/omni-extra6/results/40712e1341dc/source.jpg b/projects/video-action-editing/omni-extra6/results/40712e1341dc/source.jpg new file mode 100644 index 0000000..67d9ea9 Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/40712e1341dc/source.jpg differ diff --git a/projects/video-action-editing/omni-extra6/results/40712e1341dc/source.mp4 b/projects/video-action-editing/omni-extra6/results/40712e1341dc/source.mp4 new file mode 100644 index 0000000..47097a3 Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/40712e1341dc/source.mp4 differ diff --git a/projects/video-action-editing/omni-extra6/results/7077cfb160cf/bernini.jpg b/projects/video-action-editing/omni-extra6/results/7077cfb160cf/bernini.jpg new file mode 100644 index 0000000..48f65be Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/7077cfb160cf/bernini.jpg differ diff --git a/projects/video-action-editing/omni-extra6/results/7077cfb160cf/bernini.mp4 b/projects/video-action-editing/omni-extra6/results/7077cfb160cf/bernini.mp4 new file mode 100644 index 0000000..d8db632 Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/7077cfb160cf/bernini.mp4 differ diff --git a/projects/video-action-editing/omni-extra6/results/7077cfb160cf/bernini_receipt.json b/projects/video-action-editing/omni-extra6/results/7077cfb160cf/bernini_receipt.json new file mode 100644 index 0000000..abf8d9a --- /dev/null +++ b/projects/video-action-editing/omni-extra6/results/7077cfb160cf/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"805525dbeb52b39732e4e78de7ebc47137a6ce356c4f995a3d55603790cd98bc","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"3242f1c9cf2fc266d47b8bc3b91bf48420aa45be7a85a791d7fcc334e4150b2a","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"d83bbf735581805d0152fc360ddda145d74e255521b3f1525df5bb536eb15c78","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"300f82102fc10d09e63e2a17f7c03abc730bd107f7ccb2096126818076aa9af2","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"5f575ff125289c8ee070d4d8b1b8fdef3c9eda1f686592dcfc5b33e7c1054c3b","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"cb49e32bba7aefa6ec60db68e26ae02ebc55e92e7db8d7dcbaaf2b36ba413dcd","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"0258a143a93e3a87b3593858cd7d8bf64aa6101baef2950d3470498593a55560","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"31a1646757cf90a6a221cc036a83ea5b9b2c1c812f282db61fe5da0c81a724e3","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"53f6b977c822c0d9771683cb8ee8ee89c46adf40c807d93cce5e0d125e3bba32","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"94238c183b3a007df492f98fd15a8419bb9cd0b77e414dcd0a5f7aedfc7e53c6","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"6b71e8b1de80e387b54dd229abb4be79f462ea952ce9e3d1b27300f0143b1b97","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"5f73bf575b26aee810a964d6003e5df7008ab2a54435b8e7bb3eaa993903d2a6","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"889b6c48bc39d9658ba758ac4005a288b524064ac800c806546a4e321de5a827","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"a72213df9b5e37ef3c5b85c158a336f6b88dcc5bf9ac8538bf3c99e58881db2c","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"865571d2409a5d20d2f07c752c4d327c6d6bd899c045aaddc4bb8a268a561479","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"0f7c7871f09fd65c843693826404825ab964f51b34034ce985507823187f7cf1","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"865571d2409a5d20d2f07c752c4d327c6d6bd899c045aaddc4bb8a268a561479","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081904,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"0f7c7871f09fd65c843693826404825ab964f51b34034ce985507823187f7cf1","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"32a154b98a2d64c3d8f0ec9a02a549df8f971c2e7bd455834022a0c74a9a2802","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"0f7c7871f09fd65c843693826404825ab964f51b34034ce985507823187f7cf1"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"865571d2409a5d20d2f07c752c4d327c6d6bd899c045aaddc4bb8a268a561479","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"0f7c7871f09fd65c843693826404825ab964f51b34034ce985507823187f7cf1","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"865571d2409a5d20d2f07c752c4d327c6d6bd899c045aaddc4bb8a268a561479","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081904,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"0f7c7871f09fd65c843693826404825ab964f51b34034ce985507823187f7cf1","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"3010a54b7bd926a85e390c9a4a63d1e9f3e2cf9b5ada4bf03cda5dd549ee498f","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"0f7c7871f09fd65c843693826404825ab964f51b34034ce985507823187f7cf1"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":369,"action_prompt_utf8_sha256":"ffe3db596a0db5b6c52685fee0f53d82982bae2a354725ca2eb743558af5df28","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7077cfb160cf/source-exact81.mp4","source_video_sha256":"cef4c183b459c8aad72cdc81f3e6b2766a36fc22156bf382dd36c29cec6d5aa9","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"3348030716a1ebf2eef4e4d9fabc874eb3742b73e2ad6be58b330244168579de","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/rv2v.mp4","sha256":"be645bf32a9ccd63b25e0b4adf4519359be7484f260382d0a3ab46fad28cdb59","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"6913c685c7093d692392138cfbf6c7a98e40132d1fa4e93589b914726db7ec38","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/t2v.mp4","sha256":"c1a8aa80d9a4caa32ccbbc6b00740d576c9d74553361e6686e8d25af98a4645c","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"cef4c183b459c8aad72cdc81f3e6b2766a36fc22156bf382dd36c29cec6d5aa9","original_pre_snapshot_sha256":"cef4c183b459c8aad72cdc81f3e6b2766a36fc22156bf382dd36c29cec6d5aa9","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"cef4c183b459c8aad72cdc81f3e6b2766a36fc22156bf382dd36c29cec6d5aa9","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"3e47bdffb9d5120fad538301af793632e7ad755502d5a14f3b181ab25151e368","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"aa325c341540bec4cbb5474eb77837ce0e5dd17b3d0725a4dc07b234d064ef90","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"2e55a36c23d790d4da7510d98ba6f10cf69770f69b343bcfc0f9c7d639fdc837","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081904,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081904,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"3d0bfb2afb4aa030ed006206e701fd2adef979e7605fe93b34464abf0c9fad97","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-extra6/results/7077cfb160cf/launch.json b/projects/video-action-editing/omni-extra6/results/7077cfb160cf/launch.json new file mode 100644 index 0000000..31159a8 --- /dev/null +++ b/projects/video-action-editing/omni-extra6/results/7077cfb160cf/launch.json @@ -0,0 +1,212 @@ +{ + "case": { + "index": 2, + "case_id": "7077cfb160cf", + "name": "长椅上写字 · Write in notebook", + "page": null, + "bernini_manifest_ordinal": 4, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7077cfb160cf/source-exact81.mp4", + "instruction": "Edit the action so that the young woman sitting on a park bench thoughtfully writes in her notebook with a pen.", + "seed": 2026081904, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/rv2v.mp4", + "source_sha256": "cef4c183b459c8aad72cdc81f3e6b2766a36fc22156bf382dd36c29cec6d5aa9" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/7077cfb160cf/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081904", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/7077cfb160cf/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081904 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "9198097a2126676aecf6af6e58a181c40a818aecb91c5bc850f4a5844cc1b3a3", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-198", + "job": { + "SLURM_JOB_ID": "213583", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T07:42:34.939736+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix." +} diff --git a/projects/video-action-editing/omni-extra6/results/7077cfb160cf/omni.jpg b/projects/video-action-editing/omni-extra6/results/7077cfb160cf/omni.jpg new file mode 100644 index 0000000..73069a5 Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/7077cfb160cf/omni.jpg differ diff --git a/projects/video-action-editing/omni-extra6/results/7077cfb160cf/omni.mp4 b/projects/video-action-editing/omni-extra6/results/7077cfb160cf/omni.mp4 new file mode 100644 index 0000000..f4b37bd Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/7077cfb160cf/omni.mp4 differ diff --git a/projects/video-action-editing/omni-extra6/results/7077cfb160cf/receipt.json b/projects/video-action-editing/omni-extra6/results/7077cfb160cf/receipt.json new file mode 100644 index 0000000..8c6d447 --- /dev/null +++ b/projects/video-action-editing/omni-extra6/results/7077cfb160cf/receipt.json @@ -0,0 +1,238 @@ +{ + "status": "complete", + "case": { + "index": 2, + "case_id": "7077cfb160cf", + "name": "长椅上写字 · Write in notebook", + "page": null, + "bernini_manifest_ordinal": 4, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7077cfb160cf/source-exact81.mp4", + "instruction": "Edit the action so that the young woman sitting on a park bench thoughtfully writes in her notebook with a pen.", + "seed": 2026081904, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/rv2v.mp4", + "source_sha256": "cef4c183b459c8aad72cdc81f3e6b2766a36fc22156bf382dd36c29cec6d5aa9" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/7077cfb160cf/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081904", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/7077cfb160cf/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081904 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "9198097a2126676aecf6af6e58a181c40a818aecb91c5bc850f4a5844cc1b3a3", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-198", + "job": { + "SLURM_JOB_ID": "213583", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T07:42:34.939736+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix.", + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/7077cfb160cf/attempt-001/log_0.log", + "rank_zero_log_sha256": "246bce3b6270fb3a4d2ec558e7bea9f391db8302ad83d24195b824301fd0ca41", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8509 + ], + "max_context_len": 9216 + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/results/7077cfb160cf/omni.mp4", + "sha256": "8327af390caf24bd92892e17a1e880b87b38aba9a924f590c525e4d69f622a9b", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 604.44, + "completed_utc": "2026-09-23T07:52:22.579220+00:00" +} diff --git a/projects/video-action-editing/omni-extra6/results/7077cfb160cf/source.jpg b/projects/video-action-editing/omni-extra6/results/7077cfb160cf/source.jpg new file mode 100644 index 0000000..2dc240e Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/7077cfb160cf/source.jpg differ diff --git a/projects/video-action-editing/omni-extra6/results/7077cfb160cf/source.mp4 b/projects/video-action-editing/omni-extra6/results/7077cfb160cf/source.mp4 new file mode 100644 index 0000000..71e8152 Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/7077cfb160cf/source.mp4 differ diff --git a/projects/video-action-editing/omni-extra6/results/7e488525099e/bernini.jpg b/projects/video-action-editing/omni-extra6/results/7e488525099e/bernini.jpg new file mode 100644 index 0000000..965885e Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/7e488525099e/bernini.jpg differ diff --git a/projects/video-action-editing/omni-extra6/results/7e488525099e/bernini.mp4 b/projects/video-action-editing/omni-extra6/results/7e488525099e/bernini.mp4 new file mode 100644 index 0000000..6fc2817 Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/7e488525099e/bernini.mp4 differ diff --git a/projects/video-action-editing/omni-extra6/results/7e488525099e/bernini_receipt.json b/projects/video-action-editing/omni-extra6/results/7e488525099e/bernini_receipt.json new file mode 100644 index 0000000..8f86a2d --- /dev/null +++ b/projects/video-action-editing/omni-extra6/results/7e488525099e/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"4bb2884085d2efe9bb00f66efadbab32684d79923b32d895e1b73c366a49879b","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"11240a7dc7ab42d595f6f8d2f7b77655426d97744ff4282d776171e1b1e09e8f","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"49af87c18c57a0fe0485c6f1099392d40877bafc82f7df59873313c86341821b","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"4225b445906bad196ebc6211815cf08ba6dfec87d0371b9cc1cf0bda6eaab54a","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"f0f239f7dd0c9de37b9d6946299e406d040691422dc43ddfea09972c13e39579","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"70985e5a80b012470a96ca8d09fd4633814a5b0e6fa2684d1ece78fd678d9038","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"fde7100e71b5abb0fae607bdc626e4ce3c1820b9d05226b300e466e1ff4b442f","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"9e1088117b66b3f7a54ecc0f631a9ad18155d9bce98502e14923a8b74bb83143","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"8debbe0be07c566fc29be4d9cb91d73e63c66f6ced9ce26c0e9fb8e0c3d65a69","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"b4fd87104d2d51303797f63ba0bf14c721f93587933be40526ee440657c14ce5","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"07580c9109678b6dbfdbc5e72916dbc42a62fdb23e4e237a51935aa8b146f616","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"2068aa3ede80a4f0d829b6bf2484cf6682c5324973c4fc23f6e40bc61eb76c16","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"c152613e67559c4812b51cdb049ff7002ca64c315f853864a5e98e8ee5087eaf","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"556b9acb93d700f1b1a5d799a4447cc6ce66e8fdf2ba8944ee981d1552c9c190","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"8080494cfc9ac2566249c4f658b38448d7a1832c5cfbda1fc5461b893895a0e9","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"1f74752f30242d6ce3111ab0c67d57db03fd6d395996fdfd3e9df0b77d358a21","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"8080494cfc9ac2566249c4f658b38448d7a1832c5cfbda1fc5461b893895a0e9","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081906,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"1f74752f30242d6ce3111ab0c67d57db03fd6d395996fdfd3e9df0b77d358a21","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"fd09519ce5c820f7c0f7a9a11bfe5a200ab89eaa4334c5eb1984afc01fd81bfe","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"1f74752f30242d6ce3111ab0c67d57db03fd6d395996fdfd3e9df0b77d358a21"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"8080494cfc9ac2566249c4f658b38448d7a1832c5cfbda1fc5461b893895a0e9","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"1f74752f30242d6ce3111ab0c67d57db03fd6d395996fdfd3e9df0b77d358a21","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"8080494cfc9ac2566249c4f658b38448d7a1832c5cfbda1fc5461b893895a0e9","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081906,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"1f74752f30242d6ce3111ab0c67d57db03fd6d395996fdfd3e9df0b77d358a21","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"18cfca0fdc660fdcd85678294f6e6931f4d68853c12baac8fc1c81d1e8c2ebfd","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"1f74752f30242d6ce3111ab0c67d57db03fd6d395996fdfd3e9df0b77d358a21"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":358,"action_prompt_utf8_sha256":"9dbe71bad14d34165cbbc5236e464eb582094279ee5268bd62cda1d45c15f7a7","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7e488525099e/source-exact81.mp4","source_video_sha256":"1f3cec72bef55b67c15ebfc063252cce867ea128594a225db61688ff961b35d4","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"19b75c955d886bfe156a837658d89e65cd4b9b84fd80ddd84c856285589087c0","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/rv2v.mp4","sha256":"20154ed35790207b991e7a58e5456b93776d1223c6b666bf37aab5d84396ea08","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"10dc92b7046a38ddf688eded46b7232193947b56887762f3da40d1abebbf2fa2","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/t2v.mp4","sha256":"ef14763c12e45144e6f768a6ed5efae0ccf458086d479815cd12b4832cc17824","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"1f3cec72bef55b67c15ebfc063252cce867ea128594a225db61688ff961b35d4","original_pre_snapshot_sha256":"1f3cec72bef55b67c15ebfc063252cce867ea128594a225db61688ff961b35d4","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"1f3cec72bef55b67c15ebfc063252cce867ea128594a225db61688ff961b35d4","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"2767de6b8e73fcf639606514eb89d02fb4b94ffcdd075d5cc8da03ed0772eb85","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"68b01af00e7640dcb5bcfa9690369cfbff48541ab09702eebc53acdd51769f6f","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"b7670ae626c2159e4bef64e612d9fae530782be2c491cac2959a6432d24fca89","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081906,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081906,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"eca1cea19b7a9a1412a53d61d4808256fa6827f49fd779545346b46921e0e771","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-extra6/results/7e488525099e/launch.json b/projects/video-action-editing/omni-extra6/results/7e488525099e/launch.json new file mode 100644 index 0000000..1064c5d --- /dev/null +++ b/projects/video-action-editing/omni-extra6/results/7e488525099e/launch.json @@ -0,0 +1,212 @@ +{ + "case": { + "index": 3, + "case_id": "7e488525099e", + "name": "转身倚车 · Turn and lean on car", + "page": null, + "bernini_manifest_ordinal": 6, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7e488525099e/source-exact81.mp4", + "instruction": "Edit the action so that the woman in a black leather jacket and red pants turns and leans back against the hood of the black car.", + "seed": 2026081906, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/rv2v.mp4", + "source_sha256": "1f3cec72bef55b67c15ebfc063252cce867ea128594a225db61688ff961b35d4" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/7e488525099e/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081906", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/7e488525099e/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081906 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "9198097a2126676aecf6af6e58a181c40a818aecb91c5bc850f4a5844cc1b3a3", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-293", + "job": { + "SLURM_JOB_ID": "213600", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T07:23:51.731189+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix." +} diff --git a/projects/video-action-editing/omni-extra6/results/7e488525099e/omni.jpg b/projects/video-action-editing/omni-extra6/results/7e488525099e/omni.jpg new file mode 100644 index 0000000..fdaffdb Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/7e488525099e/omni.jpg differ diff --git a/projects/video-action-editing/omni-extra6/results/7e488525099e/omni.mp4 b/projects/video-action-editing/omni-extra6/results/7e488525099e/omni.mp4 new file mode 100644 index 0000000..0d1236f Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/7e488525099e/omni.mp4 differ diff --git a/projects/video-action-editing/omni-extra6/results/7e488525099e/receipt.json b/projects/video-action-editing/omni-extra6/results/7e488525099e/receipt.json new file mode 100644 index 0000000..2d2af6a --- /dev/null +++ b/projects/video-action-editing/omni-extra6/results/7e488525099e/receipt.json @@ -0,0 +1,238 @@ +{ + "status": "complete", + "case": { + "index": 3, + "case_id": "7e488525099e", + "name": "转身倚车 · Turn and lean on car", + "page": null, + "bernini_manifest_ordinal": 6, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7e488525099e/source-exact81.mp4", + "instruction": "Edit the action so that the woman in a black leather jacket and red pants turns and leans back against the hood of the black car.", + "seed": 2026081906, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/rv2v.mp4", + "source_sha256": "1f3cec72bef55b67c15ebfc063252cce867ea128594a225db61688ff961b35d4" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/7e488525099e/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081906", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/7e488525099e/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081906 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "9198097a2126676aecf6af6e58a181c40a818aecb91c5bc850f4a5844cc1b3a3", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-293", + "job": { + "SLURM_JOB_ID": "213600", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T07:23:51.731189+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix.", + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/7e488525099e/attempt-001/log_0.log", + "rank_zero_log_sha256": "039f96436755d057c368fe24f0ee20dc08d61ccc08c480b13f706d53be9c4f81", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8558 + ], + "max_context_len": 9216 + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/results/7e488525099e/omni.mp4", + "sha256": "f41bc5f1d9d9985661261e63c4e71f1f93d44abbe790679558d61dda1699a8cf", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 807.52, + "completed_utc": "2026-09-23T07:36:39.858351+00:00" +} diff --git a/projects/video-action-editing/omni-extra6/results/7e488525099e/source.jpg b/projects/video-action-editing/omni-extra6/results/7e488525099e/source.jpg new file mode 100644 index 0000000..3865c87 Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/7e488525099e/source.jpg differ diff --git a/projects/video-action-editing/omni-extra6/results/7e488525099e/source.mp4 b/projects/video-action-editing/omni-extra6/results/7e488525099e/source.mp4 new file mode 100644 index 0000000..d23de3a Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/7e488525099e/source.mp4 differ diff --git a/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/bernini.jpg b/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/bernini.jpg new file mode 100644 index 0000000..da026eb Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/bernini.jpg differ diff --git a/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/bernini.mp4 b/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/bernini.mp4 new file mode 100644 index 0000000..56ec22e Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/bernini.mp4 differ diff --git a/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/bernini_receipt.json b/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/bernini_receipt.json new file mode 100644 index 0000000..f340e8a --- /dev/null +++ b/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"0e3ef520bc12f16c3322dfeb5810d463e7bee5e728de439339b38512bb141137","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"cd29b62f704ca8c1579cb3a0c767346d28b684484398cfc971b948296f5aed07","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"0fa7f7a5b411878dd2248e630ed1a3d7477e4bb0460afe7949252f2694aef383","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"8ffb30e2874b54196df648959b1669d00a4d5f7daf821926456b1699eb3b7f46","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"43b69b00ada967ef76345826b0674fe7d841f244ea90523b88e9f166cb437d08","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"316d1888f0ee198f627be953524eb1c7aba5f4da4abacf123c2e6a9b44905766","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"75d93e68bf8a1d89bba7cb0f91958c8300d371794698ab96f7949dc8877007eb","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"9222c48b1aa81b3e05f3fce8d36674e040c8cc68eec751848393d9bc193e19ae","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"40e2b7b43ba9dbb148d76b5caccf57364ba283aa1fad74534466b06ecaef0858","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"5719ed9082ae985b7a8c72202e49d83c541621ce1571331b9193cedfd25fdd3b","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"b392d25ca7581c2810be2badac1880ea655b8d9e9ad28690a62348ee65d16784","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"dc7e43abdf0bfc78fd327747c6dba38e7a1c2b74bc1ea2db7ff7544bb3a14a24","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"833c04baee1212aea75bc6325dca38b7761ba030a5c5dc52ff8d4e02f1eae3c7","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"e1a0535630291d954cd87b1c9f8ef201c5a66512479252f810849031753aac72","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"dad5739e74c429c4e4df7fc1727082b13a2bed19e9edd37cf798a5b223207324","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"60c52f35fe1da3abe023e4bd9124bbe22bf38d9b2d916961e42fe20febf9e8c3","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"dad5739e74c429c4e4df7fc1727082b13a2bed19e9edd37cf798a5b223207324","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081907,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"60c52f35fe1da3abe023e4bd9124bbe22bf38d9b2d916961e42fe20febf9e8c3","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"165f816820831627f57ef91cb2359113994527313b0325cc45e2306c78011673","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"60c52f35fe1da3abe023e4bd9124bbe22bf38d9b2d916961e42fe20febf9e8c3"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"dad5739e74c429c4e4df7fc1727082b13a2bed19e9edd37cf798a5b223207324","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"60c52f35fe1da3abe023e4bd9124bbe22bf38d9b2d916961e42fe20febf9e8c3","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"dad5739e74c429c4e4df7fc1727082b13a2bed19e9edd37cf798a5b223207324","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081907,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"60c52f35fe1da3abe023e4bd9124bbe22bf38d9b2d916961e42fe20febf9e8c3","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"9111a8c3be8ce6f71847e1dd77c43d5f155206271b60b94e91215602234e2133","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"60c52f35fe1da3abe023e4bd9124bbe22bf38d9b2d916961e42fe20febf9e8c3"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":293,"action_prompt_utf8_sha256":"3c320866e1c96c3a128a525a9d0e4633d6cb1aef7b519e9c623c841f3f004e31","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d5221a1b69d5/source-exact81.mp4","source_video_sha256":"fdd1b3df4b94449dc59cd04d03deb769fb2cf6c4c2d7b87221e2b3a6b5557d14","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"4e2b456b1820d80d383681df6cb74752dd961cea36fb8bb4fc6e82ad46a75043","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/rv2v.mp4","sha256":"5cb52ddd029742d7fd8d7b6e6ef04df46dd6d3fb77a3522b4bd8f36f5afde38e","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"1fc6f50f9c555be06be5c88d710adb9ee2fb644f24875d703c3df5b877f72ee3","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/t2v.mp4","sha256":"c721c58707f97a876842d467b7e3e5ebe84eb41021512af9bdfa33ac837717d2","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"fdd1b3df4b94449dc59cd04d03deb769fb2cf6c4c2d7b87221e2b3a6b5557d14","original_pre_snapshot_sha256":"fdd1b3df4b94449dc59cd04d03deb769fb2cf6c4c2d7b87221e2b3a6b5557d14","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"fdd1b3df4b94449dc59cd04d03deb769fb2cf6c4c2d7b87221e2b3a6b5557d14","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"88083a3f93b4d2444e7e101a6aca51f275f1c3263bec08f076053272d05c7a27","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"f01ab3d32bb9c931c4b5f2ccc903f8e5a50d2a5a8bd783287f4b115838dca51c","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"409d0f5ee949db66d90b9b3a322400df21acb20a42df2d668b401bcfad6e8e6f","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081907,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081907,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"5252b29687addade7b735cfb6dfcebac9942f72444bfa98d739981c82f036fc3","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/launch.json b/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/launch.json new file mode 100644 index 0000000..52271b6 --- /dev/null +++ b/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/launch.json @@ -0,0 +1,212 @@ +{ + "case": { + "index": 4, + "case_id": "d5221a1b69d5", + "name": "闭眼尝汤 · Taste from ladle", + "page": null, + "bernini_manifest_ordinal": 7, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d5221a1b69d5/source-exact81.mp4", + "instruction": "Edit the action so that the woman in an apron closes her eyes as she tastes from a metal ladle.", + "seed": 2026081907, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/rv2v.mp4", + "source_sha256": "fdd1b3df4b94449dc59cd04d03deb769fb2cf6c4c2d7b87221e2b3a6b5557d14" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/d5221a1b69d5/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081907", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/d5221a1b69d5/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081907 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "9198097a2126676aecf6af6e58a181c40a818aecb91c5bc850f4a5844cc1b3a3", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-293", + "job": { + "SLURM_JOB_ID": "213600", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "started_utc": "2026-09-23T07:23:51.711513+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix." +} diff --git a/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/omni.jpg b/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/omni.jpg new file mode 100644 index 0000000..9a88545 Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/omni.jpg differ diff --git a/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/omni.mp4 b/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/omni.mp4 new file mode 100644 index 0000000..fbf53fe Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/omni.mp4 differ diff --git a/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/receipt.json b/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/receipt.json new file mode 100644 index 0000000..9571476 --- /dev/null +++ b/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/receipt.json @@ -0,0 +1,238 @@ +{ + "status": "complete", + "case": { + "index": 4, + "case_id": "d5221a1b69d5", + "name": "闭眼尝汤 · Taste from ladle", + "page": null, + "bernini_manifest_ordinal": 7, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d5221a1b69d5/source-exact81.mp4", + "instruction": "Edit the action so that the woman in an apron closes her eyes as she tastes from a metal ladle.", + "seed": 2026081907, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/rv2v.mp4", + "source_sha256": "fdd1b3df4b94449dc59cd04d03deb769fb2cf6c4c2d7b87221e2b3a6b5557d14" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/d5221a1b69d5/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081907", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/d5221a1b69d5/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081907 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "9198097a2126676aecf6af6e58a181c40a818aecb91c5bc850f4a5844cc1b3a3", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-293", + "job": { + "SLURM_JOB_ID": "213600", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "started_utc": "2026-09-23T07:23:51.711513+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix.", + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/d5221a1b69d5/attempt-001/log_0.log", + "rank_zero_log_sha256": "3332249fe799a99e9b446401c28eafa0aac261062191a2d86640df99cc784108", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8441 + ], + "max_context_len": 9216 + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/results/d5221a1b69d5/omni.mp4", + "sha256": "5b9ccfd890df3e3184349a417144b622c1de4494977316f456ab16b729b499c5", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 807.29, + "completed_utc": "2026-09-23T07:36:39.672553+00:00" +} diff --git a/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/source.jpg b/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/source.jpg new file mode 100644 index 0000000..b7da99e Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/source.jpg differ diff --git a/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/source.mp4 b/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/source.mp4 new file mode 100644 index 0000000..35f3fb1 Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/d5221a1b69d5/source.mp4 differ diff --git a/projects/video-action-editing/omni-extra6/results/fb7725c351ba/bernini.jpg b/projects/video-action-editing/omni-extra6/results/fb7725c351ba/bernini.jpg new file mode 100644 index 0000000..19ef5d8 Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/fb7725c351ba/bernini.jpg differ diff --git a/projects/video-action-editing/omni-extra6/results/fb7725c351ba/bernini.mp4 b/projects/video-action-editing/omni-extra6/results/fb7725c351ba/bernini.mp4 new file mode 100644 index 0000000..f0e4355 Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/fb7725c351ba/bernini.mp4 differ diff --git a/projects/video-action-editing/omni-extra6/results/fb7725c351ba/bernini_receipt.json b/projects/video-action-editing/omni-extra6/results/fb7725c351ba/bernini_receipt.json new file mode 100644 index 0000000..cbd6c7f --- /dev/null +++ b/projects/video-action-editing/omni-extra6/results/fb7725c351ba/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"be2ec7c843e350f5aee025bd2c422f7f0807bfb8a00ef9163443f6d2cc0eafc8","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"427cc6dd1c8de70592aa52107487a169595bfe529ff3257e8e42f86e8d96b72d","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"1ff488257f4c4913bef90d7915692a39126bba448dbfaa353b426e60b6a55101","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"b1d3c7f61584ce40d24116da78f2b01d04d56e3ed2fc0047cc560eb4506589c8","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"355d79080c4a1dbab48cfe565185fc7700bc41dab83d54842108afce69feeebf","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"a3467158c9eb3d9b26d1649d9c30054890ab83038ce9f4cd672cbb9c43dbd7be","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"3cfef1ae9cf793abd6e40329a8c85701d64ba12b99f5c0fe8581542262124a22","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"6323273e4f2f031e2e9c2c3d9e921440c437ecc9fa3c26646853f7ba7d8077e7","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"6d2c3d2b8d525cf1abc7a361f0a301c2d8f7ed88f1e291b35c08fa50a1f9382a","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"4c1c4a145f5ba323088768417cfbdf05b2d66a9e1da94e3fc99e3b325ac32c68","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"238f4c2e3e40cbb7ac6259faa16b3ff16e38ff7cfcc176d62e94851846de9b12","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"5718f07d21edd62047391d2515ed5127f79f1f8715dc00377806d203d9d04090","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"edc38a275746d7496fa00e90d2a0ba17e66955d03d1eba92eaf024b732fae80a","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"6fedaeb17291e306b62822478503eccc85ae4a921c10aa3ec9de65874bd4d807","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"8e26e2774c3334500f1e28fff468a12f9610f73dfb627888e689f22068537982","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"2bc2848ee815333fa0b799f191ac39d42be9cfd6ef050b340fe02ce6328c7f91","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"8e26e2774c3334500f1e28fff468a12f9610f73dfb627888e689f22068537982","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081901,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"2bc2848ee815333fa0b799f191ac39d42be9cfd6ef050b340fe02ce6328c7f91","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"80f61359e9dab41655add1772843bb06f0c0a150b53201e90c123340076545a3","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"2bc2848ee815333fa0b799f191ac39d42be9cfd6ef050b340fe02ce6328c7f91"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"8e26e2774c3334500f1e28fff468a12f9610f73dfb627888e689f22068537982","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"2bc2848ee815333fa0b799f191ac39d42be9cfd6ef050b340fe02ce6328c7f91","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"8e26e2774c3334500f1e28fff468a12f9610f73dfb627888e689f22068537982","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081901,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"2bc2848ee815333fa0b799f191ac39d42be9cfd6ef050b340fe02ce6328c7f91","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"4d021febf8e301d05621bcdfa8e3206208560a0ad22191f2a3b180b5cfd87489","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"2bc2848ee815333fa0b799f191ac39d42be9cfd6ef050b340fe02ce6328c7f91"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":283,"action_prompt_utf8_sha256":"bd72848533d16119920aa2d3e0b34a8ea82f3fad6c6f39444239e22523d11397","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/fb7725c351ba/source-exact81.mp4","source_video_sha256":"479ee891773dfffc3299149103ee2ef37f4bb63f213b1c4c7cbd5391ebd4704a","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"83881ae8d5619c4ee3c5a65fa0c8ae72a04bee424ef55f3e0910e6fe2379f892","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/rv2v.mp4","sha256":"87307f240a0e050c8f680b4eac960017786cf75a0820c8259b9352b6d72b2697","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"5fd51078c80f15fff389d0d400d841905760a642ece9c3896faa34fc39f512d0","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/t2v.mp4","sha256":"bad550261470a3d6befacf71a1d41ee5923dc74764aaa990f4e164fcac9a000c","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"479ee891773dfffc3299149103ee2ef37f4bb63f213b1c4c7cbd5391ebd4704a","original_pre_snapshot_sha256":"479ee891773dfffc3299149103ee2ef37f4bb63f213b1c4c7cbd5391ebd4704a","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"479ee891773dfffc3299149103ee2ef37f4bb63f213b1c4c7cbd5391ebd4704a","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"415b29b662b33ef06f3e969637acb45a29bd5087fd1820764ed6195e848d89d6","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"bca668cb7c69fd3dbcb1ba6823f0196d601fd967f1210b44ca1a6fa468dba78b","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"9572eb83bd3c5e2e5e83bf1fbcd4b90b9ace53a6e1a222c1e1f4f37b2a9b335d","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081901,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081901,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"0f7f845f1edcb7af7bdcf32c7864946527f388070ceb4f31f42415de538e2b08","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-extra6/results/fb7725c351ba/launch.json b/projects/video-action-editing/omni-extra6/results/fb7725c351ba/launch.json new file mode 100644 index 0000000..eba899a --- /dev/null +++ b/projects/video-action-editing/omni-extra6/results/fb7725c351ba/launch.json @@ -0,0 +1,212 @@ +{ + "case": { + "index": 0, + "case_id": "fb7725c351ba", + "name": "提杠铃 · Barbell lift", + "page": null, + "bernini_manifest_ordinal": 1, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/fb7725c351ba/source-exact81.mp4", + "instruction": "Edit the action so that the woman in a home gym lifts a barbell from the floor to her waist.", + "seed": 2026081901, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/rv2v.mp4", + "source_sha256": "479ee891773dfffc3299149103ee2ef37f4bb63f213b1c4c7cbd5391ebd4704a" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/fb7725c351ba/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081901", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/fb7725c351ba/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081901 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "9198097a2126676aecf6af6e58a181c40a818aecb91c5bc850f4a5844cc1b3a3", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-198", + "job": { + "SLURM_JOB_ID": "213583", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T07:19:57.583548+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix." +} diff --git a/projects/video-action-editing/omni-extra6/results/fb7725c351ba/omni.jpg b/projects/video-action-editing/omni-extra6/results/fb7725c351ba/omni.jpg new file mode 100644 index 0000000..4a85971 Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/fb7725c351ba/omni.jpg differ diff --git a/projects/video-action-editing/omni-extra6/results/fb7725c351ba/omni.mp4 b/projects/video-action-editing/omni-extra6/results/fb7725c351ba/omni.mp4 new file mode 100644 index 0000000..b8dd1b9 Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/fb7725c351ba/omni.mp4 differ diff --git a/projects/video-action-editing/omni-extra6/results/fb7725c351ba/receipt.json b/projects/video-action-editing/omni-extra6/results/fb7725c351ba/receipt.json new file mode 100644 index 0000000..3f67bd1 --- /dev/null +++ b/projects/video-action-editing/omni-extra6/results/fb7725c351ba/receipt.json @@ -0,0 +1,238 @@ +{ + "status": "complete", + "case": { + "index": 0, + "case_id": "fb7725c351ba", + "name": "提杠铃 · Barbell lift", + "page": null, + "bernini_manifest_ordinal": 1, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/fb7725c351ba/source-exact81.mp4", + "instruction": "Edit the action so that the woman in a home gym lifts a barbell from the floor to her waist.", + "seed": 2026081901, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/rv2v.mp4", + "source_sha256": "479ee891773dfffc3299149103ee2ef37f4bb63f213b1c4c7cbd5391ebd4704a" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/fb7725c351ba/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081901", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/fb7725c351ba/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081901 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "9198097a2126676aecf6af6e58a181c40a818aecb91c5bc850f4a5844cc1b3a3", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-198", + "job": { + "SLURM_JOB_ID": "213583", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T07:19:57.583548+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix.", + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/fb7725c351ba/attempt-001/log_0.log", + "rank_zero_log_sha256": "fe61c326e76624323df50625a90029722ea601b799d2c7e43de5436954b93d4c", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8482 + ], + "max_context_len": 9216 + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/results/fb7725c351ba/omni.mp4", + "sha256": "82b32017b5b516a2f8670c3215e6eb49618526a503925d4db6a4c6a69f4a6504", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 738.3, + "completed_utc": "2026-09-23T07:31:59.058967+00:00" +} diff --git a/projects/video-action-editing/omni-extra6/results/fb7725c351ba/source.jpg b/projects/video-action-editing/omni-extra6/results/fb7725c351ba/source.jpg new file mode 100644 index 0000000..537ba8a Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/fb7725c351ba/source.jpg differ diff --git a/projects/video-action-editing/omni-extra6/results/fb7725c351ba/source.mp4 b/projects/video-action-editing/omni-extra6/results/fb7725c351ba/source.mp4 new file mode 100644 index 0000000..3aca5fc Binary files /dev/null and b/projects/video-action-editing/omni-extra6/results/fb7725c351ba/source.mp4 differ diff --git a/projects/video-action-editing/omni-extra6/summary.json b/projects/video-action-editing/omni-extra6/summary.json new file mode 100644 index 0000000..52a2184 --- /dev/null +++ b/projects/video-action-editing/omni-extra6/summary.json @@ -0,0 +1,230 @@ +[ + { + "case_id": "fb7725c351ba", + "bernini_manifest_ordinal": 1, + "name": "提杠铃 · Barbell lift", + "seed": 2026081901, + "output_sha256": "82b32017b5b516a2f8670c3215e6eb49618526a503925d4db6a4c6a69f4a6504", + "job": { + "SLURM_JOB_ID": "213583", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "hostname": "auh7-1b-gpu-198", + "elapsed_seconds": 738.3, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/results/fb7725c351ba/omni.mp4", + "sha256": "82b32017b5b516a2f8670c3215e6eb49618526a503925d4db6a4c6a69f4a6504", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/fb7725c351ba/attempt-001/log_0.log", + "rank_zero_log_sha256": "fe61c326e76624323df50625a90029722ea601b799d2c7e43de5436954b93d4c", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8482 + ], + "max_context_len": 9216 + } + }, + { + "case_id": "3fadbe0c2961", + "bernini_manifest_ordinal": 2, + "name": "狗转头 · Dog head turn", + "seed": 2026081902, + "output_sha256": "9b27c380ead769e767542911ff95aff9e35a84ae3d2370b8fa515a0ed9082205", + "job": { + "SLURM_JOB_ID": "213583", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "hostname": "auh7-1b-gpu-198", + "elapsed_seconds": 618.31, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/results/3fadbe0c2961/omni.mp4", + "sha256": "9b27c380ead769e767542911ff95aff9e35a84ae3d2370b8fa515a0ed9082205", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/3fadbe0c2961/attempt-001/log_0.log", + "rank_zero_log_sha256": "b6c773cc73ff0aaa67166e1658c1085dfb0f574c6430932447d19145ecb1a099", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8476 + ], + "max_context_len": 9216 + } + }, + { + "case_id": "7077cfb160cf", + "bernini_manifest_ordinal": 4, + "name": "长椅上写字 · Write in notebook", + "seed": 2026081904, + "output_sha256": "8327af390caf24bd92892e17a1e880b87b38aba9a924f590c525e4d69f622a9b", + "job": { + "SLURM_JOB_ID": "213583", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "hostname": "auh7-1b-gpu-198", + "elapsed_seconds": 604.44, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/results/7077cfb160cf/omni.mp4", + "sha256": "8327af390caf24bd92892e17a1e880b87b38aba9a924f590c525e4d69f622a9b", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/7077cfb160cf/attempt-001/log_0.log", + "rank_zero_log_sha256": "246bce3b6270fb3a4d2ec558e7bea9f391db8302ad83d24195b824301fd0ca41", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8509 + ], + "max_context_len": 9216 + } + }, + { + "case_id": "7e488525099e", + "bernini_manifest_ordinal": 6, + "name": "转身倚车 · Turn and lean on car", + "seed": 2026081906, + "output_sha256": "f41bc5f1d9d9985661261e63c4e71f1f93d44abbe790679558d61dda1699a8cf", + "job": { + "SLURM_JOB_ID": "213600", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "hostname": "auh7-1b-gpu-293", + "elapsed_seconds": 807.52, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/results/7e488525099e/omni.mp4", + "sha256": "f41bc5f1d9d9985661261e63c4e71f1f93d44abbe790679558d61dda1699a8cf", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/7e488525099e/attempt-001/log_0.log", + "rank_zero_log_sha256": "039f96436755d057c368fe24f0ee20dc08d61ccc08c480b13f706d53be9c4f81", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8558 + ], + "max_context_len": 9216 + } + }, + { + "case_id": "d5221a1b69d5", + "bernini_manifest_ordinal": 7, + "name": "闭眼尝汤 · Taste from ladle", + "seed": 2026081907, + "output_sha256": "5b9ccfd890df3e3184349a417144b622c1de4494977316f456ab16b729b499c5", + "job": { + "SLURM_JOB_ID": "213600", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "hostname": "auh7-1b-gpu-293", + "elapsed_seconds": 807.29, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/results/d5221a1b69d5/omni.mp4", + "sha256": "5b9ccfd890df3e3184349a417144b622c1de4494977316f456ab16b729b499c5", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/d5221a1b69d5/attempt-001/log_0.log", + "rank_zero_log_sha256": "3332249fe799a99e9b446401c28eafa0aac261062191a2d86640df99cc784108", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8441 + ], + "max_context_len": 9216 + } + }, + { + "case_id": "40712e1341dc", + "bernini_manifest_ordinal": 11, + "name": "放下手机后翻身睡觉 · Put phone away and sleep", + "seed": 2026081911, + "output_sha256": "908d11c2d178f1d1e80ef642859448bb8a610d53986e2fedc113373a09824a7e", + "job": { + "SLURM_JOB_ID": "213600", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "hostname": "auh7-1b-gpu-293", + "elapsed_seconds": 587.36, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/results/40712e1341dc/omni.mp4", + "sha256": "908d11c2d178f1d1e80ef642859448bb8a610d53986e2fedc113373a09824a7e", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_extra_20260923_v1/work/40712e1341dc/attempt-001/log_0.log", + "rank_zero_log_sha256": "c6896c37a4caee3a23f901db8892046a0360fd72da382200da1c3ad9091650f8", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8439 + ], + "max_context_len": 9216 + } + } +] diff --git a/projects/video-action-editing/omni-gap6/index.html b/projects/video-action-editing/omni-gap6/index.html new file mode 100644 index 0000000..0a47984 --- /dev/null +++ b/projects/video-action-editing/omni-gap6/index.html @@ -0,0 +1,23 @@ + +Progress II · OmniVideo2 六例对比

Progress II 第 5–7 页 · OmniVideo2 六例对比

+

6/6 编辑视频已生成。复用 Bernini 原始 81 帧源视频和逐例 seed,均为 40 步 UniPC、25 fps。 +Omni 使用原始编辑指令及自身 Qwen 规划流程,原生输出为 832×480、CFG 3;Bernini 使用原实验生成 caption 和原生 conditioning。 +这里展示完整输出供审核,采样完成不代表动作编辑成功。

第 5 页 · Jellyfish contraction

Edit the action so that the jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water.

Source · Bernini 原始输入
Bernini-R-1.3B
OmniVideo2-1.3B
10af6c651dbc · seed 2026081910 · 81 frames / 25 fps · 运行记录

第 5 页 · Playful selfie

Edit the action so that the woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking.

Source · Bernini 原始输入
Bernini-R-1.3B
OmniVideo2-1.3B
7fa338474c75 · seed 2026081900 · 81 frames / 25 fps · 运行记录

第 6 页 · Scarf spin

Edit the action so that the woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf.

Source · Bernini 原始输入
Bernini-R-1.3B
OmniVideo2-1.3B
81533c9e56ec · seed 2026081915 · 81 frames / 25 fps · 运行记录

第 6 页 · Rub eyes then cover face

Edit the action so that the man lying on the couch rubs his tired eyes and covers his face with both hands.

Source · Bernini 原始输入
Bernini-R-1.3B
OmniVideo2-1.3B
d977ce147d80 · seed 2026081905 · 81 frames / 25 fps · 运行记录

第 7 页 · Place bottle on treadmill

Edit the action so that the woman turns her head to the left and places her water bottle onto the treadmill.

Source · Bernini 原始输入
Bernini-R-1.3B
OmniVideo2-1.3B
840b214afead · seed 2026081913 · 81 frames / 25 fps · 运行记录

第 7 页 · Bow to clap

Edit the action so that the woman in a taekwondo uniform stands in profile and claps her hands together in front of her.

Source · Bernini 原始输入
Bernini-R-1.3B
OmniVideo2-1.3B
d908552fb691 · seed 2026081903 · 81 frames / 25 fps · 运行记录
+
\ No newline at end of file diff --git a/projects/video-action-editing/omni-gap6/results/10af6c651dbc/bernini.jpg b/projects/video-action-editing/omni-gap6/results/10af6c651dbc/bernini.jpg new file mode 100644 index 0000000..c7f2fd7 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/10af6c651dbc/bernini.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/10af6c651dbc/bernini.mp4 b/projects/video-action-editing/omni-gap6/results/10af6c651dbc/bernini.mp4 new file mode 100644 index 0000000..98b3c40 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/10af6c651dbc/bernini.mp4 differ diff --git a/projects/video-action-editing/omni-gap6/results/10af6c651dbc/bernini_receipt.json b/projects/video-action-editing/omni-gap6/results/10af6c651dbc/bernini_receipt.json new file mode 100644 index 0000000..e007c7f --- /dev/null +++ b/projects/video-action-editing/omni-gap6/results/10af6c651dbc/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"865eda9a9146ff00a53995627229c6241aafdbdbf77716eba1f9a5b47262038d","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"0aac5508e42d41bb6875a63dfc05c610419d38e78c7e13d5bb9b5f1cde028b5b","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"3cee34ecc548972476540e65df8873b1bb47ae8aac4edb8a63042fb6378c1bd9","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"7f3ff14de58e3442beb06a9ef0f9514d44414935072dd967e3c13d014c648ac2","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"aba1eed7fe1a01b0425607c467cfdb4b30e9a0664ff556f7387ceb604724327f","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"3c4699d013d8e1405f81b66da29632d90623deb025eb6c8fee41a0b03f085aa0","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"a0d02f8df855e46c8edb4c8deff6071f188f1fca0a1b2e327612c50990b15c6e","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"736a7da7ba6187f82456db81ff453a92e70d880a44b86eeadb14ea55bb033f38","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"a81ba83a4aefbcfc6f10bc36288bfcfd6691c4d04a53fabf08d2def86557d79c","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"de038db05466227ffa3c40eeb9044e1a6e1820372caf2ee6a2d9adeeee674ba5","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"494305d54d8aa21e7e7f690ada8d2d541712eb0b483b18e9ebf8139b5ad1bf20","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"74df7987cb4ba137be84ed38b097cedf177914623b908b9d682e48ec2584e55b","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"4c7e622e97cc75521e6b359dfefda17f96b7de59df3c3eada7e7675ae368a7f6","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"592ba99d6a33ecd3e0cea9f10fca78dbce3f7224a4300b4ef2d9655f40865b25","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"0b85acb7370cba219f192a623c1f2b6f70d696ac59ac15cdc5a19b42073ca2a3","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"3b24517189012d2cf7fb7805850eed520865d3e7f72767ab22ab2144abe538e6","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"0b85acb7370cba219f192a623c1f2b6f70d696ac59ac15cdc5a19b42073ca2a3","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081910,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"3b24517189012d2cf7fb7805850eed520865d3e7f72767ab22ab2144abe538e6","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"1e77c693a0220e4ea8bfd32fb70439b9168f942737bb1539b36e3cd2d656584a","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"3b24517189012d2cf7fb7805850eed520865d3e7f72767ab22ab2144abe538e6"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"0b85acb7370cba219f192a623c1f2b6f70d696ac59ac15cdc5a19b42073ca2a3","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"3b24517189012d2cf7fb7805850eed520865d3e7f72767ab22ab2144abe538e6","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"0b85acb7370cba219f192a623c1f2b6f70d696ac59ac15cdc5a19b42073ca2a3","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081910,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"3b24517189012d2cf7fb7805850eed520865d3e7f72767ab22ab2144abe538e6","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"9951fa0c852fd8da6cdd33702853b4f51ba4f19707065125387cc32098f0e0fd","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"3b24517189012d2cf7fb7805850eed520865d3e7f72767ab22ab2144abe538e6"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":287,"action_prompt_utf8_sha256":"2ee4f1b1b4989f42c2a1b41aca7d635615860e252de87560f5bad2848688716f","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/10af6c651dbc/source-exact81.mp4","source_video_sha256":"ea86ef53e403f1cc602594cc3623a2fb66fb9b2f65c1461ef2bf62bee82a35fb","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"53b3ecfc7e4193e63ccd1554e832c2ecdaf4f5d3c9011965e69a667b7d6d639e","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/rv2v.mp4","sha256":"77f3f0b9446ee0b73d243bc0f5bc4ef6a43854931c4d1d03ce2f7e2b2a4e5f93","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"477f08e21106f4d2ebb214dee271325fe9dafd9d4727cf0a4c311a96d2321718","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/t2v.mp4","sha256":"b169af23b7eb5f9fd796fb01a5fd01421da15d40803d9a996fef4566722b7890","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"ea86ef53e403f1cc602594cc3623a2fb66fb9b2f65c1461ef2bf62bee82a35fb","original_pre_snapshot_sha256":"ea86ef53e403f1cc602594cc3623a2fb66fb9b2f65c1461ef2bf62bee82a35fb","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"ea86ef53e403f1cc602594cc3623a2fb66fb9b2f65c1461ef2bf62bee82a35fb","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"27bf7fa547c03f8269be8610eb7d937630813038545d9c085e1e2a226558817f","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"7cad9858365bcf3076091294ce24efbfc20feb97804917cf4287ad7d805cd23d","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"858596afad9a48d2306356d9d7d1cd9c27b1fded21b66b4d8e2fdb44c6decacb","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081910,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081910,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"1739f8b9594637c14fc72a8d927b5a9272dba82c435b159abffbd2bd38920acb","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-gap6/results/10af6c651dbc/launch.json b/projects/video-action-editing/omni-gap6/results/10af6c651dbc/launch.json new file mode 100644 index 0000000..8eb4afa --- /dev/null +++ b/projects/video-action-editing/omni-gap6/results/10af6c651dbc/launch.json @@ -0,0 +1,211 @@ +{ + "case": { + "index": 0, + "case_id": "10af6c651dbc", + "name": "Jellyfish contraction", + "page": 5, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/10af6c651dbc/source-exact81.mp4", + "source_sha256": "ea86ef53e403f1cc602594cc3623a2fb66fb9b2f65c1461ef2bf62bee82a35fb", + "instruction": "Edit the action so that the jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water.", + "seed": 2026081910, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/rv2v.mp4" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/10af6c651dbc/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081910", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/10af6c651dbc/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081910 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "7d7eb89ae4fe4f3291d0a405ca9ff7ef498e6fee73868120206a15bc74fabf02", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-198", + "job": { + "SLURM_JOB_ID": "213490", + "SLURM_ARRAY_JOB_ID": "213489", + "SLURM_ARRAY_TASK_ID": "0", + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T06:05:56.465469+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix." +} diff --git a/projects/video-action-editing/omni-gap6/results/10af6c651dbc/omni.jpg b/projects/video-action-editing/omni-gap6/results/10af6c651dbc/omni.jpg new file mode 100644 index 0000000..3a1f4ab Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/10af6c651dbc/omni.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/10af6c651dbc/omni.mp4 b/projects/video-action-editing/omni-gap6/results/10af6c651dbc/omni.mp4 new file mode 100644 index 0000000..26d98d3 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/10af6c651dbc/omni.mp4 differ diff --git a/projects/video-action-editing/omni-gap6/results/10af6c651dbc/receipt.json b/projects/video-action-editing/omni-gap6/results/10af6c651dbc/receipt.json new file mode 100644 index 0000000..409e9d8 --- /dev/null +++ b/projects/video-action-editing/omni-gap6/results/10af6c651dbc/receipt.json @@ -0,0 +1,237 @@ +{ + "status": "complete", + "case": { + "index": 0, + "case_id": "10af6c651dbc", + "name": "Jellyfish contraction", + "page": 5, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/10af6c651dbc/source-exact81.mp4", + "source_sha256": "ea86ef53e403f1cc602594cc3623a2fb66fb9b2f65c1461ef2bf62bee82a35fb", + "instruction": "Edit the action so that the jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water.", + "seed": 2026081910, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/rv2v.mp4" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/10af6c651dbc/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081910", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/10af6c651dbc/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081910 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "7d7eb89ae4fe4f3291d0a405ca9ff7ef498e6fee73868120206a15bc74fabf02", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-198", + "job": { + "SLURM_JOB_ID": "213490", + "SLURM_ARRAY_JOB_ID": "213489", + "SLURM_ARRAY_TASK_ID": "0", + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T06:05:56.465469+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix.", + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/10af6c651dbc/attempt-001/log_0.log", + "rank_zero_log_sha256": "9df1cb759d7ba258dbb8a68ddd9af298bb3a6b5ad6d1466d071ee7e924bfd779", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8462 + ], + "max_context_len": 9216 + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/results/10af6c651dbc/omni.mp4", + "sha256": "d89d6250e0a7d8d567215bc717c3348f9356e21a2931708f4988d2c2e41a83a0", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 810.02, + "completed_utc": "2026-09-23T06:19:01.858331+00:00" +} diff --git a/projects/video-action-editing/omni-gap6/results/10af6c651dbc/source.jpg b/projects/video-action-editing/omni-gap6/results/10af6c651dbc/source.jpg new file mode 100644 index 0000000..d2ed1a8 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/10af6c651dbc/source.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/10af6c651dbc/source.mp4 b/projects/video-action-editing/omni-gap6/results/10af6c651dbc/source.mp4 new file mode 100644 index 0000000..cffcbfc Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/10af6c651dbc/source.mp4 differ diff --git a/projects/video-action-editing/omni-gap6/results/7fa338474c75/bernini.jpg b/projects/video-action-editing/omni-gap6/results/7fa338474c75/bernini.jpg new file mode 100644 index 0000000..5fecf44 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/7fa338474c75/bernini.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/7fa338474c75/bernini.mp4 b/projects/video-action-editing/omni-gap6/results/7fa338474c75/bernini.mp4 new file mode 100644 index 0000000..c4a681d Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/7fa338474c75/bernini.mp4 differ diff --git a/projects/video-action-editing/omni-gap6/results/7fa338474c75/bernini_receipt.json b/projects/video-action-editing/omni-gap6/results/7fa338474c75/bernini_receipt.json new file mode 100644 index 0000000..c87d796 --- /dev/null +++ b/projects/video-action-editing/omni-gap6/results/7fa338474c75/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"f9fb66d7ba26d5b6c907907484ab012f56226413b6589008980e07769bbb72d9","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"8bcc51dc4c2e74329745d5bbb4682931a9e1fc6d0109835d876d3fddb6ab68b7","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"87748a8b55ddaaffbf5218f4f073870cfef1c1640a1f3065e4a4576649f2ef2d","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"c84892f1c13e19eb87fe487d81586dbc534037dce1397517586695c590acf5ee","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"8b35befc7791242197bb98d009552e4b9fd93e824a8a4a8213bce975cb308b50","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"07568fb4d663b6ba3673ec1e193de3821d7d820d6ce1efc00714f841e0eb4a45","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"02b1dd31203f7faf7056896412ab13cc49c1502905eea080dcdef0339f1c78ea","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"989b2ea0df40b524f363fc139658f64999ccc7f337bfbbc20a43312e2d69ca26","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"a89609a93f01479b99e582be450147e79f1f1bb7a743f733f8bb39dbcdf0cd9f","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"e4f73d861568ade971e15f4c2b887157d6a73660c95825bb8dc13ff97664cd20","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"bb2c3cae810ad8747008fc1f29f114d44b35d8ba1e6afea150fad559222261e1","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"622d0aa42aa3d1da17ddf09ad6e2045973df15689519ab42714f674ecf670f79","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"8b0e68030f5e31c73a5aef03712524132ee414e2ef7b72d2498eea16020463de","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"85cb92d76808926625238adaca005b0d57fce9efa62bac4bab9813cada4036b5","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"089225fb799a25a8c375b5fef60937ddc68aecdc9d3b6a48e91d12cab6f53b77","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"bccdd1a64ddd0ab37a65884f8516b175dccce7e4fbfebbf8208748da6825dc4e","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"089225fb799a25a8c375b5fef60937ddc68aecdc9d3b6a48e91d12cab6f53b77","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081900,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"bccdd1a64ddd0ab37a65884f8516b175dccce7e4fbfebbf8208748da6825dc4e","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"a508f70ba841f81c279f0cd4f4af7edd9610bb3b58c79379b1b3d77245b8a0ee","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"bccdd1a64ddd0ab37a65884f8516b175dccce7e4fbfebbf8208748da6825dc4e"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"089225fb799a25a8c375b5fef60937ddc68aecdc9d3b6a48e91d12cab6f53b77","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"bccdd1a64ddd0ab37a65884f8516b175dccce7e4fbfebbf8208748da6825dc4e","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"089225fb799a25a8c375b5fef60937ddc68aecdc9d3b6a48e91d12cab6f53b77","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081900,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"bccdd1a64ddd0ab37a65884f8516b175dccce7e4fbfebbf8208748da6825dc4e","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"b2738639091d9f3e01e0b563099bc817b38d90de3b66bb542ff51e87d5b01db7","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"bccdd1a64ddd0ab37a65884f8516b175dccce7e4fbfebbf8208748da6825dc4e"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":360,"action_prompt_utf8_sha256":"0ff87e5aa29e20f22ba1d2963c2700a3f10b6941147a8e517dd05e339cfb50de","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7fa338474c75/source-exact81.mp4","source_video_sha256":"4278c748fa1fdd54d908c366a781df33d3e4eb1acc1c2b7bd3492659c66a9840","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"14183c91c3d381a24be715255b3c4a9a0f370bcc69c6ed876121f61c18eea7ad","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/rv2v.mp4","sha256":"135d1e590d26a18862564839aa9e228cfde73e2f36162fec1ea410312463efa3","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"672966d65e34461fa1f289c183c94690e098d495348309643d66764adbf0bf19","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/t2v.mp4","sha256":"17b7ccb39f068649eb0ff155d50fdcba822dfd0a66bcf7965086b62651335d34","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"4278c748fa1fdd54d908c366a781df33d3e4eb1acc1c2b7bd3492659c66a9840","original_pre_snapshot_sha256":"4278c748fa1fdd54d908c366a781df33d3e4eb1acc1c2b7bd3492659c66a9840","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"4278c748fa1fdd54d908c366a781df33d3e4eb1acc1c2b7bd3492659c66a9840","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"390651d2b78ec306d9df7bad9f858f54aad88c2e5c8901777ea14d66e0b557fd","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"b375acf818287eb04d364b4e6659a6a57a3ba76383eff12ea45a12864a3556c0","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"afb24405bd96f305c72df69a42ba8f0b93714080c43bbcc42cb42392c8306099","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081900,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081900,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"e164987cde49343a15ba70910ae003f9287d20d54e99bc618833b536c123e851","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-gap6/results/7fa338474c75/comparison.jpg b/projects/video-action-editing/omni-gap6/results/7fa338474c75/comparison.jpg new file mode 100644 index 0000000..43defed Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/7fa338474c75/comparison.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/7fa338474c75/launch.json b/projects/video-action-editing/omni-gap6/results/7fa338474c75/launch.json new file mode 100644 index 0000000..fbeca15 --- /dev/null +++ b/projects/video-action-editing/omni-gap6/results/7fa338474c75/launch.json @@ -0,0 +1,211 @@ +{ + "case": { + "index": 1, + "case_id": "7fa338474c75", + "name": "Playful selfie", + "page": 5, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7fa338474c75/source-exact81.mp4", + "source_sha256": "4278c748fa1fdd54d908c366a781df33d3e4eb1acc1c2b7bd3492659c66a9840", + "instruction": "Edit the action so that the woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking.", + "seed": 2026081900, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/rv2v.mp4" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/7fa338474c75/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081900", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/7fa338474c75/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081900 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "7d7eb89ae4fe4f3291d0a405ca9ff7ef498e6fee73868120206a15bc74fabf02", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-249", + "job": { + "SLURM_JOB_ID": "213445", + "SLURM_ARRAY_JOB_ID": "213443", + "SLURM_ARRAY_TASK_ID": "1", + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T06:03:25.163144+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix." +} diff --git a/projects/video-action-editing/omni-gap6/results/7fa338474c75/omni.jpg b/projects/video-action-editing/omni-gap6/results/7fa338474c75/omni.jpg new file mode 100644 index 0000000..474d2c5 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/7fa338474c75/omni.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/7fa338474c75/omni.mp4 b/projects/video-action-editing/omni-gap6/results/7fa338474c75/omni.mp4 new file mode 100644 index 0000000..9c9e660 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/7fa338474c75/omni.mp4 differ diff --git a/projects/video-action-editing/omni-gap6/results/7fa338474c75/receipt.json b/projects/video-action-editing/omni-gap6/results/7fa338474c75/receipt.json new file mode 100644 index 0000000..6caa76f --- /dev/null +++ b/projects/video-action-editing/omni-gap6/results/7fa338474c75/receipt.json @@ -0,0 +1,237 @@ +{ + "status": "complete", + "case": { + "index": 1, + "case_id": "7fa338474c75", + "name": "Playful selfie", + "page": 5, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7fa338474c75/source-exact81.mp4", + "source_sha256": "4278c748fa1fdd54d908c366a781df33d3e4eb1acc1c2b7bd3492659c66a9840", + "instruction": "Edit the action so that the woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking.", + "seed": 2026081900, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/rv2v.mp4" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/7fa338474c75/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081900", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/7fa338474c75/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081900 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "7d7eb89ae4fe4f3291d0a405ca9ff7ef498e6fee73868120206a15bc74fabf02", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-249", + "job": { + "SLURM_JOB_ID": "213445", + "SLURM_ARRAY_JOB_ID": "213443", + "SLURM_ARRAY_TASK_ID": "1", + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T06:03:25.163144+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix.", + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/7fa338474c75/attempt-001/log_0.log", + "rank_zero_log_sha256": "dcac05cb97b4e7bad98704b61eb623f6602e60429b9a863e9206e2be1072422e", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8432 + ], + "max_context_len": 9216 + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/results/7fa338474c75/omni.mp4", + "sha256": "e64b918ae016b09942016a2eefe75498a7c7929ba17d52e263eddb1905c9f26d", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 766.46, + "completed_utc": "2026-09-23T06:15:45.381516+00:00" +} diff --git a/projects/video-action-editing/omni-gap6/results/7fa338474c75/source.jpg b/projects/video-action-editing/omni-gap6/results/7fa338474c75/source.jpg new file mode 100644 index 0000000..661fb73 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/7fa338474c75/source.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/7fa338474c75/source.mp4 b/projects/video-action-editing/omni-gap6/results/7fa338474c75/source.mp4 new file mode 100644 index 0000000..7a1fb20 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/7fa338474c75/source.mp4 differ diff --git a/projects/video-action-editing/omni-gap6/results/81533c9e56ec/bernini.jpg b/projects/video-action-editing/omni-gap6/results/81533c9e56ec/bernini.jpg new file mode 100644 index 0000000..a16e59d Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/81533c9e56ec/bernini.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/81533c9e56ec/bernini.mp4 b/projects/video-action-editing/omni-gap6/results/81533c9e56ec/bernini.mp4 new file mode 100644 index 0000000..c423fdf Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/81533c9e56ec/bernini.mp4 differ diff --git a/projects/video-action-editing/omni-gap6/results/81533c9e56ec/bernini_receipt.json b/projects/video-action-editing/omni-gap6/results/81533c9e56ec/bernini_receipt.json new file mode 100644 index 0000000..f9dcbf3 --- /dev/null +++ b/projects/video-action-editing/omni-gap6/results/81533c9e56ec/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"ce530d73daa6abb5b969f1d3266c691aa435a2c8bd0d4ca9426b5e249f66ef61","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"8f09b8ecfed65bf80b9e34cbc285bfc0cf67767df70140662a0c2840a219c0d7","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"2a53afe1650cfab2d3ac8b51fe33f02235022c4d047947dde7e999f3082191c3","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"95c8c5ec8ad4b3d7233359f321f3315046697aab827a8c951a7ca5a8e652b2f7","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"0cecd0632e41dd74a5c1c077098079bb15da04fb7bf0aa7c73ac5c7732cacb0b","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"8c9f975ba007f1ecdb769a497d9d951978e4757457d760f3c6b17cd6abd1461f","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"c078d8ca086b1ff21cad71b882c029be28e94028d2aa33dc02e84078fc677238","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"8b5b13c7294d4ad3e2be9a775865b71187be53abab4caf09f201710b0a40401d","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"435a03f05de71292fee97d5e6ba138978d92e7737ba7157c4ea326b8e78eeb4f","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"9cc054f3d575a45b39d3c832f67784c2490018697147140dd1c26f75587ff3b4","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"afa5cbf2e8426145cb1086e3c1edd81c012c2eee4462246c2d0317ec511e04e6","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"2f6d3cdd86969ea676d570f08eac7b523a75ea9d3fcbcb4839fb1a33d38c7f2f","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"072a77897e5c0dbfc7897e44a0d9683ae5efaeee64c3445701c68e668e753c6c","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"68905a2905a05bbbe8be8002f5ebc991cc7d11718cf6b0f424164ed8f5aa4091","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"a51983a760145dea7aa4a57824c0130c2be80717592390f360a7819f3f69e229","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"7bdebc631ee914dd17063a860196d41a22461b9486f2082902e591626ea30e10","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"a51983a760145dea7aa4a57824c0130c2be80717592390f360a7819f3f69e229","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081915,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"7bdebc631ee914dd17063a860196d41a22461b9486f2082902e591626ea30e10","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"2295f02c127be7b0749791e4cbc63a2d224283b236635e1fea47789137f3374b","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"7bdebc631ee914dd17063a860196d41a22461b9486f2082902e591626ea30e10"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"a51983a760145dea7aa4a57824c0130c2be80717592390f360a7819f3f69e229","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"7bdebc631ee914dd17063a860196d41a22461b9486f2082902e591626ea30e10","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"a51983a760145dea7aa4a57824c0130c2be80717592390f360a7819f3f69e229","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081915,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"7bdebc631ee914dd17063a860196d41a22461b9486f2082902e591626ea30e10","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"c5f43d5946b20260a431cdcf5de99f7d641e5a66159050aa60c616432821051a","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"7bdebc631ee914dd17063a860196d41a22461b9486f2082902e591626ea30e10"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":313,"action_prompt_utf8_sha256":"f0c58055ee24d894eb9274175c45f1bc41371cd9ff37dbae7d599298eece6bbd","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/81533c9e56ec/source-exact81.mp4","source_video_sha256":"6daa80d3ac407b01f842ce6fa611b3ec6c421851525f0845779143c4577e0b19","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"e4f07921d171f20a05139f37be8cb6ac946326e55a06cab5d577bd7a1629211e","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/rv2v.mp4","sha256":"96023f66a9a170c5880e637e2085520de6d8aa2c9889a1dc47a053812644905e","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"971b5d3e7c97d5ad3f00c69c3a637d0b3e9950689a890ab56fcf283be25b218c","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/t2v.mp4","sha256":"7dcf7690d12f8c59a3bef36b2b8a91f681d44351386bbb0f34c9f2a43625be1b","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"6daa80d3ac407b01f842ce6fa611b3ec6c421851525f0845779143c4577e0b19","original_pre_snapshot_sha256":"6daa80d3ac407b01f842ce6fa611b3ec6c421851525f0845779143c4577e0b19","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"6daa80d3ac407b01f842ce6fa611b3ec6c421851525f0845779143c4577e0b19","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"3806bba0f33f8966ce0ae354187d157fdb3d2bfc2d061326791c9782c36a3bff","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"7ff108fc95afc47faf6136fd7ed84de550b2a1c1db0e8a9f5100ab9be73aa184","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"a431bf93418404503aab9fec5fafe012793198bb0e5e48eb7f234e7640e267c7","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081915,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081915,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"f12cd6af0a68b68a7cf981c67abbbb0af0e4337064c380f67ed1be15d6af48ca","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-gap6/results/81533c9e56ec/launch.json b/projects/video-action-editing/omni-gap6/results/81533c9e56ec/launch.json new file mode 100644 index 0000000..796d1d7 --- /dev/null +++ b/projects/video-action-editing/omni-gap6/results/81533c9e56ec/launch.json @@ -0,0 +1,211 @@ +{ + "case": { + "index": 2, + "case_id": "81533c9e56ec", + "name": "Scarf spin", + "page": 6, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/81533c9e56ec/source-exact81.mp4", + "source_sha256": "6daa80d3ac407b01f842ce6fa611b3ec6c421851525f0845779143c4577e0b19", + "instruction": "Edit the action so that the woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf.", + "seed": 2026081915, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/rv2v.mp4" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/81533c9e56ec/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081915", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/81533c9e56ec/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081915 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "7d7eb89ae4fe4f3291d0a405ca9ff7ef498e6fee73868120206a15bc74fabf02", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-198", + "job": { + "SLURM_JOB_ID": "213499", + "SLURM_ARRAY_JOB_ID": "213497", + "SLURM_ARRAY_TASK_ID": "2", + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T06:19:59.377626+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix." +} diff --git a/projects/video-action-editing/omni-gap6/results/81533c9e56ec/omni.jpg b/projects/video-action-editing/omni-gap6/results/81533c9e56ec/omni.jpg new file mode 100644 index 0000000..df07a3d Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/81533c9e56ec/omni.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/81533c9e56ec/omni.mp4 b/projects/video-action-editing/omni-gap6/results/81533c9e56ec/omni.mp4 new file mode 100644 index 0000000..f3ddaa1 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/81533c9e56ec/omni.mp4 differ diff --git a/projects/video-action-editing/omni-gap6/results/81533c9e56ec/receipt.json b/projects/video-action-editing/omni-gap6/results/81533c9e56ec/receipt.json new file mode 100644 index 0000000..643ec7e --- /dev/null +++ b/projects/video-action-editing/omni-gap6/results/81533c9e56ec/receipt.json @@ -0,0 +1,237 @@ +{ + "status": "complete", + "case": { + "index": 2, + "case_id": "81533c9e56ec", + "name": "Scarf spin", + "page": 6, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/81533c9e56ec/source-exact81.mp4", + "source_sha256": "6daa80d3ac407b01f842ce6fa611b3ec6c421851525f0845779143c4577e0b19", + "instruction": "Edit the action so that the woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf.", + "seed": 2026081915, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/rv2v.mp4" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/81533c9e56ec/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081915", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/81533c9e56ec/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081915 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "7d7eb89ae4fe4f3291d0a405ca9ff7ef498e6fee73868120206a15bc74fabf02", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-198", + "job": { + "SLURM_JOB_ID": "213499", + "SLURM_ARRAY_JOB_ID": "213497", + "SLURM_ARRAY_TASK_ID": "2", + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T06:19:59.377626+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix.", + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/81533c9e56ec/attempt-001/log_0.log", + "rank_zero_log_sha256": "c8aa072cdc2b03577914d8e813d307c609422fa4756e056d62525a7bb3e842ea", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8434 + ], + "max_context_len": 9216 + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/results/81533c9e56ec/omni.mp4", + "sha256": "60dfb623480e63643bb647b7ffec5647c4f3163251164ceda6aced8b0491db2c", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 711.58, + "completed_utc": "2026-09-23T06:31:33.241425+00:00" +} diff --git a/projects/video-action-editing/omni-gap6/results/81533c9e56ec/source.jpg b/projects/video-action-editing/omni-gap6/results/81533c9e56ec/source.jpg new file mode 100644 index 0000000..4fbfb38 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/81533c9e56ec/source.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/81533c9e56ec/source.mp4 b/projects/video-action-editing/omni-gap6/results/81533c9e56ec/source.mp4 new file mode 100644 index 0000000..28d6493 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/81533c9e56ec/source.mp4 differ diff --git a/projects/video-action-editing/omni-gap6/results/840b214afead/bernini.jpg b/projects/video-action-editing/omni-gap6/results/840b214afead/bernini.jpg new file mode 100644 index 0000000..00722ae Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/840b214afead/bernini.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/840b214afead/bernini.mp4 b/projects/video-action-editing/omni-gap6/results/840b214afead/bernini.mp4 new file mode 100644 index 0000000..b2b8619 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/840b214afead/bernini.mp4 differ diff --git a/projects/video-action-editing/omni-gap6/results/840b214afead/bernini_receipt.json b/projects/video-action-editing/omni-gap6/results/840b214afead/bernini_receipt.json new file mode 100644 index 0000000..b1dff5e --- /dev/null +++ b/projects/video-action-editing/omni-gap6/results/840b214afead/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"15992f2246144c6ed07475f7c9c58de924db6ab3341cf2490300c7a0a371a5b2","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"c1f45924af0cf2c17d425fc6c25b51b74cc980f4c8d8c322224835504222c9eb","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"1b62b0dbeab6dc5846d0dc29269ca1a1529b274ff336a63a6a48a7b661ab275b","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"b1dcd2064d8530cff990cb79f835d1e9bfc9825c4838dedd51d2b71d809d0bdb","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"1ec3cf0b33e9da06d58748bfccb7ad57e5b3962f4aae6f897dd17631af9cd217","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"7a5712dbc0d5f42e15bb265b557768e845070ace4f02db5f43160d56ddc3f404","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"a5da9b87e21f746d1083fa429f04a45bb8282b23c51604d5bb792195ca7a0453","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"bcd4135f5d56fae7faeb3b58b7e73aeb3f76ca0cd1e701721880fca802c4a48b","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"37cf604ec6fe8a68353bf61bde5afd00869362861576a998a59d7a833f2cf680","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"7d6e92cc7bc79a1be341ad324d892b3e8fe01c702a8b644e0363e06aab11613f","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"0251923627620990a6a4c666eb6add662a1eaf1501456093b2dc4f019a39929e","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"965868b1b4505e33716bfe157304bc05a8c743bad5c8dc02470591bf7768b183","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"11c5947118886cebcd1bf6a1eecc823a8e13ad5a438b951b2f32934fd19522b7","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"2a5cf9984339fa101b5f3291d47ee64a270aef944d64847014093d2f3efe994a","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"0a4ae2cab750190cf746b7839bddc4cbe8a1d5b92ebe0bdc1a7c92bb652ed0b7","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"20af8631c22b9d5183c253ed91205439eeb51eb5852477000f37d0f4a3448575","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"0a4ae2cab750190cf746b7839bddc4cbe8a1d5b92ebe0bdc1a7c92bb652ed0b7","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081913,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"20af8631c22b9d5183c253ed91205439eeb51eb5852477000f37d0f4a3448575","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"682d187e508391191be118335d745986443f758560808935124d41e27192b2ee","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"20af8631c22b9d5183c253ed91205439eeb51eb5852477000f37d0f4a3448575"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"0a4ae2cab750190cf746b7839bddc4cbe8a1d5b92ebe0bdc1a7c92bb652ed0b7","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"20af8631c22b9d5183c253ed91205439eeb51eb5852477000f37d0f4a3448575","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"0a4ae2cab750190cf746b7839bddc4cbe8a1d5b92ebe0bdc1a7c92bb652ed0b7","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081913,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"20af8631c22b9d5183c253ed91205439eeb51eb5852477000f37d0f4a3448575","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"60e97ee622b93c52a8c7eb6085f0faf59e880ca7d44992f32940d7735dd812cf","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"20af8631c22b9d5183c253ed91205439eeb51eb5852477000f37d0f4a3448575"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":370,"action_prompt_utf8_sha256":"effdf094385a4f2486391efc008150b7436a8137c1d5766864a678ed6e0c749f","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/840b214afead/source-exact81.mp4","source_video_sha256":"a6e42a447d7fef26b073878c551a631afd6371987910a332e51e4a9e4dfb4646","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"1689f4723a2694b5e29c4912c91268fd8a16757433187e2d4cde44bc531f9e8f","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/rv2v.mp4","sha256":"805f6a2211b7a76e16cd85f508b341f2f06db3a04eaa336e688fe098bf5b545e","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"3c6007e70156d84f666cd1cf0a818a74cdb9c04afece892e59569de0e5f8edd7","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/t2v.mp4","sha256":"412399051be25c19ec9ab7d1406b1e6982e31e75cfa1b3920259a6c22f66113b","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"a6e42a447d7fef26b073878c551a631afd6371987910a332e51e4a9e4dfb4646","original_pre_snapshot_sha256":"a6e42a447d7fef26b073878c551a631afd6371987910a332e51e4a9e4dfb4646","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"a6e42a447d7fef26b073878c551a631afd6371987910a332e51e4a9e4dfb4646","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"604bff69e9f43990de2efd7c26e64d15b4f1e92d9c165d182c7e2707f9299251","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"a267d42ed5d6b8c080308914f0062fd01d9e5ac525637ff8aff050de28e1b298","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"e4d14f7d37fa5c7618f0971d9dd26ba3893976d748054ab0d688f290b3ce9dd0","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081913,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081913,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"5297c69ee8399f59a973efc144cd7ec61b8f2eb6c41677279ebb707a227836c7","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-gap6/results/840b214afead/launch.json b/projects/video-action-editing/omni-gap6/results/840b214afead/launch.json new file mode 100644 index 0000000..dbc3dcb --- /dev/null +++ b/projects/video-action-editing/omni-gap6/results/840b214afead/launch.json @@ -0,0 +1,211 @@ +{ + "case": { + "index": 4, + "case_id": "840b214afead", + "name": "Place bottle on treadmill", + "page": 7, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/840b214afead/source-exact81.mp4", + "source_sha256": "a6e42a447d7fef26b073878c551a631afd6371987910a332e51e4a9e4dfb4646", + "instruction": "Edit the action so that the woman turns her head to the left and places her water bottle onto the treadmill.", + "seed": 2026081913, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/rv2v.mp4" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/840b214afead/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081913", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/840b214afead/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081913 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "7d7eb89ae4fe4f3291d0a405ca9ff7ef498e6fee73868120206a15bc74fabf02", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-198", + "job": { + "SLURM_JOB_ID": "213526", + "SLURM_ARRAY_JOB_ID": "213526", + "SLURM_ARRAY_TASK_ID": "3", + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T06:44:54.791716+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix." +} diff --git a/projects/video-action-editing/omni-gap6/results/840b214afead/omni.jpg b/projects/video-action-editing/omni-gap6/results/840b214afead/omni.jpg new file mode 100644 index 0000000..777c3db Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/840b214afead/omni.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/840b214afead/omni.mp4 b/projects/video-action-editing/omni-gap6/results/840b214afead/omni.mp4 new file mode 100644 index 0000000..9f7f236 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/840b214afead/omni.mp4 differ diff --git a/projects/video-action-editing/omni-gap6/results/840b214afead/receipt.json b/projects/video-action-editing/omni-gap6/results/840b214afead/receipt.json new file mode 100644 index 0000000..cfc165a --- /dev/null +++ b/projects/video-action-editing/omni-gap6/results/840b214afead/receipt.json @@ -0,0 +1,237 @@ +{ + "status": "complete", + "case": { + "index": 4, + "case_id": "840b214afead", + "name": "Place bottle on treadmill", + "page": 7, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/840b214afead/source-exact81.mp4", + "source_sha256": "a6e42a447d7fef26b073878c551a631afd6371987910a332e51e4a9e4dfb4646", + "instruction": "Edit the action so that the woman turns her head to the left and places her water bottle onto the treadmill.", + "seed": 2026081913, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/rv2v.mp4" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/840b214afead/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081913", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/840b214afead/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081913 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "7d7eb89ae4fe4f3291d0a405ca9ff7ef498e6fee73868120206a15bc74fabf02", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-198", + "job": { + "SLURM_JOB_ID": "213526", + "SLURM_ARRAY_JOB_ID": "213526", + "SLURM_ARRAY_TASK_ID": "3", + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T06:44:54.791716+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix.", + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/840b214afead/attempt-001/log_0.log", + "rank_zero_log_sha256": "eb7f4af0a9f917d89d609335f0d04617faac266f103db5e3647bf534dfbb84f2", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8431 + ], + "max_context_len": 9216 + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/results/840b214afead/omni.mp4", + "sha256": "98eac004ebc001827750a81dc955bc30206b501d07f68cd97fd1cbec71537c63", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 619.4, + "completed_utc": "2026-09-23T06:54:56.562948+00:00" +} diff --git a/projects/video-action-editing/omni-gap6/results/840b214afead/source.jpg b/projects/video-action-editing/omni-gap6/results/840b214afead/source.jpg new file mode 100644 index 0000000..dbc338c Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/840b214afead/source.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/840b214afead/source.mp4 b/projects/video-action-editing/omni-gap6/results/840b214afead/source.mp4 new file mode 100644 index 0000000..b917388 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/840b214afead/source.mp4 differ diff --git a/projects/video-action-editing/omni-gap6/results/d908552fb691/bernini.jpg b/projects/video-action-editing/omni-gap6/results/d908552fb691/bernini.jpg new file mode 100644 index 0000000..90f78ba Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/d908552fb691/bernini.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/d908552fb691/bernini.mp4 b/projects/video-action-editing/omni-gap6/results/d908552fb691/bernini.mp4 new file mode 100644 index 0000000..13f0dff Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/d908552fb691/bernini.mp4 differ diff --git a/projects/video-action-editing/omni-gap6/results/d908552fb691/bernini_receipt.json b/projects/video-action-editing/omni-gap6/results/d908552fb691/bernini_receipt.json new file mode 100644 index 0000000..a394030 --- /dev/null +++ b/projects/video-action-editing/omni-gap6/results/d908552fb691/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"a0a093221006a4bc061d2c49d193ac3553aef2db2c994a5121d3953e7ec9f50c","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"60f4c1f2a8fa41430dfd460cf678c517c8d2a0864c6aae9931af4e99f24cc24a","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"08ac76711877a7c3c995081b07d21cab4e28dde1768dc4bd06293d2d0e594dd8","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"5afd39a16b79c04f11b123c7e732891200577346c56c6ff34194bdffca79ac7d","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"67e8cf261d8cb4f8842d5848348ad6d157a2d135fce8018f403566a68c18103c","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"e3bf8e07296b0cdcf862746603667335e86050993c53b494f51f296267237f0b","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"9285004abd79644620eb8f144c051849bb29ce584b4b4483a594456386a03e3b","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"785548ee49b875d2fcfab42cd65efdfb3516a7985c777051e8557c80580b3e56","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"400d2e2c096a5ba77d2632fa77fe0dec3e1c092e16c534a6257f23476e94c352","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"b1b95705d274ce5a92933877856d9e703f8cf0ccbda9178b0ca1ee1b382a2b17","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"9896e66b548f5147ecb12cf96e88f128c27406e6dec8350fb5972f7b7e935368","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"3849e04624c5c84e6733c1ce7edad70384ee977aa138f6e143d94e45f978400f","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"92549679f4e010e231e5b2dcdda92736c20466762730683cea7f8932fc4eb97c","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"64eb180444ab66420f959ae3a668ad3e51a80abbab6c7384bd98c48e25100270","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"6de6325eb03ecd284f77eabb2a050a89730d7f0463ef36f7ca728782897a36a5","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"e3477e803918b5d84ff200b2be049c36f69a18c79419595cc7f18e3684b2246e","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"6de6325eb03ecd284f77eabb2a050a89730d7f0463ef36f7ca728782897a36a5","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081903,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"e3477e803918b5d84ff200b2be049c36f69a18c79419595cc7f18e3684b2246e","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"e5564515e89d41c7277fa82415b91e753bd875abafe5501dfec22bbc2d0f6c36","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"e3477e803918b5d84ff200b2be049c36f69a18c79419595cc7f18e3684b2246e"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"6de6325eb03ecd284f77eabb2a050a89730d7f0463ef36f7ca728782897a36a5","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"e3477e803918b5d84ff200b2be049c36f69a18c79419595cc7f18e3684b2246e","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"6de6325eb03ecd284f77eabb2a050a89730d7f0463ef36f7ca728782897a36a5","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081903,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"e3477e803918b5d84ff200b2be049c36f69a18c79419595cc7f18e3684b2246e","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"8018b358ab8ea9e4cb9bcb228505076ad7ab084bb85c5d0706278b7073345b71","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"e3477e803918b5d84ff200b2be049c36f69a18c79419595cc7f18e3684b2246e"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":382,"action_prompt_utf8_sha256":"6c693b009c7e8c0d2f3c4ed680d119e2ef14e800cbabc6a10da0ff2556bb86b8","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d908552fb691/source-exact81.mp4","source_video_sha256":"56e1faa78c02c32d6da71354e8434241c8e9a4c334da4ac8aa4415148b6230bb","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"eed978266371e00b3feb9b7d17dcc61633f46d5ea90722e2e3e19ab61090be37","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/rv2v.mp4","sha256":"2ab7621e74b848a998822edb340ce07baca308814bb5524d7d3cd910e45e9efd","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"c1b0f92804195de0b39a900d62bf435141f4a8a095cb56abf4dee562742b940f","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/t2v.mp4","sha256":"704f866e6b6a0615f87d62f9815c61c065519e900d2e70be5a517513994daa3d","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"56e1faa78c02c32d6da71354e8434241c8e9a4c334da4ac8aa4415148b6230bb","original_pre_snapshot_sha256":"56e1faa78c02c32d6da71354e8434241c8e9a4c334da4ac8aa4415148b6230bb","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"56e1faa78c02c32d6da71354e8434241c8e9a4c334da4ac8aa4415148b6230bb","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"5f2cf4cedb92a86ab416ff83ba501d1e2e6647dd9d86fd5cd2e68ac729dbe68d","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"e8b542250790de1613b15c355501c22efa624817869e7528d8a09ef141a21a1f","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"c3f1aae496efdb016048dfc552989cc37daa8b7724258214b7a1e81adaa1c2a0","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081903,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081903,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"ec20637b3b2070c1949c0f06d95e6d6717facc1dedc3c4d52aea479e96b281a7","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-gap6/results/d908552fb691/launch.json b/projects/video-action-editing/omni-gap6/results/d908552fb691/launch.json new file mode 100644 index 0000000..944dd95 --- /dev/null +++ b/projects/video-action-editing/omni-gap6/results/d908552fb691/launch.json @@ -0,0 +1,211 @@ +{ + "case": { + "index": 5, + "case_id": "d908552fb691", + "name": "Bow to clap", + "page": 7, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d908552fb691/source-exact81.mp4", + "source_sha256": "56e1faa78c02c32d6da71354e8434241c8e9a4c334da4ac8aa4415148b6230bb", + "instruction": "Edit the action so that the woman in a taekwondo uniform stands in profile and claps her hands together in front of her.", + "seed": 2026081903, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/rv2v.mp4" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/d908552fb691/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081903", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/d908552fb691/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081903 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "7d7eb89ae4fe4f3291d0a405ca9ff7ef498e6fee73868120206a15bc74fabf02", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-198", + "job": { + "SLURM_JOB_ID": "213526", + "SLURM_ARRAY_JOB_ID": "213526", + "SLURM_ARRAY_TASK_ID": "3", + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T06:55:14.524165+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix." +} diff --git a/projects/video-action-editing/omni-gap6/results/d908552fb691/omni.jpg b/projects/video-action-editing/omni-gap6/results/d908552fb691/omni.jpg new file mode 100644 index 0000000..692d4ee Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/d908552fb691/omni.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/d908552fb691/omni.mp4 b/projects/video-action-editing/omni-gap6/results/d908552fb691/omni.mp4 new file mode 100644 index 0000000..8c8a372 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/d908552fb691/omni.mp4 differ diff --git a/projects/video-action-editing/omni-gap6/results/d908552fb691/receipt.json b/projects/video-action-editing/omni-gap6/results/d908552fb691/receipt.json new file mode 100644 index 0000000..89e8212 --- /dev/null +++ b/projects/video-action-editing/omni-gap6/results/d908552fb691/receipt.json @@ -0,0 +1,237 @@ +{ + "status": "complete", + "case": { + "index": 5, + "case_id": "d908552fb691", + "name": "Bow to clap", + "page": 7, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d908552fb691/source-exact81.mp4", + "source_sha256": "56e1faa78c02c32d6da71354e8434241c8e9a4c334da4ac8aa4415148b6230bb", + "instruction": "Edit the action so that the woman in a taekwondo uniform stands in profile and claps her hands together in front of her.", + "seed": 2026081903, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/rv2v.mp4" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/d908552fb691/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081903", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/d908552fb691/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081903 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "7d7eb89ae4fe4f3291d0a405ca9ff7ef498e6fee73868120206a15bc74fabf02", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-198", + "job": { + "SLURM_JOB_ID": "213526", + "SLURM_ARRAY_JOB_ID": "213526", + "SLURM_ARRAY_TASK_ID": "3", + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T06:55:14.524165+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix.", + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/d908552fb691/attempt-001/log_0.log", + "rank_zero_log_sha256": "bdb29fe30e9bd1fb226ee55e28693fa2d91a53e5e9bb57f56608e45020e208c5", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8449 + ], + "max_context_len": 9216 + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/results/d908552fb691/omni.mp4", + "sha256": "c28477d38438a68c82509bd1cae0f72fbf3865007bd7ea9774b8c1339b336260", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 631.1, + "completed_utc": "2026-09-23T07:05:27.998285+00:00" +} diff --git a/projects/video-action-editing/omni-gap6/results/d908552fb691/source.jpg b/projects/video-action-editing/omni-gap6/results/d908552fb691/source.jpg new file mode 100644 index 0000000..c123cff Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/d908552fb691/source.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/d908552fb691/source.mp4 b/projects/video-action-editing/omni-gap6/results/d908552fb691/source.mp4 new file mode 100644 index 0000000..ce15cf3 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/d908552fb691/source.mp4 differ diff --git a/projects/video-action-editing/omni-gap6/results/d977ce147d80/bernini.jpg b/projects/video-action-editing/omni-gap6/results/d977ce147d80/bernini.jpg new file mode 100644 index 0000000..5c5b988 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/d977ce147d80/bernini.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/d977ce147d80/bernini.mp4 b/projects/video-action-editing/omni-gap6/results/d977ce147d80/bernini.mp4 new file mode 100644 index 0000000..7458b4c Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/d977ce147d80/bernini.mp4 differ diff --git a/projects/video-action-editing/omni-gap6/results/d977ce147d80/bernini_receipt.json b/projects/video-action-editing/omni-gap6/results/d977ce147d80/bernini_receipt.json new file mode 100644 index 0000000..e2bcd41 --- /dev/null +++ b/projects/video-action-editing/omni-gap6/results/d977ce147d80/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"72c86e50643180d5462a1cfbd7866503bd47e27b48016cca61e78cbf494287cd","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"df07812ea8d48d3e0fa0ab394ed62e096dd60fcfdfd28616360b60173561fb58","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"bd952f750ac9c0fba0da81749ba7954bb9f023125ce0d7f94e6528a7aec3b972","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"1821d12e74e20c62a3406da3c39354e2e1dff719acc674fe03e1ea3d5ed3039f","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"ad029d8836050c90ebbdeac146df913676f82f1a957d13cbba7fc274dddae653","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"94bab1c3e870a44bb147ab021ba86dd13fe79a9d9236e96e21bca3029f3b9eec","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"a8ac5e4820c0b58cb6b544496076ce1c54641298dd341f135cfb575c764e225f","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"e63ae6bdcc2cd4fc6a1c6c09877fb70a792e194da858195f4adcd9865e516365","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"fc5dceb5bfc6a8a50aa23d4e2e6cc15d6d558172c3e34a85650f37f611674eb5","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"1a56ce494d1b21394b3ad3d7b75d3592116a4b7599f14b99bebb1f8b5e41ff35","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"d110645f18034ba60a6e4d7414c132abdfcb76fb788804ec612af60fc3c5bddf","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"d25a21c01fd7b4e758ef172da8d4f953a0106d5e676d0c2cc6c2aed17c921c02","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"e25ae302ef64edd9f14a03fef40e678245d7e6bd8c3e785d23d69cc319ce3fb6","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"865adedaf9f9db1049576610e242cde606d7439dea343619f73c82d8b7ca450f","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"e55f92c066aea4ceb4049375ab53d391e12a4cc8fef0bd2268e7409663da7540","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"01d9f9d890d22ab6a60aadd0143efb87aab45160079a3f4660b3856b0cb3b064","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"e55f92c066aea4ceb4049375ab53d391e12a4cc8fef0bd2268e7409663da7540","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081905,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"01d9f9d890d22ab6a60aadd0143efb87aab45160079a3f4660b3856b0cb3b064","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"d065f9f4a2e85a3097303bfa6832615de7d2abe241636716db2208f7083dc05b","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"01d9f9d890d22ab6a60aadd0143efb87aab45160079a3f4660b3856b0cb3b064"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"e55f92c066aea4ceb4049375ab53d391e12a4cc8fef0bd2268e7409663da7540","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"01d9f9d890d22ab6a60aadd0143efb87aab45160079a3f4660b3856b0cb3b064","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"e55f92c066aea4ceb4049375ab53d391e12a4cc8fef0bd2268e7409663da7540","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081905,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"01d9f9d890d22ab6a60aadd0143efb87aab45160079a3f4660b3856b0cb3b064","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"828064c90e3e07930cbcec5a0fba7d48bb6d3cb493e763f07fffda4724696e27","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"01d9f9d890d22ab6a60aadd0143efb87aab45160079a3f4660b3856b0cb3b064"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":319,"action_prompt_utf8_sha256":"e405c3746dde5e6718d5d165841db90f2078d73391a04c4e6d309c75e59cea3a","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d977ce147d80/source-exact81.mp4","source_video_sha256":"e2a056e1af423be25a5beb4b75d1145fbacd625e3316a8e64b6031e75739f80d","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"9d707f3f3e2c15e1ad8fadf35169538f7e380628620773448cc85a9b25dd5058","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/rv2v.mp4","sha256":"ca8c8d8162467af99f51cac705c13ddbdf6a30c19f2b4d75053c9ad71f2a44cd","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"1b387a9a30058c171af5dbbf67722c8edfbeda277f13ed7cf10012f10743d77b","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/t2v.mp4","sha256":"baac904b0402dfab39c956835d36f5c37e2a079d59d47517857c702f3f42f5d6","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"e2a056e1af423be25a5beb4b75d1145fbacd625e3316a8e64b6031e75739f80d","original_pre_snapshot_sha256":"e2a056e1af423be25a5beb4b75d1145fbacd625e3316a8e64b6031e75739f80d","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"e2a056e1af423be25a5beb4b75d1145fbacd625e3316a8e64b6031e75739f80d","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"9cac90cd9e7113aedd3a75fbb3867e553dac93dd7f0077b11d0328635cc90f25","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"b2cb6032bd7dd832c9c87724807bf4206caff68c9a84183460e721087847b768","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"77a92dd70655be7c3a80d59899974e3c0b9bfaa7e1a64b170e51f1b5ccc1a722","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081905,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081905,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"0624a1d4c2f2e1d6d96c4739535d98833a1914de2ae6d6984ed694278ac27afd","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-gap6/results/d977ce147d80/launch.json b/projects/video-action-editing/omni-gap6/results/d977ce147d80/launch.json new file mode 100644 index 0000000..d651ea7 --- /dev/null +++ b/projects/video-action-editing/omni-gap6/results/d977ce147d80/launch.json @@ -0,0 +1,211 @@ +{ + "case": { + "index": 3, + "case_id": "d977ce147d80", + "name": "Rub eyes then cover face", + "page": 6, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d977ce147d80/source-exact81.mp4", + "source_sha256": "e2a056e1af423be25a5beb4b75d1145fbacd625e3316a8e64b6031e75739f80d", + "instruction": "Edit the action so that the man lying on the couch rubs his tired eyes and covers his face with both hands.", + "seed": 2026081905, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/rv2v.mp4" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/d977ce147d80/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081905", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/d977ce147d80/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081905 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "7d7eb89ae4fe4f3291d0a405ca9ff7ef498e6fee73868120206a15bc74fabf02", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-198", + "job": { + "SLURM_JOB_ID": "213526", + "SLURM_ARRAY_JOB_ID": "213526", + "SLURM_ARRAY_TASK_ID": "3", + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T06:32:38.784792+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix." +} diff --git a/projects/video-action-editing/omni-gap6/results/d977ce147d80/omni.jpg b/projects/video-action-editing/omni-gap6/results/d977ce147d80/omni.jpg new file mode 100644 index 0000000..9f0669c Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/d977ce147d80/omni.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/d977ce147d80/omni.mp4 b/projects/video-action-editing/omni-gap6/results/d977ce147d80/omni.mp4 new file mode 100644 index 0000000..2238d08 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/d977ce147d80/omni.mp4 differ diff --git a/projects/video-action-editing/omni-gap6/results/d977ce147d80/receipt.json b/projects/video-action-editing/omni-gap6/results/d977ce147d80/receipt.json new file mode 100644 index 0000000..4a79665 --- /dev/null +++ b/projects/video-action-editing/omni-gap6/results/d977ce147d80/receipt.json @@ -0,0 +1,237 @@ +{ + "status": "complete", + "case": { + "index": 3, + "case_id": "d977ce147d80", + "name": "Rub eyes then cover face", + "page": 6, + "source_video": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d977ce147d80/source-exact81.mp4", + "source_sha256": "e2a056e1af423be25a5beb4b75d1145fbacd625e3316a8e64b6031e75739f80d", + "instruction": "Edit the action so that the man lying on the couch rubs his tired eyes and covers his face with both hands.", + "seed": 2026081905, + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/receipt.json", + "bernini_output": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/rv2v.mp4" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/d977ce147d80/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "v2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081905", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/pact_omnivideo2_smoke/396c741_probe_20260803/checkpoint/transformer/pytorch_model.pt", + "--sampling_rate", + "1", + "--skip_num", + "0", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--video_max_duration", + "5", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/d977ce147d80/attempt-001/source_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "231a590e9c1f7f1f0f45723e577cf029d4d31cbcfd6adf42fc2b6d4b8952b843", + "patched_generate_entry_sha256": "04f849776b07b50aab7595ad25d4cdf6ec6781b5f3c5816e65231f57ce170a80", + "runtime_patch_contract": [ + "raise_instead_of_context_truncation_and_log_exact_total", + "require_zero_missing_and_unexpected_checkpoint_keys" + ] + }, + "sampler": { + "name": "unipc", + "num_inference_steps": 40, + "guidance_scale": 3.0, + "flow_shift": 5.0, + "seed": 2026081905 + }, + "geometry": { + "policy": "official_orientation_specific_center_crop_resize", + "size": "832*480", + "frame_indices": [ + 0, + 1, + 2, + 3, + 4, + 5, + 6, + 7, + 8, + 9, + 10, + 11, + 12, + 13, + 14, + 15, + 16, + 17, + 18, + 19, + 20, + 21, + 22, + 23, + 24, + 25, + 26, + 27, + 28, + 29, + 30, + 31, + 32, + 33, + 34, + 35, + 36, + 37, + 38, + 39, + 40, + 41, + 42, + 43, + 44, + 45, + 46, + 47, + 48, + 49, + 50, + 51, + 52, + 53, + 54, + 55, + 56, + 57, + 58, + 59, + 60, + 61, + 62, + 63, + 64, + 65, + 66, + 67, + 68, + 69, + 70, + 71, + 72, + 73, + 74, + 75, + 76, + 77, + 78, + 79, + 80 + ], + "sampling_rate": 1, + "max_context_len": 9216 + }, + "manifest_sha256": "7d7eb89ae4fe4f3291d0a405ca9ff7ef498e6fee73868120206a15bc74fabf02", + "driver_sha256": "b276948e0c867f42bcadedcee58f350f579e198bc41c6bda19a34c7e9f0a5b8f", + "frozen_runner_sha256": "ddd6224609cb069cac9e2415ca1325e4f2f2cd8e8cecfca2bf17f237e147e34c", + "hostname": "auh7-1b-gpu-198", + "job": { + "SLURM_JOB_ID": "213526", + "SLURM_ARRAY_JOB_ID": "213526", + "SLURM_ARRAY_TASK_ID": "3", + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T06:32:38.784792+00:00", + "inference_inputs": [ + "source_video", + "edit_instruction" + ], + "real_target_used": false, + "text_contract": "Original manifest editing instruction; Omni native Qwen caption planning. Bernini used its generation_caption with a route prefix.", + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/d977ce147d80/attempt-001/log_0.log", + "rank_zero_log_sha256": "077eaa6598b40423896b760883fb8f772d16cde197e4a0376849ba644173eff1", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8503 + ], + "max_context_len": 9216 + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/results/d977ce147d80/omni.mp4", + "sha256": "e8f6947d204e4f31cd3b576be5c9fa6f76fc060fb8bda186e19d8f9b25b89c1d", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 735.68, + "completed_utc": "2026-09-23T06:44:36.789314+00:00" +} diff --git a/projects/video-action-editing/omni-gap6/results/d977ce147d80/source.jpg b/projects/video-action-editing/omni-gap6/results/d977ce147d80/source.jpg new file mode 100644 index 0000000..4cfb084 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/d977ce147d80/source.jpg differ diff --git a/projects/video-action-editing/omni-gap6/results/d977ce147d80/source.mp4 b/projects/video-action-editing/omni-gap6/results/d977ce147d80/source.mp4 new file mode 100644 index 0000000..633d3f9 Binary files /dev/null and b/projects/video-action-editing/omni-gap6/results/d977ce147d80/source.mp4 differ diff --git a/projects/video-action-editing/omni-gap6/summary.json b/projects/video-action-editing/omni-gap6/summary.json new file mode 100644 index 0000000..3cd5820 --- /dev/null +++ b/projects/video-action-editing/omni-gap6/summary.json @@ -0,0 +1,230 @@ +[ + { + "case_id": "10af6c651dbc", + "page": 5, + "name": "Jellyfish contraction", + "seed": 2026081910, + "output_sha256": "d89d6250e0a7d8d567215bc717c3348f9356e21a2931708f4988d2c2e41a83a0", + "job": { + "SLURM_JOB_ID": "213490", + "SLURM_ARRAY_JOB_ID": "213489", + "SLURM_ARRAY_TASK_ID": "0", + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "hostname": "auh7-1b-gpu-198", + "elapsed_seconds": 810.02, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/results/10af6c651dbc/omni.mp4", + "sha256": "d89d6250e0a7d8d567215bc717c3348f9356e21a2931708f4988d2c2e41a83a0", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/10af6c651dbc/attempt-001/log_0.log", + "rank_zero_log_sha256": "9df1cb759d7ba258dbb8a68ddd9af298bb3a6b5ad6d1466d071ee7e924bfd779", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8462 + ], + "max_context_len": 9216 + } + }, + { + "case_id": "7fa338474c75", + "page": 5, + "name": "Playful selfie", + "seed": 2026081900, + "output_sha256": "e64b918ae016b09942016a2eefe75498a7c7929ba17d52e263eddb1905c9f26d", + "job": { + "SLURM_JOB_ID": "213445", + "SLURM_ARRAY_JOB_ID": "213443", + "SLURM_ARRAY_TASK_ID": "1", + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "hostname": "auh7-1b-gpu-249", + "elapsed_seconds": 766.46, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/results/7fa338474c75/omni.mp4", + "sha256": "e64b918ae016b09942016a2eefe75498a7c7929ba17d52e263eddb1905c9f26d", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/7fa338474c75/attempt-001/log_0.log", + "rank_zero_log_sha256": "dcac05cb97b4e7bad98704b61eb623f6602e60429b9a863e9206e2be1072422e", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8432 + ], + "max_context_len": 9216 + } + }, + { + "case_id": "81533c9e56ec", + "page": 6, + "name": "Scarf spin", + "seed": 2026081915, + "output_sha256": "60dfb623480e63643bb647b7ffec5647c4f3163251164ceda6aced8b0491db2c", + "job": { + "SLURM_JOB_ID": "213499", + "SLURM_ARRAY_JOB_ID": "213497", + "SLURM_ARRAY_TASK_ID": "2", + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "hostname": "auh7-1b-gpu-198", + "elapsed_seconds": 711.58, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/results/81533c9e56ec/omni.mp4", + "sha256": "60dfb623480e63643bb647b7ffec5647c4f3163251164ceda6aced8b0491db2c", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/81533c9e56ec/attempt-001/log_0.log", + "rank_zero_log_sha256": "c8aa072cdc2b03577914d8e813d307c609422fa4756e056d62525a7bb3e842ea", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8434 + ], + "max_context_len": 9216 + } + }, + { + "case_id": "d977ce147d80", + "page": 6, + "name": "Rub eyes then cover face", + "seed": 2026081905, + "output_sha256": "e8f6947d204e4f31cd3b576be5c9fa6f76fc060fb8bda186e19d8f9b25b89c1d", + "job": { + "SLURM_JOB_ID": "213526", + "SLURM_ARRAY_JOB_ID": "213526", + "SLURM_ARRAY_TASK_ID": "3", + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "hostname": "auh7-1b-gpu-198", + "elapsed_seconds": 735.68, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/results/d977ce147d80/omni.mp4", + "sha256": "e8f6947d204e4f31cd3b576be5c9fa6f76fc060fb8bda186e19d8f9b25b89c1d", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/d977ce147d80/attempt-001/log_0.log", + "rank_zero_log_sha256": "077eaa6598b40423896b760883fb8f772d16cde197e4a0376849ba644173eff1", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8503 + ], + "max_context_len": 9216 + } + }, + { + "case_id": "840b214afead", + "page": 7, + "name": "Place bottle on treadmill", + "seed": 2026081913, + "output_sha256": "98eac004ebc001827750a81dc955bc30206b501d07f68cd97fd1cbec71537c63", + "job": { + "SLURM_JOB_ID": "213526", + "SLURM_ARRAY_JOB_ID": "213526", + "SLURM_ARRAY_TASK_ID": "3", + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "hostname": "auh7-1b-gpu-198", + "elapsed_seconds": 619.4, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/results/840b214afead/omni.mp4", + "sha256": "98eac004ebc001827750a81dc955bc30206b501d07f68cd97fd1cbec71537c63", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/840b214afead/attempt-001/log_0.log", + "rank_zero_log_sha256": "eb7f4af0a9f917d89d609335f0d04617faac266f103db5e3647bf534dfbb84f2", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8431 + ], + "max_context_len": 9216 + } + }, + { + "case_id": "d908552fb691", + "page": 7, + "name": "Bow to clap", + "seed": 2026081903, + "output_sha256": "c28477d38438a68c82509bd1cae0f72fbf3865007bd7ea9774b8c1339b336260", + "job": { + "SLURM_JOB_ID": "213526", + "SLURM_ARRAY_JOB_ID": "213526", + "SLURM_ARRAY_TASK_ID": "3", + "SLURM_JOB_GPUS": "0,1,2,3", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "hostname": "auh7-1b-gpu-198", + "elapsed_seconds": 631.1, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/results/d908552fb691/omni.mp4", + "sha256": "c28477d38438a68c82509bd1cae0f72fbf3865007bd7ea9774b8c1339b336260", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "runtime_evidence": { + "rank_zero_log_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni6_20260923_v1/work/d908552fb691/attempt-001/log_0.log", + "rank_zero_log_sha256": "bdb29fe30e9bd1fb226ee55e28693fa2d91a53e5e9bb57f56608e45020e208c5", + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 8190, + "context_total_tokens": [ + 8346, + 8449 + ], + "max_context_len": 9216 + } + } +] diff --git a/projects/video-action-editing/omni-t2v12/index.html b/projects/video-action-editing/omni-t2v12/index.html new file mode 100644 index 0000000..230fe6d --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/index.html @@ -0,0 +1,23 @@ + +Bernini / OmniVideo2 · T2V 与视频编辑十二例对比

Bernini / OmniVideo2 · T2V 与视频编辑十二例对比

+

Self-generated T2V 已收集 12/12;视频编辑已有 12/12。T2V 只接收文本,从噪声生成新视频;编辑分支接收 Source。两类结果在这里分别标注。

+

T2V 初始 caption 复用 Bernini 的旧拼接文本:MEV 整体描述 + 目标动作标注 + 保持约束。12 例均包含 Editing instruction 对应的目标动作。Omni 随后经过 Qwen 扩写,再送入 T5;两模型共享初始正文,但最终生成文本不同。下方可展开查看逐层文本及已发现的偏差。

+

Omni T2V:81 帧、25 fps、40 步、832×480;seed 与 Bernini 相同。当前视频保留原始运行结果。文本核对不等同于视频动作成功评估。

+

Real target 是样本配对的真实目标视频,仅用于对照。为同步比较,完整目标片段统一调整为 81 帧、25 fps(3.24 秒),播放速度可能与原片不同。

+

查看大模型:Bernini-R 14B / OmniVideo2-A14B,固定同一 caption 的生成与编辑对比

+
T2V 汇总
+

提杠铃 · Barbell lift

Editing instruction
Edit the action so that the woman in a home gym lifts a barbell from the floor to her waist.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V

文本核对:Omni 扩写把 lifts from the floor to her waist 写成 lowering ... from the floor to her waist,动作方向语义矛盾。初始整体 caption 还描述重复 deadlifts。

Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The woman in a home gym lifts a barbell from the floor to her waist.
原始整体描述 · MEV global_prompt.short_caption
A woman in black activewear performs barbell deadlifts with focused determination in a well-equipped home gym.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A woman in black activewear performs barbell deadlifts with focused determination in a well-equipped home gym. In this continuous shot, The woman in a home gym lifts a barbell from the floor to her waist. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A woman in sleek black activewear performs a series of controlled barbell deadlifts in a well-equipped home gym, her movements precise and deliberate. The camera holds a steady, medium-wide shot, capturing her full body as she stands with feet shoulder-width apart, gripping the barbell with a firm overhand hold. With focused determination etched on her face, she bends at the hips and knees, lowering the barbell smoothly from the floor to her waist, maintaining a straight back and engaged core throughout. The gym is bathed in soft, even lighting that highlights the clean, organized space—treadmills, weight racks, and resistance bands visible in the background. The scene remains consistent, with no changes in framing, camera angle, or lighting, emphasizing the continuity and rhythm of her exercise. Her breath is steady, her muscles taut, as she repeats the motion with unwavering form, the metallic clink of the barbell echoing faintly in the quiet room. The atmosphere is one of quiet intensity, underscoring her commitment and strength.
fb7725c351ba · seed 2026081901 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

狗转头 · Dog head turn

Editing instruction
Edit the action so that the dog turns its head further to the right while sitting in the grass.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V
Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The dog turns its head further to the right while sitting in the grass.
原始整体描述 · MEV global_prompt.short_caption
A happy Pembroke Welsh Corgi with a reddish-brown and white coat sits in a sunny green field, panting with its tongue out in a static medium shot.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A happy Pembroke Welsh Corgi with a reddish-brown and white coat sits in a sunny green field, panting with its tongue out in a static medium shot. In this continuous shot, The dog turns its head further to the right while sitting in the grass. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A happy Pembroke Welsh Corgi with a rich reddish-brown and white coat sits calmly in a sun-drenched green field, its short legs tucked beneath its sturdy body. The warm sunlight bathes the scene, casting soft highlights across the dog’s smooth fur and illuminating the vibrant blades of grass around it. The corgi pants gently, its pink tongue lolling out in a relaxed, joyful expression, conveying a sense of contentment and ease. The camera holds a steady, static medium shot, framing the dog from the mid-chest up, allowing full view of its expressive face and perked ears. As the moment unfolds, the dog slowly turns its head further to the right, its eyes briefly scanning the surroundings with quiet curiosity, while its body remains still. The lush green field stretches out behind it, dotted with wildflowers and bathed in golden afternoon light. The scene remains consistent throughout—same subject, same environment, same lighting, same framing—capturing a peaceful, serene moment in nature, with the corgi as the calm, cheerful centerpiece.
3fadbe0c2961 · seed 2026081902 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

长椅上写字 · Write in notebook

Editing instruction
Edit the action so that the young woman sitting on a park bench thoughtfully writes in her notebook with a pen.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V

文本核对:Omni 保留写字动作,但额外加入 occasionally pausing to glance up and around,目标指令没有要求这一动作。

Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The young woman sitting on a park bench thoughtfully writes in her notebook with a pen.
原始整体描述 · MEV global_prompt.short_caption
A young woman with shoulder-length light brown hair sits on a wooden bench in a sunny park or campus setting, writing in a notebook while dressed in a pink shirt and blue jeans.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A young woman with shoulder-length light brown hair sits on a wooden bench in a sunny park or campus setting, writing in a notebook while dressed in a pink shirt and blue jeans. In this continuous shot, The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A young woman with shoulder-length light brown hair sits calmly on a weathered wooden bench in a sun-drenched park or campus setting, the golden light of midday filtering through the leaves of nearby trees. She wears a soft pink button-up shirt and fitted blue jeans, her posture relaxed yet focused as she leans slightly forward, pen in hand, writing thoughtfully in a small notebook resting on her lap. Her brow is gently furrowed in concentration, occasionally pausing to glance up and around, as if gathering inspiration from the peaceful surroundings. The camera holds steady in a medium shot, capturing her from the waist up, with the background softly blurred to emphasize her presence—dappled sunlight dances across the grass and pavement, and the faint rustle of leaves and distant chatter of people passing by add a gentle soundtrack to the scene. The composition remains unchanged throughout, maintaining consistent framing, lighting, and perspective, creating a serene, contemplative moment frozen in time.
7077cfb160cf · seed 2026081904 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

转身倚车 · Turn and lean on car

Editing instruction
Edit the action so that the woman in a black leather jacket and red pants turns and leans back against the hood of the black car.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V

文本核对:Omni 保留转身倚车,但额外加入 red lighting pulses subtly,与初始 caption 的 lighting remain stable 不一致。

Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The woman in a black leather jacket and red pants turns and leans back against the hood of the black car.
原始整体描述 · MEV global_prompt.short_caption
A confident woman in red pants and a black leather jacket poses in front of a black Chevrolet Camaro in a moody, red-lit underground parking garage.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A confident woman in red pants and a black leather jacket poses in front of a black Chevrolet Camaro in a moody, red-lit underground parking garage. In this continuous shot, The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A confident woman stands in front of a sleek black Chevrolet Camaro in a moody, dimly lit underground parking garage, bathed in a deep, ambient red glow that casts dramatic shadows across the concrete walls and floor. She wears a form-fitting black leather jacket and vibrant red pants that contrast sharply with the dark surroundings, drawing the eye to her poised stance. The camera holds steady in a continuous, smooth shot, capturing her as she turns with deliberate grace, her movement fluid and intentional. She leans back against the curved hood of the car, her body angled slightly, one hand resting lightly on the glossy surface while the other hangs relaxed at her side. The red lighting pulses subtly, reflecting off the car’s polished paint and the woman’s jacket, enhancing the cinematic atmosphere. The scene remains tightly framed, with the Camaro’s aggressive lines and the woman’s commanding presence forming a powerful visual composition. The lighting, framing, and camera position remain consistent throughout, emphasizing the stillness and intensity of the moment, as if frozen in time.
7e488525099e · seed 2026081906 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

闭眼尝汤 · Taste from ladle

Editing instruction
Edit the action so that the woman in an apron closes her eyes as she tastes from a metal ladle.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V
Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The woman in an apron closes her eyes as she tastes from a metal ladle.
原始整体描述 · MEV global_prompt.short_caption
A young woman in a patterned apron stands in a modern kitchen, tasting food from a ladle with a satisfied expression.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A young woman in a patterned apron stands in a modern kitchen, tasting food from a ladle with a satisfied expression. In this continuous shot, The woman in an apron closes her eyes as she tastes from a metal ladle. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A young woman stands in a bright, modern kitchen, her figure centered in a steady, continuous shot. She wears a patterned apron over casual clothing, the fabric soft and slightly rumpled from use. The kitchen is sleek and well-lit, with natural light streaming through a large window, casting a warm glow across stainless steel appliances and clean white countertops. In her hand, she holds a metal ladle, its surface gleaming under the light. She lifts it slowly to her lips, her eyes closing gently as she tastes the food. Her expression softens into quiet satisfaction—lips parting slightly, a subtle smile forming as the flavor registers. The camera remains fixed, capturing the moment with unwavering focus, preserving the stillness of the scene. The lighting remains consistent, highlighting the contours of her face and the texture of the apron. The background remains unchanged—neatly arranged utensils, a pot simmering on the stove, a bowl of fresh herbs on the counter—all contributing to the calm, domestic atmosphere. The shot lingers, emphasizing the sensory experience, the quiet joy of a meal well-prepared, and the simple pleasure of tasting one’s own creation.
d5221a1b69d5 · seed 2026081907 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

放下手机后翻身睡觉 · Put phone away and sleep

Editing instruction
Edit the action so that the man in bed puts his smartphone on the nightstand and turns over to go to sleep.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V

文本核对:Omni 保留放手机再翻身的顺序,但额外加入 scrolling or typing 作为前置动作,可能占用短视频中的目标动作时长;是否实际影响执行需看视频。

Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The man in bed puts his smartphone on the nightstand and turns over to go to sleep.
原始整体描述 · MEV global_prompt.short_caption
A young man with dyed-blond hair lies in bed in a dark room, illuminated by his phone's blue light, wearing a pink tank top and a nose ring.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A young man with dyed-blond hair lies in bed in a dark room, illuminated by his phone's blue light, wearing a pink tank top and a nose ring. In this continuous shot, The man in bed puts his smartphone on the nightstand and turns over to go to sleep. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A young man with dyed-blond hair lies on his back in a dimly lit bedroom, the only source of light emanating from the cool blue glow of his smartphone screen. He wears a soft pink tank top, the fabric slightly rumpled from lying still, and a small nose ring glints faintly in the low light as he shifts his head. The room is dark, shadows pooling in the corners, with only the faint outline of a nightstand and a pillow visible. The camera holds a steady, fixed position, capturing the scene in a continuous, unbroken shot. The man’s fingers move slowly across the phone’s screen, scrolling or typing with quiet focus. After a moment, he lowers the device, places it gently on the nightstand beside him, and turns onto his side, pulling the blanket slightly higher. His breathing slows, and he settles into sleep, the blue light fading as the phone powers down. The scene remains unchanged in framing, lighting, and composition, maintaining a calm, intimate stillness throughout.
40712e1341dc · seed 2026081911 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

Jellyfish contraction

Editing instruction
Edit the action so that the jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V
Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water.
原始整体描述 · MEV global_prompt.short_caption
A small, white-spotted jellyfish drifts and pulsates gracefully in serene, deep blue water.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A small, white-spotted jellyfish drifts and pulsates gracefully in serene, deep blue water. In this continuous shot, The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A small, white-spotted jellyfish drifts effortlessly through serene, deep blue water, its translucent bell gently pulsating in rhythmic motion. The delicate, rhythmic contractions of its body propel it forward in a slow, graceful dance, each pulse creating a subtle ripple in the surrounding water. As the bell contracts, it reveals a distinct ring-like shape, a luminous outline that glows faintly against the rich, uniform blue backdrop. The white spots on its body shimmer faintly with the play of light filtering down from above, adding a soft, ethereal contrast to the deep oceanic hue. The scene remains calm and undisturbed, with no sudden movements or changes in the environment. The camera holds steady, maintaining a consistent framing that centers the jellyfish in the frame, capturing its elegant motion in a continuous, uninterrupted shot. The lighting remains soft and diffused, enhancing the tranquil, otherworldly atmosphere of the deep sea. The jellyfish continues its slow, mesmerizing journey, its form and movement unchanged, creating a peaceful and hypnotic visual experience.
10af6c651dbc · seed 2026081910 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

Playful selfie

Editing instruction
Edit the action so that the woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V
Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking.
原始整体描述 · MEV global_prompt.short_caption
A cheerful woman in a red bikini top and straw sun hat takes a playful selfie against a green screen background in a static medium shot.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A cheerful woman in a red bikini top and straw sun hat takes a playful selfie against a green screen background in a static medium shot. In this continuous shot, The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A cheerful woman stands in a static medium shot against a bright green screen background, her figure centered and clearly defined. She wears a vibrant red bikini top and a wide-brimmed straw sun hat that casts a soft shadow over her face, enhancing the playful, summery vibe. Her expression is lively and animated as she holds her smartphone at arm’s length, capturing a selfie with a mischievous grin. She sticks her tongue out slightly and winks one eye, adding a flirtatious, carefree energy to the moment. Her dark hair peeks out from under the hat, gently swaying as she shifts her weight slightly, maintaining a relaxed yet engaging posture. The lighting is even and bright, highlighting her features and the vivid colors of her outfit without casting harsh shadows. The camera remains completely still throughout, keeping the framing consistent and focused on her upper body and face. The green screen behind her is uniform and uncluttered, providing a clean, neutral backdrop that emphasizes her presence. The scene exudes a lighthearted, fun atmosphere, capturing a spontaneous and joyful moment in a single, continuous take.
7fa338474c75 · seed 2026081900 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

Scarf spin

Editing instruction
Edit the action so that the woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V

文本核对:初始整体 caption 写 vintage-style dress,目标动作写 green skirt and black shirt,服装描述不够一致;Omni 保留两种描述。旋转动作仍出现在扩写文本中。

Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf.
原始整体描述 · MEV global_prompt.short_caption
A woman in a vintage-style dress dances gracefully by a flower-lined fence in front of a rustic wooden house.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A woman in a vintage-style dress dances gracefully by a flower-lined fence in front of a rustic wooden house. In this continuous shot, The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A woman in a vintage-style dress dances gracefully by a flower-lined fence in front of a rustic wooden house, her movements fluid and deliberate under the warm, golden light of late afternoon. She wears a flowing green skirt that swirls with each turn, paired with a fitted black shirt that contrasts elegantly with the soft hues of the surrounding garden. In her hands, she holds a long, sheer scarf that billows like a ribbon in the breeze, catching the sunlight as she spins in a slow, continuous circle. The camera remains steady, capturing her in a wide, stable frame that emphasizes the harmony between her motion and the tranquil setting. The fence, draped in climbing roses and wildflowers, frames the scene with natural beauty, while the weathered wooden house in the background adds a sense of timeless charm. The lighting is soft and diffused, casting gentle shadows and enhancing the nostalgic atmosphere. Her expression is serene, eyes closed at times, as if lost in the rhythm of the moment. The entire scene unfolds in a single, unbroken shot, with no cuts or shifts in perspective, allowing the viewer to fully immerse in the grace and stillness of the moment.
81533c9e56ec · seed 2026081915 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

Rub eyes then cover face

Editing instruction
Edit the action so that the man lying on the couch rubs his tired eyes and covers his face with both hands.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V
Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The man lying on the couch rubs his tired eyes and covers his face with both hands.
原始整体描述 · MEV global_prompt.short_caption
A young man with dark skin, dreadlocks, and a gold septum ring lies on a dark couch in a dimly lit room, showing signs of distress.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A young man with dark skin, dreadlocks, and a gold septum ring lies on a dark couch in a dimly lit room, showing signs of distress. In this continuous shot, The man lying on the couch rubs his tired eyes and covers his face with both hands. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A young man with dark skin and long dreadlocks lies sprawled across a dark, plush couch in a dimly lit room, the low ambient light casting deep shadows that pool around him. A gold septum ring glints faintly as he shifts slightly, his body tense with quiet unease. The room is still and intimate, the atmosphere heavy with a sense of emotional weight. He lifts his hands slowly, rubbing his tired eyes with the heels of his palms, his fingers pressing into the sockets as if trying to push back exhaustion or pain. Then, with a slow, deliberate motion, he covers his face entirely, pressing both hands against his forehead and cheeks, his breath shallow and uneven. The camera holds steady, capturing the moment in a continuous, unbroken shot—no movement, no cut—allowing the viewer to sit with the man’s distress. The framing remains tight and consistent, focusing on his upper body and face, emphasizing the subtle tremors in his hands and the way his shoulders rise and fall with each labored breath. The lighting remains unchanged, soft and moody, highlighting the contours of his face and the texture of his hair, while the surrounding darkness absorbs all distractions, drawing attention solely to his internal struggle. The scene is quiet, almost still, yet charged with unspoken emotion.
d977ce147d80 · seed 2026081905 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

Place bottle on treadmill

Editing instruction
Edit the action so that the woman turns her head to the left and places her water bottle onto the treadmill.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V
Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The woman turns her head to the left and places her water bottle onto the treadmill.
原始整体描述 · MEV global_prompt.short_caption
A young woman with long reddish-blonde hair, wearing a mint green athletic outfit, stands on a treadmill in a modern gym with blue and white striped pillars, holding a water bottle.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A young woman with long reddish-blonde hair, wearing a mint green athletic outfit, stands on a treadmill in a modern gym with blue and white striped pillars, holding a water bottle. In this continuous shot, The woman turns her head to the left and places her water bottle onto the treadmill. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A young woman with long, sun-kissed reddish-blonde hair stands centered on a treadmill in a sleek, modern gym, her posture relaxed yet alert. She wears a form-fitting mint green athletic outfit—a moisture-wicking tank top and matching leggings—that contrasts softly against the cool-toned environment. The gym is illuminated by bright, even lighting that highlights the clean lines of the space, with blue and white striped pillars rising in the background, creating a rhythmic visual pattern that adds depth to the scene. The camera holds a steady, medium-wide shot, capturing her from the waist up, with the treadmill’s control panel and running belt clearly visible. In a smooth, continuous motion, she turns her head slightly to the left, her gaze briefly shifting toward the side of the treadmill, then lowers her right hand to place a clear water bottle with a blue cap onto the treadmill’s console. The bottle rests securely, and she remains in place, her expression calm and focused, as the scene continues without interruption. The lighting remains consistent, the framing stable, and the background elements—pillars, mirrors, and distant gym equipment—remain unchanged, emphasizing the quiet, deliberate nature of the moment.
840b214afead · seed 2026081913 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源

Bow to clap

Editing instruction
Edit the action so that the woman in a taekwondo uniform stands in profile and claps her hands together in front of her.

Source · 仅用于编辑分支
Real target · 真实目标视频
Bernini-R-1.3B · Self-generated T2V
OmniVideo2-1.3B · Self-generated T2V
Bernini-R-1.3B · Source-conditioned RV2V
OmniVideo2-1.3B · Source-conditioned V2V
Caption 来源与实际生成文本(展开对照)
目标动作标注 · 与 Editing instruction 的动作正文对应
The woman in a taekwondo uniform stands in profile and claps her hands together in front of her.
原始整体描述 · MEV global_prompt.short_caption
A woman in a white taekwondo uniform with a black collar and Adidas logo stands in profile against a black background under dramatic side lighting, captured in a static medium shot.
Bernini / Omni 共同初始 caption · 整体描述 + 目标动作 + 保持约束
A woman in a white taekwondo uniform with a black collar and Adidas logo stands in profile against a black background under dramatic side lighting, captured in a static medium shot. In this continuous shot, The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. The same subject identity, scene, lighting, framing, and camera remain stable.
Omni Qwen 扩写后 caption · 实际送入 T5 的文本
A woman in a crisp white taekwondo uniform stands in profile against a deep black background, her form sharply defined by dramatic side lighting that casts a strong, sculpted shadow along her silhouette. The uniform features a black collar and a subtle Adidas logo on the chest, adding a touch of brand detail to the athletic attire. She is captured in a static medium shot, framed with precision to highlight her poised stance and the clean lines of her posture. The lighting emphasizes the contours of her body, creating a high-contrast, cinematic effect that enhances the intensity of the moment. In a smooth, continuous motion, she brings her hands together in front of her chest, clapping them once with a deliberate, controlled gesture. Her movements are precise and measured, reflecting discipline and focus. The scene remains unchanged throughout—no shifts in camera angle, lighting, or background—maintaining a consistent, composed atmosphere that centers entirely on her presence and action. The stillness of the frame contrasts with the subtle energy of her motion, creating a powerful visual statement of control and readiness.
d908552fb691 · seed 2026081903 · 81 frames / 25 fps · T2V 运行记录 · Omni 文本规划结果 · Real target 来源
\ No newline at end of file diff --git a/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/bernini_receipt.json b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/bernini_receipt.json new file mode 100644 index 0000000..e007c7f --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"865eda9a9146ff00a53995627229c6241aafdbdbf77716eba1f9a5b47262038d","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"0aac5508e42d41bb6875a63dfc05c610419d38e78c7e13d5bb9b5f1cde028b5b","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"3cee34ecc548972476540e65df8873b1bb47ae8aac4edb8a63042fb6378c1bd9","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"7f3ff14de58e3442beb06a9ef0f9514d44414935072dd967e3c13d014c648ac2","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"aba1eed7fe1a01b0425607c467cfdb4b30e9a0664ff556f7387ceb604724327f","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"3c4699d013d8e1405f81b66da29632d90623deb025eb6c8fee41a0b03f085aa0","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"a0d02f8df855e46c8edb4c8deff6071f188f1fca0a1b2e327612c50990b15c6e","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"736a7da7ba6187f82456db81ff453a92e70d880a44b86eeadb14ea55bb033f38","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"a81ba83a4aefbcfc6f10bc36288bfcfd6691c4d04a53fabf08d2def86557d79c","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"de038db05466227ffa3c40eeb9044e1a6e1820372caf2ee6a2d9adeeee674ba5","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"494305d54d8aa21e7e7f690ada8d2d541712eb0b483b18e9ebf8139b5ad1bf20","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"74df7987cb4ba137be84ed38b097cedf177914623b908b9d682e48ec2584e55b","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"4c7e622e97cc75521e6b359dfefda17f96b7de59df3c3eada7e7675ae368a7f6","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"592ba99d6a33ecd3e0cea9f10fca78dbce3f7224a4300b4ef2d9655f40865b25","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"0b85acb7370cba219f192a623c1f2b6f70d696ac59ac15cdc5a19b42073ca2a3","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"3b24517189012d2cf7fb7805850eed520865d3e7f72767ab22ab2144abe538e6","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"0b85acb7370cba219f192a623c1f2b6f70d696ac59ac15cdc5a19b42073ca2a3","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081910,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"3b24517189012d2cf7fb7805850eed520865d3e7f72767ab22ab2144abe538e6","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"1e77c693a0220e4ea8bfd32fb70439b9168f942737bb1539b36e3cd2d656584a","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"3b24517189012d2cf7fb7805850eed520865d3e7f72767ab22ab2144abe538e6"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"0b85acb7370cba219f192a623c1f2b6f70d696ac59ac15cdc5a19b42073ca2a3","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"3b24517189012d2cf7fb7805850eed520865d3e7f72767ab22ab2144abe538e6","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"0b85acb7370cba219f192a623c1f2b6f70d696ac59ac15cdc5a19b42073ca2a3","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081910,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"3b24517189012d2cf7fb7805850eed520865d3e7f72767ab22ab2144abe538e6","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"9951fa0c852fd8da6cdd33702853b4f51ba4f19707065125387cc32098f0e0fd","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"3b24517189012d2cf7fb7805850eed520865d3e7f72767ab22ab2144abe538e6"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":287,"action_prompt_utf8_sha256":"2ee4f1b1b4989f42c2a1b41aca7d635615860e252de87560f5bad2848688716f","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/10af6c651dbc/source-exact81.mp4","source_video_sha256":"ea86ef53e403f1cc602594cc3623a2fb66fb9b2f65c1461ef2bf62bee82a35fb","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"53b3ecfc7e4193e63ccd1554e832c2ecdaf4f5d3c9011965e69a667b7d6d639e","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/rv2v.mp4","sha256":"77f3f0b9446ee0b73d243bc0f5bc4ef6a43854931c4d1d03ce2f7e2b2a4e5f93","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"477f08e21106f4d2ebb214dee271325fe9dafd9d4727cf0a4c311a96d2321718","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/t2v.mp4","sha256":"b169af23b7eb5f9fd796fb01a5fd01421da15d40803d9a996fef4566722b7890","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"ea86ef53e403f1cc602594cc3623a2fb66fb9b2f65c1461ef2bf62bee82a35fb","original_pre_snapshot_sha256":"ea86ef53e403f1cc602594cc3623a2fb66fb9b2f65c1461ef2bf62bee82a35fb","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"ea86ef53e403f1cc602594cc3623a2fb66fb9b2f65c1461ef2bf62bee82a35fb","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"27bf7fa547c03f8269be8610eb7d937630813038545d9c085e1e2a226558817f","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"7cad9858365bcf3076091294ce24efbfc20feb97804917cf4287ad7d805cd23d","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"858596afad9a48d2306356d9d7d1cd9c27b1fded21b66b4d8e2fdb44c6decacb","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081910,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081910,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"1739f8b9594637c14fc72a8d927b5a9272dba82c435b159abffbd2bd38920acb","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/bernini_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/bernini_t2v.jpg new file mode 100644 index 0000000..c0c20d3 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/bernini_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/bernini_t2v.mp4 new file mode 100644 index 0000000..47e667e Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/launch.json b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/launch.json new file mode 100644 index 0000000..9e7dd26 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/launch.json @@ -0,0 +1,131 @@ +{ + "case": { + "index": 0, + "case_id": "10af6c651dbc", + "name": "Jellyfish contraction", + "page": 5, + "seed": 2026081910, + "prompt": "A small, white-spotted jellyfish drifts and pulsates gracefully in serene, deep blue water. In this continuous shot, The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "2ee4f1b1b4989f42c2a1b41aca7d635615860e252de87560f5bad2848688716f", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/t2v.mp4", + "bernini_t2v_sha256": "b169af23b7eb5f9fd796fb01a5fd01421da15d40803d9a996fef4566722b7890", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/receipt.json", + "comparison_batch": "progress2_omni6_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/10af6c651dbc/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081910", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/10af6c651dbc/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "704514c4b9833292fb5bb1308eeed7454747e161b49564dd10bb3c6fbdb0b638", + "hostname": "auh7-1b-gpu-253", + "job": { + "SLURM_JOB_ID": "213687", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T08:06:32.114519+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081910 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection." +} diff --git a/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/omni_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/omni_t2v.jpg new file mode 100644 index 0000000..5578e58 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/omni_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/omni_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/omni_t2v.mp4 new file mode 100644 index 0000000..349eced Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/real_target.jpg b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/real_target.jpg new file mode 100644 index 0000000..dc8143c Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/real_target.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/real_target.mp4 b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/real_target.mp4 new file mode 100644 index 0000000..0581e04 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/real_target.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/real_target_receipt.json b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/real_target_receipt.json new file mode 100644 index 0000000..61024b4 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/real_target_receipt.json @@ -0,0 +1,58 @@ +{ + "case_id": "10af6c651dbc", + "collected_utc": "2026-09-23T17:34:58.554119+00:00", + "purpose": "review_only", + "used_for_inference": false, + "original": { + "path": "/vast/users/guangyi.chen/dataset/MEV/MEV/videos/853e5739-1635-4de1-8da0-3288460ccb98-00.00.01.720-00.00.07.000-seg2.mp4", + "sha256": "b0a83cb3001fceea40d4251c7f747a67f600ff361f34939db767d0ee440aa790" + }, + "original_probe": { + "width": 1280, + "height": 720, + "avg_frame_rate": "24/1", + "duration": "5.291667", + "nb_read_frames": "127" + }, + "display": { + "path": "results/10af6c651dbc/real_target.mp4", + "sha256": "c848feb636d4f40415224a26f79cc88659a34d63506b1ea2d95fecb6a7a01542", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + }, + "ffmpeg_command": [ + "ffmpeg", + "-hide_banner", + "-loglevel", + "error", + "-y", + "-i", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/real_targets_original/10af6c651dbc.mp4", + "-map", + "0:v:0", + "-an", + "-vf", + "setpts=(PTS-STARTPTS)*0.612283425997894,fps=25,tpad=stop_mode=clone:stop_duration=3.24,trim=end_frame=81,setpts=N/(25*TB),scale=960:540:force_original_aspect_ratio=decrease:force_divisible_by=2,pad=960:540:(ow-iw)/2:(oh-ih)/2,setsar=1", + "-frames:v", + "81", + "-c:v", + "libx264", + "-crf", + "18", + "-preset", + "fast", + "-threads", + "2", + "-pix_fmt", + "yuv420p", + "-movflags", + "+faststart", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/results/10af6c651dbc/real_target.mp4" + ], + "full_decode_passed": true +} diff --git a/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/receipt.json b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/receipt.json new file mode 100644 index 0000000..4ffede2 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/receipt.json @@ -0,0 +1,175 @@ +{ + "status": "complete", + "case": { + "index": 0, + "case_id": "10af6c651dbc", + "name": "Jellyfish contraction", + "page": 5, + "seed": 2026081910, + "prompt": "A small, white-spotted jellyfish drifts and pulsates gracefully in serene, deep blue water. In this continuous shot, The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "2ee4f1b1b4989f42c2a1b41aca7d635615860e252de87560f5bad2848688716f", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/t2v.mp4", + "bernini_t2v_sha256": "b169af23b7eb5f9fd796fb01a5fd01421da15d40803d9a996fef4566722b7890", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/10af6c651dbc/receipt.json", + "comparison_batch": "progress2_omni6_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/10af6c651dbc/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081910", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/10af6c651dbc/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "704514c4b9833292fb5bb1308eeed7454747e161b49564dd10bb3c6fbdb0b638", + "hostname": "auh7-1b-gpu-253", + "job": { + "SLURM_JOB_ID": "213687", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T08:06:32.114519+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081910 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection.", + "conditioning": { + "input_prompt": "A small, white-spotted jellyfish drifts and pulsates gracefully in serene, deep blue water. In this continuous shot, The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A small, white-spotted jellyfish drifts effortlessly through serene, deep blue water, its translucent bell gently pulsating in rhythmic motion. The delicate, rhythmic contractions of its body propel it forward in a slow, graceful dance, each pulse creating a subtle ripple in the surrounding water. As the bell contracts, it reveals a distinct ring-like shape, a luminous outline that glows faintly against the rich, uniform blue backdrop. The white spots on its body shimmer faintly with the play of light filtering down from above, adding a soft, ethereal contrast to the deep oceanic hue. The scene remains calm and undisturbed, with no sudden movements or changes in the environment. The camera holds steady, maintaining a consistent framing that centers the jellyfish in the frame, capturing its elegant motion in a continuous, uninterrupted shot. The lighting remains soft and diffused, enhancing the tranquil, otherworldly atmosphere of the deep sea. The jellyfish continues its slow, mesmerizing journey, its form and movement unchanged, creating a peaceful and hypnotic visual experience.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 67, + 2048 + ], + "t5_context_shape": [ + 253, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 334 + ], + "rank_zero_log_sha256": "1253314f59ddf9f03be7e95cfc2dd23bac0a7d266cbca65d56c57593ab4e1d71" + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/10af6c651dbc/omni_t2v.mp4", + "sha256": "2380b955b966ff8643bf20f80996659d6c9b2f986743da29a3a2136941ed4437", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 779.17, + "completed_utc": "2026-09-23T08:18:48.817827+00:00" +} diff --git a/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/t2v_conditioning.json b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/t2v_conditioning.json new file mode 100644 index 0000000..9c461d3 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/10af6c651dbc/t2v_conditioning.json @@ -0,0 +1,19 @@ +{ + "input_prompt": "A small, white-spotted jellyfish drifts and pulsates gracefully in serene, deep blue water. In this continuous shot, The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A small, white-spotted jellyfish drifts effortlessly through serene, deep blue water, its translucent bell gently pulsating in rhythmic motion. The delicate, rhythmic contractions of its body propel it forward in a slow, graceful dance, each pulse creating a subtle ripple in the surrounding water. As the bell contracts, it reveals a distinct ring-like shape, a luminous outline that glows faintly against the rich, uniform blue backdrop. The white spots on its body shimmer faintly with the play of light filtering down from above, adding a soft, ethereal contrast to the deep oceanic hue. The scene remains calm and undisturbed, with no sudden movements or changes in the environment. The camera holds steady, maintaining a consistent framing that centers the jellyfish in the frame, capturing its elegant motion in a continuous, uninterrupted shot. The lighting remains soft and diffused, enhancing the tranquil, otherworldly atmosphere of the deep sea. The jellyfish continues its slow, mesmerizing journey, its form and movement unchanged, creating a peaceful and hypnotic visual experience.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 67, + 2048 + ], + "t5_context_shape": [ + 253, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 +} \ No newline at end of file diff --git a/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/bernini_receipt.json b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/bernini_receipt.json new file mode 100644 index 0000000..0c9931c --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"0e94b25d3a005a1c1fba466437891401b4186fcfa012a82735fd9a30c43cce3c","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"71d7da6d24dd88019b8e2dbfc0274f025aaaaeec606ca658a3f8c31a4f7b101d","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"56d4cf3e697f2c1ca310581171200e937ae8d0ddbc573931d1968e70b585358a","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"0f7bf58fe1fae3e602d7ebf4826023dac24aa6ee89d498bb3c6fab0302bec51b","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"6cf432b68d741603f50739f6ef6d4060769e84c01eb8a077ab5310d5965df28f","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"4afdec2b3a8fae6fcba904e3df789f4aa6d48e11cb60762b79c80728be62f473","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"1b143a73c2c814b5e973c915edcf2526b98f27487323d1ba2751bb775f4c5a0b","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"03d5e456c3bcdd50a38f1aba843ac046b14db363294a45d9cc739c364382419c","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"c04e4d63c40dc181ae413af983a9fab4371c510452c2e759d1e7b565f77325ff","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"88a22b8c0915e0b803703869cc3c3f984b38a42ba50fa6314f2b40e2297439c6","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"94515eedaa3561dbcb7072999e37f233c23ad72c694536d4da01e71073b92dc3","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"21a5afb6de9cf9fc94c35cbedffd4eb09f9a71beb600986351741fd9eadba4be","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"b55c93057cf7c6f7053fa078a44669105d92863bd979bb1c40ce9a4a184b0087","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"2d2bad67a121496c88916f0836f6f5a64c5b349dfd8c2995cfb78e259bff09ee","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"6ea2ae31bea2c05d35ed0dfccb0eb091986304939bdd6e886f411b0b58f7ed5b","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"b7c1abda804811dbfd17180c4cd067d953f3fae3b6aae225c26a6c7e50cc4ed6","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"6ea2ae31bea2c05d35ed0dfccb0eb091986304939bdd6e886f411b0b58f7ed5b","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081902,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"b7c1abda804811dbfd17180c4cd067d953f3fae3b6aae225c26a6c7e50cc4ed6","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"2aa46249b4ff7cfa61b8b4ceac015c9da19a1fe4df741e38bb38b7b90a797477","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"b7c1abda804811dbfd17180c4cd067d953f3fae3b6aae225c26a6c7e50cc4ed6"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"6ea2ae31bea2c05d35ed0dfccb0eb091986304939bdd6e886f411b0b58f7ed5b","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"b7c1abda804811dbfd17180c4cd067d953f3fae3b6aae225c26a6c7e50cc4ed6","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"6ea2ae31bea2c05d35ed0dfccb0eb091986304939bdd6e886f411b0b58f7ed5b","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081902,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"b7c1abda804811dbfd17180c4cd067d953f3fae3b6aae225c26a6c7e50cc4ed6","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"2a2910cadcea003184cc9bff7e23a887d1f6e7a4119a225ba9e91ba989b12476","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"b7c1abda804811dbfd17180c4cd067d953f3fae3b6aae225c26a6c7e50cc4ed6"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":322,"action_prompt_utf8_sha256":"e5a7d338e43779e2faa2383a663e1b1cd80c5e99400a0119b0d3f5dfe1252623","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/3fadbe0c2961/source-exact81.mp4","source_video_sha256":"99170f8a711a3d5a3e930a995561646ac557366cf92f5ded7ac13c6a986f8364","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"d64f729b43bde4a7ab47dfb39c1f77c71b8f7aad6f950bb59cfbeed87e5e9604","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/rv2v.mp4","sha256":"12fa9f9adb2f3996849aaa8c3ea958d1c73848bbbc3c28f018377961b16a8d46","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"8c0757b7d9f565685ecf5fe45aeecb61590bad2987f58a3a2c42eedf433a8349","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/t2v.mp4","sha256":"803fc5156774d814787b26a15fd4649c4a6429a7d2ca9b8e89b352461126c924","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"99170f8a711a3d5a3e930a995561646ac557366cf92f5ded7ac13c6a986f8364","original_pre_snapshot_sha256":"99170f8a711a3d5a3e930a995561646ac557366cf92f5ded7ac13c6a986f8364","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"99170f8a711a3d5a3e930a995561646ac557366cf92f5ded7ac13c6a986f8364","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"4c8b2e4e963aa56d40d038ab70782a8e8a982d842eb80c83a112e3025f01ad34","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"63d1c47fa69475922a71a4de07757c1f9a13eefd4abdc21888e0bfd021ba4098","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"5b166d802da00ec9db2a81368d4da813f83de5cae2786b81f06bf5f477f89462","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081902,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081902,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"26f210745b68f1a3ff1b8444c86d537d622d951a185a350c3d51e7a8f0e0a126","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/bernini_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/bernini_t2v.jpg new file mode 100644 index 0000000..1672d24 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/bernini_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/bernini_t2v.mp4 new file mode 100644 index 0000000..dd65924 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/launch.json b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/launch.json new file mode 100644 index 0000000..76a28e2 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/launch.json @@ -0,0 +1,131 @@ +{ + "case": { + "index": 7, + "case_id": "3fadbe0c2961", + "name": "狗转头 · Dog head turn", + "page": null, + "seed": 2026081902, + "prompt": "A happy Pembroke Welsh Corgi with a reddish-brown and white coat sits in a sunny green field, panting with its tongue out in a static medium shot. In this continuous shot, The dog turns its head further to the right while sitting in the grass. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "e5a7d338e43779e2faa2383a663e1b1cd80c5e99400a0119b0d3f5dfe1252623", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/t2v.mp4", + "bernini_t2v_sha256": "803fc5156774d814787b26a15fd4649c4a6429a7d2ca9b8e89b352461126c924", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/receipt.json", + "comparison_batch": "progress2_omni6_extra_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/3fadbe0c2961/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081902", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/3fadbe0c2961/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "2bfe0e00ce5d62a06e2efe67ea785fb83355a0a7ee60db854c5e5cadc975c60f", + "hostname": "auh7-1b-gpu-287", + "job": { + "SLURM_JOB_ID": "213688", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T08:19:38.914017+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081902 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection." +} diff --git a/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/omni_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/omni_t2v.jpg new file mode 100644 index 0000000..98208b4 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/omni_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/omni_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/omni_t2v.mp4 new file mode 100644 index 0000000..23ffd44 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/real_target.jpg b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/real_target.jpg new file mode 100644 index 0000000..9f03e29 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/real_target.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/real_target.mp4 b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/real_target.mp4 new file mode 100644 index 0000000..7b2049f Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/real_target.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/real_target_receipt.json b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/real_target_receipt.json new file mode 100644 index 0000000..06c18d8 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/real_target_receipt.json @@ -0,0 +1,58 @@ +{ + "case_id": "3fadbe0c2961", + "collected_utc": "2026-09-23T17:35:15.640575+00:00", + "purpose": "review_only", + "used_for_inference": false, + "original": { + "path": "/vast/users/guangyi.chen/dataset/MEV/MEV/videos/1bb09296-29be-4359-b1d4-03409ed1e30f-00.00.06.110-00.00.09.625-seg2.mp4", + "sha256": "1d7d66c1b1ae73688e1d5efa1bd9daac32bc9d376f8c8673e2aa71070f03c7f3" + }, + "original_probe": { + "width": 1280, + "height": 720, + "avg_frame_rate": "25/1", + "duration": "3.520000", + "nb_read_frames": "88" + }, + "display": { + "path": "results/3fadbe0c2961/real_target.mp4", + "sha256": "2d97f922dbbaab42d8fb0ff8419410dc7275ddf07d301b1113871e2d651c1e4f", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + }, + "ffmpeg_command": [ + "ffmpeg", + "-hide_banner", + "-loglevel", + "error", + "-y", + "-i", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/real_targets_original/3fadbe0c2961.mp4", + "-map", + "0:v:0", + "-an", + "-vf", + "setpts=(PTS-STARTPTS)*0.920454545454546,fps=25,tpad=stop_mode=clone:stop_duration=3.24,trim=end_frame=81,setpts=N/(25*TB),scale=960:540:force_original_aspect_ratio=decrease:force_divisible_by=2,pad=960:540:(ow-iw)/2:(oh-ih)/2,setsar=1", + "-frames:v", + "81", + "-c:v", + "libx264", + "-crf", + "18", + "-preset", + "fast", + "-threads", + "2", + "-pix_fmt", + "yuv420p", + "-movflags", + "+faststart", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/results/3fadbe0c2961/real_target.mp4" + ], + "full_decode_passed": true +} diff --git a/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/receipt.json b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/receipt.json new file mode 100644 index 0000000..a63fc62 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/receipt.json @@ -0,0 +1,175 @@ +{ + "status": "complete", + "case": { + "index": 7, + "case_id": "3fadbe0c2961", + "name": "狗转头 · Dog head turn", + "page": null, + "seed": 2026081902, + "prompt": "A happy Pembroke Welsh Corgi with a reddish-brown and white coat sits in a sunny green field, panting with its tongue out in a static medium shot. In this continuous shot, The dog turns its head further to the right while sitting in the grass. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "e5a7d338e43779e2faa2383a663e1b1cd80c5e99400a0119b0d3f5dfe1252623", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/t2v.mp4", + "bernini_t2v_sha256": "803fc5156774d814787b26a15fd4649c4a6429a7d2ca9b8e89b352461126c924", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/3fadbe0c2961/receipt.json", + "comparison_batch": "progress2_omni6_extra_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/3fadbe0c2961/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081902", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/3fadbe0c2961/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "2bfe0e00ce5d62a06e2efe67ea785fb83355a0a7ee60db854c5e5cadc975c60f", + "hostname": "auh7-1b-gpu-287", + "job": { + "SLURM_JOB_ID": "213688", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T08:19:38.914017+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081902 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection.", + "conditioning": { + "input_prompt": "A happy Pembroke Welsh Corgi with a reddish-brown and white coat sits in a sunny green field, panting with its tongue out in a static medium shot. In this continuous shot, The dog turns its head further to the right while sitting in the grass. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A happy Pembroke Welsh Corgi with a rich reddish-brown and white coat sits calmly in a sun-drenched green field, its short legs tucked beneath its sturdy body. The warm sunlight bathes the scene, casting soft highlights across the dog’s smooth fur and illuminating the vibrant blades of grass around it. The corgi pants gently, its pink tongue lolling out in a relaxed, joyful expression, conveying a sense of contentment and ease. The camera holds a steady, static medium shot, framing the dog from the mid-chest up, allowing full view of its expressive face and perked ears. As the moment unfolds, the dog slowly turns its head further to the right, its eyes briefly scanning the surroundings with quiet curiosity, while its body remains still. The lush green field stretches out behind it, dotted with wildflowers and bathed in golden afternoon light. The scene remains consistent throughout—same subject, same environment, same lighting, same framing—capturing a peaceful, serene moment in nature, with the corgi as the calm, cheerful centerpiece.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 77, + 2048 + ], + "t5_context_shape": [ + 250, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 341 + ], + "rank_zero_log_sha256": "2a6eb521a55ce5cdc05902458c5a2b863cb3532531dd394b6fc5278eac4aa7db" + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/3fadbe0c2961/omni_t2v.mp4", + "sha256": "6b28c93fda92e5fa29cfe7e1954ee29dd4c6e1d594b657d7a9cf7df195b67e56", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 555.7, + "completed_utc": "2026-09-23T08:28:28.823972+00:00" +} diff --git a/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/t2v_conditioning.json b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/t2v_conditioning.json new file mode 100644 index 0000000..d0e86d6 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/3fadbe0c2961/t2v_conditioning.json @@ -0,0 +1,19 @@ +{ + "input_prompt": "A happy Pembroke Welsh Corgi with a reddish-brown and white coat sits in a sunny green field, panting with its tongue out in a static medium shot. In this continuous shot, The dog turns its head further to the right while sitting in the grass. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A happy Pembroke Welsh Corgi with a rich reddish-brown and white coat sits calmly in a sun-drenched green field, its short legs tucked beneath its sturdy body. The warm sunlight bathes the scene, casting soft highlights across the dog\u2019s smooth fur and illuminating the vibrant blades of grass around it. The corgi pants gently, its pink tongue lolling out in a relaxed, joyful expression, conveying a sense of contentment and ease. The camera holds a steady, static medium shot, framing the dog from the mid-chest up, allowing full view of its expressive face and perked ears. As the moment unfolds, the dog slowly turns its head further to the right, its eyes briefly scanning the surroundings with quiet curiosity, while its body remains still. The lush green field stretches out behind it, dotted with wildflowers and bathed in golden afternoon light. The scene remains consistent throughout\u2014same subject, same environment, same lighting, same framing\u2014capturing a peaceful, serene moment in nature, with the corgi as the calm, cheerful centerpiece.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 77, + 2048 + ], + "t5_context_shape": [ + 250, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 +} \ No newline at end of file diff --git a/projects/video-action-editing/omni-t2v12/results/40712e1341dc/bernini_receipt.json b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/bernini_receipt.json new file mode 100644 index 0000000..089c2b5 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"48c0f5010ed6e8b41d140dad22b63aaab5769acd75e26da3d381e0dfa08091d5","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"9ef3aa6493a2dab3675a566a58d9959531e0cf1bad8626f7975749ecda07f21a","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"c5c47a2b972fd914098f76ddd0861a3855edce832f8c25776f542b0c6c2f27b4","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"e3c811659c17cb43c44ac510fe3a9268fc530a5f519386e3f7de6afdbe2f6e44","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"168ad58122626b2a7861516828a7dd487584e4adbf6780821a88dc67f000ce0e","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"bec8e27e605a0471ea304d613ed80ec1de70d3a632e201c29c1ba7daf5386886","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"937d1efd5e00acc1ada41cbff8e3d326cc79aaab9672b02837536c4beb7b2965","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"1bd42ac658d35987dddd4cfbd2b9721fae63ffc3709f9c6dae7956584df73039","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"14c52b34b95baeaf1844052666c85132bb61df9d82146d6de38ebb65d24bfadf","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"0f90a1b7747980f2c82cd1bf605c6019387a2ecb06bae4336f84ff0a9c9b4624","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"b6436ff70eaea0076c99f3c4abd79175b91eed10d328f74a3c04f53d9fdf59ba","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"947f8ca8d2791443c2f23f0e040de2a70cca9ad23f2279af5f90e007ba0b1dcc","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"742bcaf673a42ecba49042671834f363825f3d2f011c2bf3fca90e995fa690f6","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"8bf4d4e4a9b68237f44017bd9c31b985fcfa6e44ccfd79250350e97a89326cd3","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"61bad558235fdfa10344a5355301adbe33a59ed3bd04585bd736f85e5f6cca40","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"28a421cb9991a4dc90b0dec671c069039fa1170741fbf3729124976306436ddf","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"61bad558235fdfa10344a5355301adbe33a59ed3bd04585bd736f85e5f6cca40","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081911,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"28a421cb9991a4dc90b0dec671c069039fa1170741fbf3729124976306436ddf","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"d8a3cc49ff663c598c89eb9b06ccba14567665c08b30989ec7d2ce82575e96f0","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"28a421cb9991a4dc90b0dec671c069039fa1170741fbf3729124976306436ddf"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"61bad558235fdfa10344a5355301adbe33a59ed3bd04585bd736f85e5f6cca40","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"28a421cb9991a4dc90b0dec671c069039fa1170741fbf3729124976306436ddf","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"61bad558235fdfa10344a5355301adbe33a59ed3bd04585bd736f85e5f6cca40","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081911,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"28a421cb9991a4dc90b0dec671c069039fa1170741fbf3729124976306436ddf","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"867c90f55a07c77c58a9d693db5834ced30b880cdeb542be0bc783b2c20a4673","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"28a421cb9991a4dc90b0dec671c069039fa1170741fbf3729124976306436ddf"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":328,"action_prompt_utf8_sha256":"e7cb0b2a1421644429ecb32cb531713267d01c95cc7ec7589a183c2cd226fd21","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/40712e1341dc/source-exact81.mp4","source_video_sha256":"654e997c46a6f78a2ad78359b713767aefe61a6cc732b5be4527720323349f69","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"29a9cd1b0eb92704934645b4d4ce2afc2e232817fbb4ba77fefbe9f4cb2e1d97","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/rv2v.mp4","sha256":"5b91b30b5632f6b95cd00198a19f90bb064f16d68d146d39eb680a8ae4169b73","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"397bac948f9549b04fa313b1a3b8fe7f649f1619118cf669accef467e0b1d3fa","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/t2v.mp4","sha256":"99ed719ef9adfa0e959e1cea5af546ba4b61d49d31119a9c28afe301d734bfac","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"654e997c46a6f78a2ad78359b713767aefe61a6cc732b5be4527720323349f69","original_pre_snapshot_sha256":"654e997c46a6f78a2ad78359b713767aefe61a6cc732b5be4527720323349f69","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"654e997c46a6f78a2ad78359b713767aefe61a6cc732b5be4527720323349f69","source_derived_bucket_hw":[368,656],"source_input_hw":[1080,1920],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"c502d6f1e4920488affe1b0aab2b87b2f27f5a75c8790bb5b3f36a2435dd8420","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"0ffd088bdfbad0beae08af0e57744a4b5c5b4b482e2e3eb4fa0bd6939ba0979c","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"efee3e3f36fedf0dbaf21a08996e77923d30ef158bb6610d30c8e1c1b8ba7b1f","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081911,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081911,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"7294dcc50d25701ed3131e5a7d3eee88e168fcd9904664d6917b057d71dc0314","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-t2v12/results/40712e1341dc/bernini_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/bernini_t2v.jpg new file mode 100644 index 0000000..576f504 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/40712e1341dc/bernini_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/bernini_t2v.mp4 new file mode 100644 index 0000000..325879a Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/40712e1341dc/launch.json b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/launch.json new file mode 100644 index 0000000..6fd4298 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/launch.json @@ -0,0 +1,131 @@ +{ + "case": { + "index": 11, + "case_id": "40712e1341dc", + "name": "放下手机后翻身睡觉 · Put phone away and sleep", + "page": null, + "seed": 2026081911, + "prompt": "A young man with dyed-blond hair lies in bed in a dark room, illuminated by his phone's blue light, wearing a pink tank top and a nose ring. In this continuous shot, The man in bed puts his smartphone on the nightstand and turns over to go to sleep. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "e7cb0b2a1421644429ecb32cb531713267d01c95cc7ec7589a183c2cd226fd21", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/t2v.mp4", + "bernini_t2v_sha256": "99ed719ef9adfa0e959e1cea5af546ba4b61d49d31119a9c28afe301d734bfac", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/receipt.json", + "comparison_batch": "progress2_omni6_extra_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/40712e1341dc/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081911", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/40712e1341dc/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "97496b4cd640186777543c0eb1561afdda47c2f7313f1cb51bf1780bb04e00e6", + "hostname": "auh7-1b-gpu-287", + "job": { + "SLURM_JOB_ID": "213688", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "started_utc": "2026-09-23T08:28:42.820400+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081911 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection." +} diff --git a/projects/video-action-editing/omni-t2v12/results/40712e1341dc/omni_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/omni_t2v.jpg new file mode 100644 index 0000000..b2a4b8c Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/omni_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/40712e1341dc/omni_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/omni_t2v.mp4 new file mode 100644 index 0000000..89bb81c Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/40712e1341dc/real_target.jpg b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/real_target.jpg new file mode 100644 index 0000000..570b836 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/real_target.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/40712e1341dc/real_target.mp4 b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/real_target.mp4 new file mode 100644 index 0000000..9c428f3 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/real_target.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/40712e1341dc/real_target_receipt.json b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/real_target_receipt.json new file mode 100644 index 0000000..c8e4bb3 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/real_target_receipt.json @@ -0,0 +1,58 @@ +{ + "case_id": "40712e1341dc", + "collected_utc": "2026-09-23T17:35:29.730413+00:00", + "purpose": "review_only", + "used_for_inference": false, + "original": { + "path": "/vast/users/guangyi.chen/dataset/MEV/MEV/videos/88a17729-f1d4-489d-8e73-248bbc088141-00.00.03.347-00.00.06.668-seg2.mp4", + "sha256": "2b64f8177ba8494d727bf440238f183a40df32d13d93e8ceb381617063c4fc6a" + }, + "original_probe": { + "width": 1920, + "height": 1080, + "avg_frame_rate": "24000/1001", + "duration": "3.336667", + "nb_read_frames": "80" + }, + "display": { + "path": "results/40712e1341dc/real_target.mp4", + "sha256": "4424517beb4e790280cbf782fa1a2d6589b0443d14b9adfb83922d82d919c93e", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + }, + "ffmpeg_command": [ + "ffmpeg", + "-hide_banner", + "-loglevel", + "error", + "-y", + "-i", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/real_targets_original/40712e1341dc.mp4", + "-map", + "0:v:0", + "-an", + "-vf", + "setpts=(PTS-STARTPTS)*0.97102887402309,fps=25,tpad=stop_mode=clone:stop_duration=3.24,trim=end_frame=81,setpts=N/(25*TB),scale=960:540:force_original_aspect_ratio=decrease:force_divisible_by=2,pad=960:540:(ow-iw)/2:(oh-ih)/2,setsar=1", + "-frames:v", + "81", + "-c:v", + "libx264", + "-crf", + "18", + "-preset", + "fast", + "-threads", + "2", + "-pix_fmt", + "yuv420p", + "-movflags", + "+faststart", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/results/40712e1341dc/real_target.mp4" + ], + "full_decode_passed": true +} diff --git a/projects/video-action-editing/omni-t2v12/results/40712e1341dc/receipt.json b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/receipt.json new file mode 100644 index 0000000..e759b1b --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/receipt.json @@ -0,0 +1,175 @@ +{ + "status": "complete", + "case": { + "index": 11, + "case_id": "40712e1341dc", + "name": "放下手机后翻身睡觉 · Put phone away and sleep", + "page": null, + "seed": 2026081911, + "prompt": "A young man with dyed-blond hair lies in bed in a dark room, illuminated by his phone's blue light, wearing a pink tank top and a nose ring. In this continuous shot, The man in bed puts his smartphone on the nightstand and turns over to go to sleep. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "e7cb0b2a1421644429ecb32cb531713267d01c95cc7ec7589a183c2cd226fd21", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/t2v.mp4", + "bernini_t2v_sha256": "99ed719ef9adfa0e959e1cea5af546ba4b61d49d31119a9c28afe301d734bfac", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/40712e1341dc/receipt.json", + "comparison_batch": "progress2_omni6_extra_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/40712e1341dc/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081911", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/40712e1341dc/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "97496b4cd640186777543c0eb1561afdda47c2f7313f1cb51bf1780bb04e00e6", + "hostname": "auh7-1b-gpu-287", + "job": { + "SLURM_JOB_ID": "213688", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "started_utc": "2026-09-23T08:28:42.820400+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081911 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection.", + "conditioning": { + "input_prompt": "A young man with dyed-blond hair lies in bed in a dark room, illuminated by his phone's blue light, wearing a pink tank top and a nose ring. In this continuous shot, The man in bed puts his smartphone on the nightstand and turns over to go to sleep. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A young man with dyed-blond hair lies on his back in a dimly lit bedroom, the only source of light emanating from the cool blue glow of his smartphone screen. He wears a soft pink tank top, the fabric slightly rumpled from lying still, and a small nose ring glints faintly in the low light as he shifts his head. The room is dark, shadows pooling in the corners, with only the faint outline of a nightstand and a pillow visible. The camera holds a steady, fixed position, capturing the scene in a continuous, unbroken shot. The man’s fingers move slowly across the phone’s screen, scrolling or typing with quiet focus. After a moment, he lowers the device, places it gently on the nightstand beside him, and turns onto his side, pulling the blanket slightly higher. His breathing slows, and he settles into sleep, the blue light fading as the phone powers down. The scene remains unchanged in framing, lighting, and composition, maintaining a calm, intimate stillness throughout.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 80, + 2048 + ], + "t5_context_shape": [ + 239, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 333 + ], + "rank_zero_log_sha256": "762bda731c46287b756b96674e0f3034c5c36417e76e21e33835ff39d69d3781" + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/40712e1341dc/omni_t2v.mp4", + "sha256": "5ed0844a80af94da135f1290f1307c584e6c5ce29418f8a90f3d940405b2ca11", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 539.42, + "completed_utc": "2026-09-23T08:37:24.927593+00:00" +} diff --git a/projects/video-action-editing/omni-t2v12/results/40712e1341dc/t2v_conditioning.json b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/t2v_conditioning.json new file mode 100644 index 0000000..2fb6f59 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/40712e1341dc/t2v_conditioning.json @@ -0,0 +1,19 @@ +{ + "input_prompt": "A young man with dyed-blond hair lies in bed in a dark room, illuminated by his phone's blue light, wearing a pink tank top and a nose ring. In this continuous shot, The man in bed puts his smartphone on the nightstand and turns over to go to sleep. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A young man with dyed-blond hair lies on his back in a dimly lit bedroom, the only source of light emanating from the cool blue glow of his smartphone screen. He wears a soft pink tank top, the fabric slightly rumpled from lying still, and a small nose ring glints faintly in the low light as he shifts his head. The room is dark, shadows pooling in the corners, with only the faint outline of a nightstand and a pillow visible. The camera holds a steady, fixed position, capturing the scene in a continuous, unbroken shot. The man\u2019s fingers move slowly across the phone\u2019s screen, scrolling or typing with quiet focus. After a moment, he lowers the device, places it gently on the nightstand beside him, and turns onto his side, pulling the blanket slightly higher. His breathing slows, and he settles into sleep, the blue light fading as the phone powers down. The scene remains unchanged in framing, lighting, and composition, maintaining a calm, intimate stillness throughout.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 80, + 2048 + ], + "t5_context_shape": [ + 239, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 +} \ No newline at end of file diff --git a/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/bernini_receipt.json b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/bernini_receipt.json new file mode 100644 index 0000000..abf8d9a --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"805525dbeb52b39732e4e78de7ebc47137a6ce356c4f995a3d55603790cd98bc","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"3242f1c9cf2fc266d47b8bc3b91bf48420aa45be7a85a791d7fcc334e4150b2a","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"d83bbf735581805d0152fc360ddda145d74e255521b3f1525df5bb536eb15c78","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"300f82102fc10d09e63e2a17f7c03abc730bd107f7ccb2096126818076aa9af2","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"5f575ff125289c8ee070d4d8b1b8fdef3c9eda1f686592dcfc5b33e7c1054c3b","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"cb49e32bba7aefa6ec60db68e26ae02ebc55e92e7db8d7dcbaaf2b36ba413dcd","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"0258a143a93e3a87b3593858cd7d8bf64aa6101baef2950d3470498593a55560","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"31a1646757cf90a6a221cc036a83ea5b9b2c1c812f282db61fe5da0c81a724e3","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"53f6b977c822c0d9771683cb8ee8ee89c46adf40c807d93cce5e0d125e3bba32","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"94238c183b3a007df492f98fd15a8419bb9cd0b77e414dcd0a5f7aedfc7e53c6","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"6b71e8b1de80e387b54dd229abb4be79f462ea952ce9e3d1b27300f0143b1b97","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"5f73bf575b26aee810a964d6003e5df7008ab2a54435b8e7bb3eaa993903d2a6","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"889b6c48bc39d9658ba758ac4005a288b524064ac800c806546a4e321de5a827","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"a72213df9b5e37ef3c5b85c158a336f6b88dcc5bf9ac8538bf3c99e58881db2c","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"865571d2409a5d20d2f07c752c4d327c6d6bd899c045aaddc4bb8a268a561479","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"0f7c7871f09fd65c843693826404825ab964f51b34034ce985507823187f7cf1","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"865571d2409a5d20d2f07c752c4d327c6d6bd899c045aaddc4bb8a268a561479","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081904,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"0f7c7871f09fd65c843693826404825ab964f51b34034ce985507823187f7cf1","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"32a154b98a2d64c3d8f0ec9a02a549df8f971c2e7bd455834022a0c74a9a2802","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"0f7c7871f09fd65c843693826404825ab964f51b34034ce985507823187f7cf1"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"865571d2409a5d20d2f07c752c4d327c6d6bd899c045aaddc4bb8a268a561479","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"0f7c7871f09fd65c843693826404825ab964f51b34034ce985507823187f7cf1","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"865571d2409a5d20d2f07c752c4d327c6d6bd899c045aaddc4bb8a268a561479","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081904,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"0f7c7871f09fd65c843693826404825ab964f51b34034ce985507823187f7cf1","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"3010a54b7bd926a85e390c9a4a63d1e9f3e2cf9b5ada4bf03cda5dd549ee498f","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"0f7c7871f09fd65c843693826404825ab964f51b34034ce985507823187f7cf1"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":369,"action_prompt_utf8_sha256":"ffe3db596a0db5b6c52685fee0f53d82982bae2a354725ca2eb743558af5df28","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7077cfb160cf/source-exact81.mp4","source_video_sha256":"cef4c183b459c8aad72cdc81f3e6b2766a36fc22156bf382dd36c29cec6d5aa9","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"3348030716a1ebf2eef4e4d9fabc874eb3742b73e2ad6be58b330244168579de","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/rv2v.mp4","sha256":"be645bf32a9ccd63b25e0b4adf4519359be7484f260382d0a3ab46fad28cdb59","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"6913c685c7093d692392138cfbf6c7a98e40132d1fa4e93589b914726db7ec38","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/t2v.mp4","sha256":"c1a8aa80d9a4caa32ccbbc6b00740d576c9d74553361e6686e8d25af98a4645c","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"cef4c183b459c8aad72cdc81f3e6b2766a36fc22156bf382dd36c29cec6d5aa9","original_pre_snapshot_sha256":"cef4c183b459c8aad72cdc81f3e6b2766a36fc22156bf382dd36c29cec6d5aa9","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"cef4c183b459c8aad72cdc81f3e6b2766a36fc22156bf382dd36c29cec6d5aa9","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"3e47bdffb9d5120fad538301af793632e7ad755502d5a14f3b181ab25151e368","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"aa325c341540bec4cbb5474eb77837ce0e5dd17b3d0725a4dc07b234d064ef90","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"2e55a36c23d790d4da7510d98ba6f10cf69770f69b343bcfc0f9c7d639fdc837","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081904,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081904,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"3d0bfb2afb4aa030ed006206e701fd2adef979e7605fe93b34464abf0c9fad97","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/bernini_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/bernini_t2v.jpg new file mode 100644 index 0000000..3c9229e Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/bernini_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/bernini_t2v.mp4 new file mode 100644 index 0000000..c09d894 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/launch.json b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/launch.json new file mode 100644 index 0000000..5d193f0 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/launch.json @@ -0,0 +1,131 @@ +{ + "case": { + "index": 8, + "case_id": "7077cfb160cf", + "name": "长椅上写字 · Write in notebook", + "page": null, + "seed": 2026081904, + "prompt": "A young woman with shoulder-length light brown hair sits on a wooden bench in a sunny park or campus setting, writing in a notebook while dressed in a pink shirt and blue jeans. In this continuous shot, The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "ffe3db596a0db5b6c52685fee0f53d82982bae2a354725ca2eb743558af5df28", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/t2v.mp4", + "bernini_t2v_sha256": "c1a8aa80d9a4caa32ccbbc6b00740d576c9d74553361e6686e8d25af98a4645c", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/receipt.json", + "comparison_batch": "progress2_omni6_extra_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/7077cfb160cf/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081904", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/7077cfb160cf/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "c108ae74dab9403637ddcb2bb8ca7fca54fa787a68b41d56d8db6bb0805f0352", + "hostname": "auh7-1b-gpu-287", + "job": { + "SLURM_JOB_ID": "213688", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T08:28:45.952216+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081904 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection." +} diff --git a/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/omni_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/omni_t2v.jpg new file mode 100644 index 0000000..751689a Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/omni_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/omni_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/omni_t2v.mp4 new file mode 100644 index 0000000..f69d467 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/real_target.jpg b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/real_target.jpg new file mode 100644 index 0000000..f85a241 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/real_target.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/real_target.mp4 b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/real_target.mp4 new file mode 100644 index 0000000..27cffbd Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/real_target.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/real_target_receipt.json b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/real_target_receipt.json new file mode 100644 index 0000000..d225a47 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/real_target_receipt.json @@ -0,0 +1,58 @@ +{ + "case_id": "7077cfb160cf", + "collected_utc": "2026-09-23T17:35:14.145966+00:00", + "purpose": "review_only", + "used_for_inference": false, + "original": { + "path": "/vast/users/guangyi.chen/dataset/MEV/MEV/videos/47d49b51-fde1-4c04-a895-4a483df1bfb4-00.00.18.600-00.00.20.229-seg4.mp4", + "sha256": "c683137c07b86e3b088c4bd4692b94f1604c84b8bf6a5126dfe9b9a66f4222bf" + }, + "original_probe": { + "width": 1280, + "height": 720, + "avg_frame_rate": "24000/1001", + "duration": "1.626625", + "nb_read_frames": "39" + }, + "display": { + "path": "results/7077cfb160cf/real_target.mp4", + "sha256": "03a7b92dc3800e8403ce9f7f4ce85b9668a85a82e110e0356e614d4626496bc3", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + }, + "ffmpeg_command": [ + "ffmpeg", + "-hide_banner", + "-loglevel", + "error", + "-y", + "-i", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/real_targets_original/7077cfb160cf.mp4", + "-map", + "0:v:0", + "-an", + "-vf", + "setpts=(PTS-STARTPTS)*1.99185429954661,fps=25,tpad=stop_mode=clone:stop_duration=3.24,trim=end_frame=81,setpts=N/(25*TB),scale=960:540:force_original_aspect_ratio=decrease:force_divisible_by=2,pad=960:540:(ow-iw)/2:(oh-ih)/2,setsar=1", + "-frames:v", + "81", + "-c:v", + "libx264", + "-crf", + "18", + "-preset", + "fast", + "-threads", + "2", + "-pix_fmt", + "yuv420p", + "-movflags", + "+faststart", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/results/7077cfb160cf/real_target.mp4" + ], + "full_decode_passed": true +} diff --git a/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/receipt.json b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/receipt.json new file mode 100644 index 0000000..e057a62 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/receipt.json @@ -0,0 +1,175 @@ +{ + "status": "complete", + "case": { + "index": 8, + "case_id": "7077cfb160cf", + "name": "长椅上写字 · Write in notebook", + "page": null, + "seed": 2026081904, + "prompt": "A young woman with shoulder-length light brown hair sits on a wooden bench in a sunny park or campus setting, writing in a notebook while dressed in a pink shirt and blue jeans. In this continuous shot, The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "ffe3db596a0db5b6c52685fee0f53d82982bae2a354725ca2eb743558af5df28", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/t2v.mp4", + "bernini_t2v_sha256": "c1a8aa80d9a4caa32ccbbc6b00740d576c9d74553361e6686e8d25af98a4645c", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7077cfb160cf/receipt.json", + "comparison_batch": "progress2_omni6_extra_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/7077cfb160cf/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081904", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/7077cfb160cf/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "c108ae74dab9403637ddcb2bb8ca7fca54fa787a68b41d56d8db6bb0805f0352", + "hostname": "auh7-1b-gpu-287", + "job": { + "SLURM_JOB_ID": "213688", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T08:28:45.952216+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081904 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection.", + "conditioning": { + "input_prompt": "A young woman with shoulder-length light brown hair sits on a wooden bench in a sunny park or campus setting, writing in a notebook while dressed in a pink shirt and blue jeans. In this continuous shot, The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A young woman with shoulder-length light brown hair sits calmly on a weathered wooden bench in a sun-drenched park or campus setting, the golden light of midday filtering through the leaves of nearby trees. She wears a soft pink button-up shirt and fitted blue jeans, her posture relaxed yet focused as she leans slightly forward, pen in hand, writing thoughtfully in a small notebook resting on her lap. Her brow is gently furrowed in concentration, occasionally pausing to glance up and around, as if gathering inspiration from the peaceful surroundings. The camera holds steady in a medium shot, capturing her from the waist up, with the background softly blurred to emphasize her presence—dappled sunlight dances across the grass and pavement, and the faint rustle of leaves and distant chatter of people passing by add a gentle soundtrack to the scene. The composition remains unchanged throughout, maintaining consistent framing, lighting, and perspective, creating a serene, contemplative moment frozen in time.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 80, + 2048 + ], + "t5_context_shape": [ + 226, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 320 + ], + "rank_zero_log_sha256": "2974e23fa644b0fa38f0a8091e8bf9fd9ef15ef20ffdb210b14d8a3d1aa75546" + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/7077cfb160cf/omni_t2v.mp4", + "sha256": "061290c54920d2b552b84b511873f10ead41e881d0f091fc11d0323e97e96427", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 540.8, + "completed_utc": "2026-09-23T08:37:29.711466+00:00" +} diff --git a/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/t2v_conditioning.json b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/t2v_conditioning.json new file mode 100644 index 0000000..5098843 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/7077cfb160cf/t2v_conditioning.json @@ -0,0 +1,19 @@ +{ + "input_prompt": "A young woman with shoulder-length light brown hair sits on a wooden bench in a sunny park or campus setting, writing in a notebook while dressed in a pink shirt and blue jeans. In this continuous shot, The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A young woman with shoulder-length light brown hair sits calmly on a weathered wooden bench in a sun-drenched park or campus setting, the golden light of midday filtering through the leaves of nearby trees. She wears a soft pink button-up shirt and fitted blue jeans, her posture relaxed yet focused as she leans slightly forward, pen in hand, writing thoughtfully in a small notebook resting on her lap. Her brow is gently furrowed in concentration, occasionally pausing to glance up and around, as if gathering inspiration from the peaceful surroundings. The camera holds steady in a medium shot, capturing her from the waist up, with the background softly blurred to emphasize her presence\u2014dappled sunlight dances across the grass and pavement, and the faint rustle of leaves and distant chatter of people passing by add a gentle soundtrack to the scene. The composition remains unchanged throughout, maintaining consistent framing, lighting, and perspective, creating a serene, contemplative moment frozen in time.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 80, + 2048 + ], + "t5_context_shape": [ + 226, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 +} \ No newline at end of file diff --git a/projects/video-action-editing/omni-t2v12/results/7e488525099e/bernini_receipt.json b/projects/video-action-editing/omni-t2v12/results/7e488525099e/bernini_receipt.json new file mode 100644 index 0000000..8f86a2d --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/7e488525099e/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"4bb2884085d2efe9bb00f66efadbab32684d79923b32d895e1b73c366a49879b","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"11240a7dc7ab42d595f6f8d2f7b77655426d97744ff4282d776171e1b1e09e8f","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"49af87c18c57a0fe0485c6f1099392d40877bafc82f7df59873313c86341821b","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"4225b445906bad196ebc6211815cf08ba6dfec87d0371b9cc1cf0bda6eaab54a","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"f0f239f7dd0c9de37b9d6946299e406d040691422dc43ddfea09972c13e39579","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"70985e5a80b012470a96ca8d09fd4633814a5b0e6fa2684d1ece78fd678d9038","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"fde7100e71b5abb0fae607bdc626e4ce3c1820b9d05226b300e466e1ff4b442f","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"9e1088117b66b3f7a54ecc0f631a9ad18155d9bce98502e14923a8b74bb83143","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"8debbe0be07c566fc29be4d9cb91d73e63c66f6ced9ce26c0e9fb8e0c3d65a69","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"b4fd87104d2d51303797f63ba0bf14c721f93587933be40526ee440657c14ce5","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"07580c9109678b6dbfdbc5e72916dbc42a62fdb23e4e237a51935aa8b146f616","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"2068aa3ede80a4f0d829b6bf2484cf6682c5324973c4fc23f6e40bc61eb76c16","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"c152613e67559c4812b51cdb049ff7002ca64c315f853864a5e98e8ee5087eaf","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"556b9acb93d700f1b1a5d799a4447cc6ce66e8fdf2ba8944ee981d1552c9c190","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"8080494cfc9ac2566249c4f658b38448d7a1832c5cfbda1fc5461b893895a0e9","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"1f74752f30242d6ce3111ab0c67d57db03fd6d395996fdfd3e9df0b77d358a21","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"8080494cfc9ac2566249c4f658b38448d7a1832c5cfbda1fc5461b893895a0e9","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081906,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"1f74752f30242d6ce3111ab0c67d57db03fd6d395996fdfd3e9df0b77d358a21","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"fd09519ce5c820f7c0f7a9a11bfe5a200ab89eaa4334c5eb1984afc01fd81bfe","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"1f74752f30242d6ce3111ab0c67d57db03fd6d395996fdfd3e9df0b77d358a21"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"8080494cfc9ac2566249c4f658b38448d7a1832c5cfbda1fc5461b893895a0e9","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"1f74752f30242d6ce3111ab0c67d57db03fd6d395996fdfd3e9df0b77d358a21","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"8080494cfc9ac2566249c4f658b38448d7a1832c5cfbda1fc5461b893895a0e9","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081906,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"1f74752f30242d6ce3111ab0c67d57db03fd6d395996fdfd3e9df0b77d358a21","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"18cfca0fdc660fdcd85678294f6e6931f4d68853c12baac8fc1c81d1e8c2ebfd","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"1f74752f30242d6ce3111ab0c67d57db03fd6d395996fdfd3e9df0b77d358a21"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":358,"action_prompt_utf8_sha256":"9dbe71bad14d34165cbbc5236e464eb582094279ee5268bd62cda1d45c15f7a7","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7e488525099e/source-exact81.mp4","source_video_sha256":"1f3cec72bef55b67c15ebfc063252cce867ea128594a225db61688ff961b35d4","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"19b75c955d886bfe156a837658d89e65cd4b9b84fd80ddd84c856285589087c0","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/rv2v.mp4","sha256":"20154ed35790207b991e7a58e5456b93776d1223c6b666bf37aab5d84396ea08","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"10dc92b7046a38ddf688eded46b7232193947b56887762f3da40d1abebbf2fa2","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/t2v.mp4","sha256":"ef14763c12e45144e6f768a6ed5efae0ccf458086d479815cd12b4832cc17824","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"1f3cec72bef55b67c15ebfc063252cce867ea128594a225db61688ff961b35d4","original_pre_snapshot_sha256":"1f3cec72bef55b67c15ebfc063252cce867ea128594a225db61688ff961b35d4","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"1f3cec72bef55b67c15ebfc063252cce867ea128594a225db61688ff961b35d4","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"2767de6b8e73fcf639606514eb89d02fb4b94ffcdd075d5cc8da03ed0772eb85","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"68b01af00e7640dcb5bcfa9690369cfbff48541ab09702eebc53acdd51769f6f","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"b7670ae626c2159e4bef64e612d9fae530782be2c491cac2959a6432d24fca89","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081906,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081906,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"eca1cea19b7a9a1412a53d61d4808256fa6827f49fd779545346b46921e0e771","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-t2v12/results/7e488525099e/bernini_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/7e488525099e/bernini_t2v.jpg new file mode 100644 index 0000000..1bfa876 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/7e488525099e/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/7e488525099e/bernini_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/7e488525099e/bernini_t2v.mp4 new file mode 100644 index 0000000..ea258e0 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/7e488525099e/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/7e488525099e/launch.json b/projects/video-action-editing/omni-t2v12/results/7e488525099e/launch.json new file mode 100644 index 0000000..572e7ac --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/7e488525099e/launch.json @@ -0,0 +1,131 @@ +{ + "case": { + "index": 9, + "case_id": "7e488525099e", + "name": "转身倚车 · Turn and lean on car", + "page": null, + "seed": 2026081906, + "prompt": "A confident woman in red pants and a black leather jacket poses in front of a black Chevrolet Camaro in a moody, red-lit underground parking garage. In this continuous shot, The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "9dbe71bad14d34165cbbc5236e464eb582094279ee5268bd62cda1d45c15f7a7", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/t2v.mp4", + "bernini_t2v_sha256": "ef14763c12e45144e6f768a6ed5efae0ccf458086d479815cd12b4832cc17824", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/receipt.json", + "comparison_batch": "progress2_omni6_extra_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/7e488525099e/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081906", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/7e488525099e/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "67b0556dea2138863e9524f2a6a742137d6479fa64a541dbbd88f42de988b8b8", + "hostname": "auh7-1b-gpu-287", + "job": { + "SLURM_JOB_ID": "213688", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "started_utc": "2026-09-23T08:06:59.041815+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081906 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection." +} diff --git a/projects/video-action-editing/omni-t2v12/results/7e488525099e/omni_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/7e488525099e/omni_t2v.jpg new file mode 100644 index 0000000..7bf0926 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/7e488525099e/omni_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/7e488525099e/omni_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/7e488525099e/omni_t2v.mp4 new file mode 100644 index 0000000..6e0468c Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/7e488525099e/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/7e488525099e/real_target.jpg b/projects/video-action-editing/omni-t2v12/results/7e488525099e/real_target.jpg new file mode 100644 index 0000000..c493a04 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/7e488525099e/real_target.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/7e488525099e/real_target.mp4 b/projects/video-action-editing/omni-t2v12/results/7e488525099e/real_target.mp4 new file mode 100644 index 0000000..58ff119 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/7e488525099e/real_target.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/7e488525099e/real_target_receipt.json b/projects/video-action-editing/omni-t2v12/results/7e488525099e/real_target_receipt.json new file mode 100644 index 0000000..241527c --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/7e488525099e/real_target_receipt.json @@ -0,0 +1,58 @@ +{ + "case_id": "7e488525099e", + "collected_utc": "2026-09-23T17:35:20.553761+00:00", + "purpose": "review_only", + "used_for_inference": false, + "original": { + "path": "/vast/users/guangyi.chen/dataset/MEV/MEV/videos/4fd015eb-922b-4b00-9066-e9d082de9e01-00.00.08.206-00.00.11.256-seg5.mp4", + "sha256": "dce487e374dd2fc3c6373d0ceb9e74185a28950791843a13b14d8b2a8a8850cd" + }, + "original_probe": { + "width": 1280, + "height": 720, + "avg_frame_rate": "24000/1001", + "duration": "3.128125", + "nb_read_frames": "75" + }, + "display": { + "path": "results/7e488525099e/real_target.mp4", + "sha256": "30c8909ffd3c044c78714102c8d24dc38cf3547c123f0be2deb43390a5732ec3", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + }, + "ffmpeg_command": [ + "ffmpeg", + "-hide_banner", + "-loglevel", + "error", + "-y", + "-i", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/real_targets_original/7e488525099e.mp4", + "-map", + "0:v:0", + "-an", + "-vf", + "setpts=(PTS-STARTPTS)*1.03576423576424,fps=25,tpad=stop_mode=clone:stop_duration=3.24,trim=end_frame=81,setpts=N/(25*TB),scale=960:540:force_original_aspect_ratio=decrease:force_divisible_by=2,pad=960:540:(ow-iw)/2:(oh-ih)/2,setsar=1", + "-frames:v", + "81", + "-c:v", + "libx264", + "-crf", + "18", + "-preset", + "fast", + "-threads", + "2", + "-pix_fmt", + "yuv420p", + "-movflags", + "+faststart", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/results/7e488525099e/real_target.mp4" + ], + "full_decode_passed": true +} diff --git a/projects/video-action-editing/omni-t2v12/results/7e488525099e/receipt.json b/projects/video-action-editing/omni-t2v12/results/7e488525099e/receipt.json new file mode 100644 index 0000000..82300c0 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/7e488525099e/receipt.json @@ -0,0 +1,175 @@ +{ + "status": "complete", + "case": { + "index": 9, + "case_id": "7e488525099e", + "name": "转身倚车 · Turn and lean on car", + "page": null, + "seed": 2026081906, + "prompt": "A confident woman in red pants and a black leather jacket poses in front of a black Chevrolet Camaro in a moody, red-lit underground parking garage. In this continuous shot, The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "9dbe71bad14d34165cbbc5236e464eb582094279ee5268bd62cda1d45c15f7a7", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/t2v.mp4", + "bernini_t2v_sha256": "ef14763c12e45144e6f768a6ed5efae0ccf458086d479815cd12b4832cc17824", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7e488525099e/receipt.json", + "comparison_batch": "progress2_omni6_extra_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/7e488525099e/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081906", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/7e488525099e/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "67b0556dea2138863e9524f2a6a742137d6479fa64a541dbbd88f42de988b8b8", + "hostname": "auh7-1b-gpu-287", + "job": { + "SLURM_JOB_ID": "213688", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "started_utc": "2026-09-23T08:06:59.041815+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081906 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection.", + "conditioning": { + "input_prompt": "A confident woman in red pants and a black leather jacket poses in front of a black Chevrolet Camaro in a moody, red-lit underground parking garage. In this continuous shot, The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A confident woman stands in front of a sleek black Chevrolet Camaro in a moody, dimly lit underground parking garage, bathed in a deep, ambient red glow that casts dramatic shadows across the concrete walls and floor. She wears a form-fitting black leather jacket and vibrant red pants that contrast sharply with the dark surroundings, drawing the eye to her poised stance. The camera holds steady in a continuous, smooth shot, capturing her as she turns with deliberate grace, her movement fluid and intentional. She leans back against the curved hood of the car, her body angled slightly, one hand resting lightly on the glossy surface while the other hangs relaxed at her side. The red lighting pulses subtly, reflecting off the car’s polished paint and the woman’s jacket, enhancing the cinematic atmosphere. The scene remains tightly framed, with the Camaro’s aggressive lines and the woman’s commanding presence forming a powerful visual composition. The lighting, framing, and camera position remain consistent throughout, emphasizing the stillness and intensity of the moment, as if frozen in time.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 80, + 2048 + ], + "t5_context_shape": [ + 252, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 346 + ], + "rank_zero_log_sha256": "2cb8628e967b63c4350488a3109cc8bf44c4e79d0bf6ed4828dc3a9486f3b76e" + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/7e488525099e/omni_t2v.mp4", + "sha256": "bf577e972362491fe79f36079915ac95bd4110ff4a2278184e1c284260ad64e2", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 772.82, + "completed_utc": "2026-09-23T08:19:12.510894+00:00" +} diff --git a/projects/video-action-editing/omni-t2v12/results/7e488525099e/t2v_conditioning.json b/projects/video-action-editing/omni-t2v12/results/7e488525099e/t2v_conditioning.json new file mode 100644 index 0000000..363a6ef --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/7e488525099e/t2v_conditioning.json @@ -0,0 +1,19 @@ +{ + "input_prompt": "A confident woman in red pants and a black leather jacket poses in front of a black Chevrolet Camaro in a moody, red-lit underground parking garage. In this continuous shot, The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A confident woman stands in front of a sleek black Chevrolet Camaro in a moody, dimly lit underground parking garage, bathed in a deep, ambient red glow that casts dramatic shadows across the concrete walls and floor. She wears a form-fitting black leather jacket and vibrant red pants that contrast sharply with the dark surroundings, drawing the eye to her poised stance. The camera holds steady in a continuous, smooth shot, capturing her as she turns with deliberate grace, her movement fluid and intentional. She leans back against the curved hood of the car, her body angled slightly, one hand resting lightly on the glossy surface while the other hangs relaxed at her side. The red lighting pulses subtly, reflecting off the car\u2019s polished paint and the woman\u2019s jacket, enhancing the cinematic atmosphere. The scene remains tightly framed, with the Camaro\u2019s aggressive lines and the woman\u2019s commanding presence forming a powerful visual composition. The lighting, framing, and camera position remain consistent throughout, emphasizing the stillness and intensity of the moment, as if frozen in time.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 80, + 2048 + ], + "t5_context_shape": [ + 252, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 +} \ No newline at end of file diff --git a/projects/video-action-editing/omni-t2v12/results/7fa338474c75/bernini_receipt.json b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/bernini_receipt.json new file mode 100644 index 0000000..c87d796 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"f9fb66d7ba26d5b6c907907484ab012f56226413b6589008980e07769bbb72d9","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"8bcc51dc4c2e74329745d5bbb4682931a9e1fc6d0109835d876d3fddb6ab68b7","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"87748a8b55ddaaffbf5218f4f073870cfef1c1640a1f3065e4a4576649f2ef2d","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"c84892f1c13e19eb87fe487d81586dbc534037dce1397517586695c590acf5ee","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"8b35befc7791242197bb98d009552e4b9fd93e824a8a4a8213bce975cb308b50","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"07568fb4d663b6ba3673ec1e193de3821d7d820d6ce1efc00714f841e0eb4a45","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"02b1dd31203f7faf7056896412ab13cc49c1502905eea080dcdef0339f1c78ea","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"989b2ea0df40b524f363fc139658f64999ccc7f337bfbbc20a43312e2d69ca26","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"a89609a93f01479b99e582be450147e79f1f1bb7a743f733f8bb39dbcdf0cd9f","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"e4f73d861568ade971e15f4c2b887157d6a73660c95825bb8dc13ff97664cd20","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"bb2c3cae810ad8747008fc1f29f114d44b35d8ba1e6afea150fad559222261e1","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"622d0aa42aa3d1da17ddf09ad6e2045973df15689519ab42714f674ecf670f79","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"8b0e68030f5e31c73a5aef03712524132ee414e2ef7b72d2498eea16020463de","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"85cb92d76808926625238adaca005b0d57fce9efa62bac4bab9813cada4036b5","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"089225fb799a25a8c375b5fef60937ddc68aecdc9d3b6a48e91d12cab6f53b77","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"bccdd1a64ddd0ab37a65884f8516b175dccce7e4fbfebbf8208748da6825dc4e","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"089225fb799a25a8c375b5fef60937ddc68aecdc9d3b6a48e91d12cab6f53b77","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081900,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"bccdd1a64ddd0ab37a65884f8516b175dccce7e4fbfebbf8208748da6825dc4e","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"a508f70ba841f81c279f0cd4f4af7edd9610bb3b58c79379b1b3d77245b8a0ee","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"bccdd1a64ddd0ab37a65884f8516b175dccce7e4fbfebbf8208748da6825dc4e"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"089225fb799a25a8c375b5fef60937ddc68aecdc9d3b6a48e91d12cab6f53b77","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"bccdd1a64ddd0ab37a65884f8516b175dccce7e4fbfebbf8208748da6825dc4e","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"089225fb799a25a8c375b5fef60937ddc68aecdc9d3b6a48e91d12cab6f53b77","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081900,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"bccdd1a64ddd0ab37a65884f8516b175dccce7e4fbfebbf8208748da6825dc4e","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"b2738639091d9f3e01e0b563099bc817b38d90de3b66bb542ff51e87d5b01db7","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"bccdd1a64ddd0ab37a65884f8516b175dccce7e4fbfebbf8208748da6825dc4e"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":360,"action_prompt_utf8_sha256":"0ff87e5aa29e20f22ba1d2963c2700a3f10b6941147a8e517dd05e339cfb50de","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/7fa338474c75/source-exact81.mp4","source_video_sha256":"4278c748fa1fdd54d908c366a781df33d3e4eb1acc1c2b7bd3492659c66a9840","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"14183c91c3d381a24be715255b3c4a9a0f370bcc69c6ed876121f61c18eea7ad","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/rv2v.mp4","sha256":"135d1e590d26a18862564839aa9e228cfde73e2f36162fec1ea410312463efa3","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"672966d65e34461fa1f289c183c94690e098d495348309643d66764adbf0bf19","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/t2v.mp4","sha256":"17b7ccb39f068649eb0ff155d50fdcba822dfd0a66bcf7965086b62651335d34","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"4278c748fa1fdd54d908c366a781df33d3e4eb1acc1c2b7bd3492659c66a9840","original_pre_snapshot_sha256":"4278c748fa1fdd54d908c366a781df33d3e4eb1acc1c2b7bd3492659c66a9840","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"4278c748fa1fdd54d908c366a781df33d3e4eb1acc1c2b7bd3492659c66a9840","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"390651d2b78ec306d9df7bad9f858f54aad88c2e5c8901777ea14d66e0b557fd","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"b375acf818287eb04d364b4e6659a6a57a3ba76383eff12ea45a12864a3556c0","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"afb24405bd96f305c72df69a42ba8f0b93714080c43bbcc42cb42392c8306099","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081900,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081900,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"e164987cde49343a15ba70910ae003f9287d20d54e99bc618833b536c123e851","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-t2v12/results/7fa338474c75/bernini_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/bernini_t2v.jpg new file mode 100644 index 0000000..82a6c89 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/7fa338474c75/bernini_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/bernini_t2v.mp4 new file mode 100644 index 0000000..8704ebe Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/7fa338474c75/launch.json b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/launch.json new file mode 100644 index 0000000..f22e920 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/launch.json @@ -0,0 +1,131 @@ +{ + "case": { + "index": 1, + "case_id": "7fa338474c75", + "name": "Playful selfie", + "page": 5, + "seed": 2026081900, + "prompt": "A cheerful woman in a red bikini top and straw sun hat takes a playful selfie against a green screen background in a static medium shot. In this continuous shot, The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "0ff87e5aa29e20f22ba1d2963c2700a3f10b6941147a8e517dd05e339cfb50de", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/t2v.mp4", + "bernini_t2v_sha256": "17b7ccb39f068649eb0ff155d50fdcba822dfd0a66bcf7965086b62651335d34", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/receipt.json", + "comparison_batch": "progress2_omni6_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/7fa338474c75/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081900", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/7fa338474c75/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "00d8baf84c06d97b147e7c9a6388d3e7b1ea2fa9c48f787da81820dc29e251d1", + "hostname": "auh7-1b-gpu-253", + "job": { + "SLURM_JOB_ID": "213687", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T08:19:06.632724+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081900 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection." +} diff --git a/projects/video-action-editing/omni-t2v12/results/7fa338474c75/omni_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/omni_t2v.jpg new file mode 100644 index 0000000..7927e0b Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/omni_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/7fa338474c75/omni_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/omni_t2v.mp4 new file mode 100644 index 0000000..2e2d6e5 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/7fa338474c75/real_target.jpg b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/real_target.jpg new file mode 100644 index 0000000..a7ad6b9 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/real_target.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/7fa338474c75/real_target.mp4 b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/real_target.mp4 new file mode 100644 index 0000000..9f63253 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/real_target.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/7fa338474c75/real_target_receipt.json b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/real_target_receipt.json new file mode 100644 index 0000000..cb5b63c --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/real_target_receipt.json @@ -0,0 +1,58 @@ +{ + "case_id": "7fa338474c75", + "collected_utc": "2026-09-23T17:34:57.433253+00:00", + "purpose": "review_only", + "used_for_inference": false, + "original": { + "path": "/vast/users/guangyi.chen/dataset/MEV/MEV/videos/081e2761-c4e1-47ed-8a82-808bec50a59d-00.00.03.040-00.00.08.810-seg2.mp4", + "sha256": "d128357efedf0de87647febeadc382f18ee39461fb1e2c3df8de94a5a4578a42" + }, + "original_probe": { + "width": 1280, + "height": 720, + "avg_frame_rate": "60000/1001", + "duration": "5.772433", + "nb_read_frames": "346" + }, + "display": { + "path": "results/7fa338474c75/real_target.mp4", + "sha256": "8427b71fda1c01fe061b9943820e618c9f887c03a19f79f9191e4ee879b5a25a", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + }, + "ffmpeg_command": [ + "ffmpeg", + "-hide_banner", + "-loglevel", + "error", + "-y", + "-i", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/real_targets_original/7fa338474c75.mp4", + "-map", + "0:v:0", + "-an", + "-vf", + "setpts=(PTS-STARTPTS)*0.561288454972106,fps=25,tpad=stop_mode=clone:stop_duration=3.24,trim=end_frame=81,setpts=N/(25*TB),scale=960:540:force_original_aspect_ratio=decrease:force_divisible_by=2,pad=960:540:(ow-iw)/2:(oh-ih)/2,setsar=1", + "-frames:v", + "81", + "-c:v", + "libx264", + "-crf", + "18", + "-preset", + "fast", + "-threads", + "2", + "-pix_fmt", + "yuv420p", + "-movflags", + "+faststart", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/results/7fa338474c75/real_target.mp4" + ], + "full_decode_passed": true +} diff --git a/projects/video-action-editing/omni-t2v12/results/7fa338474c75/receipt.json b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/receipt.json new file mode 100644 index 0000000..2ac1d17 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/receipt.json @@ -0,0 +1,175 @@ +{ + "status": "complete", + "case": { + "index": 1, + "case_id": "7fa338474c75", + "name": "Playful selfie", + "page": 5, + "seed": 2026081900, + "prompt": "A cheerful woman in a red bikini top and straw sun hat takes a playful selfie against a green screen background in a static medium shot. In this continuous shot, The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "0ff87e5aa29e20f22ba1d2963c2700a3f10b6941147a8e517dd05e339cfb50de", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/t2v.mp4", + "bernini_t2v_sha256": "17b7ccb39f068649eb0ff155d50fdcba822dfd0a66bcf7965086b62651335d34", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/7fa338474c75/receipt.json", + "comparison_batch": "progress2_omni6_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/7fa338474c75/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081900", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/7fa338474c75/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "00d8baf84c06d97b147e7c9a6388d3e7b1ea2fa9c48f787da81820dc29e251d1", + "hostname": "auh7-1b-gpu-253", + "job": { + "SLURM_JOB_ID": "213687", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T08:19:06.632724+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081900 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection.", + "conditioning": { + "input_prompt": "A cheerful woman in a red bikini top and straw sun hat takes a playful selfie against a green screen background in a static medium shot. In this continuous shot, The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A cheerful woman stands in a static medium shot against a bright green screen background, her figure centered and clearly defined. She wears a vibrant red bikini top and a wide-brimmed straw sun hat that casts a soft shadow over her face, enhancing the playful, summery vibe. Her expression is lively and animated as she holds her smartphone at arm’s length, capturing a selfie with a mischievous grin. She sticks her tongue out slightly and winks one eye, adding a flirtatious, carefree energy to the moment. Her dark hair peeks out from under the hat, gently swaying as she shifts her weight slightly, maintaining a relaxed yet engaging posture. The lighting is even and bright, highlighting her features and the vivid colors of her outfit without casting harsh shadows. The camera remains completely still throughout, keeping the framing consistent and focused on her upper body and face. The green screen behind her is uniform and uncluttered, providing a clean, neutral backdrop that emphasizes her presence. The scene exudes a lighthearted, fun atmosphere, capturing a spontaneous and joyful moment in a single, continuous take.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 79, + 2048 + ], + "t5_context_shape": [ + 255, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 348 + ], + "rank_zero_log_sha256": "bfa9dc5a39eb59949e0310fbc226255b473cd5ca45931ddeeb75709e0c0c89bb" + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/7fa338474c75/omni_t2v.mp4", + "sha256": "b4e27999f2701c65ac62157ae6f49539ce092acc1dba0f652532fe793b037fc3", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 548.75, + "completed_utc": "2026-09-23T08:27:57.663754+00:00" +} diff --git a/projects/video-action-editing/omni-t2v12/results/7fa338474c75/t2v_conditioning.json b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/t2v_conditioning.json new file mode 100644 index 0000000..caf0daa --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/7fa338474c75/t2v_conditioning.json @@ -0,0 +1,19 @@ +{ + "input_prompt": "A cheerful woman in a red bikini top and straw sun hat takes a playful selfie against a green screen background in a static medium shot. In this continuous shot, The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A cheerful woman stands in a static medium shot against a bright green screen background, her figure centered and clearly defined. She wears a vibrant red bikini top and a wide-brimmed straw sun hat that casts a soft shadow over her face, enhancing the playful, summery vibe. Her expression is lively and animated as she holds her smartphone at arm\u2019s length, capturing a selfie with a mischievous grin. She sticks her tongue out slightly and winks one eye, adding a flirtatious, carefree energy to the moment. Her dark hair peeks out from under the hat, gently swaying as she shifts her weight slightly, maintaining a relaxed yet engaging posture. The lighting is even and bright, highlighting her features and the vivid colors of her outfit without casting harsh shadows. The camera remains completely still throughout, keeping the framing consistent and focused on her upper body and face. The green screen behind her is uniform and uncluttered, providing a clean, neutral backdrop that emphasizes her presence. The scene exudes a lighthearted, fun atmosphere, capturing a spontaneous and joyful moment in a single, continuous take.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 79, + 2048 + ], + "t5_context_shape": [ + 255, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 +} \ No newline at end of file diff --git a/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/bernini_receipt.json b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/bernini_receipt.json new file mode 100644 index 0000000..f9dcbf3 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"ce530d73daa6abb5b969f1d3266c691aa435a2c8bd0d4ca9426b5e249f66ef61","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"8f09b8ecfed65bf80b9e34cbc285bfc0cf67767df70140662a0c2840a219c0d7","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"2a53afe1650cfab2d3ac8b51fe33f02235022c4d047947dde7e999f3082191c3","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"95c8c5ec8ad4b3d7233359f321f3315046697aab827a8c951a7ca5a8e652b2f7","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"0cecd0632e41dd74a5c1c077098079bb15da04fb7bf0aa7c73ac5c7732cacb0b","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"8c9f975ba007f1ecdb769a497d9d951978e4757457d760f3c6b17cd6abd1461f","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"c078d8ca086b1ff21cad71b882c029be28e94028d2aa33dc02e84078fc677238","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"8b5b13c7294d4ad3e2be9a775865b71187be53abab4caf09f201710b0a40401d","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"435a03f05de71292fee97d5e6ba138978d92e7737ba7157c4ea326b8e78eeb4f","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"9cc054f3d575a45b39d3c832f67784c2490018697147140dd1c26f75587ff3b4","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"afa5cbf2e8426145cb1086e3c1edd81c012c2eee4462246c2d0317ec511e04e6","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"2f6d3cdd86969ea676d570f08eac7b523a75ea9d3fcbcb4839fb1a33d38c7f2f","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"072a77897e5c0dbfc7897e44a0d9683ae5efaeee64c3445701c68e668e753c6c","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"68905a2905a05bbbe8be8002f5ebc991cc7d11718cf6b0f424164ed8f5aa4091","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"a51983a760145dea7aa4a57824c0130c2be80717592390f360a7819f3f69e229","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"7bdebc631ee914dd17063a860196d41a22461b9486f2082902e591626ea30e10","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"a51983a760145dea7aa4a57824c0130c2be80717592390f360a7819f3f69e229","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081915,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"7bdebc631ee914dd17063a860196d41a22461b9486f2082902e591626ea30e10","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"2295f02c127be7b0749791e4cbc63a2d224283b236635e1fea47789137f3374b","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"7bdebc631ee914dd17063a860196d41a22461b9486f2082902e591626ea30e10"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"a51983a760145dea7aa4a57824c0130c2be80717592390f360a7819f3f69e229","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"7bdebc631ee914dd17063a860196d41a22461b9486f2082902e591626ea30e10","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"a51983a760145dea7aa4a57824c0130c2be80717592390f360a7819f3f69e229","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081915,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"7bdebc631ee914dd17063a860196d41a22461b9486f2082902e591626ea30e10","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"c5f43d5946b20260a431cdcf5de99f7d641e5a66159050aa60c616432821051a","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"7bdebc631ee914dd17063a860196d41a22461b9486f2082902e591626ea30e10"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":313,"action_prompt_utf8_sha256":"f0c58055ee24d894eb9274175c45f1bc41371cd9ff37dbae7d599298eece6bbd","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/81533c9e56ec/source-exact81.mp4","source_video_sha256":"6daa80d3ac407b01f842ce6fa611b3ec6c421851525f0845779143c4577e0b19","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"e4f07921d171f20a05139f37be8cb6ac946326e55a06cab5d577bd7a1629211e","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/rv2v.mp4","sha256":"96023f66a9a170c5880e637e2085520de6d8aa2c9889a1dc47a053812644905e","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"971b5d3e7c97d5ad3f00c69c3a637d0b3e9950689a890ab56fcf283be25b218c","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/t2v.mp4","sha256":"7dcf7690d12f8c59a3bef36b2b8a91f681d44351386bbb0f34c9f2a43625be1b","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"6daa80d3ac407b01f842ce6fa611b3ec6c421851525f0845779143c4577e0b19","original_pre_snapshot_sha256":"6daa80d3ac407b01f842ce6fa611b3ec6c421851525f0845779143c4577e0b19","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"6daa80d3ac407b01f842ce6fa611b3ec6c421851525f0845779143c4577e0b19","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"3806bba0f33f8966ce0ae354187d157fdb3d2bfc2d061326791c9782c36a3bff","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"7ff108fc95afc47faf6136fd7ed84de550b2a1c1db0e8a9f5100ab9be73aa184","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"a431bf93418404503aab9fec5fafe012793198bb0e5e48eb7f234e7640e267c7","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081915,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081915,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"f12cd6af0a68b68a7cf981c67abbbb0af0e4337064c380f67ed1be15d6af48ca","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/bernini_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/bernini_t2v.jpg new file mode 100644 index 0000000..dc7b150 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/bernini_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/bernini_t2v.mp4 new file mode 100644 index 0000000..60d0e0c Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/launch.json b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/launch.json new file mode 100644 index 0000000..de3777b --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/launch.json @@ -0,0 +1,131 @@ +{ + "case": { + "index": 2, + "case_id": "81533c9e56ec", + "name": "Scarf spin", + "page": 6, + "seed": 2026081915, + "prompt": "A woman in a vintage-style dress dances gracefully by a flower-lined fence in front of a rustic wooden house. In this continuous shot, The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "f0c58055ee24d894eb9274175c45f1bc41371cd9ff37dbae7d599298eece6bbd", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/t2v.mp4", + "bernini_t2v_sha256": "7dcf7690d12f8c59a3bef36b2b8a91f681d44351386bbb0f34c9f2a43625be1b", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/receipt.json", + "comparison_batch": "progress2_omni6_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/81533c9e56ec/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081915", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/81533c9e56ec/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "e0acbe48472ec3cf671de0600e2a962d64aaf95869175e179d42dcce1b9536cf", + "hostname": "auh7-1b-gpu-253", + "job": { + "SLURM_JOB_ID": "213687", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T08:28:15.040774+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081915 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection." +} diff --git a/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/omni_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/omni_t2v.jpg new file mode 100644 index 0000000..6462295 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/omni_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/omni_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/omni_t2v.mp4 new file mode 100644 index 0000000..9e59345 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/real_target.jpg b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/real_target.jpg new file mode 100644 index 0000000..9468186 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/real_target.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/real_target.mp4 b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/real_target.mp4 new file mode 100644 index 0000000..28faef5 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/real_target.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/real_target_receipt.json b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/real_target_receipt.json new file mode 100644 index 0000000..3a2f4d5 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/real_target_receipt.json @@ -0,0 +1,58 @@ +{ + "case_id": "81533c9e56ec", + "collected_utc": "2026-09-23T17:34:59.431906+00:00", + "purpose": "review_only", + "used_for_inference": false, + "original": { + "path": "/vast/users/guangyi.chen/dataset/MEV/MEV/videos/f810246b-7b74-4eb7-9777-a8f8db92f951-00.00.07.981-00.00.12.766-seg2.mp4", + "sha256": "cc70ae83aa709078e90a686426c6ad7956f4d8f722c76811660a4fea4d56373e" + }, + "original_probe": { + "width": 1280, + "height": 720, + "avg_frame_rate": "25/1", + "duration": "4.760000", + "nb_read_frames": "119" + }, + "display": { + "path": "results/81533c9e56ec/real_target.mp4", + "sha256": "5edb351b04edd07ccb51fc57043298d62a9abcb959d6f86bd5912ef5d654d6d3", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + }, + "ffmpeg_command": [ + "ffmpeg", + "-hide_banner", + "-loglevel", + "error", + "-y", + "-i", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/real_targets_original/81533c9e56ec.mp4", + "-map", + "0:v:0", + "-an", + "-vf", + "setpts=(PTS-STARTPTS)*0.680672268907563,fps=25,tpad=stop_mode=clone:stop_duration=3.24,trim=end_frame=81,setpts=N/(25*TB),scale=960:540:force_original_aspect_ratio=decrease:force_divisible_by=2,pad=960:540:(ow-iw)/2:(oh-ih)/2,setsar=1", + "-frames:v", + "81", + "-c:v", + "libx264", + "-crf", + "18", + "-preset", + "fast", + "-threads", + "2", + "-pix_fmt", + "yuv420p", + "-movflags", + "+faststart", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/results/81533c9e56ec/real_target.mp4" + ], + "full_decode_passed": true +} diff --git a/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/receipt.json b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/receipt.json new file mode 100644 index 0000000..3bd80c4 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/receipt.json @@ -0,0 +1,175 @@ +{ + "status": "complete", + "case": { + "index": 2, + "case_id": "81533c9e56ec", + "name": "Scarf spin", + "page": 6, + "seed": 2026081915, + "prompt": "A woman in a vintage-style dress dances gracefully by a flower-lined fence in front of a rustic wooden house. In this continuous shot, The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "f0c58055ee24d894eb9274175c45f1bc41371cd9ff37dbae7d599298eece6bbd", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/t2v.mp4", + "bernini_t2v_sha256": "7dcf7690d12f8c59a3bef36b2b8a91f681d44351386bbb0f34c9f2a43625be1b", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/81533c9e56ec/receipt.json", + "comparison_batch": "progress2_omni6_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/81533c9e56ec/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081915", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/81533c9e56ec/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "e0acbe48472ec3cf671de0600e2a962d64aaf95869175e179d42dcce1b9536cf", + "hostname": "auh7-1b-gpu-253", + "job": { + "SLURM_JOB_ID": "213687", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T08:28:15.040774+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081915 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection.", + "conditioning": { + "input_prompt": "A woman in a vintage-style dress dances gracefully by a flower-lined fence in front of a rustic wooden house. In this continuous shot, The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A woman in a vintage-style dress dances gracefully by a flower-lined fence in front of a rustic wooden house, her movements fluid and deliberate under the warm, golden light of late afternoon. She wears a flowing green skirt that swirls with each turn, paired with a fitted black shirt that contrasts elegantly with the soft hues of the surrounding garden. In her hands, she holds a long, sheer scarf that billows like a ribbon in the breeze, catching the sunlight as she spins in a slow, continuous circle. The camera remains steady, capturing her in a wide, stable frame that emphasizes the harmony between her motion and the tranquil setting. The fence, draped in climbing roses and wildflowers, frames the scene with natural beauty, while the weathered wooden house in the background adds a sense of timeless charm. The lighting is soft and diffused, casting gentle shadows and enhancing the nostalgic atmosphere. Her expression is serene, eyes closed at times, as if lost in the rhythm of the moment. The entire scene unfolds in a single, unbroken shot, with no cuts or shifts in perspective, allowing the viewer to fully immerse in the grace and stillness of the moment.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 67, + 2048 + ], + "t5_context_shape": [ + 274, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 355 + ], + "rank_zero_log_sha256": "b6de7b091cb33a2ef71fff25d838ebe3334d7999fd50c1abde4bbe69a0ff0e80" + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/81533c9e56ec/omni_t2v.mp4", + "sha256": "11a91b035dac93b7875974b44469c54743c226ea892402e0d742dc90a0e49ca4", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 543.4, + "completed_utc": "2026-09-23T08:37:01.166639+00:00" +} diff --git a/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/t2v_conditioning.json b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/t2v_conditioning.json new file mode 100644 index 0000000..41c2440 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/81533c9e56ec/t2v_conditioning.json @@ -0,0 +1,19 @@ +{ + "input_prompt": "A woman in a vintage-style dress dances gracefully by a flower-lined fence in front of a rustic wooden house. In this continuous shot, The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A woman in a vintage-style dress dances gracefully by a flower-lined fence in front of a rustic wooden house, her movements fluid and deliberate under the warm, golden light of late afternoon. She wears a flowing green skirt that swirls with each turn, paired with a fitted black shirt that contrasts elegantly with the soft hues of the surrounding garden. In her hands, she holds a long, sheer scarf that billows like a ribbon in the breeze, catching the sunlight as she spins in a slow, continuous circle. The camera remains steady, capturing her in a wide, stable frame that emphasizes the harmony between her motion and the tranquil setting. The fence, draped in climbing roses and wildflowers, frames the scene with natural beauty, while the weathered wooden house in the background adds a sense of timeless charm. The lighting is soft and diffused, casting gentle shadows and enhancing the nostalgic atmosphere. Her expression is serene, eyes closed at times, as if lost in the rhythm of the moment. The entire scene unfolds in a single, unbroken shot, with no cuts or shifts in perspective, allowing the viewer to fully immerse in the grace and stillness of the moment.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 67, + 2048 + ], + "t5_context_shape": [ + 274, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 +} \ No newline at end of file diff --git a/projects/video-action-editing/omni-t2v12/results/840b214afead/bernini_receipt.json b/projects/video-action-editing/omni-t2v12/results/840b214afead/bernini_receipt.json new file mode 100644 index 0000000..b1dff5e --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/840b214afead/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"15992f2246144c6ed07475f7c9c58de924db6ab3341cf2490300c7a0a371a5b2","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"c1f45924af0cf2c17d425fc6c25b51b74cc980f4c8d8c322224835504222c9eb","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"1b62b0dbeab6dc5846d0dc29269ca1a1529b274ff336a63a6a48a7b661ab275b","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"b1dcd2064d8530cff990cb79f835d1e9bfc9825c4838dedd51d2b71d809d0bdb","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"1ec3cf0b33e9da06d58748bfccb7ad57e5b3962f4aae6f897dd17631af9cd217","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"7a5712dbc0d5f42e15bb265b557768e845070ace4f02db5f43160d56ddc3f404","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"a5da9b87e21f746d1083fa429f04a45bb8282b23c51604d5bb792195ca7a0453","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"bcd4135f5d56fae7faeb3b58b7e73aeb3f76ca0cd1e701721880fca802c4a48b","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"37cf604ec6fe8a68353bf61bde5afd00869362861576a998a59d7a833f2cf680","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"7d6e92cc7bc79a1be341ad324d892b3e8fe01c702a8b644e0363e06aab11613f","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"0251923627620990a6a4c666eb6add662a1eaf1501456093b2dc4f019a39929e","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"965868b1b4505e33716bfe157304bc05a8c743bad5c8dc02470591bf7768b183","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"11c5947118886cebcd1bf6a1eecc823a8e13ad5a438b951b2f32934fd19522b7","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"2a5cf9984339fa101b5f3291d47ee64a270aef944d64847014093d2f3efe994a","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"0a4ae2cab750190cf746b7839bddc4cbe8a1d5b92ebe0bdc1a7c92bb652ed0b7","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"20af8631c22b9d5183c253ed91205439eeb51eb5852477000f37d0f4a3448575","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"0a4ae2cab750190cf746b7839bddc4cbe8a1d5b92ebe0bdc1a7c92bb652ed0b7","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081913,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"20af8631c22b9d5183c253ed91205439eeb51eb5852477000f37d0f4a3448575","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"682d187e508391191be118335d745986443f758560808935124d41e27192b2ee","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"20af8631c22b9d5183c253ed91205439eeb51eb5852477000f37d0f4a3448575"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"0a4ae2cab750190cf746b7839bddc4cbe8a1d5b92ebe0bdc1a7c92bb652ed0b7","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"20af8631c22b9d5183c253ed91205439eeb51eb5852477000f37d0f4a3448575","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"0a4ae2cab750190cf746b7839bddc4cbe8a1d5b92ebe0bdc1a7c92bb652ed0b7","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081913,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"20af8631c22b9d5183c253ed91205439eeb51eb5852477000f37d0f4a3448575","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"60e97ee622b93c52a8c7eb6085f0faf59e880ca7d44992f32940d7735dd812cf","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"20af8631c22b9d5183c253ed91205439eeb51eb5852477000f37d0f4a3448575"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":370,"action_prompt_utf8_sha256":"effdf094385a4f2486391efc008150b7436a8137c1d5766864a678ed6e0c749f","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/840b214afead/source-exact81.mp4","source_video_sha256":"a6e42a447d7fef26b073878c551a631afd6371987910a332e51e4a9e4dfb4646","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"1689f4723a2694b5e29c4912c91268fd8a16757433187e2d4cde44bc531f9e8f","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/rv2v.mp4","sha256":"805f6a2211b7a76e16cd85f508b341f2f06db3a04eaa336e688fe098bf5b545e","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"3c6007e70156d84f666cd1cf0a818a74cdb9c04afece892e59569de0e5f8edd7","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/t2v.mp4","sha256":"412399051be25c19ec9ab7d1406b1e6982e31e75cfa1b3920259a6c22f66113b","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"a6e42a447d7fef26b073878c551a631afd6371987910a332e51e4a9e4dfb4646","original_pre_snapshot_sha256":"a6e42a447d7fef26b073878c551a631afd6371987910a332e51e4a9e4dfb4646","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"a6e42a447d7fef26b073878c551a631afd6371987910a332e51e4a9e4dfb4646","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"604bff69e9f43990de2efd7c26e64d15b4f1e92d9c165d182c7e2707f9299251","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"a267d42ed5d6b8c080308914f0062fd01d9e5ac525637ff8aff050de28e1b298","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"e4d14f7d37fa5c7618f0971d9dd26ba3893976d748054ab0d688f290b3ce9dd0","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081913,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081913,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"5297c69ee8399f59a973efc144cd7ec61b8f2eb6c41677279ebb707a227836c7","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-t2v12/results/840b214afead/bernini_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/840b214afead/bernini_t2v.jpg new file mode 100644 index 0000000..4e9d8e6 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/840b214afead/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/840b214afead/bernini_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/840b214afead/bernini_t2v.mp4 new file mode 100644 index 0000000..30363a0 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/840b214afead/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/840b214afead/launch.json b/projects/video-action-editing/omni-t2v12/results/840b214afead/launch.json new file mode 100644 index 0000000..d855a4c --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/840b214afead/launch.json @@ -0,0 +1,131 @@ +{ + "case": { + "index": 4, + "case_id": "840b214afead", + "name": "Place bottle on treadmill", + "page": 7, + "seed": 2026081913, + "prompt": "A young woman with long reddish-blonde hair, wearing a mint green athletic outfit, stands on a treadmill in a modern gym with blue and white striped pillars, holding a water bottle. In this continuous shot, The woman turns her head to the left and places her water bottle onto the treadmill. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "effdf094385a4f2486391efc008150b7436a8137c1d5766864a678ed6e0c749f", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/t2v.mp4", + "bernini_t2v_sha256": "412399051be25c19ec9ab7d1406b1e6982e31e75cfa1b3920259a6c22f66113b", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/receipt.json", + "comparison_batch": "progress2_omni6_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/840b214afead/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081913", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/840b214afead/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "860178e2c937fc735b0a872c3430750f72c3801c03c53a67d62833e8e5f7be26", + "hostname": "auh7-1b-gpu-253", + "job": { + "SLURM_JOB_ID": "213687", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "started_utc": "2026-09-23T08:19:05.594446+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081913 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection." +} diff --git a/projects/video-action-editing/omni-t2v12/results/840b214afead/omni_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/840b214afead/omni_t2v.jpg new file mode 100644 index 0000000..53bb951 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/840b214afead/omni_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/840b214afead/omni_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/840b214afead/omni_t2v.mp4 new file mode 100644 index 0000000..0372150 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/840b214afead/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/840b214afead/real_target.jpg b/projects/video-action-editing/omni-t2v12/results/840b214afead/real_target.jpg new file mode 100644 index 0000000..adf5f76 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/840b214afead/real_target.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/840b214afead/real_target.mp4 b/projects/video-action-editing/omni-t2v12/results/840b214afead/real_target.mp4 new file mode 100644 index 0000000..6ed4613 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/840b214afead/real_target.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/840b214afead/real_target_receipt.json b/projects/video-action-editing/omni-t2v12/results/840b214afead/real_target_receipt.json new file mode 100644 index 0000000..efd21c1 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/840b214afead/real_target_receipt.json @@ -0,0 +1,58 @@ +{ + "case_id": "840b214afead", + "collected_utc": "2026-09-23T17:35:06.913355+00:00", + "purpose": "review_only", + "used_for_inference": false, + "original": { + "path": "/vast/users/guangyi.chen/dataset/MEV/MEV/videos/a22aa389-eba0-4b78-815f-2e0f7956e226-00.00.02.420-00.00.04.312-seg2.mp4", + "sha256": "f0de03ba9c925175c5ea397a8e75203d6e4d31bed3b2baf249122f4dc0d24c3c" + }, + "original_probe": { + "width": 1280, + "height": 720, + "avg_frame_rate": "25/1", + "duration": "1.880000", + "nb_read_frames": "47" + }, + "display": { + "path": "results/840b214afead/real_target.mp4", + "sha256": "989454c22b5f6db63ebd8667c943bb2622cfc2c25990661805dda3e1f9fde52b", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + }, + "ffmpeg_command": [ + "ffmpeg", + "-hide_banner", + "-loglevel", + "error", + "-y", + "-i", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/real_targets_original/840b214afead.mp4", + "-map", + "0:v:0", + "-an", + "-vf", + "setpts=(PTS-STARTPTS)*1.72340425531915,fps=25,tpad=stop_mode=clone:stop_duration=3.24,trim=end_frame=81,setpts=N/(25*TB),scale=960:540:force_original_aspect_ratio=decrease:force_divisible_by=2,pad=960:540:(ow-iw)/2:(oh-ih)/2,setsar=1", + "-frames:v", + "81", + "-c:v", + "libx264", + "-crf", + "18", + "-preset", + "fast", + "-threads", + "2", + "-pix_fmt", + "yuv420p", + "-movflags", + "+faststart", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/results/840b214afead/real_target.mp4" + ], + "full_decode_passed": true +} diff --git a/projects/video-action-editing/omni-t2v12/results/840b214afead/receipt.json b/projects/video-action-editing/omni-t2v12/results/840b214afead/receipt.json new file mode 100644 index 0000000..1c2c53a --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/840b214afead/receipt.json @@ -0,0 +1,175 @@ +{ + "status": "complete", + "case": { + "index": 4, + "case_id": "840b214afead", + "name": "Place bottle on treadmill", + "page": 7, + "seed": 2026081913, + "prompt": "A young woman with long reddish-blonde hair, wearing a mint green athletic outfit, stands on a treadmill in a modern gym with blue and white striped pillars, holding a water bottle. In this continuous shot, The woman turns her head to the left and places her water bottle onto the treadmill. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "effdf094385a4f2486391efc008150b7436a8137c1d5766864a678ed6e0c749f", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/t2v.mp4", + "bernini_t2v_sha256": "412399051be25c19ec9ab7d1406b1e6982e31e75cfa1b3920259a6c22f66113b", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/840b214afead/receipt.json", + "comparison_batch": "progress2_omni6_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/840b214afead/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081913", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/840b214afead/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "860178e2c937fc735b0a872c3430750f72c3801c03c53a67d62833e8e5f7be26", + "hostname": "auh7-1b-gpu-253", + "job": { + "SLURM_JOB_ID": "213687", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "started_utc": "2026-09-23T08:19:05.594446+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081913 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection.", + "conditioning": { + "input_prompt": "A young woman with long reddish-blonde hair, wearing a mint green athletic outfit, stands on a treadmill in a modern gym with blue and white striped pillars, holding a water bottle. In this continuous shot, The woman turns her head to the left and places her water bottle onto the treadmill. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A young woman with long, sun-kissed reddish-blonde hair stands centered on a treadmill in a sleek, modern gym, her posture relaxed yet alert. She wears a form-fitting mint green athletic outfit—a moisture-wicking tank top and matching leggings—that contrasts softly against the cool-toned environment. The gym is illuminated by bright, even lighting that highlights the clean lines of the space, with blue and white striped pillars rising in the background, creating a rhythmic visual pattern that adds depth to the scene. The camera holds a steady, medium-wide shot, capturing her from the waist up, with the treadmill’s control panel and running belt clearly visible. In a smooth, continuous motion, she turns her head slightly to the left, her gaze briefly shifting toward the side of the treadmill, then lowers her right hand to place a clear water bottle with a blue cap onto the treadmill’s console. The bottle rests securely, and she remains in place, her expression calm and focused, as the scene continues without interruption. The lighting remains consistent, the framing stable, and the background elements—pillars, mirrors, and distant gym equipment—remain unchanged, emphasizing the quiet, deliberate nature of the moment.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 82, + 2048 + ], + "t5_context_shape": [ + 289, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 385 + ], + "rank_zero_log_sha256": "d865c4c2b75642465de5471b399e7825250690c84f63f207fafa7208dc82ca6d" + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/840b214afead/omni_t2v.mp4", + "sha256": "f8c6c74bac6feaeb53623326afaf4ba7a839d47b75d8981bd400429fd9cd5cd1", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 555.63, + "completed_utc": "2026-09-23T08:28:03.800437+00:00" +} diff --git a/projects/video-action-editing/omni-t2v12/results/840b214afead/t2v_conditioning.json b/projects/video-action-editing/omni-t2v12/results/840b214afead/t2v_conditioning.json new file mode 100644 index 0000000..2c32597 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/840b214afead/t2v_conditioning.json @@ -0,0 +1,19 @@ +{ + "input_prompt": "A young woman with long reddish-blonde hair, wearing a mint green athletic outfit, stands on a treadmill in a modern gym with blue and white striped pillars, holding a water bottle. In this continuous shot, The woman turns her head to the left and places her water bottle onto the treadmill. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A young woman with long, sun-kissed reddish-blonde hair stands centered on a treadmill in a sleek, modern gym, her posture relaxed yet alert. She wears a form-fitting mint green athletic outfit\u2014a moisture-wicking tank top and matching leggings\u2014that contrasts softly against the cool-toned environment. The gym is illuminated by bright, even lighting that highlights the clean lines of the space, with blue and white striped pillars rising in the background, creating a rhythmic visual pattern that adds depth to the scene. The camera holds a steady, medium-wide shot, capturing her from the waist up, with the treadmill\u2019s control panel and running belt clearly visible. In a smooth, continuous motion, she turns her head slightly to the left, her gaze briefly shifting toward the side of the treadmill, then lowers her right hand to place a clear water bottle with a blue cap onto the treadmill\u2019s console. The bottle rests securely, and she remains in place, her expression calm and focused, as the scene continues without interruption. The lighting remains consistent, the framing stable, and the background elements\u2014pillars, mirrors, and distant gym equipment\u2014remain unchanged, emphasizing the quiet, deliberate nature of the moment.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 82, + 2048 + ], + "t5_context_shape": [ + 289, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 +} \ No newline at end of file diff --git a/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/bernini_receipt.json b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/bernini_receipt.json new file mode 100644 index 0000000..f340e8a --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"0e3ef520bc12f16c3322dfeb5810d463e7bee5e728de439339b38512bb141137","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"cd29b62f704ca8c1579cb3a0c767346d28b684484398cfc971b948296f5aed07","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"0fa7f7a5b411878dd2248e630ed1a3d7477e4bb0460afe7949252f2694aef383","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"8ffb30e2874b54196df648959b1669d00a4d5f7daf821926456b1699eb3b7f46","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"43b69b00ada967ef76345826b0674fe7d841f244ea90523b88e9f166cb437d08","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"316d1888f0ee198f627be953524eb1c7aba5f4da4abacf123c2e6a9b44905766","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"75d93e68bf8a1d89bba7cb0f91958c8300d371794698ab96f7949dc8877007eb","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"9222c48b1aa81b3e05f3fce8d36674e040c8cc68eec751848393d9bc193e19ae","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"40e2b7b43ba9dbb148d76b5caccf57364ba283aa1fad74534466b06ecaef0858","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"5719ed9082ae985b7a8c72202e49d83c541621ce1571331b9193cedfd25fdd3b","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"b392d25ca7581c2810be2badac1880ea655b8d9e9ad28690a62348ee65d16784","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"dc7e43abdf0bfc78fd327747c6dba38e7a1c2b74bc1ea2db7ff7544bb3a14a24","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"833c04baee1212aea75bc6325dca38b7761ba030a5c5dc52ff8d4e02f1eae3c7","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"e1a0535630291d954cd87b1c9f8ef201c5a66512479252f810849031753aac72","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"dad5739e74c429c4e4df7fc1727082b13a2bed19e9edd37cf798a5b223207324","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"60c52f35fe1da3abe023e4bd9124bbe22bf38d9b2d916961e42fe20febf9e8c3","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"dad5739e74c429c4e4df7fc1727082b13a2bed19e9edd37cf798a5b223207324","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081907,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"60c52f35fe1da3abe023e4bd9124bbe22bf38d9b2d916961e42fe20febf9e8c3","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"165f816820831627f57ef91cb2359113994527313b0325cc45e2306c78011673","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"60c52f35fe1da3abe023e4bd9124bbe22bf38d9b2d916961e42fe20febf9e8c3"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"dad5739e74c429c4e4df7fc1727082b13a2bed19e9edd37cf798a5b223207324","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"60c52f35fe1da3abe023e4bd9124bbe22bf38d9b2d916961e42fe20febf9e8c3","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"dad5739e74c429c4e4df7fc1727082b13a2bed19e9edd37cf798a5b223207324","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081907,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"60c52f35fe1da3abe023e4bd9124bbe22bf38d9b2d916961e42fe20febf9e8c3","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"9111a8c3be8ce6f71847e1dd77c43d5f155206271b60b94e91215602234e2133","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"60c52f35fe1da3abe023e4bd9124bbe22bf38d9b2d916961e42fe20febf9e8c3"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":293,"action_prompt_utf8_sha256":"3c320866e1c96c3a128a525a9d0e4633d6cb1aef7b519e9c623c841f3f004e31","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d5221a1b69d5/source-exact81.mp4","source_video_sha256":"fdd1b3df4b94449dc59cd04d03deb769fb2cf6c4c2d7b87221e2b3a6b5557d14","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"4e2b456b1820d80d383681df6cb74752dd961cea36fb8bb4fc6e82ad46a75043","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/rv2v.mp4","sha256":"5cb52ddd029742d7fd8d7b6e6ef04df46dd6d3fb77a3522b4bd8f36f5afde38e","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"1fc6f50f9c555be06be5c88d710adb9ee2fb644f24875d703c3df5b877f72ee3","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/t2v.mp4","sha256":"c721c58707f97a876842d467b7e3e5ebe84eb41021512af9bdfa33ac837717d2","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"fdd1b3df4b94449dc59cd04d03deb769fb2cf6c4c2d7b87221e2b3a6b5557d14","original_pre_snapshot_sha256":"fdd1b3df4b94449dc59cd04d03deb769fb2cf6c4c2d7b87221e2b3a6b5557d14","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"fdd1b3df4b94449dc59cd04d03deb769fb2cf6c4c2d7b87221e2b3a6b5557d14","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"88083a3f93b4d2444e7e101a6aca51f275f1c3263bec08f076053272d05c7a27","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"f01ab3d32bb9c931c4b5f2ccc903f8e5a50d2a5a8bd783287f4b115838dca51c","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"409d0f5ee949db66d90b9b3a322400df21acb20a42df2d668b401bcfad6e8e6f","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081907,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081907,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"5252b29687addade7b735cfb6dfcebac9942f72444bfa98d739981c82f036fc3","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/bernini_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/bernini_t2v.jpg new file mode 100644 index 0000000..dc97d2e Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/bernini_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/bernini_t2v.mp4 new file mode 100644 index 0000000..e71c2d2 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/launch.json b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/launch.json new file mode 100644 index 0000000..a14b7a9 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/launch.json @@ -0,0 +1,131 @@ +{ + "case": { + "index": 10, + "case_id": "d5221a1b69d5", + "name": "闭眼尝汤 · Taste from ladle", + "page": null, + "seed": 2026081907, + "prompt": "A young woman in a patterned apron stands in a modern kitchen, tasting food from a ladle with a satisfied expression. In this continuous shot, The woman in an apron closes her eyes as she tastes from a metal ladle. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "3c320866e1c96c3a128a525a9d0e4633d6cb1aef7b519e9c623c841f3f004e31", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/t2v.mp4", + "bernini_t2v_sha256": "c721c58707f97a876842d467b7e3e5ebe84eb41021512af9bdfa33ac837717d2", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/receipt.json", + "comparison_batch": "progress2_omni6_extra_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/d5221a1b69d5/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081907", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/d5221a1b69d5/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "c05aa2bfd6d9ab38473e6b667f8fb640b0d6b1126adfb05f9a9a74a8cab7a553", + "hostname": "auh7-1b-gpu-287", + "job": { + "SLURM_JOB_ID": "213688", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "started_utc": "2026-09-23T08:19:38.654569+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081907 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection." +} diff --git a/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/omni_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/omni_t2v.jpg new file mode 100644 index 0000000..b1f08af Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/omni_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/omni_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/omni_t2v.mp4 new file mode 100644 index 0000000..908a6d6 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/real_target.jpg b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/real_target.jpg new file mode 100644 index 0000000..c6a16fa Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/real_target.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/real_target.mp4 b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/real_target.mp4 new file mode 100644 index 0000000..0abad7d Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/real_target.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/real_target_receipt.json b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/real_target_receipt.json new file mode 100644 index 0000000..b779ff5 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/real_target_receipt.json @@ -0,0 +1,58 @@ +{ + "case_id": "d5221a1b69d5", + "collected_utc": "2026-09-23T17:35:23.118612+00:00", + "purpose": "review_only", + "used_for_inference": false, + "original": { + "path": "/vast/users/guangyi.chen/dataset/MEV/MEV/videos/6a7753fa-f254-4570-8369-918954606350-00.00.03.841-00.00.07.536-seg2.mp4", + "sha256": "5da5df9d958b4f56a5b5b545e059ac9288471e27a0e8b36fac2c5a92a4f63b77" + }, + "original_probe": { + "width": 1280, + "height": 720, + "avg_frame_rate": "25/1", + "duration": "3.680000", + "nb_read_frames": "92" + }, + "display": { + "path": "results/d5221a1b69d5/real_target.mp4", + "sha256": "3b61c8123a193d9feab392a7780ea5b87b91099a2c41ea069875febc81ea9f4e", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + }, + "ffmpeg_command": [ + "ffmpeg", + "-hide_banner", + "-loglevel", + "error", + "-y", + "-i", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/real_targets_original/d5221a1b69d5.mp4", + "-map", + "0:v:0", + "-an", + "-vf", + "setpts=(PTS-STARTPTS)*0.880434782608696,fps=25,tpad=stop_mode=clone:stop_duration=3.24,trim=end_frame=81,setpts=N/(25*TB),scale=960:540:force_original_aspect_ratio=decrease:force_divisible_by=2,pad=960:540:(ow-iw)/2:(oh-ih)/2,setsar=1", + "-frames:v", + "81", + "-c:v", + "libx264", + "-crf", + "18", + "-preset", + "fast", + "-threads", + "2", + "-pix_fmt", + "yuv420p", + "-movflags", + "+faststart", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/results/d5221a1b69d5/real_target.mp4" + ], + "full_decode_passed": true +} diff --git a/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/receipt.json b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/receipt.json new file mode 100644 index 0000000..746e8a1 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/receipt.json @@ -0,0 +1,175 @@ +{ + "status": "complete", + "case": { + "index": 10, + "case_id": "d5221a1b69d5", + "name": "闭眼尝汤 · Taste from ladle", + "page": null, + "seed": 2026081907, + "prompt": "A young woman in a patterned apron stands in a modern kitchen, tasting food from a ladle with a satisfied expression. In this continuous shot, The woman in an apron closes her eyes as she tastes from a metal ladle. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "3c320866e1c96c3a128a525a9d0e4633d6cb1aef7b519e9c623c841f3f004e31", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/t2v.mp4", + "bernini_t2v_sha256": "c721c58707f97a876842d467b7e3e5ebe84eb41021512af9bdfa33ac837717d2", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d5221a1b69d5/receipt.json", + "comparison_batch": "progress2_omni6_extra_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/d5221a1b69d5/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081907", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/d5221a1b69d5/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "c05aa2bfd6d9ab38473e6b667f8fb640b0d6b1126adfb05f9a9a74a8cab7a553", + "hostname": "auh7-1b-gpu-287", + "job": { + "SLURM_JOB_ID": "213688", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "started_utc": "2026-09-23T08:19:38.654569+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081907 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection.", + "conditioning": { + "input_prompt": "A young woman in a patterned apron stands in a modern kitchen, tasting food from a ladle with a satisfied expression. In this continuous shot, The woman in an apron closes her eyes as she tastes from a metal ladle. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A young woman stands in a bright, modern kitchen, her figure centered in a steady, continuous shot. She wears a patterned apron over casual clothing, the fabric soft and slightly rumpled from use. The kitchen is sleek and well-lit, with natural light streaming through a large window, casting a warm glow across stainless steel appliances and clean white countertops. In her hand, she holds a metal ladle, its surface gleaming under the light. She lifts it slowly to her lips, her eyes closing gently as she tastes the food. Her expression softens into quiet satisfaction—lips parting slightly, a subtle smile forming as the flavor registers. The camera remains fixed, capturing the moment with unwavering focus, preserving the stillness of the scene. The lighting remains consistent, highlighting the contours of her face and the texture of the apron. The background remains unchanged—neatly arranged utensils, a pot simmering on the stove, a bowl of fresh herbs on the counter—all contributing to the calm, domestic atmosphere. The shot lingers, emphasizing the sensory experience, the quiet joy of a meal well-prepared, and the simple pleasure of tasting one’s own creation.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 70, + 2048 + ], + "t5_context_shape": [ + 274, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 358 + ], + "rank_zero_log_sha256": "553659a0edaf6f48af82c44481a5de73ec1c71aac3c3a88556e15fb616195053" + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/d5221a1b69d5/omni_t2v.mp4", + "sha256": "77cbffd0f6650d641829a18b2f5dc7244c69ee0d430ca1f5e2a5efaa44e984e2", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 552.79, + "completed_utc": "2026-09-23T08:28:25.409926+00:00" +} diff --git a/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/t2v_conditioning.json b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/t2v_conditioning.json new file mode 100644 index 0000000..ce46a80 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/d5221a1b69d5/t2v_conditioning.json @@ -0,0 +1,19 @@ +{ + "input_prompt": "A young woman in a patterned apron stands in a modern kitchen, tasting food from a ladle with a satisfied expression. In this continuous shot, The woman in an apron closes her eyes as she tastes from a metal ladle. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A young woman stands in a bright, modern kitchen, her figure centered in a steady, continuous shot. She wears a patterned apron over casual clothing, the fabric soft and slightly rumpled from use. The kitchen is sleek and well-lit, with natural light streaming through a large window, casting a warm glow across stainless steel appliances and clean white countertops. In her hand, she holds a metal ladle, its surface gleaming under the light. She lifts it slowly to her lips, her eyes closing gently as she tastes the food. Her expression softens into quiet satisfaction\u2014lips parting slightly, a subtle smile forming as the flavor registers. The camera remains fixed, capturing the moment with unwavering focus, preserving the stillness of the scene. The lighting remains consistent, highlighting the contours of her face and the texture of the apron. The background remains unchanged\u2014neatly arranged utensils, a pot simmering on the stove, a bowl of fresh herbs on the counter\u2014all contributing to the calm, domestic atmosphere. The shot lingers, emphasizing the sensory experience, the quiet joy of a meal well-prepared, and the simple pleasure of tasting one\u2019s own creation.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 70, + 2048 + ], + "t5_context_shape": [ + 274, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 +} \ No newline at end of file diff --git a/projects/video-action-editing/omni-t2v12/results/d908552fb691/bernini_receipt.json b/projects/video-action-editing/omni-t2v12/results/d908552fb691/bernini_receipt.json new file mode 100644 index 0000000..a394030 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/d908552fb691/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"a0a093221006a4bc061d2c49d193ac3553aef2db2c994a5121d3953e7ec9f50c","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"60f4c1f2a8fa41430dfd460cf678c517c8d2a0864c6aae9931af4e99f24cc24a","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"08ac76711877a7c3c995081b07d21cab4e28dde1768dc4bd06293d2d0e594dd8","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"5afd39a16b79c04f11b123c7e732891200577346c56c6ff34194bdffca79ac7d","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"67e8cf261d8cb4f8842d5848348ad6d157a2d135fce8018f403566a68c18103c","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"e3bf8e07296b0cdcf862746603667335e86050993c53b494f51f296267237f0b","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"9285004abd79644620eb8f144c051849bb29ce584b4b4483a594456386a03e3b","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"785548ee49b875d2fcfab42cd65efdfb3516a7985c777051e8557c80580b3e56","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"400d2e2c096a5ba77d2632fa77fe0dec3e1c092e16c534a6257f23476e94c352","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"b1b95705d274ce5a92933877856d9e703f8cf0ccbda9178b0ca1ee1b382a2b17","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"9896e66b548f5147ecb12cf96e88f128c27406e6dec8350fb5972f7b7e935368","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"3849e04624c5c84e6733c1ce7edad70384ee977aa138f6e143d94e45f978400f","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"92549679f4e010e231e5b2dcdda92736c20466762730683cea7f8932fc4eb97c","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"64eb180444ab66420f959ae3a668ad3e51a80abbab6c7384bd98c48e25100270","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"6de6325eb03ecd284f77eabb2a050a89730d7f0463ef36f7ca728782897a36a5","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"e3477e803918b5d84ff200b2be049c36f69a18c79419595cc7f18e3684b2246e","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"6de6325eb03ecd284f77eabb2a050a89730d7f0463ef36f7ca728782897a36a5","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081903,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"e3477e803918b5d84ff200b2be049c36f69a18c79419595cc7f18e3684b2246e","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"e5564515e89d41c7277fa82415b91e753bd875abafe5501dfec22bbc2d0f6c36","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"e3477e803918b5d84ff200b2be049c36f69a18c79419595cc7f18e3684b2246e"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"6de6325eb03ecd284f77eabb2a050a89730d7f0463ef36f7ca728782897a36a5","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"e3477e803918b5d84ff200b2be049c36f69a18c79419595cc7f18e3684b2246e","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"6de6325eb03ecd284f77eabb2a050a89730d7f0463ef36f7ca728782897a36a5","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081903,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"e3477e803918b5d84ff200b2be049c36f69a18c79419595cc7f18e3684b2246e","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"8018b358ab8ea9e4cb9bcb228505076ad7ab084bb85c5d0706278b7073345b71","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"e3477e803918b5d84ff200b2be049c36f69a18c79419595cc7f18e3684b2246e"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":382,"action_prompt_utf8_sha256":"6c693b009c7e8c0d2f3c4ed680d119e2ef14e800cbabc6a10da0ff2556bb86b8","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d908552fb691/source-exact81.mp4","source_video_sha256":"56e1faa78c02c32d6da71354e8434241c8e9a4c334da4ac8aa4415148b6230bb","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"eed978266371e00b3feb9b7d17dcc61633f46d5ea90722e2e3e19ab61090be37","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/rv2v.mp4","sha256":"2ab7621e74b848a998822edb340ce07baca308814bb5524d7d3cd910e45e9efd","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"c1b0f92804195de0b39a900d62bf435141f4a8a095cb56abf4dee562742b940f","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/t2v.mp4","sha256":"704f866e6b6a0615f87d62f9815c61c065519e900d2e70be5a517513994daa3d","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"56e1faa78c02c32d6da71354e8434241c8e9a4c334da4ac8aa4415148b6230bb","original_pre_snapshot_sha256":"56e1faa78c02c32d6da71354e8434241c8e9a4c334da4ac8aa4415148b6230bb","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"56e1faa78c02c32d6da71354e8434241c8e9a4c334da4ac8aa4415148b6230bb","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"5f2cf4cedb92a86ab416ff83ba501d1e2e6647dd9d86fd5cd2e68ac729dbe68d","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"e8b542250790de1613b15c355501c22efa624817869e7528d8a09ef141a21a1f","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"c3f1aae496efdb016048dfc552989cc37daa8b7724258214b7a1e81adaa1c2a0","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081903,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081903,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"ec20637b3b2070c1949c0f06d95e6d6717facc1dedc3c4d52aea479e96b281a7","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-t2v12/results/d908552fb691/bernini_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/d908552fb691/bernini_t2v.jpg new file mode 100644 index 0000000..8766b07 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/d908552fb691/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/d908552fb691/bernini_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/d908552fb691/bernini_t2v.mp4 new file mode 100644 index 0000000..884df3d Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/d908552fb691/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/d908552fb691/launch.json b/projects/video-action-editing/omni-t2v12/results/d908552fb691/launch.json new file mode 100644 index 0000000..6691ef5 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/d908552fb691/launch.json @@ -0,0 +1,131 @@ +{ + "case": { + "index": 5, + "case_id": "d908552fb691", + "name": "Bow to clap", + "page": 7, + "seed": 2026081903, + "prompt": "A woman in a white taekwondo uniform with a black collar and Adidas logo stands in profile against a black background under dramatic side lighting, captured in a static medium shot. In this continuous shot, The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "6c693b009c7e8c0d2f3c4ed680d119e2ef14e800cbabc6a10da0ff2556bb86b8", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/t2v.mp4", + "bernini_t2v_sha256": "704f866e6b6a0615f87d62f9815c61c065519e900d2e70be5a517513994daa3d", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/receipt.json", + "comparison_batch": "progress2_omni6_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/d908552fb691/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081903", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/d908552fb691/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "9f11a79adac35975bf5bcb465e3c8e935472854124d0997dc6922841bc903c30", + "hostname": "auh7-1b-gpu-253", + "job": { + "SLURM_JOB_ID": "213687", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "started_utc": "2026-09-23T08:28:21.078158+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081903 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection." +} diff --git a/projects/video-action-editing/omni-t2v12/results/d908552fb691/omni_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/d908552fb691/omni_t2v.jpg new file mode 100644 index 0000000..a72a488 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/d908552fb691/omni_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/d908552fb691/omni_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/d908552fb691/omni_t2v.mp4 new file mode 100644 index 0000000..0709854 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/d908552fb691/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/d908552fb691/real_target.jpg b/projects/video-action-editing/omni-t2v12/results/d908552fb691/real_target.jpg new file mode 100644 index 0000000..e18fd6c Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/d908552fb691/real_target.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/d908552fb691/real_target.mp4 b/projects/video-action-editing/omni-t2v12/results/d908552fb691/real_target.mp4 new file mode 100644 index 0000000..54a9897 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/d908552fb691/real_target.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/d908552fb691/real_target_receipt.json b/projects/video-action-editing/omni-t2v12/results/d908552fb691/real_target_receipt.json new file mode 100644 index 0000000..766a0e3 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/d908552fb691/real_target_receipt.json @@ -0,0 +1,58 @@ +{ + "case_id": "d908552fb691", + "collected_utc": "2026-09-23T17:35:06.549658+00:00", + "purpose": "review_only", + "used_for_inference": false, + "original": { + "path": "/vast/users/guangyi.chen/dataset/MEV/MEV/videos/317a8639-705d-42b8-b51a-7226e7a3c7a6-00.00.06.631-00.00.10.787-seg2.mp4", + "sha256": "935406db5a168206aea061e44f9f577135605454e1ccb0eaea91828ec28f2d0f" + }, + "original_probe": { + "width": 1280, + "height": 720, + "avg_frame_rate": "24000/1001", + "duration": "4.170833", + "nb_read_frames": "100" + }, + "display": { + "path": "results/d908552fb691/real_target.mp4", + "sha256": "ff161cba09e00e281c6407a3e96e7e359f9900a4d0af4dc6a0d042931aeadcf6", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + }, + "ffmpeg_command": [ + "ffmpeg", + "-hide_banner", + "-loglevel", + "error", + "-y", + "-i", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/real_targets_original/d908552fb691.mp4", + "-map", + "0:v:0", + "-an", + "-vf", + "setpts=(PTS-STARTPTS)*0.776823238906952,fps=25,tpad=stop_mode=clone:stop_duration=3.24,trim=end_frame=81,setpts=N/(25*TB),scale=960:540:force_original_aspect_ratio=decrease:force_divisible_by=2,pad=960:540:(ow-iw)/2:(oh-ih)/2,setsar=1", + "-frames:v", + "81", + "-c:v", + "libx264", + "-crf", + "18", + "-preset", + "fast", + "-threads", + "2", + "-pix_fmt", + "yuv420p", + "-movflags", + "+faststart", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/results/d908552fb691/real_target.mp4" + ], + "full_decode_passed": true +} diff --git a/projects/video-action-editing/omni-t2v12/results/d908552fb691/receipt.json b/projects/video-action-editing/omni-t2v12/results/d908552fb691/receipt.json new file mode 100644 index 0000000..06c0c71 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/d908552fb691/receipt.json @@ -0,0 +1,175 @@ +{ + "status": "complete", + "case": { + "index": 5, + "case_id": "d908552fb691", + "name": "Bow to clap", + "page": 7, + "seed": 2026081903, + "prompt": "A woman in a white taekwondo uniform with a black collar and Adidas logo stands in profile against a black background under dramatic side lighting, captured in a static medium shot. In this continuous shot, The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "6c693b009c7e8c0d2f3c4ed680d119e2ef14e800cbabc6a10da0ff2556bb86b8", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/t2v.mp4", + "bernini_t2v_sha256": "704f866e6b6a0615f87d62f9815c61c065519e900d2e70be5a517513994daa3d", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d908552fb691/receipt.json", + "comparison_batch": "progress2_omni6_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/d908552fb691/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081903", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/d908552fb691/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "9f11a79adac35975bf5bcb465e3c8e935472854124d0997dc6922841bc903c30", + "hostname": "auh7-1b-gpu-253", + "job": { + "SLURM_JOB_ID": "213687", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "started_utc": "2026-09-23T08:28:21.078158+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081903 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection.", + "conditioning": { + "input_prompt": "A woman in a white taekwondo uniform with a black collar and Adidas logo stands in profile against a black background under dramatic side lighting, captured in a static medium shot. In this continuous shot, The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A woman in a crisp white taekwondo uniform stands in profile against a deep black background, her form sharply defined by dramatic side lighting that casts a strong, sculpted shadow along her silhouette. The uniform features a black collar and a subtle Adidas logo on the chest, adding a touch of brand detail to the athletic attire. She is captured in a static medium shot, framed with precision to highlight her poised stance and the clean lines of her posture. The lighting emphasizes the contours of her body, creating a high-contrast, cinematic effect that enhances the intensity of the moment. In a smooth, continuous motion, she brings her hands together in front of her chest, clapping them once with a deliberate, controlled gesture. Her movements are precise and measured, reflecting discipline and focus. The scene remains unchanged throughout—no shifts in camera angle, lighting, or background—maintaining a consistent, composed atmosphere that centers entirely on her presence and action. The stillness of the frame contrasts with the subtle energy of her motion, creating a powerful visual statement of control and readiness.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 85, + 2048 + ], + "t5_context_shape": [ + 236, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 335 + ], + "rank_zero_log_sha256": "4f029607a0c836fa49e9a318191fdfebd6a1aff88df0fe004ff5b9ba44aafa00" + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/d908552fb691/omni_t2v.mp4", + "sha256": "97ca0d377f030e084df41b86b49ad784496e336a90223c1acd81eb886f8366f6", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 533.44, + "completed_utc": "2026-09-23T08:36:57.331581+00:00" +} diff --git a/projects/video-action-editing/omni-t2v12/results/d908552fb691/t2v_conditioning.json b/projects/video-action-editing/omni-t2v12/results/d908552fb691/t2v_conditioning.json new file mode 100644 index 0000000..574a153 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/d908552fb691/t2v_conditioning.json @@ -0,0 +1,19 @@ +{ + "input_prompt": "A woman in a white taekwondo uniform with a black collar and Adidas logo stands in profile against a black background under dramatic side lighting, captured in a static medium shot. In this continuous shot, The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A woman in a crisp white taekwondo uniform stands in profile against a deep black background, her form sharply defined by dramatic side lighting that casts a strong, sculpted shadow along her silhouette. The uniform features a black collar and a subtle Adidas logo on the chest, adding a touch of brand detail to the athletic attire. She is captured in a static medium shot, framed with precision to highlight her poised stance and the clean lines of her posture. The lighting emphasizes the contours of her body, creating a high-contrast, cinematic effect that enhances the intensity of the moment. In a smooth, continuous motion, she brings her hands together in front of her chest, clapping them once with a deliberate, controlled gesture. Her movements are precise and measured, reflecting discipline and focus. The scene remains unchanged throughout\u2014no shifts in camera angle, lighting, or background\u2014maintaining a consistent, composed atmosphere that centers entirely on her presence and action. The stillness of the frame contrasts with the subtle energy of her motion, creating a powerful visual statement of control and readiness.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 85, + 2048 + ], + "t5_context_shape": [ + 236, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 +} \ No newline at end of file diff --git a/projects/video-action-editing/omni-t2v12/results/d977ce147d80/bernini_receipt.json b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/bernini_receipt.json new file mode 100644 index 0000000..e2bcd41 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"72c86e50643180d5462a1cfbd7866503bd47e27b48016cca61e78cbf494287cd","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"df07812ea8d48d3e0fa0ab394ed62e096dd60fcfdfd28616360b60173561fb58","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"bd952f750ac9c0fba0da81749ba7954bb9f023125ce0d7f94e6528a7aec3b972","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"1821d12e74e20c62a3406da3c39354e2e1dff719acc674fe03e1ea3d5ed3039f","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"ad029d8836050c90ebbdeac146df913676f82f1a957d13cbba7fc274dddae653","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"94bab1c3e870a44bb147ab021ba86dd13fe79a9d9236e96e21bca3029f3b9eec","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"a8ac5e4820c0b58cb6b544496076ce1c54641298dd341f135cfb575c764e225f","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"e63ae6bdcc2cd4fc6a1c6c09877fb70a792e194da858195f4adcd9865e516365","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"fc5dceb5bfc6a8a50aa23d4e2e6cc15d6d558172c3e34a85650f37f611674eb5","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"1a56ce494d1b21394b3ad3d7b75d3592116a4b7599f14b99bebb1f8b5e41ff35","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"d110645f18034ba60a6e4d7414c132abdfcb76fb788804ec612af60fc3c5bddf","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"d25a21c01fd7b4e758ef172da8d4f953a0106d5e676d0c2cc6c2aed17c921c02","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"e25ae302ef64edd9f14a03fef40e678245d7e6bd8c3e785d23d69cc319ce3fb6","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"865adedaf9f9db1049576610e242cde606d7439dea343619f73c82d8b7ca450f","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"e55f92c066aea4ceb4049375ab53d391e12a4cc8fef0bd2268e7409663da7540","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"01d9f9d890d22ab6a60aadd0143efb87aab45160079a3f4660b3856b0cb3b064","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"e55f92c066aea4ceb4049375ab53d391e12a4cc8fef0bd2268e7409663da7540","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081905,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"01d9f9d890d22ab6a60aadd0143efb87aab45160079a3f4660b3856b0cb3b064","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"d065f9f4a2e85a3097303bfa6832615de7d2abe241636716db2208f7083dc05b","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"01d9f9d890d22ab6a60aadd0143efb87aab45160079a3f4660b3856b0cb3b064"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"e55f92c066aea4ceb4049375ab53d391e12a4cc8fef0bd2268e7409663da7540","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"01d9f9d890d22ab6a60aadd0143efb87aab45160079a3f4660b3856b0cb3b064","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"e55f92c066aea4ceb4049375ab53d391e12a4cc8fef0bd2268e7409663da7540","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081905,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"01d9f9d890d22ab6a60aadd0143efb87aab45160079a3f4660b3856b0cb3b064","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"828064c90e3e07930cbcec5a0fba7d48bb6d3cb493e763f07fffda4724696e27","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"01d9f9d890d22ab6a60aadd0143efb87aab45160079a3f4660b3856b0cb3b064"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":319,"action_prompt_utf8_sha256":"e405c3746dde5e6718d5d165841db90f2078d73391a04c4e6d309c75e59cea3a","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/d977ce147d80/source-exact81.mp4","source_video_sha256":"e2a056e1af423be25a5beb4b75d1145fbacd625e3316a8e64b6031e75739f80d","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"9d707f3f3e2c15e1ad8fadf35169538f7e380628620773448cc85a9b25dd5058","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/rv2v.mp4","sha256":"ca8c8d8162467af99f51cac705c13ddbdf6a30c19f2b4d75053c9ad71f2a44cd","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"1b387a9a30058c171af5dbbf67722c8edfbeda277f13ed7cf10012f10743d77b","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/t2v.mp4","sha256":"baac904b0402dfab39c956835d36f5c37e2a079d59d47517857c702f3f42f5d6","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"e2a056e1af423be25a5beb4b75d1145fbacd625e3316a8e64b6031e75739f80d","original_pre_snapshot_sha256":"e2a056e1af423be25a5beb4b75d1145fbacd625e3316a8e64b6031e75739f80d","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"e2a056e1af423be25a5beb4b75d1145fbacd625e3316a8e64b6031e75739f80d","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"9cac90cd9e7113aedd3a75fbb3867e553dac93dd7f0077b11d0328635cc90f25","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"b2cb6032bd7dd832c9c87724807bf4206caff68c9a84183460e721087847b768","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"77a92dd70655be7c3a80d59899974e3c0b9bfaa7e1a64b170e51f1b5ccc1a722","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081905,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081905,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"0624a1d4c2f2e1d6d96c4739535d98833a1914de2ae6d6984ed694278ac27afd","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-t2v12/results/d977ce147d80/bernini_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/bernini_t2v.jpg new file mode 100644 index 0000000..256df07 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/d977ce147d80/bernini_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/bernini_t2v.mp4 new file mode 100644 index 0000000..53e617d Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/d977ce147d80/launch.json b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/launch.json new file mode 100644 index 0000000..3500590 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/launch.json @@ -0,0 +1,131 @@ +{ + "case": { + "index": 3, + "case_id": "d977ce147d80", + "name": "Rub eyes then cover face", + "page": 6, + "seed": 2026081905, + "prompt": "A young man with dark skin, dreadlocks, and a gold septum ring lies on a dark couch in a dimly lit room, showing signs of distress. In this continuous shot, The man lying on the couch rubs his tired eyes and covers his face with both hands. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "e405c3746dde5e6718d5d165841db90f2078d73391a04c4e6d309c75e59cea3a", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/t2v.mp4", + "bernini_t2v_sha256": "baac904b0402dfab39c956835d36f5c37e2a079d59d47517857c702f3f42f5d6", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/receipt.json", + "comparison_batch": "progress2_omni6_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/d977ce147d80/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081905", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/d977ce147d80/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "54e178e1d21b606a4d9ae16c9a4df2e90b15e7f14afee9b6deeb8f5d88ac797b", + "hostname": "auh7-1b-gpu-253", + "job": { + "SLURM_JOB_ID": "213687", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "started_utc": "2026-09-23T08:06:32.200611+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081905 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection." +} diff --git a/projects/video-action-editing/omni-t2v12/results/d977ce147d80/omni_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/omni_t2v.jpg new file mode 100644 index 0000000..73144f6 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/omni_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/d977ce147d80/omni_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/omni_t2v.mp4 new file mode 100644 index 0000000..7e6d5c5 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/d977ce147d80/real_target.jpg b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/real_target.jpg new file mode 100644 index 0000000..b736e2e Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/real_target.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/d977ce147d80/real_target.mp4 b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/real_target.mp4 new file mode 100644 index 0000000..de93c0d Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/real_target.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/d977ce147d80/real_target_receipt.json b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/real_target_receipt.json new file mode 100644 index 0000000..fce1b85 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/real_target_receipt.json @@ -0,0 +1,58 @@ +{ + "case_id": "d977ce147d80", + "collected_utc": "2026-09-23T17:35:05.571840+00:00", + "purpose": "review_only", + "used_for_inference": false, + "original": { + "path": "/vast/users/guangyi.chen/dataset/MEV/MEV/videos/4867ced3-df82-498c-876b-4452fe7ffec1-00.00.08.489-00.00.12.425-seg3.mp4", + "sha256": "ac544e4c77f2fa0650d9397cd1fafaff40e6b3ac673385c69cf723fc754ebd30" + }, + "original_probe": { + "width": 1280, + "height": 720, + "avg_frame_rate": "24/1", + "duration": "3.916667", + "nb_read_frames": "94" + }, + "display": { + "path": "results/d977ce147d80/real_target.mp4", + "sha256": "9a2ad5f5fc5fca2da6532ecddbf6d5879e9c09cfcb57b952b8b28758d628cb1e", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + }, + "ffmpeg_command": [ + "ffmpeg", + "-hide_banner", + "-loglevel", + "error", + "-y", + "-i", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/real_targets_original/d977ce147d80.mp4", + "-map", + "0:v:0", + "-an", + "-vf", + "setpts=(PTS-STARTPTS)*0.8272339721503,fps=25,tpad=stop_mode=clone:stop_duration=3.24,trim=end_frame=81,setpts=N/(25*TB),scale=960:540:force_original_aspect_ratio=decrease:force_divisible_by=2,pad=960:540:(ow-iw)/2:(oh-ih)/2,setsar=1", + "-frames:v", + "81", + "-c:v", + "libx264", + "-crf", + "18", + "-preset", + "fast", + "-threads", + "2", + "-pix_fmt", + "yuv420p", + "-movflags", + "+faststart", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/results/d977ce147d80/real_target.mp4" + ], + "full_decode_passed": true +} diff --git a/projects/video-action-editing/omni-t2v12/results/d977ce147d80/receipt.json b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/receipt.json new file mode 100644 index 0000000..96899f2 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/receipt.json @@ -0,0 +1,175 @@ +{ + "status": "complete", + "case": { + "index": 3, + "case_id": "d977ce147d80", + "name": "Rub eyes then cover face", + "page": 6, + "seed": 2026081905, + "prompt": "A young man with dark skin, dreadlocks, and a gold septum ring lies on a dark couch in a dimly lit room, showing signs of distress. In this continuous shot, The man lying on the couch rubs his tired eyes and covers his face with both hands. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "e405c3746dde5e6718d5d165841db90f2078d73391a04c4e6d309c75e59cea3a", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/t2v.mp4", + "bernini_t2v_sha256": "baac904b0402dfab39c956835d36f5c37e2a079d59d47517857c702f3f42f5d6", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/d977ce147d80/receipt.json", + "comparison_batch": "progress2_omni6_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/d977ce147d80/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081905", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/d977ce147d80/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "54e178e1d21b606a4d9ae16c9a4df2e90b15e7f14afee9b6deeb8f5d88ac797b", + "hostname": "auh7-1b-gpu-253", + "job": { + "SLURM_JOB_ID": "213687", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "started_utc": "2026-09-23T08:06:32.200611+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081905 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection.", + "conditioning": { + "input_prompt": "A young man with dark skin, dreadlocks, and a gold septum ring lies on a dark couch in a dimly lit room, showing signs of distress. In this continuous shot, The man lying on the couch rubs his tired eyes and covers his face with both hands. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A young man with dark skin and long dreadlocks lies sprawled across a dark, plush couch in a dimly lit room, the low ambient light casting deep shadows that pool around him. A gold septum ring glints faintly as he shifts slightly, his body tense with quiet unease. The room is still and intimate, the atmosphere heavy with a sense of emotional weight. He lifts his hands slowly, rubbing his tired eyes with the heels of his palms, his fingers pressing into the sockets as if trying to push back exhaustion or pain. Then, with a slow, deliberate motion, he covers his face entirely, pressing both hands against his forehead and cheeks, his breath shallow and uneven. The camera holds steady, capturing the moment in a continuous, unbroken shot—no movement, no cut—allowing the viewer to sit with the man’s distress. The framing remains tight and consistent, focusing on his upper body and face, emphasizing the subtle tremors in his hands and the way his shoulders rise and fall with each labored breath. The lighting remains unchanged, soft and moody, highlighting the contours of his face and the texture of his hair, while the surrounding darkness absorbs all distractions, drawing attention solely to his internal struggle. The scene is quiet, almost still, yet charged with unspoken emotion.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 78, + 2048 + ], + "t5_context_shape": [ + 307, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 399 + ], + "rank_zero_log_sha256": "553e3d91be0dff92c44c637859f9a1428b84512cd4ae3cb64beb94aafe45df43" + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/d977ce147d80/omni_t2v.mp4", + "sha256": "511b0763dc6b87bd4ecb80dae8ba4b95442b8c424f861e2587297e9841316edd", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 778.41, + "completed_utc": "2026-09-23T08:18:48.058409+00:00" +} diff --git a/projects/video-action-editing/omni-t2v12/results/d977ce147d80/t2v_conditioning.json b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/t2v_conditioning.json new file mode 100644 index 0000000..d82e569 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/d977ce147d80/t2v_conditioning.json @@ -0,0 +1,19 @@ +{ + "input_prompt": "A young man with dark skin, dreadlocks, and a gold septum ring lies on a dark couch in a dimly lit room, showing signs of distress. In this continuous shot, The man lying on the couch rubs his tired eyes and covers his face with both hands. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A young man with dark skin and long dreadlocks lies sprawled across a dark, plush couch in a dimly lit room, the low ambient light casting deep shadows that pool around him. A gold septum ring glints faintly as he shifts slightly, his body tense with quiet unease. The room is still and intimate, the atmosphere heavy with a sense of emotional weight. He lifts his hands slowly, rubbing his tired eyes with the heels of his palms, his fingers pressing into the sockets as if trying to push back exhaustion or pain. Then, with a slow, deliberate motion, he covers his face entirely, pressing both hands against his forehead and cheeks, his breath shallow and uneven. The camera holds steady, capturing the moment in a continuous, unbroken shot\u2014no movement, no cut\u2014allowing the viewer to sit with the man\u2019s distress. The framing remains tight and consistent, focusing on his upper body and face, emphasizing the subtle tremors in his hands and the way his shoulders rise and fall with each labored breath. The lighting remains unchanged, soft and moody, highlighting the contours of his face and the texture of his hair, while the surrounding darkness absorbs all distractions, drawing attention solely to his internal struggle. The scene is quiet, almost still, yet charged with unspoken emotion.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 78, + 2048 + ], + "t5_context_shape": [ + 307, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 +} \ No newline at end of file diff --git a/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/bernini_receipt.json b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/bernini_receipt.json new file mode 100644 index 0000000..cbd6c7f --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/bernini_receipt.json @@ -0,0 +1 @@ +{"arms":["t2v","rv2v"],"bernini_commit":"2d2b4591ac053ec25c6371b01a5a6746679e5793","bernini_inference_files":{"bernini/cli.py":"26949fbf246003403ed0cca1ec1bbb62c2099fc9740bb17ba5a1e7c86fbc0edf","bernini/io_utils.py":"233541373746f5d97e1cb3680d3c2a41d5d212b797eefb97693afa6e3ab5f30a","bernini/pipeline.py":"c6acf05c01a637d9bce69e8160eb6eb4260ff4ec798fd990de8e5aa73999ab40"},"checkpoint":{"content":{"every_file_sha256_verified":true,"manifest_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/bernini_counterfactual_identity_orbit_v5_20260808_c099c6f/runtime/source_ea900d5/methods/bernini_action_editing/audits/bernini_r13_ff4c5d4_checkpoint.sha256","manifest_sha256_computed":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","manifest_sha256_expected":"a95ac2d74fc4379134a6276355d472810ef08e3d9de79761f1244375a6fad831","verified_entries_digest":"676e6104eebee3ab1066c70f40af385346b013a3afcab8cafb06c5290994d9ba","verified_file_count":23},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit/checkpoints/Bernini-R-1.3B-Diffusers-ff4c5d4","tree_sha256":"6be0d0db0dd483daf1a843efa2b5aafc20090ad11dc0fc6ee8859bdf150635ca"},"condition_identities":{"full_source_video":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"be2ec7c843e350f5aee025bd2c422f7f0807bfb8a00ef9163443f6d2cc0eafc8","dtype":"torch.float32","finite":true,"label":"full_source_video","numel":1267392,"raw_storage_sha256":"427cc6dd1c8de70592aa52107487a169595bfe529ff3257e8e42f86e8d96b72d","shape":[1,16,21,46,82]}},"rank_zero_broadcasts":{"full_source_video":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,21,46,82]},"prebroadcast_metadata_all_rank_exact":true},"references":{"0":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"27":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"53":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true},"80":{"authoritative_rank":0,"broadcast_before_renderer":true,"contract":{"device_type":"cuda","dtype":"torch.float32","finite":true,"shape":[1,16,1,46,82]},"prebroadcast_metadata_all_rank_exact":true}}},"references":{"0":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"1ff488257f4c4913bef90d7915692a39126bba448dbfaa353b426e60b6a55101","dtype":"torch.float32","finite":true,"label":"source_reference_0","numel":60352,"raw_storage_sha256":"b1d3c7f61584ce40d24116da78f2b01d04d56e3ed2fc0047cc560eb4506589c8","shape":[1,16,1,46,82]}},"27":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"355d79080c4a1dbab48cfe565185fc7700bc41dab83d54842108afce69feeebf","dtype":"torch.float32","finite":true,"label":"source_reference_27","numel":60352,"raw_storage_sha256":"a3467158c9eb3d9b26d1649d9c30054890ab83038ce9f4cd672cbb9c43dbd7be","shape":[1,16,1,46,82]}},"53":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"3cfef1ae9cf793abd6e40329a8c85701d64ba12b99f5c0fe8581542262124a22","dtype":"torch.float32","finite":true,"label":"source_reference_53","numel":60352,"raw_storage_sha256":"6323273e4f2f031e2e9c2c3d9e921440c437ecc9fa3c26646853f7ba7d8077e7","shape":[1,16,1,46,82]}},"80":{"all_rank_exact":true,"identity":{"byte_count":241408,"content_sha256":"6d2c3d2b8d525cf1abc7a361f0a301c2d8f7ed88f1e291b35c08fa50a1f9382a","dtype":"torch.float32","finite":true,"label":"source_reference_80","numel":60352,"raw_storage_sha256":"4c1c4a145f5ba323088768417cfbdf05b2d66a9e1da94e3fc99e3b325ac32c68","shape":[1,16,1,46,82]}}}},"conditioning":{"rv2v":{"full_source_video_count":1,"reference_encoding":"independent_rgb_frame_to_wan_vae_[1,C,1,H,W]","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":4,"source_frame_indices":[0,27,53,80],"source_ids":{"conditioning_source_count":5,"max_conditioning_source_id":5,"reference_source_ids":[2,3,4,5],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[1],"within_pretrained_source_ids_1_through_5":true}},"t2v":{"full_source_video_count":0,"reference_encoding":"none","reference_from_temporal_video_latent_slice":false,"source_derived_reference_count":0,"source_frame_indices":[],"source_ids":{"conditioning_source_count":0,"max_conditioning_source_id":0,"reference_source_ids":[],"source_id_interpolation_required":false,"target_source_id":0,"video_source_ids":[],"within_pretrained_source_ids_1_through_5":true}}},"experimental_canary":true,"freeze_certificate":{"base_frozen":true,"lora_module_count":0,"trainable_parameter_elements":0,"trainable_parameter_tensors":0},"generated_identities":{"rv2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"238f4c2e3e40cbb7ac6259faa16b3ff16e38ff7cfcc176d62e94851846de9b12","dtype":"torch.float32","finite":true,"label":"generated_rv2v","numel":1267392,"raw_storage_sha256":"5718f07d21edd62047391d2515ed5127f79f1f8715dc00377806d203d9d04090","shape":[1,16,21,46,82]}},"t2v":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"edc38a275746d7496fa00e90d2a0ba17e66955d03d1eba92eaf024b732fae80a","dtype":"torch.float32","finite":true,"label":"generated_t2v","numel":1267392,"raw_storage_sha256":"6fedaeb17291e306b62822478503eccc85ae4a921c10aa3ec9de65874bd4d807","shape":[1,16,21,46,82]}}},"initial_noise_artifacts":{"rv2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"8e26e2774c3334500f1e28fff468a12f9610f73dfb627888e689f22068537982","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_rv2v","numel":1267392,"raw_storage_sha256":"2bc2848ee815333fa0b799f191ac39d42be9cfd6ef050b340fe02ce6328c7f91","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"8e26e2774c3334500f1e28fff468a12f9610f73dfb627888e689f22068537982","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081901,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/rv2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"2bc2848ee815333fa0b799f191ac39d42be9cfd6ef050b340fe02ce6328c7f91","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"80f61359e9dab41655add1772843bb06f0c0a150b53201e90c123340076545a3","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"2bc2848ee815333fa0b799f191ac39d42be9cfd6ef050b340fe02ce6328c7f91"},"t2v":{"all_rank_identity":{"all_rank_exact":true,"identity":{"byte_count":5069568,"content_sha256":"8e26e2774c3334500f1e28fff468a12f9610f73dfb627888e689f22068537982","dtype":"torch.float32","finite":true,"label":"official_initial_gaussian_t2v","numel":1267392,"raw_storage_sha256":"2bc2848ee815333fa0b799f191ac39d42be9cfd6ef050b340fe02ce6328c7f91","shape":[1,16,21,46,82]}},"byte_count":5069568,"captured_from_native_sampler":true,"content_sha256":"8e26e2774c3334500f1e28fff468a12f9610f73dfb627888e689f22068537982","coordinate":"bernini_native_target_latent_before_rearrange","dtype":"torch.float32","external_initial_noise_injection":false,"generator_device":"cpu","generator_initial_seed":2026081901,"numel":1267392,"observer_added_device_to_cpu_readback":true,"observer_changed_return_value":false,"observer_only":true,"official_module_global_symbol":"bernini.models.wan_diffusion.randn_tensor","official_randn_tensor_call_count":1,"origin":"observed_return_of_official_module_global_randn_tensor","original_callable_invoked_once_with_unchanged_arguments":true,"original_device":"cuda:0","original_return_tensor_forwarded_by_identity":true,"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/t2v.official-initial-gaussian.safetensors","randn_tensor_call_count":1,"raw_value_sha256":"2bc2848ee815333fa0b799f191ac39d42be9cfd6ef050b340fe02ce6328c7f91","requested_device":"cuda:0","requested_dtype":"torch.float32","roundtrip_raw_value_exact":true,"sampler_noise_replacement":false,"sha256":"4d021febf8e301d05621bcdfa8e3206208560a0ad22191f2a3b180b5cfd87489","shape":[1,16,21,46,82],"source_or_target_derived":false,"stored_device":"cpu","stored_dtype":"torch.float32","tensor_key":"official_initial_gaussian","tensor_value_sha256":"2bc2848ee815333fa0b799f191ac39d42be9cfd6ef050b340fe02ce6328c7f91"}},"input":{"accepted_external_conditions":["source_video","action_prompt"],"action_prompt_utf8_bytes":283,"action_prompt_utf8_sha256":"bd72848533d16119920aa2d3e0b34a8ea82f3fad6c6f39444239e22523d11397","external_first_frame_anchor":false,"external_mask_flow_pose_track_trajectory":false,"external_reference_image_or_video":false,"source_video_path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/preprocessed_sources/fb7725c351ba/source-exact81.mp4","source_video_sha256":"479ee891773dfffc3299149103ee2ef37f4bb63f213b1c4c7cbd5391ebd4704a","target_video":false},"interpretation":{"best_arm_selected":false,"purpose":"test_native_identity_conditioned_generation_before_training","quality_claim":false,"training_performed":false},"latent_geometry":{"one_reference_patch_tokens":943,"per_arm_total_visual_tokens":{"r2v":24518,"rv2v":43378,"t2v":19803},"reference_latent_shape":[1,16,1,46,82],"target_patch_tokens":19803,"video_latent_shape":[1,16,21,46,82]},"method":"frozen-bernini-native-identity-generation-canary","method_source_archive_sha256":"fc4a5b08df0da1ba264543753f356d116174f507cdc3b6ba45b55535c7f09619","method_source_revision":"f47f9d3630142d7c20bc6c163a52405aac249a4f","outputs":{"rv2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/rv2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"83881ae8d5619c4ee3c5a65fa0c8ae72a04bee424ef55f3e0910e6fe2379f892","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/rv2v.mp4","sha256":"87307f240a0e050c8f680b4eac960017786cf75a0820c8259b9352b6d72b2697","width":656},"t2v":{"fps":25,"frame_count":81,"height":368,"normalized_clean_latent":{"artifact_role":"native_sampler_proposal","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":true,"origin":"native_sampler_before_vae_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/t2v.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"5fd51078c80f15fff389d0d400d841905760a642ece9c3896faa34fc39f512d0","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":false,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/t2v.mp4","sha256":"bad550261470a3d6befacf71a1d41ee5923dc74764aaa990f4e164fcac9a000c","width":656}},"preprocessing":{"decoded_from_private_byte_snapshot":true,"external_shared_i0":false,"fps":25.0,"frame_count":81,"max_pixels":245760,"original_post_snapshot_sha256":"479ee891773dfffc3299149103ee2ef37f4bb63f213b1c4c7cbd5391ebd4704a","original_pre_snapshot_sha256":"479ee891773dfffc3299149103ee2ef37f4bb63f213b1c4c7cbd5391ebd4704a","original_stat_identity_stable":true,"reported_fps":25.0,"resize":"torchvision_bicubic_antialias_true","snapshot_sha256":"479ee891773dfffc3299149103ee2ef37f4bb63f213b1c4c7cbd5391ebd4704a","source_derived_bucket_hw":[368,656],"source_input_hw":[720,1280],"spatial_policy":"sqrt_max_pixels_then_floor_each_dimension_to_stride","stride":16,"temporal_policy":"all_integer_frames_0_through_80_no_subsampling"},"production_claim_forbidden":true,"prompt_contract":{"rv2v":{"binding_clause_sha256":"8574f7e8b0f996a84da5e01fc31154dfcd197da2d371800f40f03bbfa0e28d4b","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"415b29b662b33ef06f3e969637acb45a29bd5087fd1820764ed6195e848d89d6","guidance_mode":"rv2v","inference_arm":"rv2v","system_prompt_sha256":"de4b6a32c46d3e9f1172c2801f8f29c18a448f7b1f3c907d91b3f87c4870aca2","tokenizer_fix_mistral_regex":true,"training_task_name":"vr2v"},"t2v":{"binding_clause_sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","cleaner":"diffusers.pipelines.wan.pipeline_wan.prompt_clean","full_prompt_sha256":"bca668cb7c69fd3dbcb1ba6823f0196d601fd967f1210b44ca1a6fa468dba78b","guidance_mode":"t2v_apg","inference_arm":"t2v","system_prompt_sha256":"31641ecb2329849be215b334ee550241479e84b3306e148369f6a076b23002e8","tokenizer_fix_mistral_regex":true,"training_task_name":"t2v"}},"receipt_digest":"9572eb83bd3c5e2e5e83bf1fbcd4b90b9ace53a6e1a222c1e1f4f37b2a9b335d","runtime_versions":{"diffusers":"0.38.0","torch":"2.7.1+rocm6.3","torch_hip":"6.3.42131-fa1d09cbd","transformers":"5.5.4"},"sampling":{"rv2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"rv2v","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081901,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4},"t2v":{"custom_sampler_or_scheduler":false,"eta":0.5,"flow_shift":5.0,"guidance_mode":"t2v_apg","momentum":0.0,"norm_threshold":[50.0,50.0],"num_frames":81,"num_inference_steps":40,"omega_img":4.5,"omega_scale":0.8,"omega_txt":4.0,"omega_vid":1.25,"same_seed_and_target_shape_across_arms":true,"seed":2026081901,"single_expert":"transformer_1","target_initialization":"official_gen_wanx22_fresh_gaussian","target_mixed_with_source_latent":false,"ulysses_size":4}},"schema_version":"bernini-native-identity-generation-canary-v1","scientific_claim_authorized":false,"source_condition_artifact":{"artifact_role":"source_video_condition","coordinate":"bernini_normalized_clean_vae_latent","mp4_decode_reencode_used":false,"native_sampler_before_vae_decode":false,"origin":"source_video_vae_encode_before_any_decode","path":"/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/source.normalized-clean-latent.safetensors","roundtrip_byte_exact_fp32":true,"sampler_return_dtype":"torch.float32","sha256":"0f7f845f1edcb7af7bdcf32c7864946527f388070ceb4f31f42415de538e2b08","shape":[1,16,21,46,82],"source_video_vae_encode_before_any_decode":true,"stored_dtype":"torch.float32","tensor_key":"normalized_clean_latent"},"veomni_commit":"f90b3dc6fbb0ce693745223cc7a94064123dbf4d"} diff --git a/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/bernini_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/bernini_t2v.jpg new file mode 100644 index 0000000..c586d3c Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/bernini_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/bernini_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/bernini_t2v.mp4 new file mode 100644 index 0000000..45d0cf2 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/bernini_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/launch.json b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/launch.json new file mode 100644 index 0000000..e1ee5b7 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/launch.json @@ -0,0 +1,131 @@ +{ + "case": { + "index": 6, + "case_id": "fb7725c351ba", + "name": "提杠铃 · Barbell lift", + "page": null, + "seed": 2026081901, + "prompt": "A woman in black activewear performs barbell deadlifts with focused determination in a well-equipped home gym. In this continuous shot, The woman in a home gym lifts a barbell from the floor to her waist. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "bd72848533d16119920aa2d3e0b34a8ea82f3fad6c6f39444239e22523d11397", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/t2v.mp4", + "bernini_t2v_sha256": "bad550261470a3d6befacf71a1d41ee5923dc74764aaa990f4e164fcac9a000c", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/receipt.json", + "comparison_batch": "progress2_omni6_extra_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/fb7725c351ba/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081901", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/fb7725c351ba/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "afda3b5eae7e6735b7e51101193b6da532c3845d203e519519e24c1d0488b73b", + "hostname": "auh7-1b-gpu-287", + "job": { + "SLURM_JOB_ID": "213688", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T08:06:59.576739+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081901 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection." +} diff --git a/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/omni_t2v.jpg b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/omni_t2v.jpg new file mode 100644 index 0000000..920c002 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/omni_t2v.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/omni_t2v.mp4 b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/omni_t2v.mp4 new file mode 100644 index 0000000..c763267 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/omni_t2v.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/real_target.jpg b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/real_target.jpg new file mode 100644 index 0000000..7f8f852 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/real_target.jpg differ diff --git a/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/real_target.mp4 b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/real_target.mp4 new file mode 100644 index 0000000..964d873 Binary files /dev/null and b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/real_target.mp4 differ diff --git a/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/real_target_receipt.json b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/real_target_receipt.json new file mode 100644 index 0000000..1bdf92c --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/real_target_receipt.json @@ -0,0 +1,58 @@ +{ + "case_id": "fb7725c351ba", + "collected_utc": "2026-09-23T17:35:12.301202+00:00", + "purpose": "review_only", + "used_for_inference": false, + "original": { + "path": "/vast/users/guangyi.chen/dataset/MEV/MEV/videos/11ea4341-888a-41c7-9482-49046d1e113b-00.00.01.984-00.00.04.353-seg2.mp4", + "sha256": "5b49f9be6549c6fef6cc803eb278b83e9cbaa7f1ef8de299d24433ba79dd1b3c" + }, + "original_probe": { + "width": 1280, + "height": 720, + "avg_frame_rate": "25/1", + "duration": "2.440000", + "nb_read_frames": "61" + }, + "display": { + "path": "results/fb7725c351ba/real_target.mp4", + "sha256": "4c783a0078c94ec89c48be96a9ccf4cdf736ac5f7593164cf86b79bdaeb0f88b", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + }, + "ffmpeg_command": [ + "ffmpeg", + "-hide_banner", + "-loglevel", + "error", + "-y", + "-i", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/real_targets_original/fb7725c351ba.mp4", + "-map", + "0:v:0", + "-an", + "-vf", + "setpts=(PTS-STARTPTS)*1.32786885245902,fps=25,tpad=stop_mode=clone:stop_duration=3.24,trim=end_frame=81,setpts=N/(25*TB),scale=960:540:force_original_aspect_ratio=decrease:force_divisible_by=2,pad=960:540:(ow-iw)/2:(oh-ih)/2,setsar=1", + "-frames:v", + "81", + "-c:v", + "libx264", + "-crf", + "18", + "-preset", + "fast", + "-threads", + "2", + "-pix_fmt", + "yuv420p", + "-movflags", + "+faststart", + "/Users/siriuschu/ML/VideoEditing/VideoEdit/artifacts/progress2_omni_t2v12_20260923/results/fb7725c351ba/real_target.mp4" + ], + "full_decode_passed": true +} diff --git a/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/receipt.json b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/receipt.json new file mode 100644 index 0000000..2cbd934 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/receipt.json @@ -0,0 +1,175 @@ +{ + "status": "complete", + "case": { + "index": 6, + "case_id": "fb7725c351ba", + "name": "提杠铃 · Barbell lift", + "page": null, + "seed": 2026081901, + "prompt": "A woman in black activewear performs barbell deadlifts with focused determination in a well-equipped home gym. In this continuous shot, The woman in a home gym lifts a barbell from the floor to her waist. The same subject identity, scene, lighting, framing, and camera remain stable.", + "prompt_sha256": "bd72848533d16119920aa2d3e0b34a8ea82f3fad6c6f39444239e22523d11397", + "bernini_t2v": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/t2v.mp4", + "bernini_t2v_sha256": "bad550261470a3d6befacf71a1d41ee5923dc74764aaa990f4e164fcac9a000c", + "bernini_receipt": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/mev_action_anchor_target_gap16_20260819_v1/generation/fb7725c351ba/receipt.json", + "comparison_batch": "progress2_omni6_extra_20260923" + }, + "command": [ + "/vast/users/guangyi.chen/anaconda3/envs/vace/bin/python3.12", + "-m", + "torch.distributed.run", + "--standalone", + "--nproc-per-node", + "1", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/fb7725c351ba/attempt-001/omni_runtime/tools/inference/generate_omni_v2v_1_3B.py", + "--task", + "t2v-1.3B", + "--size", + "832*480", + "--frame_num", + "81", + "--sample_fps", + "25", + "--sample_shift", + "5", + "--sample_solver", + "unipc", + "--sample_steps", + "40", + "--sample_guide_scale", + "3", + "--base_seed", + "2026081901", + "--classifier_free_ratio", + "0", + "--ckpt_dir", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "--new_checkpoint", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e/transformer/pytorch_model.pt", + "--use_usp", + "false", + "--sp_size", + "1", + "--t5_fsdp", + "false", + "--dit_fsdp", + "false", + "--max_context_len", + "9216", + "--qwen3vl_dtype", + "bf16", + "--qwen3vl_device_map", + "balanced_low_0", + "--qwen3vl_temperature", + "0", + "--qwen3vl_model_path", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "--prompt_file", + "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/work/fb7725c351ba/attempt-001/text_only_input.jsonl" + ], + "model": { + "family": "Fudan-FUXI/OmniVideo2-1.3B", + "checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/action_editing_shared8_20260805_10932d4/models/OmniVideo2-1.3B-composite-d994028e", + "transformer_sha256": "f269fe8c6b35993bbb4ea340c535ee9893928ea215fb8c4be3d5e9f122d844d6", + "special_tokens_sha256": "72129ce9ade25aa0fbf738c005d3dc090c1b6c45918580e1c683b6ecef726ad4", + "umt5_checkpoint_sha256": "7cace0da2b446bbbbc57d031ab6cf163a3d59b366da94e5afe36745b746fd81d", + "vae_checkpoint_sha256": "38071ab59bd94681c686fa51d75a1968f64e470262043be31f7a094e442fd981", + "umt5_plus_tokenizer_prior_identity_manifest_sha256": "99bec3d4e1a5c50694eb95d3fbec880d32bac8c0536c3dea8080b459f90e32cd", + "qwen_checkpoint_path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/marp_omnivideo2_maskfree/models/Qwen3-VL-30B-A3B-Instruct", + "qwen_prior_identity_manifest_sha256": "5a0c83274293904863d5aed304385e906afa02dc04d36e9b34ac8383775b78be", + "qwen_prior_identity_file_count": 25, + "qwen_prior_identity_total_bytes": 62153207155, + "adaptation": "official_base_no_project_MARP_adapter", + "official_revision": "adcee0a4a5b439ad3615f825298221b21177d4e3", + "official_archive_sha256": "2095a1b0449215fcb8151aac76584b6b2fb4a99541e30e0bb986901a81007ffd", + "official_unified_model_sha256": "739addc6b46c62fb389cf037736d52837d8e0fc911d84e3ad7db05e094ee7328", + "official_generate_entry_sha256": "f7cb67288d9a860a92fa0a548b139d6a15194b1a7db837b04889dc8d75b36be6", + "patched_unified_model_sha256": "7d1dee31b4cb2632cce7ee722e3ce2f43fbbf75c6f93203aaccf5b568efbba0d", + "patched_generate_entry_sha256": "d46a0b3863944689c1566722b299745f531c6baacafa67f9902a4101e4517973", + "runtime_patch_contract": [ + "T2V entrypoint adaptation for single-model 1.3B", + "strict-equivalent checkpoint load", + "reject all input-media reads and source VAE encoding", + "reject visual tokens and context truncation" + ], + "official_t2v_entry_sha256": "f3e3ad47d37e436a6a633da07e5156dcd9238d635f94f4470d289067942d0284", + "official_vlm_helper_sha256": "8aa7e97603094dfeeb5e9b02bfe294d7dce3fad780eed1e43cc044efa56d295f", + "transplanted_t2v_conditioning_block_sha256": "94d0f178304d21781651cb26386d8ea8f191f872f9e8424912461cb6bfea4279", + "entrypoint_adaptation": "Official T2V Qwen/T5 conditioning block transplanted unchanged into official 1.3B single-checkpoint entry; no model/sampler changes." + }, + "manifest_sha256": "e8ad3586da335f84e80987c146fb54347127cd9e0d57b89c1ded65d12c65ded5", + "driver_sha256": "e79d83272c2286c25f01674c11270081ed21fbafe4844bdc6b6c16a2c1ddf453", + "runtime_adapter_sha256": "fff4529cc4e52dde617c2cb8b056cdd8772985520bf90407b27baab0f9be0770", + "prompt_file_sha256": "afda3b5eae7e6735b7e51101193b6da532c3845d203e519519e24c1d0488b73b", + "hostname": "auh7-1b-gpu-287", + "job": { + "SLURM_JOB_ID": "213688", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "started_utc": "2026-09-23T08:06:59.576739+00:00", + "inference_inputs": [ + "text_prompt" + ], + "source_video_used": false, + "real_target_used": false, + "reference_media_used": false, + "sampler": { + "name": "unipc", + "steps": 40, + "cfg": 3, + "flow_shift": 5, + "seed": 2026081901 + }, + "geometry": { + "width": 832, + "height": 480, + "frames": 81, + "fps": 25 + }, + "text_contract": "Exact Bernini T2V body caption; native Omni Qwen text-only expansion and features, then T5. No Bernini task-prefix injection.", + "conditioning": { + "input_prompt": "A woman in black activewear performs barbell deadlifts with focused determination in a well-equipped home gym. In this continuous shot, The woman in a home gym lifts a barbell from the floor to her waist. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A woman in sleek black activewear performs a series of controlled barbell deadlifts in a well-equipped home gym, her movements precise and deliberate. The camera holds a steady, medium-wide shot, capturing her full body as she stands with feet shoulder-width apart, gripping the barbell with a firm overhand hold. With focused determination etched on her face, she bends at the hips and knees, lowering the barbell smoothly from the floor to her waist, maintaining a straight back and engaged core throughout. The gym is bathed in soft, even lighting that highlights the clean, organized space—treadmills, weight racks, and resistance bands visible in the background. The scene remains consistent, with no changes in framing, camera angle, or lighting, emphasizing the continuity and rhythm of her exercise. Her breath is steady, her muscles taut, as she repeats the motion with unwavering form, the metallic clink of the barbell echoing faintly in the quiet room. The atmosphere is one of quiet intensity, underscoring her commitment and strength.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 65, + 2048 + ], + "t5_context_shape": [ + 243, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 322 + ], + "rank_zero_log_sha256": "329d3cbfb8739a2bd3f2683b42a4efd725f0e02a935aa0908ae813b354bd02a9" + }, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/fb7725c351ba/omni_t2v.mp4", + "sha256": "032ff8669d17b5b23b66c8f92b0119b23484b8011eed7238f7509b3d8c77b6f9", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "full_decode_passed": true, + "elapsed_seconds": 773.34, + "completed_utc": "2026-09-23T08:19:13.031682+00:00" +} diff --git a/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/t2v_conditioning.json b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/t2v_conditioning.json new file mode 100644 index 0000000..3909eb1 --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/results/fb7725c351ba/t2v_conditioning.json @@ -0,0 +1,19 @@ +{ + "input_prompt": "A woman in black activewear performs barbell deadlifts with focused determination in a well-equipped home gym. In this continuous shot, The woman in a home gym lifts a barbell from the floor to her waist. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A woman in sleek black activewear performs a series of controlled barbell deadlifts in a well-equipped home gym, her movements precise and deliberate. The camera holds a steady, medium-wide shot, capturing her full body as she stands with feet shoulder-width apart, gripping the barbell with a firm overhand hold. With focused determination etched on her face, she bends at the hips and knees, lowering the barbell smoothly from the floor to her waist, maintaining a straight back and engaged core throughout. The gym is bathed in soft, even lighting that highlights the clean, organized space\u2014treadmills, weight racks, and resistance bands visible in the background. The scene remains consistent, with no changes in framing, camera angle, or lighting, emphasizing the continuity and rhythm of her exercise. Her breath is steady, her muscles taut, as she repeats the motion with unwavering form, the metallic clink of the barbell echoing faintly in the quiet room. The atmosphere is one of quiet intensity, underscoring her commitment and strength.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 65, + 2048 + ], + "t5_context_shape": [ + 243, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 +} \ No newline at end of file diff --git a/projects/video-action-editing/omni-t2v12/summary.json b/projects/video-action-editing/omni-t2v12/summary.json new file mode 100644 index 0000000..0ce66ab --- /dev/null +++ b/projects/video-action-editing/omni-t2v12/summary.json @@ -0,0 +1,782 @@ +[ + { + "case_id": "fb7725c351ba", + "name": "提杠铃 · Barbell lift", + "seed": 2026081901, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/fb7725c351ba/omni_t2v.mp4", + "sha256": "032ff8669d17b5b23b66c8f92b0119b23484b8011eed7238f7509b3d8c77b6f9", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "job": { + "SLURM_JOB_ID": "213688", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "hostname": "auh7-1b-gpu-287", + "elapsed_seconds": 773.34, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 322 + ], + "rank_zero_log_sha256": "329d3cbfb8739a2bd3f2683b42a4efd725f0e02a935aa0908ae813b354bd02a9" + }, + "conditioning": { + "input_prompt": "A woman in black activewear performs barbell deadlifts with focused determination in a well-equipped home gym. In this continuous shot, The woman in a home gym lifts a barbell from the floor to her waist. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A woman in sleek black activewear performs a series of controlled barbell deadlifts in a well-equipped home gym, her movements precise and deliberate. The camera holds a steady, medium-wide shot, capturing her full body as she stands with feet shoulder-width apart, gripping the barbell with a firm overhand hold. With focused determination etched on her face, she bends at the hips and knees, lowering the barbell smoothly from the floor to her waist, maintaining a straight back and engaged core throughout. The gym is bathed in soft, even lighting that highlights the clean, organized space—treadmills, weight racks, and resistance bands visible in the background. The scene remains consistent, with no changes in framing, camera angle, or lighting, emphasizing the continuity and rhythm of her exercise. Her breath is steady, her muscles taut, as she repeats the motion with unwavering form, the metallic clink of the barbell echoing faintly in the quiet room. The atmosphere is one of quiet intensity, underscoring her commitment and strength.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 65, + 2048 + ], + "t5_context_shape": [ + 243, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "real_target": { + "path": "results/fb7725c351ba/real_target.mp4", + "sha256": "4c783a0078c94ec89c48be96a9ccf4cdf736ac5f7593164cf86b79bdaeb0f88b", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + } + }, + { + "case_id": "3fadbe0c2961", + "name": "狗转头 · Dog head turn", + "seed": 2026081902, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/3fadbe0c2961/omni_t2v.mp4", + "sha256": "6b28c93fda92e5fa29cfe7e1954ee29dd4c6e1d594b657d7a9cf7df195b67e56", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "job": { + "SLURM_JOB_ID": "213688", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "hostname": "auh7-1b-gpu-287", + "elapsed_seconds": 555.7, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 341 + ], + "rank_zero_log_sha256": "2a6eb521a55ce5cdc05902458c5a2b863cb3532531dd394b6fc5278eac4aa7db" + }, + "conditioning": { + "input_prompt": "A happy Pembroke Welsh Corgi with a reddish-brown and white coat sits in a sunny green field, panting with its tongue out in a static medium shot. In this continuous shot, The dog turns its head further to the right while sitting in the grass. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A happy Pembroke Welsh Corgi with a rich reddish-brown and white coat sits calmly in a sun-drenched green field, its short legs tucked beneath its sturdy body. The warm sunlight bathes the scene, casting soft highlights across the dog’s smooth fur and illuminating the vibrant blades of grass around it. The corgi pants gently, its pink tongue lolling out in a relaxed, joyful expression, conveying a sense of contentment and ease. The camera holds a steady, static medium shot, framing the dog from the mid-chest up, allowing full view of its expressive face and perked ears. As the moment unfolds, the dog slowly turns its head further to the right, its eyes briefly scanning the surroundings with quiet curiosity, while its body remains still. The lush green field stretches out behind it, dotted with wildflowers and bathed in golden afternoon light. The scene remains consistent throughout—same subject, same environment, same lighting, same framing—capturing a peaceful, serene moment in nature, with the corgi as the calm, cheerful centerpiece.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 77, + 2048 + ], + "t5_context_shape": [ + 250, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "real_target": { + "path": "results/3fadbe0c2961/real_target.mp4", + "sha256": "2d97f922dbbaab42d8fb0ff8419410dc7275ddf07d301b1113871e2d651c1e4f", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + } + }, + { + "case_id": "7077cfb160cf", + "name": "长椅上写字 · Write in notebook", + "seed": 2026081904, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/7077cfb160cf/omni_t2v.mp4", + "sha256": "061290c54920d2b552b84b511873f10ead41e881d0f091fc11d0323e97e96427", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "job": { + "SLURM_JOB_ID": "213688", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "hostname": "auh7-1b-gpu-287", + "elapsed_seconds": 540.8, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 320 + ], + "rank_zero_log_sha256": "2974e23fa644b0fa38f0a8091e8bf9fd9ef15ef20ffdb210b14d8a3d1aa75546" + }, + "conditioning": { + "input_prompt": "A young woman with shoulder-length light brown hair sits on a wooden bench in a sunny park or campus setting, writing in a notebook while dressed in a pink shirt and blue jeans. In this continuous shot, The young woman sitting on a park bench thoughtfully writes in her notebook with a pen. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A young woman with shoulder-length light brown hair sits calmly on a weathered wooden bench in a sun-drenched park or campus setting, the golden light of midday filtering through the leaves of nearby trees. She wears a soft pink button-up shirt and fitted blue jeans, her posture relaxed yet focused as she leans slightly forward, pen in hand, writing thoughtfully in a small notebook resting on her lap. Her brow is gently furrowed in concentration, occasionally pausing to glance up and around, as if gathering inspiration from the peaceful surroundings. The camera holds steady in a medium shot, capturing her from the waist up, with the background softly blurred to emphasize her presence—dappled sunlight dances across the grass and pavement, and the faint rustle of leaves and distant chatter of people passing by add a gentle soundtrack to the scene. The composition remains unchanged throughout, maintaining consistent framing, lighting, and perspective, creating a serene, contemplative moment frozen in time.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 80, + 2048 + ], + "t5_context_shape": [ + 226, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "real_target": { + "path": "results/7077cfb160cf/real_target.mp4", + "sha256": "03a7b92dc3800e8403ce9f7f4ce85b9668a85a82e110e0356e614d4626496bc3", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + } + }, + { + "case_id": "7e488525099e", + "name": "转身倚车 · Turn and lean on car", + "seed": 2026081906, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/7e488525099e/omni_t2v.mp4", + "sha256": "bf577e972362491fe79f36079915ac95bd4110ff4a2278184e1c284260ad64e2", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "job": { + "SLURM_JOB_ID": "213688", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "hostname": "auh7-1b-gpu-287", + "elapsed_seconds": 772.82, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 346 + ], + "rank_zero_log_sha256": "2cb8628e967b63c4350488a3109cc8bf44c4e79d0bf6ed4828dc3a9486f3b76e" + }, + "conditioning": { + "input_prompt": "A confident woman in red pants and a black leather jacket poses in front of a black Chevrolet Camaro in a moody, red-lit underground parking garage. In this continuous shot, The woman in a black leather jacket and red pants turns and leans back against the hood of the black car. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A confident woman stands in front of a sleek black Chevrolet Camaro in a moody, dimly lit underground parking garage, bathed in a deep, ambient red glow that casts dramatic shadows across the concrete walls and floor. She wears a form-fitting black leather jacket and vibrant red pants that contrast sharply with the dark surroundings, drawing the eye to her poised stance. The camera holds steady in a continuous, smooth shot, capturing her as she turns with deliberate grace, her movement fluid and intentional. She leans back against the curved hood of the car, her body angled slightly, one hand resting lightly on the glossy surface while the other hangs relaxed at her side. The red lighting pulses subtly, reflecting off the car’s polished paint and the woman’s jacket, enhancing the cinematic atmosphere. The scene remains tightly framed, with the Camaro’s aggressive lines and the woman’s commanding presence forming a powerful visual composition. The lighting, framing, and camera position remain consistent throughout, emphasizing the stillness and intensity of the moment, as if frozen in time.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 80, + 2048 + ], + "t5_context_shape": [ + 252, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "real_target": { + "path": "results/7e488525099e/real_target.mp4", + "sha256": "30c8909ffd3c044c78714102c8d24dc38cf3547c123f0be2deb43390a5732ec3", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + } + }, + { + "case_id": "d5221a1b69d5", + "name": "闭眼尝汤 · Taste from ladle", + "seed": 2026081907, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/d5221a1b69d5/omni_t2v.mp4", + "sha256": "77cbffd0f6650d641829a18b2f5dc7244c69ee0d430ca1f5e2a5efaa44e984e2", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "job": { + "SLURM_JOB_ID": "213688", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "hostname": "auh7-1b-gpu-287", + "elapsed_seconds": 552.79, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 358 + ], + "rank_zero_log_sha256": "553659a0edaf6f48af82c44481a5de73ec1c71aac3c3a88556e15fb616195053" + }, + "conditioning": { + "input_prompt": "A young woman in a patterned apron stands in a modern kitchen, tasting food from a ladle with a satisfied expression. In this continuous shot, The woman in an apron closes her eyes as she tastes from a metal ladle. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A young woman stands in a bright, modern kitchen, her figure centered in a steady, continuous shot. She wears a patterned apron over casual clothing, the fabric soft and slightly rumpled from use. The kitchen is sleek and well-lit, with natural light streaming through a large window, casting a warm glow across stainless steel appliances and clean white countertops. In her hand, she holds a metal ladle, its surface gleaming under the light. She lifts it slowly to her lips, her eyes closing gently as she tastes the food. Her expression softens into quiet satisfaction—lips parting slightly, a subtle smile forming as the flavor registers. The camera remains fixed, capturing the moment with unwavering focus, preserving the stillness of the scene. The lighting remains consistent, highlighting the contours of her face and the texture of the apron. The background remains unchanged—neatly arranged utensils, a pot simmering on the stove, a bowl of fresh herbs on the counter—all contributing to the calm, domestic atmosphere. The shot lingers, emphasizing the sensory experience, the quiet joy of a meal well-prepared, and the simple pleasure of tasting one’s own creation.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 70, + 2048 + ], + "t5_context_shape": [ + 274, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "real_target": { + "path": "results/d5221a1b69d5/real_target.mp4", + "sha256": "3b61c8123a193d9feab392a7780ea5b87b91099a2c41ea069875febc81ea9f4e", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + } + }, + { + "case_id": "40712e1341dc", + "name": "放下手机后翻身睡觉 · Put phone away and sleep", + "seed": 2026081911, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/40712e1341dc/omni_t2v.mp4", + "sha256": "5ed0844a80af94da135f1290f1307c584e6c5ce29418f8a90f3d940405b2ca11", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "job": { + "SLURM_JOB_ID": "213688", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "hostname": "auh7-1b-gpu-287", + "elapsed_seconds": 539.42, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 333 + ], + "rank_zero_log_sha256": "762bda731c46287b756b96674e0f3034c5c36417e76e21e33835ff39d69d3781" + }, + "conditioning": { + "input_prompt": "A young man with dyed-blond hair lies in bed in a dark room, illuminated by his phone's blue light, wearing a pink tank top and a nose ring. In this continuous shot, The man in bed puts his smartphone on the nightstand and turns over to go to sleep. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A young man with dyed-blond hair lies on his back in a dimly lit bedroom, the only source of light emanating from the cool blue glow of his smartphone screen. He wears a soft pink tank top, the fabric slightly rumpled from lying still, and a small nose ring glints faintly in the low light as he shifts his head. The room is dark, shadows pooling in the corners, with only the faint outline of a nightstand and a pillow visible. The camera holds a steady, fixed position, capturing the scene in a continuous, unbroken shot. The man’s fingers move slowly across the phone’s screen, scrolling or typing with quiet focus. After a moment, he lowers the device, places it gently on the nightstand beside him, and turns onto his side, pulling the blanket slightly higher. His breathing slows, and he settles into sleep, the blue light fading as the phone powers down. The scene remains unchanged in framing, lighting, and composition, maintaining a calm, intimate stillness throughout.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 80, + 2048 + ], + "t5_context_shape": [ + 239, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "real_target": { + "path": "results/40712e1341dc/real_target.mp4", + "sha256": "4424517beb4e790280cbf782fa1a2d6589b0443d14b9adfb83922d82d919c93e", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + } + }, + { + "case_id": "10af6c651dbc", + "name": "Jellyfish contraction", + "seed": 2026081910, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/10af6c651dbc/omni_t2v.mp4", + "sha256": "2380b955b966ff8643bf20f80996659d6c9b2f986743da29a3a2136941ed4437", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "job": { + "SLURM_JOB_ID": "213687", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "hostname": "auh7-1b-gpu-253", + "elapsed_seconds": 779.17, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 334 + ], + "rank_zero_log_sha256": "1253314f59ddf9f03be7e95cfc2dd23bac0a7d266cbca65d56c57593ab4e1d71" + }, + "conditioning": { + "input_prompt": "A small, white-spotted jellyfish drifts and pulsates gracefully in serene, deep blue water. In this continuous shot, The jellyfish pulsates, its bell contracting to reveal a ring-like shape in the blue water. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A small, white-spotted jellyfish drifts effortlessly through serene, deep blue water, its translucent bell gently pulsating in rhythmic motion. The delicate, rhythmic contractions of its body propel it forward in a slow, graceful dance, each pulse creating a subtle ripple in the surrounding water. As the bell contracts, it reveals a distinct ring-like shape, a luminous outline that glows faintly against the rich, uniform blue backdrop. The white spots on its body shimmer faintly with the play of light filtering down from above, adding a soft, ethereal contrast to the deep oceanic hue. The scene remains calm and undisturbed, with no sudden movements or changes in the environment. The camera holds steady, maintaining a consistent framing that centers the jellyfish in the frame, capturing its elegant motion in a continuous, uninterrupted shot. The lighting remains soft and diffused, enhancing the tranquil, otherworldly atmosphere of the deep sea. The jellyfish continues its slow, mesmerizing journey, its form and movement unchanged, creating a peaceful and hypnotic visual experience.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 67, + 2048 + ], + "t5_context_shape": [ + 253, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "real_target": { + "path": "results/10af6c651dbc/real_target.mp4", + "sha256": "c848feb636d4f40415224a26f79cc88659a34d63506b1ea2d95fecb6a7a01542", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + } + }, + { + "case_id": "7fa338474c75", + "name": "Playful selfie", + "seed": 2026081900, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/7fa338474c75/omni_t2v.mp4", + "sha256": "b4e27999f2701c65ac62157ae6f49539ce092acc1dba0f652532fe793b037fc3", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "job": { + "SLURM_JOB_ID": "213687", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "hostname": "auh7-1b-gpu-253", + "elapsed_seconds": 548.75, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 348 + ], + "rank_zero_log_sha256": "bfa9dc5a39eb59949e0310fbc226255b473cd5ca45931ddeeb75709e0c0c89bb" + }, + "conditioning": { + "input_prompt": "A cheerful woman in a red bikini top and straw sun hat takes a playful selfie against a green screen background in a static medium shot. In this continuous shot, The woman in a red bikini top and straw hat takes a playful selfie with her phone, sticking her tongue out and winking. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A cheerful woman stands in a static medium shot against a bright green screen background, her figure centered and clearly defined. She wears a vibrant red bikini top and a wide-brimmed straw sun hat that casts a soft shadow over her face, enhancing the playful, summery vibe. Her expression is lively and animated as she holds her smartphone at arm’s length, capturing a selfie with a mischievous grin. She sticks her tongue out slightly and winks one eye, adding a flirtatious, carefree energy to the moment. Her dark hair peeks out from under the hat, gently swaying as she shifts her weight slightly, maintaining a relaxed yet engaging posture. The lighting is even and bright, highlighting her features and the vivid colors of her outfit without casting harsh shadows. The camera remains completely still throughout, keeping the framing consistent and focused on her upper body and face. The green screen behind her is uniform and uncluttered, providing a clean, neutral backdrop that emphasizes her presence. The scene exudes a lighthearted, fun atmosphere, capturing a spontaneous and joyful moment in a single, continuous take.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 79, + 2048 + ], + "t5_context_shape": [ + 255, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "real_target": { + "path": "results/7fa338474c75/real_target.mp4", + "sha256": "8427b71fda1c01fe061b9943820e618c9f887c03a19f79f9191e4ee879b5a25a", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + } + }, + { + "case_id": "81533c9e56ec", + "name": "Scarf spin", + "seed": 2026081915, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/81533c9e56ec/omni_t2v.mp4", + "sha256": "11a91b035dac93b7875974b44469c54743c226ea892402e0d742dc90a0e49ca4", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "job": { + "SLURM_JOB_ID": "213687", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "0,1,2,3" + }, + "hostname": "auh7-1b-gpu-253", + "elapsed_seconds": 543.4, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 355 + ], + "rank_zero_log_sha256": "b6de7b091cb33a2ef71fff25d838ebe3334d7999fd50c1abde4bbe69a0ff0e80" + }, + "conditioning": { + "input_prompt": "A woman in a vintage-style dress dances gracefully by a flower-lined fence in front of a rustic wooden house. In this continuous shot, The woman wearing a green skirt and black shirt gracefully spins in a circle while holding a scarf. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A woman in a vintage-style dress dances gracefully by a flower-lined fence in front of a rustic wooden house, her movements fluid and deliberate under the warm, golden light of late afternoon. She wears a flowing green skirt that swirls with each turn, paired with a fitted black shirt that contrasts elegantly with the soft hues of the surrounding garden. In her hands, she holds a long, sheer scarf that billows like a ribbon in the breeze, catching the sunlight as she spins in a slow, continuous circle. The camera remains steady, capturing her in a wide, stable frame that emphasizes the harmony between her motion and the tranquil setting. The fence, draped in climbing roses and wildflowers, frames the scene with natural beauty, while the weathered wooden house in the background adds a sense of timeless charm. The lighting is soft and diffused, casting gentle shadows and enhancing the nostalgic atmosphere. Her expression is serene, eyes closed at times, as if lost in the rhythm of the moment. The entire scene unfolds in a single, unbroken shot, with no cuts or shifts in perspective, allowing the viewer to fully immerse in the grace and stillness of the moment.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 67, + 2048 + ], + "t5_context_shape": [ + 274, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "real_target": { + "path": "results/81533c9e56ec/real_target.mp4", + "sha256": "5edb351b04edd07ccb51fc57043298d62a9abcb959d6f86bd5912ef5d654d6d3", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + } + }, + { + "case_id": "d977ce147d80", + "name": "Rub eyes then cover face", + "seed": 2026081905, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/d977ce147d80/omni_t2v.mp4", + "sha256": "511b0763dc6b87bd4ecb80dae8ba4b95442b8c424f861e2587297e9841316edd", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "job": { + "SLURM_JOB_ID": "213687", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "hostname": "auh7-1b-gpu-253", + "elapsed_seconds": 778.41, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 399 + ], + "rank_zero_log_sha256": "553e3d91be0dff92c44c637859f9a1428b84512cd4ae3cb64beb94aafe45df43" + }, + "conditioning": { + "input_prompt": "A young man with dark skin, dreadlocks, and a gold septum ring lies on a dark couch in a dimly lit room, showing signs of distress. In this continuous shot, The man lying on the couch rubs his tired eyes and covers his face with both hands. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A young man with dark skin and long dreadlocks lies sprawled across a dark, plush couch in a dimly lit room, the low ambient light casting deep shadows that pool around him. A gold septum ring glints faintly as he shifts slightly, his body tense with quiet unease. The room is still and intimate, the atmosphere heavy with a sense of emotional weight. He lifts his hands slowly, rubbing his tired eyes with the heels of his palms, his fingers pressing into the sockets as if trying to push back exhaustion or pain. Then, with a slow, deliberate motion, he covers his face entirely, pressing both hands against his forehead and cheeks, his breath shallow and uneven. The camera holds steady, capturing the moment in a continuous, unbroken shot—no movement, no cut—allowing the viewer to sit with the man’s distress. The framing remains tight and consistent, focusing on his upper body and face, emphasizing the subtle tremors in his hands and the way his shoulders rise and fall with each labored breath. The lighting remains unchanged, soft and moody, highlighting the contours of his face and the texture of his hair, while the surrounding darkness absorbs all distractions, drawing attention solely to his internal struggle. The scene is quiet, almost still, yet charged with unspoken emotion.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 78, + 2048 + ], + "t5_context_shape": [ + 307, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "real_target": { + "path": "results/d977ce147d80/real_target.mp4", + "sha256": "9a2ad5f5fc5fca2da6532ecddbf6d5879e9c09cfcb57b952b8b28758d628cb1e", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + } + }, + { + "case_id": "840b214afead", + "name": "Place bottle on treadmill", + "seed": 2026081913, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/840b214afead/omni_t2v.mp4", + "sha256": "f8c6c74bac6feaeb53623326afaf4ba7a839d47b75d8981bd400429fd9cd5cd1", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "job": { + "SLURM_JOB_ID": "213687", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "hostname": "auh7-1b-gpu-253", + "elapsed_seconds": 555.63, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 385 + ], + "rank_zero_log_sha256": "d865c4c2b75642465de5471b399e7825250690c84f63f207fafa7208dc82ca6d" + }, + "conditioning": { + "input_prompt": "A young woman with long reddish-blonde hair, wearing a mint green athletic outfit, stands on a treadmill in a modern gym with blue and white striped pillars, holding a water bottle. In this continuous shot, The woman turns her head to the left and places her water bottle onto the treadmill. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A young woman with long, sun-kissed reddish-blonde hair stands centered on a treadmill in a sleek, modern gym, her posture relaxed yet alert. She wears a form-fitting mint green athletic outfit—a moisture-wicking tank top and matching leggings—that contrasts softly against the cool-toned environment. The gym is illuminated by bright, even lighting that highlights the clean lines of the space, with blue and white striped pillars rising in the background, creating a rhythmic visual pattern that adds depth to the scene. The camera holds a steady, medium-wide shot, capturing her from the waist up, with the treadmill’s control panel and running belt clearly visible. In a smooth, continuous motion, she turns her head slightly to the left, her gaze briefly shifting toward the side of the treadmill, then lowers her right hand to place a clear water bottle with a blue cap onto the treadmill’s console. The bottle rests securely, and she remains in place, her expression calm and focused, as the scene continues without interruption. The lighting remains consistent, the framing stable, and the background elements—pillars, mirrors, and distant gym equipment—remain unchanged, emphasizing the quiet, deliberate nature of the moment.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 82, + 2048 + ], + "t5_context_shape": [ + 289, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "real_target": { + "path": "results/840b214afead/real_target.mp4", + "sha256": "989454c22b5f6db63ebd8667c943bb2622cfc2c25990661805dda3e1f9fde52b", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + } + }, + { + "case_id": "d908552fb691", + "name": "Bow to clap", + "seed": 2026081903, + "output": { + "path": "/vast/users/guangyi.chen/causal_group/peiyuan.zhu/work/VideoEditing/VideoEdit_experiments/progress2_omni_t2v12_20260923_v1/results/d908552fb691/omni_t2v.mp4", + "sha256": "97ca0d377f030e084df41b86b49ad784496e336a90223c1acd81eb886f8366f6", + "codec": "h264", + "width": 832, + "height": 480, + "frame_count": 81, + "fps": 25.0, + "duration_seconds": 3.24 + }, + "job": { + "SLURM_JOB_ID": "213687", + "SLURM_ARRAY_JOB_ID": null, + "SLURM_ARRAY_TASK_ID": null, + "SLURM_JOB_GPUS": "0,1,2,3,4,5,6,7", + "ROCR_VISIBLE_DEVICES": "4,5,6,7" + }, + "hostname": "auh7-1b-gpu-253", + "elapsed_seconds": 533.44, + "runtime_evidence": { + "strict_equivalent_checkpoint_load": true, + "context_truncation": false, + "visual_condition_tokens": 0, + "context_log_records": 80, + "context_total_tokens": [ + 144, + 335 + ], + "rank_zero_log_sha256": "4f029607a0c836fa49e9a318191fdfebd6a1aff88df0fe004ff5b9ba44aafa00" + }, + "conditioning": { + "input_prompt": "A woman in a white taekwondo uniform with a black collar and Adidas logo stands in profile against a black background under dramatic side lighting, captured in a static medium shot. In this continuous shot, The woman in a taekwondo uniform stands in profile and claps her hands together in front of her. The same subject identity, scene, lighting, framing, and camera remain stable.", + "expanded_caption": "A woman in a crisp white taekwondo uniform stands in profile against a deep black background, her form sharply defined by dramatic side lighting that casts a strong, sculpted shadow along her silhouette. The uniform features a black collar and a subtle Adidas logo on the chest, adding a touch of brand detail to the athletic attire. She is captured in a static medium shot, framed with precision to highlight her poised stance and the clean lines of her posture. The lighting emphasizes the contours of her body, creating a high-contrast, cinematic effect that enhances the intensity of the moment. In a smooth, continuous motion, she brings her hands together in front of her chest, clapping them once with a deliberate, controlled gesture. Her movements are precise and measured, reflecting discipline and focus. The scene remains unchanged throughout—no shifts in camera angle, lighting, or background—maintaining a consistent, composed atmosphere that centers entirely on her presence and action. The stillness of the frame contrasts with the subtle energy of her motion, creating a powerful visual statement of control and readiness.", + "source_video_path": null, + "visual_embedding": null, + "source_video_caption": "", + "qwen_features_origin": "text_only", + "qwen_feature_shape": [ + 1, + 85, + 2048 + ], + "t5_context_shape": [ + 236, + 4096 + ], + "media_read_attempts": 0, + "source_vae_encode_attempts": 0 + }, + "real_target": { + "path": "results/d908552fb691/real_target.mp4", + "sha256": "ff161cba09e00e281c6407a3e96e7e359f9900a4d0af4dc6a0d042931aeadcf6", + "frames": 81, + "fps": 25, + "duration": 3.24, + "width": 960, + "height": 540, + "temporal_normalization": "full clip rescaled to 3.24 seconds", + "spatial_normalization": "fit and letterbox; no crop" + } + } +] diff --git a/projects/video-action-editing/paper/action_support_recovery.pdf b/projects/video-action-editing/paper/action_support_recovery.pdf new file mode 100644 index 0000000..fd74c2a Binary files /dev/null and b/projects/video-action-editing/paper/action_support_recovery.pdf differ diff --git a/projects/video-action-editing/paper/action_support_recovery.svg b/projects/video-action-editing/paper/action_support_recovery.svg new file mode 100644 index 0000000..83b4b68 --- /dev/null +++ b/projects/video-action-editing/paper/action_support_recovery.svg @@ -0,0 +1,305 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/data_generating_process.pdf b/projects/video-action-editing/paper/data_generating_process.pdf new file mode 100644 index 0000000..9aa5dda Binary files /dev/null and b/projects/video-action-editing/paper/data_generating_process.pdf differ diff --git a/projects/video-action-editing/paper/data_generating_process.png b/projects/video-action-editing/paper/data_generating_process.png new file mode 100644 index 0000000..5aa6408 Binary files /dev/null and b/projects/video-action-editing/paper/data_generating_process.png differ diff --git a/projects/video-action-editing/paper/equations/action-condition.svg b/projects/video-action-editing/paper/equations/action-condition.svg new file mode 100644 index 0000000..7af000f --- /dev/null +++ b/projects/video-action-editing/paper/equations/action-condition.svg @@ -0,0 +1,57 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/action-condition.tex b/projects/video-action-editing/paper/equations/action-condition.tex new file mode 100644 index 0000000..9912839 --- /dev/null +++ b/projects/video-action-editing/paper/equations/action-condition.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from 3_method.tex: \mathbf K(V_{\mathrm r}) +\documentclass[border=0pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\newsavebox{\equationbox} +\begin{document}% +\savebox{\equationbox}{$\mathbf K(V_{\mathrm r})$}% +\typeout{MATHBOX:\the\wd\equationbox,\the\ht\equationbox,\the\dp\equationbox}% +\usebox{\equationbox}% +\end{document} diff --git a/projects/video-action-editing/paper/equations/action-margin.svg b/projects/video-action-editing/paper/equations/action-margin.svg new file mode 100644 index 0000000..3d22bbf --- /dev/null +++ b/projects/video-action-editing/paper/equations/action-margin.svg @@ -0,0 +1,37 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/action-margin.tex b/projects/video-action-editing/paper/equations/action-margin.tex new file mode 100644 index 0000000..e29b9a7 --- /dev/null +++ b/projects/video-action-editing/paper/equations/action-margin.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from appendix_b_unified_observations.tex: m_{\mathrm{act}} +\documentclass[border=0pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\newsavebox{\equationbox} +\begin{document}% +\savebox{\equationbox}{$m_{\mathrm{act}}$}% +\typeout{MATHBOX:\the\wd\equationbox,\the\ht\equationbox,\the\dp\equationbox}% +\usebox{\equationbox}% +\end{document} diff --git a/projects/video-action-editing/paper/equations/action-packet.svg b/projects/video-action-editing/paper/equations/action-packet.svg new file mode 100644 index 0000000..8b838fe --- /dev/null +++ b/projects/video-action-editing/paper/equations/action-packet.svg @@ -0,0 +1,18 @@ + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/action-packet.tex b/projects/video-action-editing/paper/equations/action-packet.tex new file mode 100644 index 0000000..28e2495 --- /dev/null +++ b/projects/video-action-editing/paper/equations/action-packet.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from 3_method.tex: \mathbf K +\documentclass[border=0pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\newsavebox{\equationbox} +\begin{document}% +\savebox{\equationbox}{$\mathbf K$}% +\typeout{MATHBOX:\the\wd\equationbox,\the\ht\equationbox,\the\dp\equationbox}% +\usebox{\equationbox}% +\end{document} diff --git a/projects/video-action-editing/paper/equations/action-regime.svg b/projects/video-action-editing/paper/equations/action-regime.svg new file mode 100644 index 0000000..f0c2dce --- /dev/null +++ b/projects/video-action-editing/paper/equations/action-regime.svg @@ -0,0 +1,18 @@ + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/action-regime.tex b/projects/video-action-editing/paper/equations/action-regime.tex new file mode 100644 index 0000000..6bfb624 --- /dev/null +++ b/projects/video-action-editing/paper/equations/action-regime.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from 2_theory.tex: u +\documentclass[border=0pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\newsavebox{\equationbox} +\begin{document}% +\savebox{\equationbox}{$u$}% +\typeout{MATHBOX:\the\wd\equationbox,\the\ht\equationbox,\the\dp\equationbox}% +\usebox{\equationbox}% +\end{document} diff --git a/projects/video-action-editing/paper/equations/action-trajectory.svg b/projects/video-action-editing/paper/equations/action-trajectory.svg new file mode 100644 index 0000000..f37d627 --- /dev/null +++ b/projects/video-action-editing/paper/equations/action-trajectory.svg @@ -0,0 +1,50 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/action-trajectory.tex b/projects/video-action-editing/paper/equations/action-trajectory.tex new file mode 100644 index 0000000..05e0fbd --- /dev/null +++ b/projects/video-action-editing/paper/equations/action-trajectory.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from 2_theory.tex: \mathbf z^{\mathrm a}_{0:T} +\documentclass[border=0pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\newsavebox{\equationbox} +\begin{document}% +\savebox{\equationbox}{$\mathbf z^{\mathrm a}_{0:T}$}% +\typeout{MATHBOX:\the\wd\equationbox,\the\ht\equationbox,\the\dp\equationbox}% +\usebox{\equationbox}% +\end{document} diff --git a/projects/video-action-editing/paper/equations/adapter-update.svg b/projects/video-action-editing/paper/equations/adapter-update.svg new file mode 100644 index 0000000..741c6e3 --- /dev/null +++ b/projects/video-action-editing/paper/equations/adapter-update.svg @@ -0,0 +1,203 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/adapter-update.tex b/projects/video-action-editing/paper/equations/adapter-update.tex new file mode 100644 index 0000000..d97cce4 --- /dev/null +++ b/projects/video-action-editing/paper/equations/adapter-update.tex @@ -0,0 +1,12 @@ +% Extracted unchanged from 3_method.tex: eq:method-adapter +\documentclass[border=4pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\begin{document} +$\displaystyle +\Delta \mathbf u=\alpha_k \mathbf W_{\mathrm{up}}\!\left[ + (\mathbf W_u \mathbf u)\odot\tanh(\mathbf W_k \mathbf k) + +(\mathbf W_k \mathbf k)\odot\bigl(\mathbf 1+\tanh(\mathbf W_b \mathbf b)\bigr)\right]. +$ +\end{document} diff --git a/projects/video-action-editing/paper/equations/anchor-identification.svg b/projects/video-action-editing/paper/equations/anchor-identification.svg new file mode 100644 index 0000000..3f986bd --- /dev/null +++ b/projects/video-action-editing/paper/equations/anchor-identification.svg @@ -0,0 +1,177 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/anchor-identification.tex b/projects/video-action-editing/paper/equations/anchor-identification.tex new file mode 100644 index 0000000..fb69b5b --- /dev/null +++ b/projects/video-action-editing/paper/equations/anchor-identification.tex @@ -0,0 +1,12 @@ +% Extracted unchanged from 2_theory.tex: eq:anchor-identification +\documentclass[border=4pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\begin{document} +$\displaystyle +E_{\mathrm a}(V)=h_{\mathrm a}(\mathbf z^{\mathrm a}),\qquad + P(h_{\mathrm a}(\mathbf z^{\mathrm a}))=\mu_k(\mathbf z^{\mathrm a}) + \quad\text{almost surely}, +$ +\end{document} diff --git a/projects/video-action-editing/paper/equations/anchor-loss.svg b/projects/video-action-editing/paper/equations/anchor-loss.svg new file mode 100644 index 0000000..f8cba98 --- /dev/null +++ b/projects/video-action-editing/paper/equations/anchor-loss.svg @@ -0,0 +1,128 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/anchor-loss.tex b/projects/video-action-editing/paper/equations/anchor-loss.tex new file mode 100644 index 0000000..ed8bfda --- /dev/null +++ b/projects/video-action-editing/paper/equations/anchor-loss.tex @@ -0,0 +1,13 @@ +% Extracted unchanged from 3_method.tex: eq:method-anchor-loss +\documentclass[border=4pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\begin{document} +$\displaystyle +\mathcal L_{\mathrm{anchor}} + =\lambda_{\mathrm{obs}}\mathcal L_{\mathrm{obs}} + +\lambda_{\mathrm{view}}\mathcal L_{\mathrm{view}} + +\mathcal L_{\mathrm{reg}}. +$ +\end{document} diff --git a/projects/video-action-editing/paper/equations/anchor-objective.svg b/projects/video-action-editing/paper/equations/anchor-objective.svg new file mode 100644 index 0000000..cbd78d1 --- /dev/null +++ b/projects/video-action-editing/paper/equations/anchor-objective.svg @@ -0,0 +1,303 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/anchor-objective.tex b/projects/video-action-editing/paper/equations/anchor-objective.tex new file mode 100644 index 0000000..ac300fa --- /dev/null +++ b/projects/video-action-editing/paper/equations/anchor-objective.tex @@ -0,0 +1,15 @@ +% Extracted unchanged from 2_theory.tex: eq:anchor-objective +\documentclass[border=4pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\begin{document} +$\displaystyle +\begin{aligned} + \mathcal J(E_{\mathrm a},P) + ={}&\lambda\,\underbrace{\E\|E_{\mathrm a}(V)-E_{\mathrm a}(V^+)\|^2}_{\mathcal L_{\mathrm{inv}}}\\ + &+\underbrace{\E\|P(E_{\mathrm a}(V))-\varphi(V^+)\|_{\mathcal H_k}^2}_{\mathcal L_{\mathrm{pred}}}, + \qquad\lambda>0 . + \end{aligned} +$ +\end{document} diff --git a/projects/video-action-editing/paper/equations/anchor-views.svg b/projects/video-action-editing/paper/equations/anchor-views.svg new file mode 100644 index 0000000..02e86cb --- /dev/null +++ b/projects/video-action-editing/paper/equations/anchor-views.svg @@ -0,0 +1,151 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/anchor-views.tex b/projects/video-action-editing/paper/equations/anchor-views.tex new file mode 100644 index 0000000..6acf9eb --- /dev/null +++ b/projects/video-action-editing/paper/equations/anchor-views.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from 2_theory.tex: eq:controlled-anchor-views +\documentclass[border=4pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\begin{document} +$\displaystyle +V=g_{\mathrm{ctrl}}(\mathbf z^{\mathrm c},\mathcal F_T(\mathbf w)),\qquad + V^+=g_{\mathrm{ctrl}}(\mathbf z^{\mathrm c+},\mathcal F_T(\mathbf w)). +$ +\end{document} diff --git a/projects/video-action-editing/paper/equations/behavior-loss.svg b/projects/video-action-editing/paper/equations/behavior-loss.svg new file mode 100644 index 0000000..0eb3213 --- /dev/null +++ b/projects/video-action-editing/paper/equations/behavior-loss.svg @@ -0,0 +1,199 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/behavior-loss.tex b/projects/video-action-editing/paper/equations/behavior-loss.tex new file mode 100644 index 0000000..542dce8 --- /dev/null +++ b/projects/video-action-editing/paper/equations/behavior-loss.tex @@ -0,0 +1,13 @@ +% Extracted unchanged from 3_method.tex: eq:method-behavior-loss +\documentclass[border=4pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\begin{document} +$\displaystyle +\ell_{\mathrm{act},k}=1-\gamma_{+,k} + -\lambda_{\mathrm{disc}}\log + \frac{\exp(\gamma_{+,k}/\tau)} + {\sum_{j\in\mathcal K}\exp(\gamma_{j,k}/\tau)} +$ +\end{document} diff --git a/projects/video-action-editing/paper/equations/behavior-similarity.svg b/projects/video-action-editing/paper/equations/behavior-similarity.svg new file mode 100644 index 0000000..f3cf28d --- /dev/null +++ b/projects/video-action-editing/paper/equations/behavior-similarity.svg @@ -0,0 +1,126 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/behavior-similarity.tex b/projects/video-action-editing/paper/equations/behavior-similarity.tex new file mode 100644 index 0000000..b116993 --- /dev/null +++ b/projects/video-action-editing/paper/equations/behavior-similarity.tex @@ -0,0 +1,10 @@ +% Extracted unchanged from 3_method.tex: \gamma_{j,k}=\operatorname{sim}(e_{\mathrm J}(\widehat V_{0\mid k}),e_{\mathrm J}(V_j)) +\documentclass[border=4pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\begin{document} +$\displaystyle +\gamma_{j,k}=\operatorname{sim}(e_{\mathrm J}(\widehat V_{0\mid k}),e_{\mathrm J}(V_j)) +$ +\end{document} diff --git a/projects/video-action-editing/paper/equations/content-code.svg b/projects/video-action-editing/paper/equations/content-code.svg new file mode 100644 index 0000000..6e23f14 --- /dev/null +++ b/projects/video-action-editing/paper/equations/content-code.svg @@ -0,0 +1,29 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/content-code.tex b/projects/video-action-editing/paper/equations/content-code.tex new file mode 100644 index 0000000..e2261b6 --- /dev/null +++ b/projects/video-action-editing/paper/equations/content-code.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from 2_theory.tex: \mathbf z^{\mathrm c} +\documentclass[border=0pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\newsavebox{\equationbox} +\begin{document}% +\savebox{\equationbox}{$\mathbf z^{\mathrm c}$}% +\typeout{MATHBOX:\the\wd\equationbox,\the\ht\equationbox,\the\dp\equationbox}% +\usebox{\equationbox}% +\end{document} diff --git a/projects/video-action-editing/paper/equations/demonstration-video.svg b/projects/video-action-editing/paper/equations/demonstration-video.svg new file mode 100644 index 0000000..cd13d6e --- /dev/null +++ b/projects/video-action-editing/paper/equations/demonstration-video.svg @@ -0,0 +1,29 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/demonstration-video.tex b/projects/video-action-editing/paper/equations/demonstration-video.tex new file mode 100644 index 0000000..8af845a --- /dev/null +++ b/projects/video-action-editing/paper/equations/demonstration-video.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from 3_method.tex: V_{\mathrm r} +\documentclass[border=0pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\newsavebox{\equationbox} +\begin{document}% +\savebox{\equationbox}{$V_{\mathrm r}$}% +\typeout{MATHBOX:\the\wd\equationbox,\the\ht\equationbox,\the\dp\equationbox}% +\usebox{\equationbox}% +\end{document} diff --git a/projects/video-action-editing/paper/equations/generated-token.svg b/projects/video-action-editing/paper/equations/generated-token.svg new file mode 100644 index 0000000..6ea97b1 --- /dev/null +++ b/projects/video-action-editing/paper/equations/generated-token.svg @@ -0,0 +1,18 @@ + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/generated-token.tex b/projects/video-action-editing/paper/equations/generated-token.tex new file mode 100644 index 0000000..eb76e51 --- /dev/null +++ b/projects/video-action-editing/paper/equations/generated-token.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from 3_method.tex: \mathbf u +\documentclass[border=0pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\newsavebox{\equationbox} +\begin{document}% +\savebox{\equationbox}{$\mathbf u$}% +\typeout{MATHBOX:\the\wd\equationbox,\the\ht\equationbox,\the\dp\equationbox}% +\usebox{\equationbox}% +\end{document} diff --git a/projects/video-action-editing/paper/equations/identification-map.svg b/projects/video-action-editing/paper/equations/identification-map.svg new file mode 100644 index 0000000..5234c07 --- /dev/null +++ b/projects/video-action-editing/paper/equations/identification-map.svg @@ -0,0 +1,29 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/identification-map.tex b/projects/video-action-editing/paper/equations/identification-map.tex new file mode 100644 index 0000000..412f9c2 --- /dev/null +++ b/projects/video-action-editing/paper/equations/identification-map.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from 2_theory.tex: h_{\mathrm a} +\documentclass[border=0pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\newsavebox{\equationbox} +\begin{document}% +\savebox{\equationbox}{$h_{\mathrm a}$}% +\typeout{MATHBOX:\the\wd\equationbox,\the\ht\equationbox,\the\dp\equationbox}% +\usebox{\equationbox}% +\end{document} diff --git a/projects/video-action-editing/paper/equations/kernel-mean.svg b/projects/video-action-editing/paper/equations/kernel-mean.svg new file mode 100644 index 0000000..ab8354b --- /dev/null +++ b/projects/video-action-editing/paper/equations/kernel-mean.svg @@ -0,0 +1,29 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/kernel-mean.tex b/projects/video-action-editing/paper/equations/kernel-mean.tex new file mode 100644 index 0000000..c83c81e --- /dev/null +++ b/projects/video-action-editing/paper/equations/kernel-mean.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from 2_theory.tex: \mu_k +\documentclass[border=0pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\newsavebox{\equationbox} +\begin{document}% +\savebox{\equationbox}{$\mu_k$}% +\typeout{MATHBOX:\the\wd\equationbox,\the\ht\equationbox,\the\dp\equationbox}% +\usebox{\equationbox}% +\end{document} diff --git a/projects/video-action-editing/paper/equations/manifest.json b/projects/video-action-editing/paper/equations/manifest.json new file mode 100644 index 0000000..bf142af --- /dev/null +++ b/projects/video-action-editing/paper/equations/manifest.json @@ -0,0 +1,400 @@ +[ + { + "name": "anchor-views", + "source": "/paper/source/2_theory.tex", + "source_sha256": "cea2d74371d5ebc780faf1715c3ed386bbc5263309f84754389b2057df4f35d7", + "extraction": "equation", + "selector": "eq:controlled-anchor-views", + "body": "V=g_{\\mathrm{ctrl}}(\\mathbf z^{\\mathrm c},\\mathcal F_T(\\mathbf w)),\\qquad\n V^+=g_{\\mathrm{ctrl}}(\\mathbf z^{\\mathrm c+},\\mathcal F_T(\\mathbf w)).", + "inline": false, + "single_line": true, + "latex": "/paper/equations/anchor-views.tex", + "svg": "/paper/equations/anchor-views.svg", + "svg_sha256": "dc739ae5d698fd321f344453458481ed2ce371307a83d50b4a4e7d13e108496e", + "label": "eq:controlled-anchor-views" + }, + { + "name": "anchor-objective", + "source": "/paper/source/2_theory.tex", + "source_sha256": "cea2d74371d5ebc780faf1715c3ed386bbc5263309f84754389b2057df4f35d7", + "extraction": "equation", + "selector": "eq:anchor-objective", + "body": "\\begin{aligned}\n \\mathcal J(E_{\\mathrm a},P)\n ={}&\\lambda\\,\\underbrace{\\E\\|E_{\\mathrm a}(V)-E_{\\mathrm a}(V^+)\\|^2}_{\\mathcal L_{\\mathrm{inv}}}\\\\\n &+\\underbrace{\\E\\|P(E_{\\mathrm a}(V))-\\varphi(V^+)\\|_{\\mathcal H_k}^2}_{\\mathcal L_{\\mathrm{pred}}},\n \\qquad\\lambda>0 .\n \\end{aligned}", + "inline": false, + "single_line": false, + "latex": "/paper/equations/anchor-objective.tex", + "svg": "/paper/equations/anchor-objective.svg", + "svg_sha256": "11d777ce785478829a7a7a4b73428b6f3c217d5dda22cd22e7645930283796fa", + "label": "eq:anchor-objective" + }, + { + "name": "anchor-identification", + "source": "/paper/source/2_theory.tex", + "source_sha256": "cea2d74371d5ebc780faf1715c3ed386bbc5263309f84754389b2057df4f35d7", + "extraction": "equation", + "selector": "eq:anchor-identification", + "body": "E_{\\mathrm a}(V)=h_{\\mathrm a}(\\mathbf z^{\\mathrm a}),\\qquad\n P(h_{\\mathrm a}(\\mathbf z^{\\mathrm a}))=\\mu_k(\\mathbf z^{\\mathrm a})\n \\quad\\text{almost surely},", + "inline": false, + "single_line": true, + "latex": "/paper/equations/anchor-identification.tex", + "svg": "/paper/equations/anchor-identification.svg", + "svg_sha256": "b2ed758116dc9d6b8b95933f859daf7893acc7ed5c59972cd96c740adf7f8e5d", + "label": "eq:anchor-identification" + }, + { + "name": "temporal-observations", + "source": "/paper/source/2_theory.tex", + "source_sha256": "cea2d74371d5ebc780faf1715c3ed386bbc5263309f84754389b2057df4f35d7", + "extraction": "display", + "selector": "p_t=p_0+t v_0+\\tfrac12t^2u", + "body": "p_t=p_0+t v_0+\\tfrac12t^2u,\\qquad \\mathbf x_t=\\rho(c,p_t),", + "inline": false, + "single_line": true, + "latex": "/paper/equations/temporal-observations.tex", + "svg": "/paper/equations/temporal-observations.svg", + "svg_sha256": "8a377fe29884d789124c2d6deb4df7d14e17a0d1ed40a7aecb8297a0c8603e6a" + }, + { + "name": "anchor-loss", + "source": "/paper/source/3_method.tex", + "source_sha256": "5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c", + "extraction": "equation", + "selector": "eq:method-anchor-loss", + "body": "\\mathcal L_{\\mathrm{anchor}}\n =\\lambda_{\\mathrm{obs}}\\mathcal L_{\\mathrm{obs}}\n +\\lambda_{\\mathrm{view}}\\mathcal L_{\\mathrm{view}}\n +\\mathcal L_{\\mathrm{reg}}.", + "inline": false, + "single_line": true, + "latex": "/paper/equations/anchor-loss.tex", + "svg": "/paper/equations/anchor-loss.svg", + "svg_sha256": "0ea8b09e8b5afb187bb769a5f427dbcef00ae3d15a70bd4a6d26cdb360c22b82", + "label": "eq:method-anchor-loss" + }, + { + "name": "adapter-update", + "source": "/paper/source/3_method.tex", + "source_sha256": "5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c", + "extraction": "equation", + "selector": "eq:method-adapter", + "body": "\\Delta \\mathbf u=\\alpha_k \\mathbf W_{\\mathrm{up}}\\!\\left[\n (\\mathbf W_u \\mathbf u)\\odot\\tanh(\\mathbf W_k \\mathbf k)\n +(\\mathbf W_k \\mathbf k)\\odot\\bigl(\\mathbf 1+\\tanh(\\mathbf W_b \\mathbf b)\\bigr)\\right].", + "inline": false, + "single_line": true, + "latex": "/paper/equations/adapter-update.tex", + "svg": "/paper/equations/adapter-update.svg", + "svg_sha256": "8645a29c0f488e8219dd53deecaba8a0e90d4a29aa6ca28bb3a87411e0260550", + "label": "eq:method-adapter" + }, + { + "name": "behavior-similarity", + "source": "/paper/source/3_method.tex", + "source_sha256": "5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c", + "extraction": "inline", + "selector": "\\gamma_{j,k}=\\operatorname{sim}(e_{\\mathrm J}(\\widehat V_{0\\mid k}),e_{\\mathrm J}(V_j))", + "body": "\\gamma_{j,k}=\\operatorname{sim}(e_{\\mathrm J}(\\widehat V_{0\\mid k}),e_{\\mathrm J}(V_j))", + "inline": false, + "single_line": true, + "latex": "/paper/equations/behavior-similarity.tex", + "svg": "/paper/equations/behavior-similarity.svg", + "svg_sha256": "e431339494a4833e08b41719a8d0df9e8d6bf0affc02f626488cf430c3c64123" + }, + { + "name": "behavior-loss", + "source": "/paper/source/3_method.tex", + "source_sha256": "5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c", + "extraction": "equation", + "selector": "eq:method-behavior-loss", + "body": "\\ell_{\\mathrm{act},k}=1-\\gamma_{+,k}\n -\\lambda_{\\mathrm{disc}}\\log\n \\frac{\\exp(\\gamma_{+,k}/\\tau)}\n {\\sum_{j\\in\\mathcal K}\\exp(\\gamma_{j,k}/\\tau)}", + "inline": false, + "single_line": true, + "latex": "/paper/equations/behavior-loss.tex", + "svg": "/paper/equations/behavior-loss.svg", + "svg_sha256": "3fc4bb8343f4bfaeb9d2c000f827ad8843235ef1327f6729a7529e0da914a04b", + "label": "eq:method-behavior-loss" + }, + { + "name": "multiplicative-map", + "source": "/paper/source/appendix_e_synthetic_protocol.tex", + "source_sha256": "4a28dec0bbbd86de384ff2471c30d3f3e2e188855eb650553520f7a698127dad", + "extraction": "inline", + "selector": "\\rho(c,p)=(cp,c)", + "body": "\\rho(c,p)=(cp,c)", + "inline": true, + "single_line": true, + "latex": "/paper/equations/multiplicative-map.tex", + "svg": "/paper/equations/multiplicative-map.svg", + "svg_sha256": "82bf133a32ea4ef69d5d5bc90ebb593fe2bb86309e7545ff73bfa6a0d31a3ce2", + "width_em": 6.5993, + "height_em": 0.75, + "depth_em": 0.25 + }, + { + "name": "zero-conditional-mean", + "source": "/paper/source/appendix_e_synthetic_protocol.tex", + "source_sha256": "4a28dec0bbbd86de384ff2471c30d3f3e2e188855eb650553520f7a698127dad", + "extraction": "inline", + "selector": "\\E[V\\mid\\mathbf z^{\\mathrm a}]=\\mathbf 0", + "body": "\\E[V\\mid\\mathbf z^{\\mathrm a}]=\\mathbf 0", + "inline": true, + "single_line": true, + "latex": "/paper/equations/zero-conditional-mean.tex", + "svg": "/paper/equations/zero-conditional-mean.svg", + "svg_sha256": "49d98decb307591099d1c5e646fa0e6356ee5f05a2d98fd3ba127d1ab5e5d795", + "width_em": 5.72914, + "height_em": 0.75, + "depth_em": 0.25 + }, + { + "name": "content-code", + "source": "/paper/source/2_theory.tex", + "source_sha256": "cea2d74371d5ebc780faf1715c3ed386bbc5263309f84754389b2057df4f35d7", + "extraction": "inline", + "selector": "\\mathbf z^{\\mathrm c}", + "body": "\\mathbf z^{\\mathrm c}", + "inline": true, + "single_line": true, + "latex": "/paper/equations/content-code.tex", + "svg": "/paper/equations/content-code.svg", + "svg_sha256": "860f090a6343d40afb8aad52269a00f967e374cca2173ee6fd319bc554f31b50", + "width_em": 0.91667, + "height_em": 0.66428, + "depth_em": 0.0 + }, + { + "name": "action-trajectory", + "source": "/paper/source/2_theory.tex", + "source_sha256": "cea2d74371d5ebc780faf1715c3ed386bbc5263309f84754389b2057df4f35d7", + "extraction": "fragment", + "selector": "\\mathbf z^{\\mathrm a}_{0:T}", + "body": "\\mathbf z^{\\mathrm a}_{0:T}", + "inline": true, + "single_line": true, + "latex": "/paper/equations/action-trajectory.tex", + "svg": "/paper/equations/action-trajectory.svg", + "svg_sha256": "9757c94d72829e4c42d310b809c1ee9efb6a07d1535c581f14bb5399014ea8e9", + "width_em": 1.76608, + "height_em": 0.66428, + "depth_em": 0.27543 + }, + { + "name": "action-regime", + "source": "/paper/source/2_theory.tex", + "source_sha256": "cea2d74371d5ebc780faf1715c3ed386bbc5263309f84754389b2057df4f35d7", + "extraction": "inline", + "selector": "u", + "body": "u", + "inline": true, + "single_line": true, + "latex": "/paper/equations/action-regime.tex", + "svg": "/paper/equations/action-regime.svg", + "svg_sha256": "0c9f2dc8308bdcd5be55a457f7f94837efc09d16511ddb2103954d8b8fbbf15a", + "width_em": 0.57246, + "height_em": 0.43055, + "depth_em": 0.0 + }, + { + "name": "identification-map", + "source": "/paper/source/2_theory.tex", + "source_sha256": "cea2d74371d5ebc780faf1715c3ed386bbc5263309f84754389b2057df4f35d7", + "extraction": "inline", + "selector": "h_{\\mathrm a}", + "body": "h_{\\mathrm a}", + "inline": true, + "single_line": true, + "latex": "/paper/equations/identification-map.tex", + "svg": "/paper/equations/identification-map.svg", + "svg_sha256": "9d7de8f8db084c9bd4efcc4f32b85d5f930d6f01237fd12b1747b130f70bb51b", + "width_em": 1.02477, + "height_em": 0.69444, + "depth_em": 0.15 + }, + { + "name": "kernel-mean", + "source": "/paper/source/2_theory.tex", + "source_sha256": "cea2d74371d5ebc780faf1715c3ed386bbc5263309f84754389b2057df4f35d7", + "extraction": "fragment", + "selector": "\\mu_k", + "body": "\\mu_k", + "inline": true, + "single_line": true, + "latex": "/paper/equations/kernel-mean.tex", + "svg": "/paper/equations/kernel-mean.svg", + "svg_sha256": "9f14a2e57615009e6fdd597069463d058832c58403f546f24ef25980b8a640a6", + "width_em": 1.09457, + "height_em": 0.43055, + "depth_em": 0.19444 + }, + { + "name": "demonstration-video", + "source": "/paper/source/3_method.tex", + "source_sha256": "5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c", + "extraction": "inline", + "selector": "V_{\\mathrm r}", + "body": "V_{\\mathrm r}", + "inline": true, + "single_line": true, + "latex": "/paper/equations/demonstration-video.tex", + "svg": "/paper/equations/demonstration-video.svg", + "svg_sha256": "2c79e2497e6a249486e9308da253a796d8650d5b12e00955eb416284c1edfcd0", + "width_em": 0.94583, + "height_em": 0.68333, + "depth_em": 0.15 + }, + { + "name": "action-condition", + "source": "/paper/source/3_method.tex", + "source_sha256": "5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c", + "extraction": "fragment", + "selector": "\\mathbf K(V_{\\mathrm r})", + "body": "\\mathbf K(V_{\\mathrm r})", + "inline": true, + "single_line": true, + "latex": "/paper/equations/action-condition.tex", + "svg": "/paper/equations/action-condition.svg", + "svg_sha256": "37062d3c825580b40956b7a46912e7e4a00c1e8434ee0102be0464429aa586f3", + "width_em": 2.625, + "height_em": 0.75, + "depth_em": 0.25 + }, + { + "name": "action-packet", + "source": "/paper/source/3_method.tex", + "source_sha256": "5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c", + "extraction": "inline", + "selector": "\\mathbf K", + "body": "\\mathbf K", + "inline": true, + "single_line": true, + "latex": "/paper/equations/action-packet.tex", + "svg": "/paper/equations/action-packet.svg", + "svg_sha256": "8d4a716fdb5d52503f43ceef63577d5500d944b5f23a1c725c0dcf1f891127de", + "width_em": 0.90138, + "height_em": 0.68611, + "depth_em": 0.0 + }, + { + "name": "generated-token", + "source": "/paper/source/3_method.tex", + "source_sha256": "5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c", + "extraction": "inline", + "selector": "\\mathbf u", + "body": "\\mathbf u", + "inline": true, + "single_line": true, + "latex": "/paper/equations/generated-token.tex", + "svg": "/paper/equations/generated-token.svg", + "svg_sha256": "8fe941b5fa7f85a06309001efa7e74452fbf883a95c618d84ed2e20a324d2989", + "width_em": 0.63888, + "height_em": 0.44444, + "depth_em": 0.0 + }, + { + "name": "source-context", + "source": "/paper/source/3_method.tex", + "source_sha256": "5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c", + "extraction": "inline", + "selector": "\\mathbf b", + "body": "\\mathbf b", + "inline": true, + "single_line": true, + "latex": "/paper/equations/source-context.tex", + "svg": "/paper/equations/source-context.svg", + "svg_sha256": "bbe0b3972c9a3ba28bff05a7983378cf5c8c4bb670804f43788dd8f641381b08", + "width_em": 0.63888, + "height_em": 0.69444, + "depth_em": 0.0 + }, + { + "name": "sampling-gate", + "source": "/paper/source/3_method.tex", + "source_sha256": "5536821070969800450da1769973067858e0e7ff6a7f993de9ea69be3227d55c", + "extraction": "inline", + "selector": "\\alpha_k", + "body": "\\alpha_k", + "inline": true, + "single_line": true, + "latex": "/paper/equations/sampling-gate.tex", + "svg": "/paper/equations/sampling-gate.svg", + "svg_sha256": "1f5f2559e0a3445cd88a3525eaa8389056e2372090a8ea1d980502b061d2afd4", + "width_em": 1.13172, + "height_em": 0.43055, + "depth_em": 0.15 + }, + { + "name": "action-margin", + "source": "/paper/source/appendix_b_unified_observations.tex", + "source_sha256": "95a7866b782ff54a2a6c0c1bfbdfe0f1c59eb0dfcb2fc6af4e72ace1a857337b", + "extraction": "inline", + "selector": "m_{\\mathrm{act}}", + "body": "m_{\\mathrm{act}}", + "inline": true, + "single_line": true, + "latex": "/paper/equations/action-margin.tex", + "svg": "/paper/equations/action-margin.svg", + "svg_sha256": "e21aac7853ff1dd9736f96d0ecbcc711d3c67b5a312b9a78d30fc15bf6bc6c27", + "width_em": 1.99469, + "height_em": 0.43055, + "depth_em": 0.15 + }, + { + "name": "r-squared", + "source": "/paper/source/appendix_e_synthetic_protocol.tex", + "source_sha256": "4a28dec0bbbd86de384ff2471c30d3f3e2e188855eb650553520f7a698127dad", + "extraction": "inline", + "selector": "R^2", + "body": "R^2", + "inline": true, + "single_line": true, + "latex": "/paper/equations/r-squared.tex", + "svg": "/paper/equations/r-squared.svg", + "svg_sha256": "63cbbee88673c779f5921f5b31bd90d2431ec8ac8519a8ed046a1fd823159575", + "width_em": 1.21563, + "height_em": 0.814, + "depth_em": 0.0 + }, + { + "name": "midpoint-position", + "source": "/paper/source/appendix_e_synthetic_protocol.tex", + "source_sha256": "4a28dec0bbbd86de384ff2471c30d3f3e2e188855eb650553520f7a698127dad", + "extraction": "inline", + "selector": "p", + "body": "p", + "inline": true, + "single_line": true, + "latex": "/paper/equations/midpoint-position.tex", + "svg": "/paper/equations/midpoint-position.svg", + "svg_sha256": "47d675d737b942475834c217d7d3cd9a794c9bb85ce8773fe339789ef271c568", + "width_em": 0.50313, + "height_em": 0.43055, + "depth_em": 0.19444 + }, + { + "name": "velocity", + "source": "/paper/source/appendix_e_synthetic_protocol.tex", + "source_sha256": "4a28dec0bbbd86de384ff2471c30d3f3e2e188855eb650553520f7a698127dad", + "extraction": "inline", + "selector": "v", + "body": "v", + "inline": true, + "single_line": true, + "latex": "/paper/equations/velocity.tex", + "svg": "/paper/equations/velocity.svg", + "svg_sha256": "ad5d5b38263b131822c61bc43116c70dfa0dcbd6ab8f727795ec14917e9bd67b", + "width_em": 0.5206, + "height_em": 0.43055, + "depth_em": 0.0 + }, + { + "name": "three-frames", + "source": "/paper/source/appendix_e_synthetic_protocol.tex", + "source_sha256": "4a28dec0bbbd86de384ff2471c30d3f3e2e188855eb650553520f7a698127dad", + "extraction": "inline", + "selector": "T=3", + "body": "T=3", + "inline": true, + "single_line": true, + "latex": "/paper/equations/three-frames.tex", + "svg": "/paper/equations/three-frames.svg", + "svg_sha256": "dea0511da14cb6ae10810722650d641ac869aac227eb6a98f3a5e77781f812fc", + "width_em": 2.55659, + "height_em": 0.68333, + "depth_em": 0.0 + } +] diff --git a/projects/video-action-editing/paper/equations/midpoint-position.svg b/projects/video-action-editing/paper/equations/midpoint-position.svg new file mode 100644 index 0000000..f123ded --- /dev/null +++ b/projects/video-action-editing/paper/equations/midpoint-position.svg @@ -0,0 +1,18 @@ + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/midpoint-position.tex b/projects/video-action-editing/paper/equations/midpoint-position.tex new file mode 100644 index 0000000..4b01415 --- /dev/null +++ b/projects/video-action-editing/paper/equations/midpoint-position.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from appendix_e_synthetic_protocol.tex: p +\documentclass[border=0pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\newsavebox{\equationbox} +\begin{document}% +\savebox{\equationbox}{$p$}% +\typeout{MATHBOX:\the\wd\equationbox,\the\ht\equationbox,\the\dp\equationbox}% +\usebox{\equationbox}% +\end{document} diff --git a/projects/video-action-editing/paper/equations/multiplicative-map.svg b/projects/video-action-editing/paper/equations/multiplicative-map.svg new file mode 100644 index 0000000..de076e7 --- /dev/null +++ b/projects/video-action-editing/paper/equations/multiplicative-map.svg @@ -0,0 +1,101 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/multiplicative-map.tex b/projects/video-action-editing/paper/equations/multiplicative-map.tex new file mode 100644 index 0000000..8c5446d --- /dev/null +++ b/projects/video-action-editing/paper/equations/multiplicative-map.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from appendix_e_synthetic_protocol.tex: \rho(c,p)=(cp,c) +\documentclass[border=0pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\newsavebox{\equationbox} +\begin{document}% +\savebox{\equationbox}{$\rho(c,p)=(cp,c)$}% +\typeout{MATHBOX:\the\wd\equationbox,\the\ht\equationbox,\the\dp\equationbox}% +\usebox{\equationbox}% +\end{document} diff --git a/projects/video-action-editing/paper/equations/r-squared.svg b/projects/video-action-editing/paper/equations/r-squared.svg new file mode 100644 index 0000000..4d88260 --- /dev/null +++ b/projects/video-action-editing/paper/equations/r-squared.svg @@ -0,0 +1,24 @@ + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/r-squared.tex b/projects/video-action-editing/paper/equations/r-squared.tex new file mode 100644 index 0000000..e949f71 --- /dev/null +++ b/projects/video-action-editing/paper/equations/r-squared.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from appendix_e_synthetic_protocol.tex: R^2 +\documentclass[border=0pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\newsavebox{\equationbox} +\begin{document}% +\savebox{\equationbox}{$R^2$}% +\typeout{MATHBOX:\the\wd\equationbox,\the\ht\equationbox,\the\dp\equationbox}% +\usebox{\equationbox}% +\end{document} diff --git a/projects/video-action-editing/paper/equations/sampling-gate.svg b/projects/video-action-editing/paper/equations/sampling-gate.svg new file mode 100644 index 0000000..6c4d952 --- /dev/null +++ b/projects/video-action-editing/paper/equations/sampling-gate.svg @@ -0,0 +1,29 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/sampling-gate.tex b/projects/video-action-editing/paper/equations/sampling-gate.tex new file mode 100644 index 0000000..00824b6 --- /dev/null +++ b/projects/video-action-editing/paper/equations/sampling-gate.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from 3_method.tex: \alpha_k +\documentclass[border=0pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\newsavebox{\equationbox} +\begin{document}% +\savebox{\equationbox}{$\alpha_k$}% +\typeout{MATHBOX:\the\wd\equationbox,\the\ht\equationbox,\the\dp\equationbox}% +\usebox{\equationbox}% +\end{document} diff --git a/projects/video-action-editing/paper/equations/source-context.svg b/projects/video-action-editing/paper/equations/source-context.svg new file mode 100644 index 0000000..91230c7 --- /dev/null +++ b/projects/video-action-editing/paper/equations/source-context.svg @@ -0,0 +1,18 @@ + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/source-context.tex b/projects/video-action-editing/paper/equations/source-context.tex new file mode 100644 index 0000000..e4dc823 --- /dev/null +++ b/projects/video-action-editing/paper/equations/source-context.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from 3_method.tex: \mathbf b +\documentclass[border=0pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\newsavebox{\equationbox} +\begin{document}% +\savebox{\equationbox}{$\mathbf b$}% +\typeout{MATHBOX:\the\wd\equationbox,\the\ht\equationbox,\the\dp\equationbox}% +\usebox{\equationbox}% +\end{document} diff --git a/projects/video-action-editing/paper/equations/temporal-observations.svg b/projects/video-action-editing/paper/equations/temporal-observations.svg new file mode 100644 index 0000000..d09489c --- /dev/null +++ b/projects/video-action-editing/paper/equations/temporal-observations.svg @@ -0,0 +1,131 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/temporal-observations.tex b/projects/video-action-editing/paper/equations/temporal-observations.tex new file mode 100644 index 0000000..cfb800d --- /dev/null +++ b/projects/video-action-editing/paper/equations/temporal-observations.tex @@ -0,0 +1,10 @@ +% Extracted unchanged from 2_theory.tex: p_t=p_0+t v_0+\tfrac12t^2u +\documentclass[border=4pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\begin{document} +$\displaystyle +p_t=p_0+t v_0+\tfrac12t^2u,\qquad \mathbf x_t=\rho(c,p_t), +$ +\end{document} diff --git a/projects/video-action-editing/paper/equations/three-frames.svg b/projects/video-action-editing/paper/equations/three-frames.svg new file mode 100644 index 0000000..31b81c1 --- /dev/null +++ b/projects/video-action-editing/paper/equations/three-frames.svg @@ -0,0 +1,35 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/three-frames.tex b/projects/video-action-editing/paper/equations/three-frames.tex new file mode 100644 index 0000000..c1b516e --- /dev/null +++ b/projects/video-action-editing/paper/equations/three-frames.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from appendix_e_synthetic_protocol.tex: T=3 +\documentclass[border=0pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\newsavebox{\equationbox} +\begin{document}% +\savebox{\equationbox}{$T=3$}% +\typeout{MATHBOX:\the\wd\equationbox,\the\ht\equationbox,\the\dp\equationbox}% +\usebox{\equationbox}% +\end{document} diff --git a/projects/video-action-editing/paper/equations/velocity.svg b/projects/video-action-editing/paper/equations/velocity.svg new file mode 100644 index 0000000..e295f90 --- /dev/null +++ b/projects/video-action-editing/paper/equations/velocity.svg @@ -0,0 +1,18 @@ + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/velocity.tex b/projects/video-action-editing/paper/equations/velocity.tex new file mode 100644 index 0000000..436f9c0 --- /dev/null +++ b/projects/video-action-editing/paper/equations/velocity.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from appendix_e_synthetic_protocol.tex: v +\documentclass[border=0pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\newsavebox{\equationbox} +\begin{document}% +\savebox{\equationbox}{$v$}% +\typeout{MATHBOX:\the\wd\equationbox,\the\ht\equationbox,\the\dp\equationbox}% +\usebox{\equationbox}% +\end{document} diff --git a/projects/video-action-editing/paper/equations/zero-conditional-mean.svg b/projects/video-action-editing/paper/equations/zero-conditional-mean.svg new file mode 100644 index 0000000..c46ab5a --- /dev/null +++ b/projects/video-action-editing/paper/equations/zero-conditional-mean.svg @@ -0,0 +1,96 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/projects/video-action-editing/paper/equations/zero-conditional-mean.tex b/projects/video-action-editing/paper/equations/zero-conditional-mean.tex new file mode 100644 index 0000000..9c049ca --- /dev/null +++ b/projects/video-action-editing/paper/equations/zero-conditional-mean.tex @@ -0,0 +1,11 @@ +% Extracted unchanged from appendix_e_synthetic_protocol.tex: \E[V\mid\mathbf z^{\mathrm a}]=\mathbf 0 +\documentclass[border=0pt]{standalone} +\usepackage{times} +\usepackage{amsmath,amsfonts,bm} +\newcommand{\E}{\mathbb{E}} +\newsavebox{\equationbox} +\begin{document}% +\savebox{\equationbox}{$\E[V\mid\mathbf z^{\mathrm a}]=\mathbf 0$}% +\typeout{MATHBOX:\the\wd\equationbox,\the\ht\equationbox,\the\dp\equationbox}% +\usebox{\equationbox}% +\end{document} diff --git a/projects/video-action-editing/paper/source/2_theory.tex b/projects/video-action-editing/paper/source/2_theory.tex new file mode 100644 index 0000000..21f34ab --- /dev/null +++ b/projects/video-action-editing/paper/source/2_theory.tex @@ -0,0 +1,191 @@ +\section{Theory} +\label{sec:theory} +We model action editing with a latent video-generating process, establish +when paired-view learning identifies action anchors, and explain their role +in demonstration-guided editing. + +\subsection{Problem formulation} +\label{subsec:dgp-overview} + +For a video $V=(\mathbf x_1,\ldots,\mathbf x_T)$, let $\mathbf z^{\mathrm c}$ +denote persistent content and $\mathbf z^{\mathrm a}_t$ its action state. +For a controlled description with physical context fixed, the generating process is +\begin{equation} + \begin{aligned} + \mathbf z^{\mathrm c}&\sim p_{\mathrm c},\qquad (u,\mathbf z^{\mathrm a}_0,\boldsymbol\epsilon_{1:T})\sim p_{\mathrm{dyn}},\\ + \mathbf z^{\mathrm a}_t&=f(\mathbf z^{\mathrm a}_{t-1},u,\boldsymbol\epsilon_t),\qquad + V=g_{\mathrm{ctrl}}(\mathbf z^{\mathrm c},\mathbf z^{\mathrm a}_{0:T}). + \end{aligned} + \label{eq:dgp-controlled} +\end{equation} +Here, $u$ specifies the action regime (e.g., raising or lowering an arm), +and $\boldsymbol\epsilon_t$ captures stochastic variation in the state +transition $f$. The observation map $g_{\mathrm{ctrl}}$ maps content and +the resulting action trajectory to a video. $p_{\mathrm c}$ is the content +distribution, while $p_{\mathrm{dyn}}$ is the joint distribution of $u$, +the initial state $\mathbf z^{\mathrm a}_0$, and $\boldsymbol\epsilon_{1:T}$. +The action block is $\mathbf z^{\mathrm a}:=\mathbf z^{\mathrm a}_{0:T}$. +Content is independent of the action-generating variables +(Appendix~\ref{sec:controlled-transfer}). For source +$V_{\mathrm s}=g_{\mathrm{ctrl}}(\mathbf z^{\mathrm c}_{\mathrm s},\mathbf z^{\mathrm a}_{\mathrm s})$ and demonstration +$V_{\mathrm r}=g_{\mathrm{ctrl}}(\mathbf z^{\mathrm c}_{\mathrm r},\mathbf z^{\mathrm a\star})$, the desired edit is +\begin{equation} + V^\star=g_{\mathrm{ctrl}}(\mathbf z^{\mathrm c}_{\mathrm s},\mathbf z^{\mathrm a\star}). + \label{eq:dgp-counterfactual} +\end{equation} +Action-preserving pairs vary appearance at a fixed trajectory +(Figure~\ref{fig:controlled-dgp}). We use this relation to study when +an action representation can be recovered independently of appearance. + +\begin{figure}[!htbp] + \centering + \includegraphics[width=\linewidth]{data_generating_process.pdf} + \caption{Controlled video generation and content--action recombination within a fixed physical context. + Content $\mathbf z^{\mathrm c}$ and action $\mathbf z^{\mathrm a}_{0:T}$ jointly determine the video + through the renderer $g_{\mathrm{ctrl}}$ (left). + Rows share content and columns share action; the desired edit combines source content + $\mathbf z^{\mathrm c}_{\mathrm s}$ with demonstrated action $\mathbf z^{\mathrm a\star}$ (right).} + \label{fig:controlled-dgp} +\end{figure} +\subsection{Learning identifiable action anchors} +\label{subsec:anchor-learning} +\label{subsec:anchor-identification} + +A demonstration supplies temporal behavior together with its visual content. +The learning problem is to retain the former across changes in the latter. +Let $\mathbf w$ collect the initial state, regime, and innovations in +Eq.~\ref{eq:dgp-controlled}, and let $\mathcal F_T(\mathbf w)=\mathbf z^{\mathrm a}_{0:T}$ +be its unrolled trajectory. An action-preserving pair holds $\mathbf w$ fixed: +\begin{equation} + V=g_{\mathrm{ctrl}}(\mathbf z^{\mathrm c},\mathcal F_T(\mathbf w)),\qquad + V^+=g_{\mathrm{ctrl}}(\mathbf z^{\mathrm c+},\mathcal F_T(\mathbf w)). + \label{eq:controlled-anchor-views} +\end{equation} +The entire realized trajectory is shared, including timing and interactions; +an action label alone does not specify this relation. These are +representation-learning pairs; the source and target-action demonstration +may depict different actions. + +\begin{definition}[Blockwise identification] +\label{def:anchor-identification} +An encoder $E_{\mathrm a}:\mathcal V\to\R^{d_{\mathrm a}}$ identifies the action block if +$E_{\mathrm a}(V)=h_{\mathrm a}(\mathbf z^{\mathrm a})$ almost surely, +where $h_{\mathrm a}$ is injective on a full-measure subset of the action support. +Coordinates may mix within the block. +\end{definition} + +\Needspace{13\baselineskip} +\begin{condition}[Nonlinear action identification] +\label{cond:anchor-identification} +\leavevmode + +\par\noindent\textup{(i)} \textbf{Regularity.} +The supports $\mathcal W$ and $\mathcal Z^{\mathrm c}$ are compact, and +$f$ and $g_{\mathrm{ctrl}}$ are continuous. Write +$\mathcal A_T=\mathcal F_T(\mathcal W)$ for the supported trajectory family. + +\par\noindent\textup{(ii)} \textbf{Appearance variation.} +The two content variables in Eq.~\ref{eq:controlled-anchor-views} are +independent draws from $p_{\mathrm c}$, independently of $\mathbf w$, +and $p_{\mathrm c}$ has full support on $\mathcal Z^{\mathrm c}$. + +\par\noindent\textup{(iii)} \textbf{Temporal observability.} +Two distinct trajectories in $\mathcal A_T$ cannot generate the same +complete video under any supported content choices. +\end{condition} +Part (iii) concerns the ordered video, not each frame separately. +An injective video-generating map suffices, but recovering content is +unnecessary. The observation map may mix action and appearance nonlinearly; +no additive feature decomposition is imposed. + +\paragraph{Population learning problem.} +Agreement alone permits collapse, while predicting an ordinary feature +mean can erase differences between actions. We therefore analyze prediction +of the action-conditional video distribution. Let $k$ be a bounded, +continuous characteristic kernel on ordered videos, with feature map +$\varphi(V)=k(V,\cdot)$ in its reproducing kernel Hilbert space $\mathcal H_k$. +``Characteristic'' means that the mean embedding uniquely determines a +probability distribution; a Gaussian kernel on vectorized videos is one +choice~\citep{sriperumbudur2010hilbert}. Consider +\begin{equation} + \begin{aligned} + \mathcal J(E_{\mathrm a},P) + ={}&\lambda\,\underbrace{\E\|E_{\mathrm a}(V)-E_{\mathrm a}(V^+)\|^2}_{\mathcal L_{\mathrm{inv}}}\\ + &+\underbrace{\E\|P(E_{\mathrm a}(V))-\varphi(V^+)\|_{\mathcal H_k}^2}_{\mathcal L_{\mathrm{pred}}}, + \qquad\lambda>0 . + \end{aligned} + \label{eq:anchor-objective} +\end{equation} +We optimize over all continuous encoders and measurable predictors +with finite risk. The code dimension must admit continuous +injective coordinates of $\mathcal A_T$; the full trajectory always +provides such coordinates. This criterion uses observed view pairs +without action-coordinate labels. + +\begin{theorem}[Blockwise identification by paired-view learning] +\label{thm:anchor-identification} +Under Eq.~\ref{eq:controlled-anchor-views} and +Condition~\ref{cond:anchor-identification}, the population class above +attains the minimum of Eq.~\ref{eq:anchor-objective}. +Every global minimizer satisfies +\begin{equation} + E_{\mathrm a}(V)=h_{\mathrm a}(\mathbf z^{\mathrm a}),\qquad + P(h_{\mathrm a}(\mathbf z^{\mathrm a}))=\mu_k(\mathbf z^{\mathrm a}) + \quad\text{almost surely}, + \label{eq:anchor-identification} +\end{equation} +where $\mu_k(\mathbf a)=\E[\varphi(V)\mid\mathbf z^{\mathrm a}=\mathbf a]$ +and $h_{\mathrm a}$ is injective on a full-measure action subset. +\end{theorem} + +\paragraph{Proof sketch.} +Temporal observability and compactness give a continuous action readout +from the whole video. Distinct actions induce distributions supported on +disjoint sets of videos, so their characteristic embeddings differ. +These facts construct an invariant encoder and predictor attaining the +irreducible prediction variance. Conditional independence decomposes the +objective into this variance and two nonnegative errors. Every global +optimum therefore eliminates appearance variation while retaining distinct +action distributions (Appendix~\ref{subsec:nonlinear-anchor-proof}). + +\subsection{Temporal information and action transfer} +\label{subsec:anchor-realization} + +Consider position--velocity dynamics with constant acceleration $u$ and +nonlinear frame observations +\[ + p_t=p_0+t v_0+\tfrac12t^2u,\qquad \mathbf x_t=\rho(c,p_t), +\] +where $\rho$ is any continuous invertible map with continuous inverse +on the supported inputs. Three distinct observation times determine +$(p_0,v_0,u)$ and the full trajectory, whereas two times leave an ambiguity. +Thus single-frame recovery of the action block is unnecessary, even when +appearance and position interact nonlinearly +(Appendix~\ref{subsec:nonlinear-temporal-example}). + +For additive features, the prediction target can be simplified. On the +supported content--trajectory pairs, let +\[ + \Phi(V)=q_{1:T}(\mathbf z^{\mathrm a})+\mathbf D r(\mathbf z^{\mathrm c}), + \qquad + \mathcal N_T=\operatorname{im}\Cov(\mathbf D r(\mathbf z^{\mathrm c})), +\] +where $\mathbf D$ is fixed, $q_{1:T}$ stacks the framewise action responses +$q_t$, and $\mathcal N_T$ is the subspace of appearance variation. + +\begin{corollary}[Identification from additive features] +\label{cor:additive-anchor-learning} +Assume Condition~\ref{cond:anchor-identification}(i)--(ii), continuous +$\Phi,q_t$, and finite covariance of $r(\mathbf z^{\mathrm c})$. +Suppose $q_{1:T}(\mathbf a)-q_{1:T}(\mathbf a')\notin\mathcal N_T$ +for any distinct $\mathbf a,\mathbf a'\in\mathcal A_T$. +Over the population model class above, with +$d_{\mathrm a}\geq\operatorname{rank}\Cov(\Phi(V))-\dim\mathcal N_T$, +every global minimizer of Eq.~\ref{eq:anchor-objective} with +$\varphi(V^+)$ replaced by $\Phi(V^+)$ and squared Euclidean prediction +error identifies the action block. +\end{corollary} + +Averaging over appearance leaves an injective function of the action +trajectory, allowing ordinary feature prediction to identify the action +block (proof in Appendix~\ref{subsec:anchor-proof-identification}). diff --git a/projects/video-action-editing/paper/source/3_method.tex b/projects/video-action-editing/paper/source/3_method.tex new file mode 100644 index 0000000..6351798 --- /dev/null +++ b/projects/video-action-editing/paper/source/3_method.tex @@ -0,0 +1,135 @@ +\section{Method} +\label{sec:method} +VADD learns action representations from demonstrations and trains an +editor to execute them under source conditioning +(Figure~\ref{fig:vadd-method}). The editor receives source $V_{\mathrm s}$, +instruction $i$, and demonstration $V_{\mathrm r}$, any video that performs +the requested action, such as a reference recording or a text-to-video +sample; it need not share the source's appearance or frame alignment. +Section~\ref{subsec:experimental-setup} describes the demonstrations used +in training and at inference. + +\begin{figure}[!t] + \centering + \includegraphics[width=\linewidth]{vadd_method_overview_anchor.pdf} + \caption{VADD overview. + (a) A temporal encoder extracts action anchors from full dynamic observations. + Normalized anchors (orange) and compressed V-JEPA2 features (teal) form + $\mathbf K$. Training uses same-video patch views for consistency, + dynamic-observation reconstruction, and KL matching to a history-conditioned + factorized prior. + (b) Source context, generated states, and phase-aligned action conditions + drive residual adapters during early sampling steps. + Clean predictions receive source-preservation and ordered behavior + supervision, with source, reversed, and shuffled videos as controls. + Dashed paths denote training; repeated $\widehat V_{0\mid k}$ ports refer + to the same prediction. Source/text preprocessing and the sampling loop + are condensed. Videos, tokens, and distributions are schematic.} + \label{fig:vadd-method} +\end{figure} + +\subsection{Learning action representations from demonstrations} +\label{subsec:method-anchor} + +Frozen backbone features of a demonstration yield dynamic observations $\mathbf O(V_{\mathrm r})\in\R^{L\times d_o}$ over $L$ +resampled temporal phases. Temporal centering removes constant offsets; +signed changes and local change magnitudes retain direction and variation. +Alternating spatial patches of the same video provide two training views. + +A bidirectional recurrent encoder produces a Gaussian posterior +$q_\phi(\widetilde{\mathbf z}^{\mathrm a}_{1:L}\mid \mathbf O)$. Its mean sequence $\widehat{\mathbf z}^{\mathrm a}=E_{\mathrm a}(V_{\mathrm r})=\boldsymbol\mu_\phi(\mathbf O(V_{\mathrm r}))$ serves as the +learned action anchor, with $d_{\mathrm a}=Ld_z$ after vectorization. A history-conditioned prior factorizes as +\begin{equation} + p_\psi(\widetilde{\mathbf z}^{\mathrm a}_{1:L}) + =\prod_{t=1}^{L}\prod_{j=1}^{d_z} + p_{\psi,t,j}(\widetilde z^{\mathrm a}_{t,j}\mid \widetilde{\mathbf z}^{\mathrm a}_{