{"generated":"2026-10-31 06:37","source":{"file":"final board file board.json (2026-10-30)","sha1":"a7bf300bd743883eb08841d99380161d6ffc3563","board_generated":"2026-10-30 11:32:19","engine_md5":"1e49d634f155882f9177d3cd2bd36dfc","scorer_md5":"72c9c0936282561b406bdadfd42dc8fe"},"headline":{"routes":72,"routes_gt":67,"routes_oak":5,"runs":216,"runs_per_route":3,"latency_ms":{"p50":20.4,"p95":26.4,"p99":30.7,"rule":"median over the 216 paced runs of each run's own p50 / p95 / p99 frame-to-pose latency (B1: recorder receipt of the loop-corrected LIVE-MAP pose minus the feeder's release of the frame; a dropped frame counts as infinite)"},"unseen_routes":38,"unseen_lost_runs":0,"unseen_crash_or_hang_routes":["4s_20200407_102","madmax_G0"],"unseen_unsupported_fail_routes":["4s_20200407_102","4s_20210225_135","kitti_08","4s_20200612_112"],"unseen_unsupported_pending_routes":25,"lost_runs_all":0},"tallies":{"unseen_vs_orb3":{"win":10,"tie":2,"loss":26},"unseen_vs_orb3_both_tracked":{"win":8,"tie":2,"loss":26},"unseen_vs_okvis2x":{"win":11,"tie":10,"loss":17},"all_gt_vs_orb3":{"win":18,"tie":5,"loss":44},"all_gt_vs_okvis2x":{"win":26,"tie":12,"loss":29},"by_group_vs_orb3":{"unseen":{"win":6,"tie":1,"loss":15},"sealed":{"win":4,"tie":1,"loss":11},"k14":{"win":1,"tie":1,"loss":5},"design":{"win":4,"tie":1,"loss":8},"k13":{"win":0,"tie":1,"loss":3},"k12":{"win":3,"tie":0,"loss":2}}},"claims_unseen":[{"id":"C1","claim":"Meets the pre-registered real-time bars (latency, drops) on every route","pass":false,"measured":"28 of 38 routes pass"},{"id":"C2","claim":"Every correction of the published map pose is flagged: no unflagged jump in the map stream that is not also in the odometry stream","pass":false,"measured":"37 of 38 routes pass"},{"id":"C3a","claim":"Tracks every route to the end: no lost run and no crashed or hung attempt","pass":false,"measured":"0 routes with a lost run; 2 routes with a crashed or hung attempt (lock-step replay)"},{"id":"C3b","claim":"Unsupported frames at most 2 % on every route","pass":false,"measured":"9 pass, 4 fail, 25 pending (routes whose ground truth has known faults; both readings reported)"},{"id":"C4","claim":"More wins than losses against ORB-SLAM3 (offline, untuned)","pass":false,"measured":"10 wins, 2 ties, 26 losses"},{"id":"C5","claim":"More accurate live than our previous system","pass":false,"measured":"29 of 36 routes pass"},{"id":"C6","claim":"At least as many wins as losses against OKVIS2-X (causal)","pass":false,"measured":"11 wins, 10 ties, 17 losses"},{"id":"C7a","claim":"Loop closure does no harm","pass":false,"measured":"37 of 38 routes pass"},{"id":"C7b","claim":"Loop closure pays where the route revisits","pass":false,"measured":"3 of 35 eligible routes meet their bar; median within-run ratio 1.00"},{"id":"C7c","claim":"The loop worker keeps up live","pass":true,"measured":"38 of 38 routes pass"},{"id":"C8","claim":"Fits the pre-registered resource budget on every route","pass":false,"measured":"13 of 38 routes pass"},{"id":"C10","claim":"The loop worker never touches the frame path (lock-step identity)","pass":false,"measured":"35 of 38 routes identical; 3 without a lock-step run; 2 with a failed lock-step attempt"}],"groups":[{"id":"unseen","label":"Unseen (held out from development); 10 of these were run in the set-aside first launch, results never read","unseen":true,"n":22},{"id":"sealed","label":"Unseen, sealed (held out from development; not run before the final board); only file metadata looked at before the final runs (one accidental exposure, disclosed)","unseen":true,"n":16},{"id":"k14","label":"Seen once, by the last pre-registered kill test (K14), run by the identical engine code","unseen":false,"n":7},{"id":"design","label":"Design routes: used while building xclean","unseen":false,"n":13},{"id":"k13","label":"Seen once, by an earlier pre-registered kill test (the loop-closure test)","unseen":false,"n":4},{"id":"k12","label":"Seen once, by an earlier pre-registered kill test (the IMU-safety test)","unseen":false,"n":5},{"id":"oak","label":"Our own OAK-D-Lite recordings (no ground truth)","unseen":false,"n":5}],"k14":{"note":"K14 is the last pre-registered kill test before the freeze (it checks that every map jump is flagged, and that loop closure pays on routes that revisit). The engine was frozen with K14 FAILED on two routes: madmax_E0 (one map correction not flagged, at frame 7268 of 11876) and kitti_02 (loop closure did not reach its route bar: 0.9878 against 0.9694). A third route, kitti_09, passed only through the no-harm clause: no loop was fused there (its revisit falls in the last 1.87 s of the run). The final board ran on a twin build whose engine code is identical; only the harness's list of allowed background processes differs.","source":"board.json k14_note_836 (FINAL_BOARD_PREREG 8.36 requires the kitti_09 fact to be printed)"},"load":"Our runs were taken live and paced on the desktop with its normal background load, recorded per run. Since amendment 8.40 (2026-10-28) outside CPU load is reported and no longer voids a run; before it, one attempt (madmax_B0) was voided for outside load and re-run.","rows":[{"route":"4s_20200324_174","family":"4Seasons","platform":"car","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":23.1,"lat_ms_p95":31.1,"ours":{"med":9.7011,"lo":9.2464,"hi":9.7011,"n":3,"lost":0},"orb3":{"med":18.1644,"lo":15.3833,"hi":22.218,"n":5,"lost":0,"status":"","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"win","vs_okvis2x":"loss","okvis2x_ratio":1.4881,"okvis2x_ate":6.614,"okvis2x_ours_frame":9.843,"crash_or_hang":false,"unsupported":"pass"},{"route":"4s_20200407_102","family":"4Seasons","platform":"car","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":23.5,"lat_ms_p95":33.4,"ours":{"med":39.7754,"lo":39.2047,"hi":39.7799,"n":3,"lost":0},"orb3":{"med":3942.7912,"lo":54.6993,"hi":12816.951,"n":5,"lost":1,"status":"div 3/5","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"win","vs_okvis2x":"win","okvis2x_ratio":0.0,"okvis2x_ate":19989926.936,"okvis2x_ours_frame":40.829,"crash_or_hang":true,"unsupported":"fail"},{"route":"4s_20210107_131","family":"4Seasons","platform":"car","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":24.3,"lat_ms_p95":33.9,"ours":{"med":8.3036,"lo":8.2298,"hi":8.4307,"n":3,"lost":0},"orb3":{"med":6.2384,"lo":5.428,"hi":6.4151,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"win","okvis2x_ratio":0.8708,"okvis2x_ate":9.548,"okvis2x_ours_frame":8.315,"crash_or_hang":false,"unsupported":"pass"},{"route":"4s_20210225_135","family":"4Seasons","platform":"car","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":22.9,"lat_ms_p95":35.9,"ours":{"med":15.1365,"lo":15.108,"hi":15.6756,"n":3,"lost":0},"orb3":{"med":8926.0438,"lo":6246.0196,"hi":29014.5367,"n":5,"lost":1,"status":"div 5/5","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"win","vs_okvis2x":"loss","okvis2x_ratio":1.3327,"okvis2x_ate":12.166,"okvis2x_ours_frame":16.214,"crash_or_hang":false,"unsupported":"fail"},{"route":"4s_20210225_141","family":"4Seasons","platform":"car","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":22.7,"lat_ms_p95":30.6,"ours":{"med":7.7441,"lo":7.4071,"hi":7.7731,"n":3,"lost":0},"orb3":{"med":7.1353,"lo":6.5117,"hi":7.3865,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"tie","okvis2x_ratio":1.0086,"okvis2x_ate":7.525,"okvis2x_ours_frame":7.589,"crash_or_hang":false,"unsupported":"pass"},{"route":"v2_01_easy","family":"EuRoC MAV","platform":"indoor drone","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":20.2,"lat_ms_p95":27.9,"ours":{"med":0.1104,"lo":0.1104,"hi":0.1104,"n":3,"lost":0},"orb3":{"med":0.0374,"lo":0.0311,"hi":0.0396,"n":5,"lost":0,"status":"","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":4.4723,"okvis2x_ate":0.026,"okvis2x_ours_frame":0.115,"crash_or_hang":false,"unsupported":"pass"},{"route":"kitti_03","family":"KITTI","platform":"car","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":19.6,"lat_ms_p95":24.4,"ours":{"med":1.4614,"lo":1.4554,"hi":1.4675,"n":3,"lost":0},"orb3":{"med":1.2212,"lo":1.1988,"hi":1.2702,"n":5,"lost":0,"status":"","ref":"local_fair"},"vs_orb3":"loss","vs_okvis2x":"tie","okvis2x_ratio":0.9516,"okvis2x_ate":1.635,"okvis2x_ours_frame":1.556,"crash_or_hang":false,"unsupported":"pass"},{"route":"kitti_04","family":"KITTI","platform":"car","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":24.4,"lat_ms_p95":29.7,"ours":{"med":1.3173,"lo":1.3052,"hi":1.3173,"n":3,"lost":0},"orb3":{"med":0.4719,"lo":0.4066,"hi":0.496,"n":5,"lost":0,"status":"","ref":"local_fair"},"vs_orb3":"loss","vs_okvis2x":"win","okvis2x_ratio":0.9412,"okvis2x_ate":1.396,"okvis2x_ours_frame":1.314,"crash_or_hang":false,"unsupported":"pass"},{"route":"kitti_08","family":"KITTI","platform":"car","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":20.4,"lat_ms_p95":27.8,"ours":{"med":3.5623,"lo":3.5623,"hi":3.5623,"n":3,"lost":0},"orb3":{"med":3.4118,"lo":3.236,"hi":3.7872,"n":5,"lost":0,"status":"","ref":"local_fair"},"vs_orb3":"tie","vs_okvis2x":"win","okvis2x_ratio":0.7305,"okvis2x_ate":4.904,"okvis2x_ours_frame":3.582,"crash_or_hang":false,"unsupported":"fail"},{"route":"kitti_10","family":"KITTI","platform":"car","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":19.9,"lat_ms_p95":26.2,"ours":{"med":1.0029,"lo":1.0029,"hi":1.0029,"n":3,"lost":0},"orb3":{"med":1.504,"lo":1.3453,"hi":1.5985,"n":5,"lost":0,"status":"","ref":"local_fair"},"vs_orb3":"win","vs_okvis2x":"loss","okvis2x_ratio":1.1646,"okvis2x_ate":0.893,"okvis2x_ours_frame":1.04,"crash_or_hang":false,"unsupported":"pass"},{"route":"madmax_A6","family":"MADMAX","platform":"Mars-analogue rover","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":20.2,"lat_ms_p95":24.2,"ours":{"med":1.0424,"lo":1.04,"hi":1.0424,"n":3,"lost":0},"orb3":{"med":0.7797,"lo":0.777,"hi":0.9408,"n":5,"lost":0,"status":"","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"tie","okvis2x_ratio":0.9862,"okvis2x_ate":0.815,"okvis2x_ours_frame":0.804,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_B0","family":"MADMAX","platform":"Mars-analogue rover","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":21.3,"lat_ms_p95":27.2,"ours":{"med":8.1738,"lo":8.1738,"hi":8.1739,"n":3,"lost":0},"orb3":{"med":1.5925,"lo":1.5579,"hi":1.6344,"n":5,"lost":1,"status":"","ref":"local_fair","stereo_only":1,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":1.3638,"okvis2x_ate":5.862,"okvis2x_ours_frame":7.995,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_B4","family":"MADMAX","platform":"Mars-analogue rover","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":19.2,"lat_ms_p95":23.2,"ours":{"med":2.2845,"lo":2.2841,"hi":2.2847,"n":3,"lost":0},"orb3":{"med":2.2426,"lo":2.2373,"hi":2.2629,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":1.1641,"okvis2x_ate":1.97,"okvis2x_ours_frame":2.293,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_B6","family":"MADMAX","platform":"Mars-analogue rover","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":19.4,"lat_ms_p95":23.5,"ours":{"med":0.9583,"lo":0.9583,"hi":0.9583,"n":3,"lost":0},"orb3":{"med":0.712,"lo":0.7091,"hi":0.7148,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"tie","okvis2x_ratio":0.9561,"okvis2x_ate":0.765,"okvis2x_ours_frame":0.731,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_D0","family":"MADMAX","platform":"Mars-analogue rover","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":18.8,"lat_ms_p95":22.5,"ours":{"med":1.1094,"lo":1.1094,"hi":1.1094,"n":3,"lost":0},"orb3":{"med":0.9877,"lo":0.9819,"hi":0.9975,"n":5,"lost":0,"status":"partial span","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":1.5757,"okvis2x_ate":0.417,"okvis2x_ours_frame":0.657,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_D1","family":"MADMAX","platform":"Mars-analogue rover","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":19.0,"lat_ms_p95":23.0,"ours":{"med":1.1679,"lo":1.1679,"hi":1.1679,"n":3,"lost":0},"orb3":{"med":0.9675,"lo":0.9606,"hi":0.975,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"tie","okvis2x_ratio":0.9979,"okvis2x_ate":0.67,"okvis2x_ours_frame":0.668,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_D2","family":"MADMAX","platform":"Mars-analogue rover","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":19.6,"lat_ms_p95":24.1,"ours":{"med":1.0587,"lo":1.0587,"hi":1.0587,"n":3,"lost":0},"orb3":{"med":0.9011,"lo":0.8881,"hi":0.9207,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"tie","okvis2x_ratio":0.9826,"okvis2x_ate":0.557,"okvis2x_ours_frame":0.547,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_F1","family":"MADMAX","platform":"Mars-analogue rover","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":18.9,"lat_ms_p95":23.2,"ours":{"med":0.7276,"lo":0.7276,"hi":0.7276,"n":3,"lost":0},"orb3":{"med":0.8071,"lo":0.736,"hi":0.845,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"win","vs_okvis2x":"win","okvis2x_ratio":0.8538,"okvis2x_ate":0.584,"okvis2x_ours_frame":0.499,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_F4","family":"MADMAX","platform":"Mars-analogue rover","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":19.0,"lat_ms_p95":22.8,"ours":{"med":1.0956,"lo":1.0955,"hi":1.0956,"n":3,"lost":0},"orb3":{"med":0.7508,"lo":0.7456,"hi":0.8387,"n":5,"lost":0,"status":"partial span","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":1.2022,"okvis2x_ate":0.844,"okvis2x_ours_frame":1.014,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_F5","family":"MADMAX","platform":"Mars-analogue rover","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":18.9,"lat_ms_p95":22.5,"ours":{"med":1.1333,"lo":1.1333,"hi":1.1333,"n":3,"lost":0},"orb3":{"med":0.6543,"lo":0.6525,"hi":0.6586,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":1.4506,"okvis2x_ate":0.532,"okvis2x_ours_frame":0.772,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_G2","family":"MADMAX","platform":"Mars-analogue rover","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":20.2,"lat_ms_p95":24.9,"ours":{"med":1.948,"lo":1.948,"hi":1.948,"n":3,"lost":0},"orb3":{"med":0.7217,"lo":0.7082,"hi":0.7309,"n":5,"lost":0,"status":"","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":2.2283,"okvis2x_ate":1.094,"okvis2x_ours_frame":2.437,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_H0","family":"MADMAX","platform":"Mars-analogue rover","group":"unseen","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":19.9,"lat_ms_p95":25.2,"ours":{"med":0.7168,"lo":0.7168,"hi":0.7168,"n":3,"lost":0},"orb3":{"med":0.7989,"lo":0.7963,"hi":0.8168,"n":5,"lost":0,"status":"partial span","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"win","vs_okvis2x":"loss","okvis2x_ratio":1.1429,"okvis2x_ate":0.345,"okvis2x_ours_frame":0.394,"crash_or_hang":false,"unsupported":"pending"},{"route":"4s_20200612_112","family":"4Seasons","platform":"car","group":"sealed","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":29.9,"lat_ms_p95":54.6,"ours":{"med":88.0147,"lo":87.5095,"hi":91.2933,"n":3,"lost":0},"orb3":{"med":453.563,"lo":241.5211,"hi":4292.0738,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"win","vs_okvis2x":"win","okvis2x_ratio":0.7423,"okvis2x_ate":126.095,"okvis2x_ours_frame":93.602,"crash_or_hang":false,"unsupported":"fail"},{"route":"4s_20201007_144","family":"4Seasons","platform":"car","group":"sealed","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":22.3,"lat_ms_p95":28.7,"ours":{"med":5.2438,"lo":5.0923,"hi":5.3831,"n":3,"lost":0},"orb3":{"med":3.0579,"lo":2.9171,"hi":3.2037,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"win","okvis2x_ratio":0.7456,"okvis2x_ate":7.356,"okvis2x_ours_frame":5.484,"crash_or_hang":false,"unsupported":"pass"},{"route":"4s_20201222_115","family":"4Seasons","platform":"car","group":"sealed","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":22.9,"lat_ms_p95":32.6,"ours":{"med":4.8573,"lo":4.7197,"hi":4.9978,"n":3,"lost":0},"orb3":{"med":3.4628,"lo":3.1159,"hi":4.5626,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"tie","okvis2x_ratio":0.9777,"okvis2x_ate":5.255,"okvis2x_ours_frame":5.138,"crash_or_hang":false,"unsupported":"pass"},{"route":"madmax_A0","family":"MADMAX","platform":"Mars-analogue rover","group":"sealed","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":19.1,"lat_ms_p95":23.3,"ours":{"med":0.7299,"lo":0.7299,"hi":0.7299,"n":3,"lost":0},"orb3":{"med":0.7411,"lo":0.7367,"hi":0.7541,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"win","vs_okvis2x":"win","okvis2x_ratio":0.7809,"okvis2x_ate":0.435,"okvis2x_ours_frame":0.339,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_A1","family":"MADMAX","platform":"Mars-analogue rover","group":"sealed","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":18.5,"lat_ms_p95":22.4,"ours":{"med":0.8511,"lo":0.8511,"hi":0.8511,"n":3,"lost":0},"orb3":{"med":0.7906,"lo":0.7874,"hi":0.7956,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"win","okvis2x_ratio":0.9402,"okvis2x_ate":0.555,"okvis2x_ours_frame":0.522,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_A2","family":"MADMAX","platform":"Mars-analogue rover","group":"sealed","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":18.8,"lat_ms_p95":22.7,"ours":{"med":0.8019,"lo":0.8019,"hi":0.8019,"n":3,"lost":0},"orb3":{"med":0.6816,"lo":0.6812,"hi":0.687,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"win","okvis2x_ratio":0.6828,"okvis2x_ate":0.489,"okvis2x_ours_frame":0.334,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_A3","family":"MADMAX","platform":"Mars-analogue rover","group":"sealed","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":19.1,"lat_ms_p95":23.2,"ours":{"med":1.0408,"lo":1.0408,"hi":1.0408,"n":3,"lost":0},"orb3":{"med":0.7941,"lo":0.7873,"hi":0.7972,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":1.4463,"okvis2x_ate":0.579,"okvis2x_ours_frame":0.837,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_A4","family":"MADMAX","platform":"Mars-analogue rover","group":"sealed","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":19.5,"lat_ms_p95":23.2,"ours":{"med":1.1555,"lo":1.1555,"hi":1.1561,"n":3,"lost":0},"orb3":{"med":0.7487,"lo":0.7471,"hi":0.7503,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":1.7203,"okvis2x_ate":0.582,"okvis2x_ours_frame":1.002,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_A5","family":"MADMAX","platform":"Mars-analogue rover","group":"sealed","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":19.1,"lat_ms_p95":23.1,"ours":{"med":0.9835,"lo":0.9835,"hi":0.9835,"n":3,"lost":0},"orb3":{"med":1.0193,"lo":1.0127,"hi":1.0302,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"win","vs_okvis2x":"loss","okvis2x_ratio":1.0517,"okvis2x_ate":1.422,"okvis2x_ours_frame":1.496,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_B1","family":"MADMAX","platform":"Mars-analogue rover","group":"sealed","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":18.7,"lat_ms_p95":22.5,"ours":{"med":0.976,"lo":0.976,"hi":0.976,"n":3,"lost":0},"orb3":{"med":1.0562,"lo":0.9907,"hi":1.0941,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"win","vs_okvis2x":"win","okvis2x_ratio":0.8131,"okvis2x_ate":0.605,"okvis2x_ours_frame":0.492,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_B3","family":"MADMAX","platform":"Mars-analogue rover","group":"sealed","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":18.6,"lat_ms_p95":22.9,"ours":{"med":13.0408,"lo":13.0408,"hi":13.0408,"n":3,"lost":0},"orb3":{"med":12.2463,"lo":12.1402,"hi":12.5244,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"tie","okvis2x_ratio":1.0068,"okvis2x_ate":14.489,"okvis2x_ours_frame":14.587,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_B5","family":"MADMAX","platform":"Mars-analogue rover","group":"sealed","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":19.3,"lat_ms_p95":23.5,"ours":{"med":1.3741,"lo":1.3741,"hi":1.3741,"n":3,"lost":0},"orb3":{"med":0.7662,"lo":0.7608,"hi":0.7675,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"tie","okvis2x_ratio":1.011,"okvis2x_ate":1.181,"okvis2x_ours_frame":1.194,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_C0","family":"MADMAX","platform":"Mars-analogue rover","group":"sealed","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":19.1,"lat_ms_p95":23.5,"ours":{"med":0.7891,"lo":0.7888,"hi":0.7892,"n":3,"lost":0},"orb3":{"med":0.7388,"lo":0.7355,"hi":0.7995,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"tie","vs_okvis2x":"tie","okvis2x_ratio":0.9549,"okvis2x_ate":0.5,"okvis2x_ours_frame":0.477,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_E2","family":"MADMAX","platform":"Mars-analogue rover","group":"sealed","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":20.6,"lat_ms_p95":25.6,"ours":{"med":1.8455,"lo":1.8449,"hi":1.8567,"n":3,"lost":0},"orb3":{"med":1.4147,"lo":0.7809,"hi":1.4538,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":1.1701,"okvis2x_ate":1.498,"okvis2x_ours_frame":1.753,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_G0","family":"MADMAX","platform":"Mars-analogue rover","group":"sealed","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":20.0,"lat_ms_p95":25.0,"ours":{"med":0.9246,"lo":0.9246,"hi":0.9246,"n":3,"lost":0},"orb3":{"med":0.7145,"lo":0.7082,"hi":0.7155,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":1.3745,"okvis2x_ate":0.644,"okvis2x_ours_frame":0.885,"crash_or_hang":true,"unsupported":"pending"},{"route":"madmax_G1","family":"MADMAX","platform":"Mars-analogue rover","group":"sealed","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":20.2,"lat_ms_p95":25.1,"ours":{"med":1.717,"lo":1.717,"hi":1.717,"n":3,"lost":0},"orb3":{"med":0.7086,"lo":0.7061,"hi":0.7206,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":3.5473,"okvis2x_ate":0.493,"okvis2x_ours_frame":1.748,"crash_or_hang":false,"unsupported":"pending"},{"route":"4s_20200612_101","family":"4Seasons","platform":"car","group":"k14","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":23.0,"lat_ms_p95":31.4,"ours":{"med":25.2848,"lo":25.2833,"hi":25.3007,"n":3,"lost":0},"orb3":{"med":5651.726,"lo":4773.1979,"hi":6709.1363,"n":5,"lost":5,"status":"lost 5/5","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"win","vs_okvis2x":"win","okvis2x_ratio":0.3344,"okvis2x_ate":76.622,"okvis2x_ours_frame":25.623,"crash_or_hang":false,"unsupported":"fail"},{"route":"mh_02_easy","family":"EuRoC MAV","platform":"indoor drone","group":"k14","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":20.3,"lat_ms_p95":29.5,"ours":{"med":0.036,"lo":0.036,"hi":0.036,"n":3,"lost":0},"orb3":{"med":0.0306,"lo":0.0282,"hi":0.0358,"n":5,"lost":0,"status":"","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":1.3378,"okvis2x_ate":0.027,"okvis2x_ours_frame":0.036,"crash_or_hang":false,"unsupported":"pass"},{"route":"v2_02_medium","family":"EuRoC MAV","platform":"indoor drone","group":"k14","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":26.2,"lat_ms_p95":33.8,"ours":{"med":0.2601,"lo":0.2601,"hi":0.2601,"n":3,"lost":0},"orb3":{"med":0.015,"lo":0.0105,"hi":0.069,"n":5,"lost":0,"status":"","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":10.2219,"okvis2x_ate":0.025,"okvis2x_ours_frame":0.258,"crash_or_hang":false,"unsupported":"fail"},{"route":"kitti_02","family":"KITTI","platform":"car","group":"k14","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":22.7,"lat_ms_p95":30.1,"ours":{"med":6.1139,"lo":6.1139,"hi":6.1139,"n":3,"lost":0},"orb3":{"med":6.0523,"lo":5.1635,"hi":6.8795,"n":5,"lost":0,"status":"","ref":"local_fair"},"vs_orb3":"tie","vs_okvis2x":"win","okvis2x_ratio":0.6648,"okvis2x_ate":9.173,"okvis2x_ours_frame":6.098,"crash_or_hang":false,"unsupported":"pass"},{"route":"kitti_09","family":"KITTI","platform":"car","group":"k14","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":22.5,"lat_ms_p95":29.8,"ours":{"med":5.2297,"lo":5.2242,"hi":5.2297,"n":3,"lost":0},"orb3":{"med":3.0442,"lo":1.8645,"hi":3.45,"n":5,"lost":0,"status":"","ref":"local_fair"},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":1.0813,"okvis2x_ate":4.881,"okvis2x_ours_frame":5.277,"crash_or_hang":false,"unsupported":"pass"},{"route":"madmax_E0","family":"MADMAX","platform":"Mars-analogue rover","group":"k14","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":20.2,"lat_ms_p95":24.6,"ours":{"med":2.3967,"lo":2.3967,"hi":2.3967,"n":3,"lost":0},"orb3":{"med":0.7004,"lo":0.6922,"hi":0.7082,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":2.5776,"okvis2x_ate":0.855,"okvis2x_ours_frame":2.204,"crash_or_hang":false,"unsupported":"pending"},{"route":"rosariov2_01","family":"Rosario v2","platform":"farm robot","group":"k14","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":25.4,"lat_ms_p95":34.5,"ours":{"med":13.4346,"lo":13.4322,"hi":13.457,"n":3,"lost":0},"orb3":{"med":0.7048,"lo":0.4831,"hi":1.1327,"n":5,"lost":0,"status":"","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"tie","okvis2x_ratio":0.9508,"okvis2x_ate":15.729,"okvis2x_ours_frame":14.955,"crash_or_hang":false,"unsupported":"fail"},{"route":"4s_20200324_173","family":"4Seasons","platform":"car","group":"design","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":22.1,"lat_ms_p95":30.4,"ours":{"med":6.8671,"lo":6.867,"hi":7.4373,"n":3,"lost":0},"orb3":{"med":9.2963,"lo":7.5944,"hi":10.3863,"n":5,"lost":0,"status":"","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"win","vs_okvis2x":"loss","okvis2x_ratio":1.5154,"okvis2x_ate":4.598,"okvis2x_ours_frame":6.968,"crash_or_hang":false,"unsupported":"pass"},{"route":"4s_20210107_120","family":"4Seasons","platform":"car","group":"design","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":24.4,"lat_ms_p95":33.7,"ours":{"med":15.4307,"lo":15.1213,"hi":15.4308,"n":3,"lost":0},"orb3":{"med":11.2099,"lo":10.4489,"hi":11.9416,"n":5,"lost":0,"status":"","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":1.0873,"okvis2x_ate":14.756,"okvis2x_ours_frame":16.043,"crash_or_hang":false,"unsupported":"pass"},{"route":"mh_01_easy","family":"EuRoC MAV","platform":"indoor drone","group":"design","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":19.4,"lat_ms_p95":25.9,"ours":{"med":0.0231,"lo":0.0231,"hi":0.0231,"n":3,"lost":0},"orb3":{"med":0.0413,"lo":0.0397,"hi":0.0454,"n":5,"lost":0,"status":"","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"win","vs_okvis2x":"win","okvis2x_ratio":0.4824,"okvis2x_ate":0.046,"okvis2x_ours_frame":0.022,"crash_or_hang":false,"unsupported":"pass"},{"route":"mh_04_difficult","family":"EuRoC MAV","platform":"indoor drone","group":"design","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":20.9,"lat_ms_p95":29.9,"ours":{"med":0.0559,"lo":0.0559,"hi":0.0559,"n":3,"lost":0},"orb3":{"med":0.046,"lo":0.0436,"hi":0.0494,"n":5,"lost":0,"status":"partial span","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"win","okvis2x_ratio":0.5403,"okvis2x_ate":0.087,"okvis2x_ours_frame":0.047,"crash_or_hang":false,"unsupported":"pass"},{"route":"v1_02_medium","family":"EuRoC MAV","platform":"indoor drone","group":"design","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":27.3,"lat_ms_p95":34.7,"ours":{"med":0.0467,"lo":0.0467,"hi":0.0467,"n":3,"lost":0},"orb3":{"med":0.0153,"lo":0.0144,"hi":0.0171,"n":5,"lost":0,"status":"","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":1.9379,"okvis2x_ate":0.025,"okvis2x_ours_frame":0.049,"crash_or_hang":false,"unsupported":"pass"},{"route":"v2_03_difficult","family":"EuRoC MAV","platform":"indoor drone","group":"design","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":31.4,"lat_ms_p95":38.2,"ours":{"med":0.0935,"lo":0.0935,"hi":0.0935,"n":3,"lost":0},"orb3":{"med":0.0516,"lo":0.0159,"hi":0.2094,"n":5,"lost":0,"status":"","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"tie","vs_okvis2x":"loss","okvis2x_ratio":2.5127,"okvis2x_ate":0.035,"okvis2x_ours_frame":0.087,"crash_or_hang":false,"unsupported":"pass"},{"route":"kitti_00","family":"KITTI","platform":"car","group":"design","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":20.6,"lat_ms_p95":27.6,"ours":{"med":1.8498,"lo":1.8498,"hi":1.8498,"n":3,"lost":0},"orb3":{"med":1.4168,"lo":1.3746,"hi":1.448,"n":5,"lost":0,"status":"","ref":"local_fair"},"vs_orb3":"loss","vs_okvis2x":"win","okvis2x_ratio":0.5751,"okvis2x_ate":3.173,"okvis2x_ours_frame":1.825,"crash_or_hang":false,"unsupported":"pass"},{"route":"kitti_01","family":"KITTI","platform":"car","group":"design","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":29.7,"lat_ms_p95":34.6,"ours":{"med":30.2031,"lo":30.2031,"hi":30.2031,"n":3,"lost":0},"orb3":{"med":11.2623,"lo":10.6839,"hi":12.9934,"n":5,"lost":0,"status":"","ref":"local_fair"},"vs_orb3":"loss","vs_okvis2x":"win","okvis2x_ratio":0.7574,"okvis2x_ate":39.96,"okvis2x_ours_frame":30.266,"crash_or_hang":false,"unsupported":"fail"},{"route":"kitti_07","family":"KITTI","platform":"car","group":"design","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":18.7,"lat_ms_p95":24.0,"ours":{"med":1.2812,"lo":1.2803,"hi":1.282,"n":3,"lost":0},"orb3":{"med":0.5171,"lo":0.4434,"hi":0.6708,"n":5,"lost":0,"status":"","ref":"local_fair"},"vs_orb3":"loss","vs_okvis2x":"win","okvis2x_ratio":0.6244,"okvis2x_ate":2.091,"okvis2x_ours_frame":1.305,"crash_or_hang":false,"unsupported":"fail"},{"route":"madmax_E1","family":"MADMAX","platform":"Mars-analogue rover","group":"design","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":20.5,"lat_ms_p95":24.9,"ours":{"med":3.3838,"lo":3.3838,"hi":3.3838,"n":3,"lost":0},"orb3":{"med":0.7093,"lo":0.6799,"hi":0.7267,"n":5,"lost":0,"status":"","ref":"local","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":2.8219,"okvis2x_ate":1.135,"okvis2x_ours_frame":3.202,"crash_or_hang":false,"unsupported":"pending"},{"route":"madmax_F3","family":"MADMAX","platform":"Mars-analogue rover","group":"design","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":19.2,"lat_ms_p95":23.6,"ours":{"med":1.0504,"lo":1.0504,"hi":1.0504,"n":3,"lost":0},"orb3":{"med":0.7271,"lo":0.7253,"hi":0.73,"n":5,"lost":0,"status":"","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":1.4397,"okvis2x_ate":0.683,"okvis2x_ours_frame":0.983,"crash_or_hang":false,"unsupported":"pending"},{"route":"rosario_03","family":"Rosario","platform":"farm robot","group":"design","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":20.0,"lat_ms_p95":25.5,"ours":{"med":0.8342,"lo":0.6066,"hi":0.9508,"n":3,"lost":0},"orb3":{"med":2.7203,"lo":1.6811,"hi":3.5973,"n":5,"lost":5,"status":"lost 5/5","ref":"local_fair","stereo_only":5,"draws":5},"vs_orb3":"win","vs_okvis2x":"win","okvis2x_ratio":0.0003,"okvis2x_ate":4793.432,"okvis2x_ours_frame":1.277,"crash_or_hang":false,"unsupported":"pending"},{"route":"rosario_04","family":"Rosario","platform":"farm robot","group":"design","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":18.1,"lat_ms_p95":22.2,"ours":{"med":1.5064,"lo":1.5064,"hi":1.5064,"n":3,"lost":0},"orb3":{"med":1132.8756,"lo":867.5482,"hi":1320.5398,"n":5,"lost":0,"status":"div 5/5","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"win","vs_okvis2x":"win","okvis2x_ratio":0.0009,"okvis2x_ate":1538.037,"okvis2x_ours_frame":1.409,"crash_or_hang":false,"unsupported":"pending"},{"route":"mh_03_medium","family":"EuRoC MAV","platform":"indoor drone","group":"k13","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":21.6,"lat_ms_p95":31.2,"ours":{"med":0.0419,"lo":0.0419,"hi":0.0419,"n":3,"lost":0},"orb3":{"med":0.0272,"lo":0.0245,"hi":0.0288,"n":5,"lost":0,"status":"partial span","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":1.0665,"okvis2x_ate":0.039,"okvis2x_ours_frame":0.041,"crash_or_hang":false,"unsupported":"pass"},{"route":"v1_01_easy","family":"EuRoC MAV","platform":"indoor drone","group":"k13","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":22.1,"lat_ms_p95":29.3,"ours":{"med":0.0367,"lo":0.0367,"hi":0.0367,"n":3,"lost":0},"orb3":{"med":0.0372,"lo":0.0363,"hi":0.0375,"n":5,"lost":0,"status":"","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"tie","vs_okvis2x":"tie","okvis2x_ratio":1.0301,"okvis2x_ate":0.036,"okvis2x_ours_frame":0.037,"crash_or_hang":false,"unsupported":"fail"},{"route":"kitti_05","family":"KITTI","platform":"car","group":"k13","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":20.4,"lat_ms_p95":27.0,"ours":{"med":2.1099,"lo":2.1099,"hi":2.1099,"n":3,"lost":0},"orb3":{"med":0.9964,"lo":0.9415,"hi":1.5573,"n":5,"lost":0,"status":"","ref":"local_fair"},"vs_orb3":"loss","vs_okvis2x":"win","okvis2x_ratio":0.5535,"okvis2x_ate":3.799,"okvis2x_ours_frame":2.103,"crash_or_hang":false,"unsupported":"pass"},{"route":"kitti_06","family":"KITTI","platform":"car","group":"k13","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":22.5,"lat_ms_p95":30.3,"ours":{"med":2.5152,"lo":2.5152,"hi":2.5152,"n":3,"lost":0},"orb3":{"med":0.8691,"lo":0.8184,"hi":0.9085,"n":5,"lost":0,"status":"","ref":"local_fair"},"vs_orb3":"loss","vs_okvis2x":"win","okvis2x_ratio":0.8979,"okvis2x_ate":2.827,"okvis2x_ours_frame":2.538,"crash_or_hang":false,"unsupported":"pass"},{"route":"mh_05_difficult","family":"EuRoC MAV","platform":"indoor drone","group":"k12","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":21.2,"lat_ms_p95":29.2,"ours":{"med":0.1005,"lo":0.1005,"hi":0.1005,"n":3,"lost":0},"orb3":{"med":0.0591,"lo":0.0561,"hi":0.0649,"n":5,"lost":0,"status":"partial span","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"win","okvis2x_ratio":0.7875,"okvis2x_ate":0.128,"okvis2x_ours_frame":0.1,"crash_or_hang":false,"unsupported":"pass"},{"route":"v1_03_difficult","family":"EuRoC MAV","platform":"indoor drone","group":"k12","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":30.1,"lat_ms_p95":36.9,"ours":{"med":0.0362,"lo":0.0362,"hi":0.0362,"n":3,"lost":0},"orb3":{"med":0.0245,"lo":0.0231,"hi":0.0273,"n":5,"lost":0,"status":"","ref":"local_fair","stereo_only":0,"draws":5},"vs_orb3":"loss","vs_okvis2x":"loss","okvis2x_ratio":1.0859,"okvis2x_ate":0.032,"okvis2x_ours_frame":0.035,"crash_or_hang":false,"unsupported":"pass"},{"route":"rosario_01","family":"Rosario","platform":"farm robot","group":"k12","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":21.1,"lat_ms_p95":26.3,"ours":{"med":0.6387,"lo":0.4393,"hi":2.1553,"n":3,"lost":0},"orb3":{"med":0.9999,"lo":0.6188,"hi":2.9959,"n":5,"lost":5,"status":"lost 5/5","ref":"local_fair","stereo_only":5,"draws":5},"vs_orb3":"win_forfeit","vs_okvis2x":"win","okvis2x_ratio":0.0,"okvis2x_ate":7093099.755,"okvis2x_ours_frame":2.306,"crash_or_hang":false,"unsupported":"pending"},{"route":"rosario_02","family":"Rosario","platform":"farm robot","group":"k12","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":22.0,"lat_ms_p95":28.3,"ours":{"med":1.2517,"lo":0.7241,"hi":4.1194,"n":3,"lost":0},"orb3":{"med":1.6687,"lo":1.2684,"hi":3.9925,"n":5,"lost":4,"status":"lost 4/5","ref":"local_fair","stereo_only":5,"draws":5},"vs_orb3":"win_forfeit","vs_okvis2x":"win","okvis2x_ratio":0.0,"okvis2x_ate":11864586.304,"okvis2x_ours_frame":4.17,"crash_or_hang":false,"unsupported":"pending"},{"route":"rosario_06","family":"Rosario","platform":"farm robot","group":"k12","gt":true,"runs":3,"lost_runs":0,"lat_ms_p50":20.7,"lat_ms_p95":26.9,"ours":{"med":4.327,"lo":2.2365,"hi":5.177,"n":3,"lost":0},"orb3":{"med":3.2106,"lo":2.6596,"hi":5.3386,"n":5,"lost":4,"status":"lost 4/5","ref":"local_fair","stereo_only":5,"draws":5},"vs_orb3":"win_forfeit","vs_okvis2x":"win","okvis2x_ratio":0.0,"okvis2x_ate":10957131.566,"okvis2x_ours_frame":5.405,"crash_or_hang":false,"unsupported":"pending"},{"route":"oak_161206","family":"OAK-D-Lite (own)","platform":"handheld / vehicle","group":"oak","gt":false,"runs":3,"lost_runs":0,"lat_ms_p50":18.5,"lat_ms_p95":24.4,"crash_or_hang":false,"unsupported":"pass"},{"route":"oak_161834","family":"OAK-D-Lite (own)","platform":"handheld / vehicle","group":"oak","gt":false,"runs":3,"lost_runs":0,"lat_ms_p50":23.1,"lat_ms_p95":31.1,"crash_or_hang":false,"unsupported":"pass"},{"route":"oak_20260327_164002","family":"OAK-D-Lite (own)","platform":"handheld / vehicle","group":"oak","gt":false,"runs":3,"lost_runs":0,"lat_ms_p50":22.9,"lat_ms_p95":30.0,"crash_or_hang":false,"unsupported":"pass"},{"route":"oak_20260327_164424","family":"OAK-D-Lite (own)","platform":"handheld / vehicle","group":"oak","gt":false,"runs":3,"lost_runs":0,"lat_ms_p50":20.3,"lat_ms_p95":25.8,"crash_or_hang":false,"unsupported":"pass"},{"route":"oak_20260329_160543","family":"OAK-D-Lite (own)","platform":"handheld / vehicle","group":"oak","gt":false,"runs":3,"lost_runs":0,"lat_ms_p50":18.9,"lat_ms_p95":23.8,"crash_or_hang":false,"unsupported":"pass"}],"flagged_wins":{"unseen":[{"route":"4s_20200407_102","status":"div 3/5"},{"route":"4s_20210225_135","status":"div 5/5"},{"route":"madmax_H0","status":"partial span"}],"all_gt":[{"route":"4s_20200407_102","status":"div 3/5"},{"route":"4s_20200612_101","status":"lost 5/5"},{"route":"4s_20210225_135","status":"div 5/5"},{"route":"madmax_H0","status":"partial span"},{"route":"rosario_01","status":"lost 5/5"},{"route":"rosario_02","status":"lost 4/5"},{"route":"rosario_03","status":"lost 5/5"},{"route":"rosario_04","status":"div 5/5"},{"route":"rosario_06","status":"lost 4/5"}]},"forfeits":{"unseen":0,"all_gt":3,"orb3_unseen":{"routes":[],"changed_verdict":[],"would_win_anyway":[]},"orb3_all_gt":{"routes":["4s_20200612_101","rosario_01","rosario_02","rosario_03","rosario_06"],"changed_verdict":["rosario_01","rosario_02","rosario_06"],"would_win_anyway":["4s_20200612_101","rosario_03"]}},"okvis2x_failed_unseen":["4s_20200407_102"],"okvis2x_failed_all_gt":["4s_20200407_102","rosario_01","rosario_02","rosario_03","rosario_04","rosario_06"],"attempts":{"attempts":224,"valid":216,"VOID":8,"INCOMPLETE_not_attempts":3,"void_reasons":[{"route":"4s_20200612_112","why":"feeder timing","also_load":false},{"route":"4s_20201222_115","why":"feeder timing","also_load":false},{"route":"4s_20210107_131","why":"feeder timing","also_load":false},{"route":"4s_20210225_141","why":"feeder timing","also_load":false},{"route":"4s_20210225_141","why":"feeder timing","also_load":false},{"route":"madmax_A0","why":"feeder timing","also_load":true},{"route":"madmax_A3","why":"feeder timing","also_load":false},{"route":"madmax_B0","why":"outside CPU load","also_load":false}],"note":"attempts = valid + VOID; INCOMPLETE attempts (power / session outages that killed the block) are parked and not counted as attempts (FINAL_BOARD_PREREG 5.3)"},"c1_fail":[{"route":"4s_20210107_131","failed":["worst-frame latency (a dropped frame counts as infinite)","longest gap between published frames","consecutive dropped frames","worst 1-s window of drops"],"drops_min":29,"drops_max":39,"drop_pct_max":0.32},{"route":"4s_20210225_141","failed":["worst-frame latency (a dropped frame counts as infinite)","longest gap between published frames","consecutive dropped frames","worst 1-s window of drops"],"drops_min":39,"drops_max":91,"drop_pct_max":0.73},{"route":"4s_20200324_174","failed":["worst-frame latency (a dropped frame counts as infinite)","longest gap between published frames","consecutive dropped frames","latency drift (late p95 against early p95)"],"drops_min":3,"drops_max":4,"drop_pct_max":0.03},{"route":"4s_20200407_102","failed":["worst-frame latency (a dropped frame counts as infinite)","longest gap between published frames","consecutive dropped frames","worst 1-s window of drops"],"drops_min":17,"drops_max":19,"drop_pct_max":0.12},{"route":"4s_20210225_135","failed":["p99 latency","worst-frame latency (a dropped frame counts as infinite)","longest gap between published frames","consecutive dropped frames","worst 1-s window of drops"],"drops_min":6,"drops_max":647,"drop_pct_max":4.51},{"route":"madmax_B0","failed":["latency drift (late p95 against early p95)"],"drops_min":0,"drops_max":0,"drop_pct_max":0.0},{"route":"madmax_H0","failed":["latency drift (late p95 against early p95)"],"drops_min":0,"drops_max":0,"drop_pct_max":0.0},{"route":"4s_20201222_115","failed":["p99 latency","worst-frame latency (a dropped frame counts as infinite)","longest gap between published frames","worst 1-s window of drops"],"drops_min":55,"drops_max":61,"drop_pct_max":0.62},{"route":"4s_20201007_144","failed":["worst-frame latency (a dropped frame counts as infinite)","longest gap between published frames","worst 1-s window of drops"],"drops_min":7,"drops_max":13,"drop_pct_max":0.13},{"route":"4s_20200612_112","failed":["p95 latency","p99 latency","worst-frame latency (a dropped frame counts as infinite)","longest gap between published frames","consecutive dropped frames","worst 1-s window of drops","latency drift (late p95 against early p95)"],"drops_min":91,"drops_max":302,"drop_pct_max":1.76}],"imu":{"by_family":{"EuRoC MAV":{"kept":21,"dropped":12,"refused":0,"none":0,"other":0},"KITTI":{"kept":0,"dropped":0,"refused":0,"none":33,"other":0},"4Seasons":{"kept":29,"dropped":4,"refused":0,"none":0,"other":0},"MADMAX":{"kept":0,"dropped":84,"refused":0,"none":0,"other":0},"Rosario":{"kept":0,"dropped":15,"refused":0,"none":0,"other":0},"Rosario v2":{"kept":0,"dropped":3,"refused":0,"none":0,"other":0},"OAK-D-Lite (own)":{"kept":0,"dropped":3,"refused":12,"none":0,"other":0}},"total":{"kept":50,"dropped":121,"refused":12,"none":33,"other":0},"rule":"kept = the IMU was in use to the end of the run; dropped = admitted, then demoted during the run by the IMU consistency check (W1); refused = not admitted at start (gyro inconsistent with the visual rotations); none = the dataset has no IMU stream","source":"board.json runs[].imu over the 216 valid runs"},"launch1":{"routes":["4s_20200324_174","4s_20200407_102","4s_20210225_135","kitti_03","kitti_04","kitti_08","madmax_A6","madmax_B0","madmax_G2","v2_01_easy"],"valid_runs_set_aside":["4s_20200324_174","4s_20200407_102","4s_20210225_135","kitti_03","kitti_04","kitti_08","madmax_A6","madmax_G2","v2_01_easy"],"void_attempts":{"v2_01_easy":1,"kitti_03":1,"madmax_A6":1,"madmax_B0":6,"4s_20210225_135":1},"sentinels_valid":1,"sentinel_voids":3,"route_attempts":19,"attempts_total":23,"all_unseen":true,"note":"pre-fix build 6bb6e65a, identical engine code (only the harness allow-list differs); every run of it was set aside, never used for a claim, and no accuracy number of it was read (FINAL_BOARD_PREREG 8.35-8.36)"},"c2":{"pass_rows":37,"of":38,"odom_jumps_zero_rows":6},"c3b":{"pass":9,"fail":4,"pending":25,"pending_all_madmax":true},"identical_runs":{"routes":40,"no_dropped_frame":39,"byte_identical":28,"max_spread_m":4.92e-05,"rule":"ours lo == hi at 4 decimals (0.1 mm); byte identity of the three trajectory_kf.csv board exports (LIVE-MAP at the worker KF stamps)"},"prereg":{"sha256":"ca7e7adebb492e6e51ac23fd3ab7002c51de3ff5309ed4429378621425355018","first_version":"2026-10-27 10:40 IST","last_amendment":"8.44, dated 2026-10-30 (~09:4x IST in its header)","file_last_written":"2026-10-30 09:28:34 IST","board_evaluated":"2026-10-30 11:32:19 IST","hash_published":"2026-10-31","amendments_during_board":[{"id":"8.35-8.39","date":"2026-10-28","what":"the first launch stopped: a defect in the board block script (its sentinel witness test required a latency stage, \"track\", that the engine never records) voided every later sentinel, and outside load voided madmax_B0 six times. The corrections: Windows OS processes exempted from the per-process load rule (8.36), evaluator changes (8.38, put into the evaluator on 2026-10-30), and a relaunch on a twin build with identical engine code, before any run of that build"},{"id":"8.40","date":"2026-10-28","what":"run validity: outside CPU load is reported per run and no longer voids a run"},{"id":"8.41","date":"2026-10-28","what":"a 4Seasons data copy (USB drive to SSD) that ran during four paced runs; it caused one VOID (madmax_A0), which stays a VOID of record, and the overlap is printed beside the three valid runs"},{"id":"8.42","date":"2026-10-28","what":"the remaining 4Seasons copies, made with the block paused"},{"id":"8.43","date":"2026-10-28","what":"the limit on incomplete attempts per draw raised from 3 to 10, after power and session outages"},{"id":"8.44","date":"2026-10-30","what":"an outside app that only holds a GPU context is reported, never voids a run"}],"note":"the prereg states for each of them that no accuracy number of any board run was read; validity outcomes (VOIDs, feeder timing, incomplete attempts) were read, and they drove 8.36 and 8.40-8.43"}}