Python
docs: settle the SMPL conversion on the fit-free path after finding --fit-iters 400 unconverged by 8 mm, and add the gen6/gen7 results
mohamdev3b6774a84740
diff --git a/benchmark/README.md b/benchmark/README.mdindex cea93be..09b0974 100644--- a/benchmark/README.md+++ b/benchmark/README.md@@ -435,9 +435,97 @@ Per-joint, the error is concentrated in the extremities the adapter has toextrapolate — `left/right_hand` at 97-98 mm and the wrists at 79-82 mm, against30-40 mm at the collars, neck, pelvis and hips.+### `--fit-iters 400` is too low by ~4x — every number below it is inflated (2026-09-11)++**The default was not converged**, and it is the reason this repo carried three+mutually inconsistent conversions. On 3DPW test the fit leaves **16.13 mm** of+surface residual at 400 iterations and **7.96 mm** at 4000; the metrics move+with it, by far more than any model change on the roadmap:++| fit-iters | residual | PVE | J14 PA | SMPL24 PA |+|---|---|---|---|---|+| 400 | 16.13 | 82.34 | 45.95 | 49.16 |+| 1500 | 8.94 | 80.96 | 42.71 | 46.56 |+| 4000 | 7.96 | 81.01 | 42.33 | 45.93 |++Worse, **the sign is not predictable**: on EMDB, PVE gets *worse* as the fit+converges (92.45 -> 93.84 -> 94.07) because at 400 iterations the fit is+accidentally regularised toward the SMPL mean shape. A number you cannot+defend without saying how long Adam ran is not a protocol. Use >= 1500, or+skip the fit entirely (next section). The EMDB table two sections down was+produced at 400 and is inflated.++### The conversion, settled: one surface, one operator on both sides++`barycentric_transfer` already returns the prediction **in SMPL topology**,+vertex i <-> SMPL vertex i. So the SMPL parameter fit is not needed to reach+either PVE or a regressed joint set — it exists only to recover the 24+*kinematic* joints, which come off the kinematic chain. Measured on identical+predictions, a converged fit converges *toward* the fit-free answer, so all it+adds in those cases is a hyperparameter with a 3-4 mm blast radius.++The protocol, in order of what the ground truth actually *is*:++| metric | GT is | conversion |+|---|---|---|+| **PVE / PA-PVE** | vertices | none — compare directly |+| **3DPW J14** | `J_regressor_h36m @ GT verts` | same regressor on **both** sides, so its bias cancels exactly |+| **EMDB SMPL-24** | kinematic joints | a vertex regressor approximates these; costs ~1.1 mm (see below) |++Nothing here is fitted by us: only the rig, Meta's published barycentric map,+and the benchmark's own regressor. There is no optimiser and no free parameter,+so the failure above cannot recur.++**The one approximation, quantified.** EMDB's 24 kinematic joints are not a+linear function of posed vertices. Regressing them from the surface carries, on+EMDB GT bodies, **10.15 mm mid-hip / 7.02 mm Procrustes** of bias. Errors add in+quadrature, so at a ~50 mm error level that costs **~1.1 mm** of PA-MPJPE:+sqrt(50.73^2 + 7.02^2) = 51.2 against 51.82 measured. Quote it; do not+reach for the fit to remove it unless you run >= 1500 iterations.++**Conversion floor, measured on EMDB (2026-09-11).** `make_mhr_gt.py`'s cached+MHR fit of EMDB's own GT, pushed through this exact forward path — the oracle+row, the best any MHR-rigged model could score:++| | MPJPE | PA-MPJPE | PVE |+|---|---|---|---|+| oracle (conversion floor) | 18.64 | **12.36** | 19.92 |++The oracle's own surface fit leaves 9.40 mm, so this is an **upper bound** on+conversion cost, not a tight estimate. At a 51.8 mm result, a 12.4 mm floor+contributes ~1.5 mm in quadrature: **conversion is not what separates this+model from SOTA.** Do not subtract it — errors do not add linearly.++### The EMDB person-box convention: quote `--bbox annotated` for published tables++Not because it scores better — it scores **8-12 mm worse**, and it changes the+ranking. Measured over all 24,103 frames, PA-MPJPE penalty for switching from+projected-GT-joint boxes to EMDB's own:++| run | gt-joints | annotated | penalty |+|---|---|---|---|+| b3_s1 | 53.16 | 60.15 | +6.99 |+| g6bv_s | 52.01 | 60.33 | +8.32 |+| g6b_s | 54.78 | 63.30 | +8.52 |+| g6v_s (v2) | 52.50 | 64.36 | **+11.86** |+| g6vv_s (v2) | 51.81 | 63.81 | **+12.00** |++Published "Oracle: annotated bounding boxes" rows use EMDB's own boxes, so that+is the only row that may sit beside them. Picking the cheaper convention while+comparing against papers that used theirs is the same error as picking a+flattering joint conversion.++**`--preset v2` is markedly more box-sensitive** (~12 mm against ~8.4 mm), which+reverses the ranking: g6vv_s is best under projected boxes and *fourth* under+EMDB's. v2 sets `cliff_follows_aug`, so the model leans harder on the CLIFF+vector describing its crop; EMDB's boxes are 17.5 % larger and 5.7 % off-centre+against the padded boxes it trained on. Truncation augmentation does not cover+this mismatch. Check both conventions before claiming a v2 win.+### EMDB-1, SMPL space via mesh conversion (2026-09-08)-All 17 sequences, all 24,103 frames, projected-GT-joint boxes, `--fit-iters 400`.+All 17 sequences, all 24,103 frames, projected-GT-joint boxes, `--fit-iters 400`+— **inflated, see the fit-iters section above; kept for provenance only.**Report in `benchmark/results/emdb1_smplfit_gt-joints.json`.| run | epoch | MPJPE | **PA-MPJPE** | PVE | PA-PVE | mean fit residual |@@ -470,6 +558,54 @@ linearly. Treating model and conversion error as independent, sqrt(50^2 +18.8^2) = 53.4 against sqrt(50^2 + 10.7^2) = 51.1, so ~2.3 mm predicted against1.8 mm observed. The real win is that **PVE exists at all**.+### Generation 6 — the `preset x --w-verts` 2x2 (2026-09-11)++Scored through the fit-free conversion above, all frames, `best_student_model_v3.pth`+(selected on 3DPW validation). All four are seed 0, `--losses rebalanced+--cliff-focal --bound-scales --anomaly-safe-fallback --crop-centre-fix`.++**3DPW test** — 35,463 person-frames, J14/H36M, published-protocol GT:++| run | preset | w_verts | ep | MPJPE | PA-MPJPE | PVE | PA-PVE | J14+adapter PA |+|---|---|---|---|---|---|---|---|---|+| g6vv_s | v2 | 0.35 | 239 | 67.71 | **42.69** | 81.01 | **57.68** | **41.77** |+| g6v_s | v2 | 0 | 225 | **67.27** | 43.16 | **80.57** | 58.07 | 42.21 |+| g6bv_s | baseline | 0.35 | 247 | 70.31 | 43.30 | 83.51 | 58.51 | 42.55 |+| g6b_s | baseline | 0 | 102 | 73.98 | 45.27 | 87.92 | 61.07 | 44.44 |+| b3_s1 (gen5) | baseline | 0 | 137 | 69.10 | 43.03 | 82.81 | 58.31 | 41.81 |+| bno_s0 (gen5) | v2 | 0 | 85 | 69.84 | 44.80 | 83.39 | 60.04 | 43.78 |++**EMDB-1** — 24,103 frames, SMPL-24 kinematic, projected-GT-joint boxes (for the+`--bbox annotated` row that belongs beside published tables, see above):++| run | preset | w_verts | ep | MPJPE | PA-MPJPE | PVE | PA-PVE |+|---|---|---|---|---|---|---|---|+| g6vv_s | v2 | 0.35 | 239 | **78.71** | **51.81** | **94.71** | **61.67** |+| g6bv_s | baseline | 0.35 | 247 | 79.20 | 52.01 | 95.01 | 61.69 |+| g6v_s | v2 | 0 | 225 | 79.44 | 52.50 | 95.29 | 62.68 |+| g6b_s | baseline | 0 | 102 | 83.31 | 54.78 | 99.82 | 64.30 |+| b3_s1 (gen5) | baseline | 0 | 137 | 78.01 | 53.16 | 94.17 | 63.66 |+| bno_s0 (gen5) | v2 | 0 | 85 | 80.55 | 55.36 | 96.82 | 65.88 |++**`--preset v2` is the win, and it lands where the mechanism says it should.**+At nearly matched epochs (g6bv_s 247 vs g6vv_s 239), 3DPW MPJPE drops **2.60 mm**+and PVE **2.50 mm** while PA-MPJPE moves only 0.61 mm. That is the signature of+v2's absolute-pose supervision — `w_reproj` 0.01 -> 0.5 and the unsquared+Euclidean `loss_cam` fix *where the body sits*, and Procrustes discards exactly+that. Read it next to the box-sensitivity finding above before shipping it.++**`--w-verts 0.35` does not deliver what it was added for.** At matched epochs it+moves PVE by -0.58 mm on EMDB and **+0.44 mm on 3DPW** — the wrong sign, net+~zero. PVE is the only metric that can see the 45 `shape_params`, so this was+the row where the surface term should have shown up. It did not, at one seed.++**g6b_s is not a fair member of the 2x2.** Its best checkpoint is epoch 102+against the others' 225-247 and its run died at 171 of a 300-epoch+`OneCycleLR`, so it never annealed. Its ~2 mm deficit is maturity.++**One seed per arm.** Every gap above except the v2 MPJPE/PVE effect is under+1 mm, well inside seed spread. Only the 2.5 mm v2 result is safe to act on.+### What these metrics cannot seeBoth headline metrics are alignment-invariant, and that hides exactly the@@ -515,9 +651,11 @@ camera translation never enters the metric.`good_frames_mask` is set and the subject is at least 60 % inside the image.Metrics are over the 24 SMPL kinematic joints, aligned at the midpoint of thetwo hips (SMPL indices 1 and 2, not the `pelvis` joint), reached through the-fixed MHR70 → SMPL-24 map fitted on 3DPW train teacher labels. PA-MPJPE is-Procrustes with uniform scale. Person boxes: say which of the two conventions-above you used. PVE is not reported — see the EMDB section for why.+rig mesh and Meta's barycentric map, then a vertex regressor (see "The+conversion, settled" — the ~1.1 mm kinematic approximation is quoted with the+result). PA-MPJPE is Procrustes with uniform scale. PVE is vertex-to-vertex+against the GT SMPL mesh, mid-hip aligned. Person boxes: say which of the two+conventions you used, and use `--bbox annotated` for any published comparison.**COCO val2017.** Top-down with **ground-truth boxes**, one crop per annotatedperson with `num_keypoints ≥ 1` and `iscrowd = 0`. These AP numbers are *not*diff --git a/benchmark/eval_smpl_fit.py b/benchmark/eval_smpl_fit.pyindex 77e65b7..f10c46e 100644--- a/benchmark/eval_smpl_fit.py+++ b/benchmark/eval_smpl_fit.py@@ -92,7 +92,10 @@ def parse_args():p.add_argument("--bbox", default="gt-joints", choices=["gt-joints", "annotated"],help="EMDB only; 3DPW always uses projected-GT-joint boxes")p.add_argument("--fit-iters", type=int, default=400,- help="400 is within 0.3 mm of 550 on the round trip")+ help="USE >= 1500. 400 converges on the round trip but NOT "+ "on real predictions: 16.1 mm residual on 3DPW vs 8.0 "+ "at 4000, worth 3.6 mm of J14 PA-MPJPE, and the sign "+ "differs per dataset. See benchmark/README.md.")p.add_argument("--fit-batch", type=int, default=64)p.add_argument("--batch-size", type=int, default=64)p.add_argument("--num-workers", type=int, default=10)diff --git a/benchmark/results/gen6_3dpw_j14adapter.json b/benchmark/results/gen6_3dpw_j14adapter.jsonnew file mode 100644index 0000000..2049f00--- /dev/null+++ b/benchmark/results/gen6_3dpw_j14adapter.json@@ -0,0 +1,290 @@+{+ "instanthmr_distill_train/runs/g6b_s/g6b_s/best_student_model_v3.pth|h36m": {+ "ckpt": "instanthmr_distill_train/runs/g6b_s/g6b_s/best_student_model_v3.pth",+ "gt": "h36m",+ "split": "test",+ "stride": 1,+ "epoch": 102,+ "source": "ema",+ "n": 35463,+ "n_dropped": 0,+ "results": [+ {+ "joint_set": "J14",+ "num_joints": 14,+ "num_samples": 35463,+ "MPJPE_mm": 109.31060473532123,+ "PA_MPJPE_mm": 69.03721010395624,+ "PCK3D_50mm": 0.39503546956385127,+ "PCK3D_100mm": 0.8118159369322554,+ "AUC_0_150mm": 0.5504897620951336,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 69.5568811480596,+ "right_knee": 47.95772431021306,+ "right_hip": 99.03357432412425,+ "left_hip": 88.40061029784397,+ "left_knee": 47.56725775636462,+ "left_ankle": 70.29666472194043,+ "right_wrist": 73.90936250413914,+ "right_elbow": 60.21047147727324,+ "right_shoulder": 48.7594881479906,+ "left_shoulder": 50.23575878992591,+ "left_elbow": 70.73785149884611,+ "left_wrist": 77.19405228378567,+ "neck": 34.421872822977555,+ "head": 128.23937137190305+ }+ },+ {+ "joint_set": "J12",+ "num_joints": 12,+ "num_samples": 35463,+ "MPJPE_mm": 107.94474039350453,+ "PA_MPJPE_mm": 64.11260767952042,+ "PCK3D_50mm": 0.428681536625027,+ "PCK3D_100mm": 0.8689455676808693,+ "AUC_0_150mm": 0.5801218989714861,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 65.42470164585065,+ "right_knee": 49.69509364988518,+ "right_hip": 98.15725842851955,+ "left_hip": 87.51582399401904,+ "left_knee": 48.39252151040565,+ "left_ankle": 65.18918021243668,+ "right_wrist": 70.85586623493876,+ "right_elbow": 51.488877615927244,+ "right_shoulder": 50.59903888387248,+ "left_shoulder": 51.03028577756485,+ "left_elbow": 57.469193567248524,+ "left_wrist": 73.53345063357644+ }+ },+ {+ "joint_set": "J14+adapter",+ "num_joints": 14,+ "num_samples": 35463,+ "MPJPE_mm": 75.0772344122537,+ "PA_MPJPE_mm": 44.465876009326585,+ "PCK3D_50mm": 0.696097743724848,+ "PCK3D_100mm": 0.9355042076047068,+ "AUC_0_150mm": 0.7058889572840962+ }+ ]+ },+ "instanthmr_distill_train/runs/g6bv_s/g6bv_s/best_student_model_v3.pth|h36m": {+ "ckpt": "instanthmr_distill_train/runs/g6bv_s/g6bv_s/best_student_model_v3.pth",+ "gt": "h36m",+ "split": "test",+ "stride": 1,+ "epoch": 247,+ "source": "ema",+ "n": 35463,+ "n_dropped": 0,+ "results": [+ {+ "joint_set": "J14",+ "num_joints": 14,+ "num_samples": 35463,+ "MPJPE_mm": 107.50022500460784,+ "PA_MPJPE_mm": 67.88658382068638,+ "PCK3D_50mm": 0.4046611961762964,+ "PCK3D_100mm": 0.8177819135436935,+ "AUC_0_150mm": 0.5560052789491378,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 67.87522395933384,+ "right_knee": 47.35189113996917,+ "right_hip": 98.6727272726729,+ "left_hip": 90.38633017011507,+ "left_knee": 47.60500718940778,+ "left_ankle": 67.85544440533677,+ "right_wrist": 70.28749044470575,+ "right_elbow": 59.395211074024495,+ "right_shoulder": 47.97138190216553,+ "left_shoulder": 49.411469179216006,+ "left_elbow": 69.10694208638806,+ "left_wrist": 74.10098938192529,+ "neck": 33.505073863521076,+ "head": 126.88699142082751+ }+ },+ {+ "joint_set": "J12",+ "num_joints": 12,+ "num_samples": 35463,+ "MPJPE_mm": 106.07782437778351,+ "PA_MPJPE_mm": 63.02085164461351,+ "PCK3D_50mm": 0.44028282999182244,+ "PCK3D_100mm": 0.8755886416828808,+ "AUC_0_150mm": 0.5857787110539867,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 64.46720310312233,+ "right_knee": 49.029458093319604,+ "right_hip": 97.94139039788224,+ "left_hip": 89.66296993519647,+ "left_knee": 48.356036572418745,+ "left_ankle": 63.2247706954782,+ "right_wrist": 67.10022184348587,+ "right_elbow": 50.488811815830545,+ "right_shoulder": 49.32164792363375,+ "left_shoulder": 49.684912271450415,+ "left_elbow": 56.347339522093506,+ "left_wrist": 70.62545756145039+ }+ },+ {+ "joint_set": "J14+adapter",+ "num_joints": 14,+ "num_samples": 35463,+ "MPJPE_mm": 71.7470439611344,+ "PA_MPJPE_mm": 42.578590821670765,+ "PCK3D_50mm": 0.7166362526738129,+ "PCK3D_100mm": 0.9450453390052409,+ "AUC_0_150mm": 0.716836370379409+ }+ ]+ },+ "instanthmr_distill_train/runs/g6v_s/g6v_s/best_student_model_v3.pth|h36m": {+ "ckpt": "instanthmr_distill_train/runs/g6v_s/g6v_s/best_student_model_v3.pth",+ "gt": "h36m",+ "split": "test",+ "stride": 1,+ "epoch": 225,+ "source": "raw",+ "n": 35463,+ "n_dropped": 0,+ "results": [+ {+ "joint_set": "J14",+ "num_joints": 14,+ "num_samples": 35463,+ "MPJPE_mm": 103.79603864551636,+ "PA_MPJPE_mm": 67.23530884349267,+ "PCK3D_50mm": 0.4025342308482483,+ "PCK3D_100mm": 0.8281629545482011,+ "AUC_0_150mm": 0.5595563286509688,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 66.38307779824238,+ "right_knee": 47.103437333772014,+ "right_hip": 98.13827811820883,+ "left_hip": 88.11436838234566,+ "left_knee": 46.94140350787356,+ "left_ankle": 66.80158151802696,+ "right_wrist": 68.3841582458417,+ "right_elbow": 57.80165606918464,+ "right_shoulder": 49.52095693867013,+ "left_shoulder": 49.73127411968748,+ "left_elbow": 68.30390384132103,+ "left_wrist": 73.84761435117764,+ "neck": 33.726795140357595,+ "head": 126.49581844418778+ }+ },+ {+ "joint_set": "J12",+ "num_joints": 12,+ "num_samples": 35463,+ "MPJPE_mm": 101.60904983902788,+ "PA_MPJPE_mm": 62.23479546950118,+ "PCK3D_50mm": 0.44078335166229593,+ "PCK3D_100mm": 0.8846896765643064,+ "AUC_0_150mm": 0.5899720108099945,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 62.42316944731556,+ "right_knee": 48.75024941003139,+ "right_hip": 97.4505108204137,+ "left_hip": 87.21530864401828,+ "left_knee": 47.86222433250393,+ "left_ankle": 62.25955806480468,+ "right_wrist": 66.02621371548021,+ "right_elbow": 50.039525918380654,+ "right_shoulder": 49.07085543967181,+ "left_shoulder": 49.70148336401379,+ "left_elbow": 55.46603484511562,+ "left_wrist": 70.55241163226455+ }+ },+ {+ "joint_set": "J14+adapter",+ "num_joints": 14,+ "num_samples": 35463,+ "MPJPE_mm": 67.98746005488917,+ "PA_MPJPE_mm": 42.234429549831546,+ "PCK3D_50mm": 0.720356427826185,+ "PCK3D_100mm": 0.9478188534528945,+ "AUC_0_150mm": 0.7183568101289705+ }+ ]+ },+ "instanthmr_distill_train/runs/g6vv_s/g6vv_s/best_student_model_v3.pth|h36m": {+ "ckpt": "instanthmr_distill_train/runs/g6vv_s/g6vv_s/best_student_model_v3.pth",+ "gt": "h36m",+ "split": "test",+ "stride": 1,+ "epoch": 239,+ "source": "ema",+ "n": 35463,+ "n_dropped": 0,+ "results": [+ {+ "joint_set": "J14",+ "num_joints": 14,+ "num_samples": 35463,+ "MPJPE_mm": 104.38210751397787,+ "PA_MPJPE_mm": 67.15630163795679,+ "PCK3D_50mm": 0.4068445583122852,+ "PCK3D_100mm": 0.8279494523467115,+ "AUC_0_150mm": 0.5599351878526994,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 64.7665394538419,+ "right_knee": 46.58257021084827,+ "right_hip": 98.5812079766113,+ "left_hip": 87.86653676233917,+ "left_knee": 45.38419871281326,+ "left_ankle": 67.16328284270159,+ "right_wrist": 69.49749995124274,+ "right_elbow": 58.21540961885245,+ "right_shoulder": 48.25533546902176,+ "left_shoulder": 49.95558925474159,+ "left_elbow": 68.64531375386449,+ "left_wrist": 72.17055782128531,+ "neck": 33.67057865370319,+ "head": 129.43360244952788+ }+ },+ {+ "joint_set": "J12",+ "num_joints": 12,+ "num_samples": 35463,+ "MPJPE_mm": 102.11241461195807,+ "PA_MPJPE_mm": 61.72775478336907,+ "PCK3D_50mm": 0.4480937878916053,+ "PCK3D_100mm": 0.8883319704104747,+ "AUC_0_150mm": 0.5929310239750109,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 60.87709732727048,+ "right_knee": 48.32575395623139,+ "right_hip": 97.87117835471858,+ "left_hip": 87.07298605453178,+ "left_knee": 46.09251651935203,+ "left_ankle": 61.71549070086557,+ "right_wrist": 66.47290693562417,+ "right_elbow": 49.05797557258036,+ "right_shoulder": 49.54315937498645,+ "left_shoulder": 50.0186382492938,+ "left_elbow": 55.23074208132174,+ "left_wrist": 68.45461227365254+ }+ },+ {+ "joint_set": "J14+adapter",+ "num_joints": 14,+ "num_samples": 35463,+ "MPJPE_mm": 68.4703090038315,+ "PA_MPJPE_mm": 41.78863155958053,+ "PCK3D_50mm": 0.7237603780197469,+ "PCK3D_100mm": 0.9499720030132008,+ "AUC_0_150mm": 0.721090106115662+ }+ ]+ }+}\ No newline at end of filediff --git a/benchmark/results/gen6_3dpw_smplfit.json b/benchmark/results/gen6_3dpw_smplfit.jsonnew file mode 100644index 0000000..716954c--- /dev/null+++ b/benchmark/results/gen6_3dpw_smplfit.json@@ -0,0 +1,174 @@+{+ "instanthmr_distill_train/runs/g6b_s/g6b_s/best_student_model_v3.pth": {+ "ckpt": "instanthmr_distill_train/runs/g6b_s/g6b_s/best_student_model_v3.pth",+ "dataset": "3DPW/test",+ "bbox": "gt-joints",+ "stride": 1,+ "n": 35463,+ "fit_iters": 400,+ "epoch": 102,+ "source": "ema",+ "fit_residual_mm": 16.407779693603516,+ "MPJPE_mm": 75.09175109863281,+ "PA_MPJPE_mm": 51.997389429496,+ "PVE_mm": 88.99562652986062,+ "PA_PVE_mm": 62.232839273349775,+ "J14_h36m_viamesh_MPJPE_mm": 75.06359100341797,+ "J14_h36m_viamesh_PA_MPJPE_mm": 48.0625726362123,+ "per_sequence_PA_MPJPE_mm": {+ "downtown_arguing_00": 52.35380204853086,+ "downtown_bar_00": 63.43621329400987,+ "downtown_bus_00": 70.42712580551195,+ "downtown_cafe_00": 47.011574173008455,+ "downtown_car_00": 60.77430019284298,+ "downtown_crossStreets_00": 51.18487757623839,+ "downtown_downstairs_00": 43.35631228850949,+ "downtown_enterShop_00": 44.915920302835474,+ "downtown_rampAndStairs_00": 48.29072450053912,+ "downtown_runForBus_00": 45.24491591290331,+ "downtown_runForBus_01": 56.95027485318371,+ "downtown_sitOnStairs_00": 47.6351770869155,+ "downtown_stairs_00": 60.041978509870916,+ "downtown_upstairs_00": 41.888490125483685,+ "downtown_walkBridge_01": 43.297105145822556,+ "downtown_walkUphill_00": 39.704988938823426,+ "downtown_walking_00": 49.266615736123995,+ "downtown_warmWelcome_00": 56.68671025624492,+ "downtown_weeklyMarket_00": 46.43459014394701,+ "downtown_windowShopping_00": 41.19524987284674,+ "flat_guitar_01": 65.11440430066091,+ "flat_packBags_00": 57.99867125376623,+ "office_phoneCall_00": 41.297467198364956,+ "outdoors_fencing_01": 49.71312080688268+ }+ },+ "instanthmr_distill_train/runs/g6bv_s/g6bv_s/best_student_model_v3.pth": {+ "ckpt": "instanthmr_distill_train/runs/g6bv_s/g6bv_s/best_student_model_v3.pth",+ "dataset": "3DPW/test",+ "bbox": "gt-joints",+ "stride": 1,+ "n": 35463,+ "fit_iters": 400,+ "epoch": 247,+ "source": "ema",+ "fit_residual_mm": 16.44468116760254,+ "MPJPE_mm": 71.14830780029297,+ "PA_MPJPE_mm": 49.70935360363883,+ "PVE_mm": 84.52926939081257,+ "PA_PVE_mm": 59.69143506594802,+ "J14_h36m_viamesh_MPJPE_mm": 71.13408660888672,+ "J14_h36m_viamesh_PA_MPJPE_mm": 46.101878495835884,+ "per_sequence_PA_MPJPE_mm": {+ "downtown_arguing_00": 52.031236927354335,+ "downtown_bar_00": 61.81048529655713,+ "downtown_bus_00": 62.00489752242751,+ "downtown_cafe_00": 45.17636336684825,+ "downtown_car_00": 60.668824113978154,+ "downtown_crossStreets_00": 49.38730167442858,+ "downtown_downstairs_00": 41.66461687753154,+ "downtown_enterShop_00": 40.737916968050165,+ "downtown_rampAndStairs_00": 45.575119645039635,+ "downtown_runForBus_00": 43.856374789751726,+ "downtown_runForBus_01": 56.691850799168535,+ "downtown_sitOnStairs_00": 46.95034291987287,+ "downtown_stairs_00": 61.9412683432234,+ "downtown_upstairs_00": 38.167424639991026,+ "downtown_walkBridge_01": 38.987812005278904,+ "downtown_walkUphill_00": 36.832141521119155,+ "downtown_walking_00": 46.391550816843775,+ "downtown_warmWelcome_00": 54.93313575074026,+ "downtown_weeklyMarket_00": 43.59573050730472,+ "downtown_windowShopping_00": 38.98571115726211,+ "flat_guitar_01": 62.50786710991815,+ "flat_packBags_00": 55.29524804866438,+ "office_phoneCall_00": 39.142479316853695,+ "outdoors_fencing_01": 48.53746768617269+ }+ },+ "instanthmr_distill_train/runs/g6v_s/g6v_s/best_student_model_v3.pth": {+ "ckpt": "instanthmr_distill_train/runs/g6v_s/g6v_s/best_student_model_v3.pth",+ "dataset": "3DPW/test",+ "bbox": "gt-joints",+ "stride": 1,+ "n": 35463,+ "fit_iters": 400,+ "epoch": 225,+ "source": "raw",+ "fit_residual_mm": 16.19407844543457,+ "MPJPE_mm": 68.57659149169922,+ "PA_MPJPE_mm": 49.277110368518564,+ "PVE_mm": 81.60751473960043,+ "PA_PVE_mm": 59.19252199670127,+ "J14_h36m_viamesh_MPJPE_mm": 68.0377197265625,+ "J14_h36m_viamesh_PA_MPJPE_mm": 45.818179457288885,+ "per_sequence_PA_MPJPE_mm": {+ "downtown_arguing_00": 53.654612794436275,+ "downtown_bar_00": 61.32844290121133,+ "downtown_bus_00": 58.07648931695738,+ "downtown_cafe_00": 45.83578195474714,+ "downtown_car_00": 56.24965576365669,+ "downtown_crossStreets_00": 48.07396249981064,+ "downtown_downstairs_00": 41.53538553211249,+ "downtown_enterShop_00": 38.1628359228303,+ "downtown_rampAndStairs_00": 47.140114824312974,+ "downtown_runForBus_00": 44.17973487466733,+ "downtown_runForBus_01": 55.4910134237619,+ "downtown_sitOnStairs_00": 47.52558021833354,+ "downtown_stairs_00": 59.88327898559083,+ "downtown_upstairs_00": 38.66000085104978,+ "downtown_walkBridge_01": 37.6729155352188,+ "downtown_walkUphill_00": 38.12688843232087,+ "downtown_walking_00": 46.38571317138245,+ "downtown_warmWelcome_00": 57.24636250782035,+ "downtown_weeklyMarket_00": 43.718720459737646,+ "downtown_windowShopping_00": 37.57489380475218,+ "flat_guitar_01": 62.42108643644976,+ "flat_packBags_00": 57.026405168890136,+ "office_phoneCall_00": 40.822180300111086,+ "outdoors_fencing_01": 46.8167621028375+ }+ },+ "instanthmr_distill_train/runs/g6vv_s/g6vv_s/best_student_model_v3.pth": {+ "ckpt": "instanthmr_distill_train/runs/g6vv_s/g6vv_s/best_student_model_v3.pth",+ "dataset": "3DPW/test",+ "bbox": "gt-joints",+ "stride": 1,+ "n": 35463,+ "fit_iters": 400,+ "epoch": 239,+ "source": "ema",+ "fit_residual_mm": 16.134763717651367,+ "MPJPE_mm": 68.75614166259766,+ "PA_MPJPE_mm": 48.85976575938138,+ "PVE_mm": 82.17483175804935,+ "PA_PVE_mm": 58.922767700609775,+ "J14_h36m_viamesh_MPJPE_mm": 68.67670440673828,+ "J14_h36m_viamesh_PA_MPJPE_mm": 45.700203014070375,+ "per_sequence_PA_MPJPE_mm": {+ "downtown_arguing_00": 52.81382585719828,+ "downtown_bar_00": 59.8867111583646,+ "downtown_bus_00": 59.6588530827453,+ "downtown_cafe_00": 45.07045578806903,+ "downtown_car_00": 55.3646862528783,+ "downtown_crossStreets_00": 48.26229494702743,+ "downtown_downstairs_00": 41.648202117137984,+ "downtown_enterShop_00": 37.82838810971019,+ "downtown_rampAndStairs_00": 46.62054654021483,+ "downtown_runForBus_00": 44.48715914045716,+ "downtown_runForBus_01": 56.257055296433,+ "downtown_sitOnStairs_00": 46.83417974089869,+ "downtown_stairs_00": 58.466226055982474,+ "downtown_upstairs_00": 39.68883644049444,+ "downtown_walkBridge_01": 38.646604867544205,+ "downtown_walkUphill_00": 38.29069005784523,+ "downtown_walking_00": 45.79220479206771,+ "downtown_warmWelcome_00": 56.37613800716904,+ "downtown_weeklyMarket_00": 42.11701588308054,+ "downtown_windowShopping_00": 38.40437632341867,+ "flat_guitar_01": 57.64387081332988,+ "flat_packBags_00": 55.160215101019304,+ "office_phoneCall_00": 39.43539451340168,+ "outdoors_fencing_01": 48.00674327896801+ }+ }+}\ No newline at end of filediff --git a/benchmark/results/gen6_emdb1_smpl24adapter.json b/benchmark/results/gen6_emdb1_smpl24adapter.jsonnew file mode 100644index 0000000..66aa961--- /dev/null+++ b/benchmark/results/gen6_emdb1_smpl24adapter.json@@ -0,0 +1,686 @@+{+ "instanthmr_distill_train/runs/g6b_s/g6b_s/best_student_model_v3.pth": {+ "ckpt": "instanthmr_distill_train/runs/g6b_s/g6b_s/best_student_model_v3.pth",+ "dataset": "EMDB1",+ "split": "emdb1",+ "stride": 1,+ "bbox": "gt-joints",+ "adapter": "benchmark/results/adapter_smpl24_teacher.npz",+ "epoch": 102,+ "source": "ema",+ "n": 24103,+ "n_dropped": 0,+ "num_sequences": 17,+ "results": [+ {+ "joint_set": "SMPL24+adapter",+ "num_joints": 24,+ "num_samples": 24103,+ "MPJPE_mm": 85.24908665569862,+ "PA_MPJPE_mm": 55.44934350591747,+ "PCK3D_50mm": 0.6303433874068235,+ "PCK3D_100mm": 0.8986848110193751,+ "AUC_0_150mm": 0.6570538000222164,+ "per_joint_PA_MPJPE_mm": {+ "pelvis": 40.44276850297125,+ "left_hip": 41.537323716220456,+ "right_hip": 40.83889567412325,+ "spine1": 47.591581757428976,+ "left_knee": 59.06540487001995,+ "right_knee": 57.68392632974216,+ "spine2": 43.522468816932076,+ "left_ankle": 64.72579890189495,+ "right_ankle": 67.53222921055465,+ "spine3": 40.546135936069575,+ "left_foot": 72.56786270235342,+ "right_foot": 74.28700017742666,+ "neck": 36.16823799839183,+ "left_collar": 30.84593635100392,+ "right_collar": 30.87846376826569,+ "head": 42.869070904273045,+ "left_shoulder": 39.87788877285762,+ "right_shoulder": 40.93670745505024,+ "left_elbow": 54.33933161260382,+ "right_elbow": 51.9918869815113,+ "left_wrist": 79.99968499743431,+ "right_wrist": 79.17244427923963,+ "left_hand": 95.39213276028248,+ "right_hand": 97.97106166536739+ }+ },+ {+ "joint_set": "J14",+ "num_joints": 14,+ "num_samples": 24103,+ "MPJPE_mm": 94.87598513934071,+ "PA_MPJPE_mm": 61.39192918123466,+ "PCK3D_50mm": 0.5332916471571411,+ "PCK3D_100mm": 0.8685640791602705,+ "AUC_0_150mm": 0.6141937701695354,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 69.30459760585951,+ "right_knee": 54.58202973959393,+ "right_hip": 51.20044830862761,+ "left_hip": 48.2350682050327,+ "left_knee": 57.78033752675744,+ "left_ankle": 69.22462357276686,+ "right_wrist": 80.90026764736525,+ "right_elbow": 46.725279563116594,+ "right_shoulder": 52.81483639467326,+ "left_shoulder": 42.86777081428923,+ "left_elbow": 50.904126458628454,+ "left_wrist": 84.23369414174194,+ "neck": 45.221201369742765,+ "head": 105.49272718908968+ }+ },+ {+ "joint_set": "J12",+ "num_joints": 12,+ "num_samples": 24103,+ "MPJPE_mm": 89.60147429303947,+ "PA_MPJPE_mm": 56.762792878143536,+ "PCK3D_50mm": 0.5970695210831294,+ "PCK3D_100mm": 0.9003650997801104,+ "AUC_0_150mm": 0.6466039117961045,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 66.86427842066897,+ "right_knee": 54.83300212466379,+ "right_hip": 48.6203023849111,+ "left_hip": 46.57846367605056,+ "left_knee": 57.991104920598715,+ "left_ankle": 65.92114345863513,+ "right_wrist": 78.82243478171007,+ "right_elbow": 44.040242793090364,+ "right_shoulder": 47.426811932820634,+ "left_shoulder": 42.93378383216155,+ "left_elbow": 47.067751536020246,+ "left_wrist": 80.05419467639135+ }+ }+ ],+ "per_sequence_SMPL24_adapter": {+ "P1_14_outdoor_climb": {+ "n": 1270,+ "PA_MPJPE_mm": 43.66515964403605+ },+ "P2_23_outdoor_hug_tree": {+ "n": 1086,+ "PA_MPJPE_mm": 53.386934652987286+ },+ "P3_31_outdoor_workout": {+ "n": 1216,+ "PA_MPJPE_mm": 52.30633511102723+ },+ "P3_32_outdoor_soccer_warmup_a": {+ "n": 1084,+ "PA_MPJPE_mm": 53.5295522291753+ },+ "P3_33_outdoor_soccer_warmup_b": {+ "n": 1433,+ "PA_MPJPE_mm": 48.29547818782338+ },+ "P5_42_indoor_dancing": {+ "n": 1291,+ "PA_MPJPE_mm": 73.83213823491313+ },+ "P5_44_indoor_rom": {+ "n": 1381,+ "PA_MPJPE_mm": 49.11944288349437+ },+ "P6_49_outdoor_big_stairs_down": {+ "n": 1559,+ "PA_MPJPE_mm": 64.321551743386+ },+ "P6_50_outdoor_workout": {+ "n": 1532,+ "PA_MPJPE_mm": 50.815677401932994+ },+ "P6_51_outdoor_dancing": {+ "n": 1427,+ "PA_MPJPE_mm": 45.324366828245026+ },+ "P7_57_outdoor_rock_chair": {+ "n": 1558,+ "PA_MPJPE_mm": 49.33170640233391+ },+ "P7_59_outdoor_rom": {+ "n": 1839,+ "PA_MPJPE_mm": 53.68090116841388+ },+ "P7_60_outdoor_workout": {+ "n": 1693,+ "PA_MPJPE_mm": 45.94319803020966+ },+ "P8_64_outdoor_skateboard": {+ "n": 1704,+ "PA_MPJPE_mm": 49.86315457060261+ },+ "P8_68_outdoor_handstand": {+ "n": 1606,+ "PA_MPJPE_mm": 94.36464376588654+ },+ "P8_69_outdoor_cartwheel": {+ "n": 656,+ "PA_MPJPE_mm": 62.46249814840102+ },+ "P9_76_outdoor_sitting": {+ "n": 1768,+ "PA_MPJPE_mm": 53.968853360928975+ }+ }+ },+ "instanthmr_distill_train/runs/g6bv_s/g6bv_s/best_student_model_v3.pth": {+ "ckpt": "instanthmr_distill_train/runs/g6bv_s/g6bv_s/best_student_model_v3.pth",+ "dataset": "EMDB1",+ "split": "emdb1",+ "stride": 1,+ "bbox": "gt-joints",+ "adapter": "benchmark/results/adapter_smpl24_teacher.npz",+ "epoch": 247,+ "source": "ema",+ "n": 24103,+ "n_dropped": 0,+ "num_sequences": 17,+ "results": [+ {+ "joint_set": "SMPL24+adapter",+ "num_joints": 24,+ "num_samples": 24103,+ "MPJPE_mm": 81.39060362181309,+ "PA_MPJPE_mm": 52.78712376976438,+ "PCK3D_50mm": 0.6439827683967417,+ "PCK3D_100mm": 0.9095340828942455,+ "AUC_0_150mm": 0.6663711160748741,+ "per_joint_PA_MPJPE_mm": {+ "pelvis": 40.01883427645608,+ "left_hip": 41.26715291990504,+ "right_hip": 40.59560413306814,+ "spine1": 47.211135495716064,+ "left_knee": 54.07129993331573,+ "right_knee": 51.22826390004105,+ "spine2": 43.47053100257457,+ "left_ankle": 60.42976835229707,+ "right_ankle": 60.109835959627475,+ "spine3": 40.56446121949907,+ "left_foot": 67.66038088157181,+ "right_foot": 67.20682151149438,+ "neck": 35.49749139737654,+ "left_collar": 30.45434777688604,+ "right_collar": 29.945759278738805,+ "head": 41.14971274272008,+ "left_shoulder": 39.42971880286286,+ "right_shoulder": 38.60963627394683,+ "left_elbow": 52.432809884889636,+ "right_elbow": 48.739740787964216,+ "left_wrist": 76.5847725330413,+ "right_wrist": 74.88977793086886,+ "left_hand": 91.947187695367,+ "right_hand": 93.37592578411665+ }+ },+ {+ "joint_set": "J14",+ "num_joints": 14,+ "num_samples": 24103,+ "MPJPE_mm": 91.69099578645202,+ "PA_MPJPE_mm": 58.58589537201083,+ "PCK3D_50mm": 0.5510576632428684,+ "PCK3D_100mm": 0.878559871029688,+ "AUC_0_150mm": 0.6242627884820733,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 62.9398698320647,+ "right_knee": 48.70823929264372,+ "right_hip": 51.26898188028841,+ "left_hip": 47.340733332433125,+ "left_knee": 54.47894716026778,+ "left_ankle": 64.29507565211546,+ "right_wrist": 76.3910190457949,+ "right_elbow": 44.26002490301836,+ "right_shoulder": 51.01331403806369,+ "left_shoulder": 41.39904010703302,+ "left_elbow": 48.234218818912936,+ "left_wrist": 79.76576475431467,+ "neck": 45.215729070168166,+ "head": 104.89157732103257+ }+ },+ {+ "joint_set": "J12",+ "num_joints": 12,+ "num_samples": 24103,+ "MPJPE_mm": 86.34770762458652,+ "PA_MPJPE_mm": 53.48934341210172,+ "PCK3D_50mm": 0.6205866489648592,+ "PCK3D_100mm": 0.9117986695985285,+ "AUC_0_150mm": 0.6588061362102341,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 60.094435246763915,+ "right_knee": 48.960518042555194,+ "right_hip": 48.42810003524638,+ "left_hip": 45.36082824221826,+ "left_knee": 54.91487326770962,+ "left_ankle": 61.44566114113791,+ "right_wrist": 74.11045153762892,+ "right_elbow": 41.399519390619325,+ "right_shoulder": 44.423552162499995,+ "left_shoulder": 41.47769336689967,+ "left_elbow": 45.399908223627406,+ "left_wrist": 75.85658028831402+ }+ }+ ],+ "per_sequence_SMPL24_adapter": {+ "P1_14_outdoor_climb": {+ "n": 1270,+ "PA_MPJPE_mm": 41.27623425052127+ },+ "P2_23_outdoor_hug_tree": {+ "n": 1086,+ "PA_MPJPE_mm": 51.30494088711467+ },+ "P3_31_outdoor_workout": {+ "n": 1216,+ "PA_MPJPE_mm": 51.190737385397+ },+ "P3_32_outdoor_soccer_warmup_a": {+ "n": 1084,+ "PA_MPJPE_mm": 49.959443277910445+ },+ "P3_33_outdoor_soccer_warmup_b": {+ "n": 1433,+ "PA_MPJPE_mm": 46.399577689238605+ },+ "P5_42_indoor_dancing": {+ "n": 1291,+ "PA_MPJPE_mm": 70.33963063922049+ },+ "P5_44_indoor_rom": {+ "n": 1381,+ "PA_MPJPE_mm": 46.56238898164989+ },+ "P6_49_outdoor_big_stairs_down": {+ "n": 1559,+ "PA_MPJPE_mm": 61.62643348383337+ },+ "P6_50_outdoor_workout": {+ "n": 1532,+ "PA_MPJPE_mm": 48.89072501280143+ },+ "P6_51_outdoor_dancing": {+ "n": 1427,+ "PA_MPJPE_mm": 43.27561230353556+ },+ "P7_57_outdoor_rock_chair": {+ "n": 1558,+ "PA_MPJPE_mm": 52.00803125854006+ },+ "P7_59_outdoor_rom": {+ "n": 1839,+ "PA_MPJPE_mm": 51.11736699906316+ },+ "P7_60_outdoor_workout": {+ "n": 1693,+ "PA_MPJPE_mm": 45.57351587489808+ },+ "P8_64_outdoor_skateboard": {+ "n": 1704,+ "PA_MPJPE_mm": 49.41187331370503+ },+ "P8_68_outdoor_handstand": {+ "n": 1606,+ "PA_MPJPE_mm": 77.39830882410666+ },+ "P8_69_outdoor_cartwheel": {+ "n": 656,+ "PA_MPJPE_mm": 58.65838547226543+ },+ "P9_76_outdoor_sitting": {+ "n": 1768,+ "PA_MPJPE_mm": 53.32869985598444+ }+ }+ },+ "instanthmr_distill_train/runs/g6v_s/g6v_s/best_student_model_v3.pth": {+ "ckpt": "instanthmr_distill_train/runs/g6v_s/g6v_s/best_student_model_v3.pth",+ "dataset": "EMDB1",+ "split": "emdb1",+ "stride": 1,+ "bbox": "gt-joints",+ "adapter": "benchmark/results/adapter_smpl24_teacher.npz",+ "epoch": 225,+ "source": "raw",+ "n": 24103,+ "n_dropped": 0,+ "num_sequences": 17,+ "results": [+ {+ "joint_set": "SMPL24+adapter",+ "num_joints": 24,+ "num_samples": 24103,+ "MPJPE_mm": 81.67234323853624,+ "PA_MPJPE_mm": 53.14881633351334,+ "PCK3D_50mm": 0.6394622384488791,+ "PCK3D_100mm": 0.9079972755811863,+ "AUC_0_150mm": 0.6634924533108135,+ "per_joint_PA_MPJPE_mm": {+ "pelvis": 39.19292169475212,+ "left_hip": 41.45500628056827,+ "right_hip": 40.541136540400686,+ "spine1": 46.20372459798169,+ "left_knee": 54.69418407839382,+ "right_knee": 53.766838428818396,+ "spine2": 42.712495783690606,+ "left_ankle": 58.50568266377871,+ "right_ankle": 59.61915907264363,+ "spine3": 40.310623689717474,+ "left_foot": 64.72012099983473,+ "right_foot": 65.31113701222193,+ "neck": 35.90498704809899,+ "left_collar": 30.613988391446586,+ "right_collar": 31.018642126117832,+ "head": 42.037296140906605,+ "left_shoulder": 40.34064854072661,+ "right_shoulder": 41.83985460570097,+ "left_elbow": 53.809594392978966,+ "right_elbow": 50.90747734441213,+ "left_wrist": 78.22019178792188,+ "right_wrist": 76.18306708250148,+ "left_hand": 92.8576913233281,+ "right_hand": 94.80512237737673+ }+ },+ {+ "joint_set": "J14",+ "num_joints": 14,+ "num_samples": 24103,+ "MPJPE_mm": 91.36362163829955,+ "PA_MPJPE_mm": 59.34886674839958,+ "PCK3D_50mm": 0.54367565389015,+ "PCK3D_100mm": 0.8759312711517832,+ "AUC_0_150mm": 0.6205009950575019,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 61.510409617905154,+ "right_knee": 51.30217662740902,+ "right_hip": 50.842734490587226,+ "left_hip": 46.83592032884032,+ "left_knee": 54.163994918998945,+ "left_ankle": 62.64579203303455,+ "right_wrist": 77.96599707863224,+ "right_elbow": 45.41432359258422,+ "right_shoulder": 55.00612888634326,+ "left_shoulder": 42.39492242978502,+ "left_elbow": 50.2108397276734,+ "left_wrist": 83.31423575103972,+ "neck": 45.04362486192491,+ "head": 104.23303413283618+ }+ },+ {+ "joint_set": "J12",+ "num_joints": 12,+ "num_samples": 24103,+ "MPJPE_mm": 86.37051494700557,+ "PA_MPJPE_mm": 54.52220104838302,+ "PCK3D_50mm": 0.6091012183822208,+ "PCK3D_100mm": 0.9083447427014618,+ "AUC_0_150mm": 0.6533335430069609,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 58.69641833400611,+ "right_knee": 51.3839495031858,+ "right_hip": 48.12415629259117,+ "left_hip": 45.04815504463009,+ "left_knee": 54.59121129051678,+ "left_ankle": 59.68592516087166,+ "right_wrist": 75.773909756642,+ "right_elbow": 43.09055455498249,+ "right_shoulder": 48.35399819031066,+ "left_shoulder": 42.37838978201944,+ "left_elbow": 47.7645840092948,+ "left_wrist": 79.37516066154522+ }+ }+ ],+ "per_sequence_SMPL24_adapter": {+ "P1_14_outdoor_climb": {+ "n": 1270,+ "PA_MPJPE_mm": 42.04874761935634+ },+ "P2_23_outdoor_hug_tree": {+ "n": 1086,+ "PA_MPJPE_mm": 50.26032023685678+ },+ "P3_31_outdoor_workout": {+ "n": 1216,+ "PA_MPJPE_mm": 51.06371790301442+ },+ "P3_32_outdoor_soccer_warmup_a": {+ "n": 1084,+ "PA_MPJPE_mm": 52.849367348358705+ },+ "P3_33_outdoor_soccer_warmup_b": {+ "n": 1433,+ "PA_MPJPE_mm": 49.16156904715849+ },+ "P5_42_indoor_dancing": {+ "n": 1291,+ "PA_MPJPE_mm": 68.3372732833773+ },+ "P5_44_indoor_rom": {+ "n": 1381,+ "PA_MPJPE_mm": 48.52030048095535+ },+ "P6_49_outdoor_big_stairs_down": {+ "n": 1559,+ "PA_MPJPE_mm": 59.71073877006052+ },+ "P6_50_outdoor_workout": {+ "n": 1532,+ "PA_MPJPE_mm": 48.350753318583045+ },+ "P6_51_outdoor_dancing": {+ "n": 1427,+ "PA_MPJPE_mm": 43.158471445028894+ },+ "P7_57_outdoor_rock_chair": {+ "n": 1558,+ "PA_MPJPE_mm": 50.116466258401836+ },+ "P7_59_outdoor_rom": {+ "n": 1839,+ "PA_MPJPE_mm": 51.02608445976944+ },+ "P7_60_outdoor_workout": {+ "n": 1693,+ "PA_MPJPE_mm": 43.69734517983646+ },+ "P8_64_outdoor_skateboard": {+ "n": 1704,+ "PA_MPJPE_mm": 48.708660854338866+ },+ "P8_68_outdoor_handstand": {+ "n": 1606,+ "PA_MPJPE_mm": 84.31221432789145+ },+ "P8_69_outdoor_cartwheel": {+ "n": 656,+ "PA_MPJPE_mm": 59.78676368209051+ },+ "P9_76_outdoor_sitting": {+ "n": 1768,+ "PA_MPJPE_mm": 54.144779093609436+ }+ }+ },+ "instanthmr_distill_train/runs/g6vv_s/g6vv_s/best_student_model_v3.pth": {+ "ckpt": "instanthmr_distill_train/runs/g6vv_s/g6vv_s/best_student_model_v3.pth",+ "dataset": "EMDB1",+ "split": "emdb1",+ "stride": 1,+ "bbox": "gt-joints",+ "adapter": "benchmark/results/adapter_smpl24_teacher.npz",+ "epoch": 239,+ "source": "ema",+ "n": 24103,+ "n_dropped": 0,+ "num_sequences": 17,+ "results": [+ {+ "joint_set": "SMPL24+adapter",+ "num_joints": 24,+ "num_samples": 24103,+ "MPJPE_mm": 80.8388164639782,+ "PA_MPJPE_mm": 52.492057030998936,+ "PCK3D_50mm": 0.6409264406920301,+ "PCK3D_100mm": 0.9122636877843698,+ "AUC_0_150mm": 0.6665234082760411,+ "per_joint_PA_MPJPE_mm": {+ "pelvis": 39.5173001947221,+ "left_hip": 40.93687239313311,+ "right_hip": 40.470826420546786,+ "spine1": 46.292761894118335,+ "left_knee": 54.5434503733806,+ "right_knee": 53.1692009948552,+ "spine2": 42.78351268865345,+ "left_ankle": 58.67837996388447,+ "right_ankle": 60.14529867036297,+ "spine3": 39.88261944112938,+ "left_foot": 66.37824342178689,+ "right_foot": 66.60436949815637,+ "neck": 36.20816598036446,+ "left_collar": 30.61573052378412,+ "right_collar": 30.349233402107203,+ "head": 42.12061096013422,+ "left_shoulder": 39.739920516958506,+ "right_shoulder": 39.54386087105362,+ "left_elbow": 52.105730853592775,+ "right_elbow": 49.65800015055759,+ "left_wrist": 75.16283400303837,+ "right_wrist": 73.57376719343458,+ "left_hand": 89.72087722264682,+ "right_hand": 91.6078011115718+ }+ },+ {+ "joint_set": "J14",+ "num_joints": 14,+ "num_samples": 24103,+ "MPJPE_mm": 91.59636844538235,+ "PA_MPJPE_mm": 58.58564589932577,+ "PCK3D_50mm": 0.550325685599303,+ "PCK3D_100mm": 0.8768588379632648,+ "AUC_0_150mm": 0.6237037437831608,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 62.70154315537687,+ "right_knee": 50.64757250784787,+ "right_hip": 50.828102396842795,+ "left_hip": 47.34674906877681,+ "left_knee": 53.83874414824775,+ "left_ankle": 63.660653499345635,+ "right_wrist": 74.4958157667914,+ "right_elbow": 44.5602167982945,+ "right_shoulder": 51.99381055264517,+ "left_shoulder": 41.45297960362028,+ "left_elbow": 48.030263424886854,+ "left_wrist": 78.53945031747034,+ "neck": 45.57499282103069,+ "head": 106.52814852938386+ }+ },+ {+ "joint_set": "J12",+ "num_joints": 12,+ "num_samples": 24103,+ "MPJPE_mm": 85.66504711722767,+ "PA_MPJPE_mm": 53.203264963279565,+ "PCK3D_50mm": 0.6213680178124438,+ "PCK3D_100mm": 0.9131712511582237,+ "AUC_0_150mm": 0.6596636790405334,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 59.62621825720753,+ "right_knee": 50.72520946117408,+ "right_hip": 48.02264267888712,+ "left_hip": 45.093007144744185,+ "left_knee": 54.112639805033346,+ "left_ankle": 59.93621495766321,+ "right_wrist": 72.17271131220497,+ "right_elbow": 41.82290591142253,+ "right_shoulder": 45.720285663919114,+ "left_shoulder": 41.50812120327427,+ "left_elbow": 45.170328955465074,+ "left_wrist": 74.52889420835932+ }+ }+ ],+ "per_sequence_SMPL24_adapter": {+ "P1_14_outdoor_climb": {+ "n": 1270,+ "PA_MPJPE_mm": 41.22893034085069+ },+ "P2_23_outdoor_hug_tree": {+ "n": 1086,+ "PA_MPJPE_mm": 50.10120372897257+ },+ "P3_31_outdoor_workout": {+ "n": 1216,+ "PA_MPJPE_mm": 51.713349838206234+ },+ "P3_32_outdoor_soccer_warmup_a": {+ "n": 1084,+ "PA_MPJPE_mm": 50.84240167090533+ },+ "P3_33_outdoor_soccer_warmup_b": {+ "n": 1433,+ "PA_MPJPE_mm": 46.54020753726515+ },+ "P5_42_indoor_dancing": {+ "n": 1291,+ "PA_MPJPE_mm": 68.32164948268385+ },+ "P5_44_indoor_rom": {+ "n": 1381,+ "PA_MPJPE_mm": 47.44759077309669+ },+ "P6_49_outdoor_big_stairs_down": {+ "n": 1559,+ "PA_MPJPE_mm": 58.96885962140703+ },+ "P6_50_outdoor_workout": {+ "n": 1532,+ "PA_MPJPE_mm": 46.42842266255204+ },+ "P6_51_outdoor_dancing": {+ "n": 1427,+ "PA_MPJPE_mm": 43.1381303991415+ },+ "P7_57_outdoor_rock_chair": {+ "n": 1558,+ "PA_MPJPE_mm": 52.07759183937822+ },+ "P7_59_outdoor_rom": {+ "n": 1839,+ "PA_MPJPE_mm": 50.28301493840896+ },+ "P7_60_outdoor_workout": {+ "n": 1693,+ "PA_MPJPE_mm": 44.115564045640156+ },+ "P8_64_outdoor_skateboard": {+ "n": 1704,+ "PA_MPJPE_mm": 47.02788058784131+ },+ "P8_68_outdoor_handstand": {+ "n": 1606,+ "PA_MPJPE_mm": 82.59746344528897+ },+ "P8_69_outdoor_cartwheel": {+ "n": 656,+ "PA_MPJPE_mm": 59.80553886673358+ },+ "P9_76_outdoor_sitting": {+ "n": 1768,+ "PA_MPJPE_mm": 53.78672892188069+ }+ }+ }+}\ No newline at end of filediff --git a/benchmark/results/gen6_emdb1_smplfit.json b/benchmark/results/gen6_emdb1_smplfit.jsonnew file mode 100644index 0000000..d2f5dea--- /dev/null+++ b/benchmark/results/gen6_emdb1_smplfit.json@@ -0,0 +1,146 @@+{+ "instanthmr_distill_train/runs/g6b_s/g6b_s/best_student_model_v3.pth": {+ "ckpt": "instanthmr_distill_train/runs/g6b_s/g6b_s/best_student_model_v3.pth",+ "dataset": "EMDB1",+ "bbox": "gt-joints",+ "stride": 1,+ "n": 24103,+ "fit_iters": 400,+ "epoch": 102,+ "source": "ema",+ "fit_residual_mm": 14.30030345916748,+ "MPJPE_mm": 82.50424194335938,+ "PA_MPJPE_mm": 53.630448317554475,+ "PVE_mm": 97.47888544609019,+ "PA_PVE_mm": 63.253926476830515,+ "J14_h36m_viamesh_MPJPE_mm": 80.97623443603516,+ "J14_h36m_viamesh_PA_MPJPE_mm": 49.348192690589,+ "per_sequence_PA_MPJPE_mm": {+ "P1_14_outdoor_climb": 40.19883884313969,+ "P2_23_outdoor_hug_tree": 52.456288460241744,+ "P3_31_outdoor_workout": 51.53924413457358,+ "P3_32_outdoor_soccer_warmup_a": 52.70549120145435,+ "P3_33_outdoor_soccer_warmup_b": 48.09691879414547,+ "P5_42_indoor_dancing": 72.86494091057435,+ "P5_44_indoor_rom": 48.81177007852985,+ "P6_49_outdoor_big_stairs_down": 62.43381219712345,+ "P6_50_outdoor_workout": 49.38750120275361,+ "P6_51_outdoor_dancing": 44.805854253346425,+ "P7_57_outdoor_rock_chair": 46.358417588952314,+ "P7_59_outdoor_rom": 52.27356134260238,+ "P7_60_outdoor_workout": 43.69644338518449,+ "P8_64_outdoor_skateboard": 47.828347816320175,+ "P8_68_outdoor_handstand": 92.90519698038229,+ "P8_69_outdoor_cartwheel": 59.74083776717741,+ "P9_76_outdoor_sitting": 48.22672952341287+ }+ },+ "instanthmr_distill_train/runs/g6bv_s/g6bv_s/best_student_model_v3.pth": {+ "ckpt": "instanthmr_distill_train/runs/g6bv_s/g6bv_s/best_student_model_v3.pth",+ "dataset": "EMDB1",+ "bbox": "gt-joints",+ "stride": 1,+ "n": 24103,+ "fit_iters": 400,+ "epoch": 247,+ "source": "ema",+ "fit_residual_mm": 14.43234634399414,+ "MPJPE_mm": 78.12178039550781,+ "PA_MPJPE_mm": 50.73391808179524,+ "PVE_mm": 92.54210270906181,+ "PA_PVE_mm": 60.60177938772959,+ "J14_h36m_viamesh_MPJPE_mm": 76.23255157470703,+ "J14_h36m_viamesh_PA_MPJPE_mm": 46.21968662656892,+ "per_sequence_PA_MPJPE_mm": {+ "P1_14_outdoor_climb": 37.38836410475635,+ "P2_23_outdoor_hug_tree": 50.25822391648926,+ "P3_31_outdoor_workout": 50.2125611592255,+ "P3_32_outdoor_soccer_warmup_a": 48.83342154213949,+ "P3_33_outdoor_soccer_warmup_b": 46.20071574026429,+ "P5_42_indoor_dancing": 69.61155737449016,+ "P5_44_indoor_rom": 46.18514740454893,+ "P6_49_outdoor_big_stairs_down": 59.273861728340805,+ "P6_50_outdoor_workout": 46.88291877013638,+ "P6_51_outdoor_dancing": 42.430497456679575,+ "P7_57_outdoor_rock_chair": 48.84798872367035,+ "P7_59_outdoor_rom": 49.12946709631032,+ "P7_60_outdoor_workout": 42.909592200731446,+ "P8_64_outdoor_skateboard": 46.96549114523738,+ "P8_68_outdoor_handstand": 75.75563453564564,+ "P8_69_outdoor_cartwheel": 55.808674554177585,+ "P9_76_outdoor_sitting": 47.93093974219468+ }+ },+ "instanthmr_distill_train/runs/g6v_s/g6v_s/best_student_model_v3.pth": {+ "ckpt": "instanthmr_distill_train/runs/g6v_s/g6v_s/best_student_model_v3.pth",+ "dataset": "EMDB1",+ "bbox": "gt-joints",+ "stride": 1,+ "n": 24103,+ "fit_iters": 400,+ "epoch": 225,+ "source": "raw",+ "fit_residual_mm": 14.628873825073242,+ "MPJPE_mm": 78.38782501220703,+ "PA_MPJPE_mm": 51.342255464859115,+ "PVE_mm": 92.74704889821241,+ "PA_PVE_mm": 61.62021675354329,+ "J14_h36m_viamesh_MPJPE_mm": 76.76594543457031,+ "J14_h36m_viamesh_PA_MPJPE_mm": 47.25285211533647,+ "per_sequence_PA_MPJPE_mm": {+ "P1_14_outdoor_climb": 38.18086105192671,+ "P2_23_outdoor_hug_tree": 48.9477478015161,+ "P3_31_outdoor_workout": 50.25096136567123,+ "P3_32_outdoor_soccer_warmup_a": 52.17091963663792,+ "P3_33_outdoor_soccer_warmup_b": 48.89497629299315,+ "P5_42_indoor_dancing": 67.59165316745444,+ "P5_44_indoor_rom": 48.250051509854664,+ "P6_49_outdoor_big_stairs_down": 58.111135330682956,+ "P6_50_outdoor_workout": 46.77052387379077,+ "P6_51_outdoor_dancing": 42.87896974838975,+ "P7_57_outdoor_rock_chair": 46.755298978881,+ "P7_59_outdoor_rom": 49.44025848980838,+ "P7_60_outdoor_workout": 41.04483850742212,+ "P8_64_outdoor_skateboard": 46.89091605881439,+ "P8_68_outdoor_handstand": 83.20208888949294,+ "P8_69_outdoor_cartwheel": 57.45923317591712,+ "P9_76_outdoor_sitting": 48.82811972679905+ }+ },+ "instanthmr_distill_train/runs/g6vv_s/g6vv_s/best_student_model_v3.pth": {+ "ckpt": "instanthmr_distill_train/runs/g6vv_s/g6vv_s/best_student_model_v3.pth",+ "dataset": "EMDB1",+ "bbox": "gt-joints",+ "stride": 1,+ "n": 24103,+ "fit_iters": 400,+ "epoch": 239,+ "source": "ema",+ "fit_residual_mm": 14.366242408752441,+ "MPJPE_mm": 77.56647491455078,+ "PA_MPJPE_mm": 50.68995444446009,+ "PVE_mm": 92.34008350832515,+ "PA_PVE_mm": 60.63477876512061,+ "J14_h36m_viamesh_MPJPE_mm": 76.6056900024414,+ "J14_h36m_viamesh_PA_MPJPE_mm": 46.800030606742794,+ "per_sequence_PA_MPJPE_mm": {+ "P1_14_outdoor_climb": 37.348505120306996,+ "P2_23_outdoor_hug_tree": 48.915155503100486,+ "P3_31_outdoor_workout": 51.1337024534537,+ "P3_32_outdoor_soccer_warmup_a": 50.384480748001124,+ "P3_33_outdoor_soccer_warmup_b": 46.83623959506515,+ "P5_42_indoor_dancing": 68.04583433850948,+ "P5_44_indoor_rom": 47.43597349329044,+ "P6_49_outdoor_big_stairs_down": 57.029334946014046,+ "P6_50_outdoor_workout": 44.73937441685114,+ "P6_51_outdoor_dancing": 42.55079609281225,+ "P7_57_outdoor_rock_chair": 48.73104939849944,+ "P7_59_outdoor_rom": 48.61240233840695,+ "P7_60_outdoor_workout": 41.175174065305455,+ "P8_64_outdoor_skateboard": 45.14990130797402,+ "P8_68_outdoor_handstand": 81.86023152094495,+ "P8_69_outdoor_cartwheel": 57.25147003355788,+ "P9_76_outdoor_sitting": 47.962357497378235+ }+ }+}\ No newline at end of filediff --git a/benchmark/results/gen7_3dpw_test.json b/benchmark/results/gen7_3dpw_test.jsonnew file mode 100644index 0000000..31ed650--- /dev/null+++ b/benchmark/results/gen7_3dpw_test.json@@ -0,0 +1,146 @@+{+ "instanthmr_distill_train/runs/g7r_s0/g7r_s0/best_student_model_v3.pth|h36m": {+ "ckpt": "instanthmr_distill_train/runs/g7r_s0/g7r_s0/best_student_model_v3.pth",+ "gt": "h36m",+ "split": "test",+ "stride": 1,+ "epoch": 169,+ "source": "ema",+ "n": 35463,+ "n_dropped": 0,+ "results": [+ {+ "joint_set": "J14",+ "num_joints": 14,+ "num_samples": 35463,+ "MPJPE_mm": 106.55963232427057,+ "PA_MPJPE_mm": 67.59828859909312,+ "PCK3D_50mm": 0.3942298008789845,+ "PCK3D_100mm": 0.8283099890831893,+ "AUC_0_150mm": 0.5574437873913111,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 64.46382356533427,+ "right_knee": 47.25597372496897,+ "right_hip": 98.07144410741707,+ "left_hip": 87.49522052231794,+ "left_knee": 44.323743383557606,+ "left_ankle": 66.46594863836347,+ "right_wrist": 69.61139208366498,+ "right_elbow": 58.25602058897865,+ "right_shoulder": 51.48491089262547,+ "left_shoulder": 53.19574911798813,+ "left_elbow": 67.50110591724483,+ "left_wrist": 73.81250672134334,+ "neck": 31.457780983702975,+ "head": 132.9804201397962+ }+ },+ {+ "joint_set": "J12",+ "num_joints": 12,+ "num_samples": 35463,+ "MPJPE_mm": 104.86066023996102,+ "PA_MPJPE_mm": 61.927791610931955,+ "PCK3D_50mm": 0.4436619387342676,+ "PCK3D_100mm": 0.8896525956630855,+ "AUC_0_150mm": 0.5917538164114106,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 61.39738917874813,+ "right_knee": 49.284650222721915,+ "right_hip": 98.12497192706117,+ "left_hip": 86.9643206519134,+ "left_knee": 45.27319245312406,+ "left_ankle": 61.848608069967995,+ "right_wrist": 65.83881379194949,+ "right_elbow": 49.28868611126632,+ "right_shoulder": 50.777514327694306,+ "left_shoulder": 50.06590186895298,+ "left_elbow": 54.691430452746104,+ "left_wrist": 69.57802027503759+ }+ },+ {+ "joint_set": "J14+adapter",+ "num_joints": 14,+ "num_samples": 35463,+ "MPJPE_mm": 70.8794869952138,+ "PA_MPJPE_mm": 41.55189456354803,+ "PCK3D_50mm": 0.728433256391974,+ "PCK3D_100mm": 0.9495832678727527,+ "AUC_0_150mm": 0.7225466771299639+ }+ ]+ },+ "instanthmr_distill_train/runs/g7h_s0/g7h_s0/best_student_model_v3.pth|h36m": {+ "ckpt": "instanthmr_distill_train/runs/g7h_s0/g7h_s0/best_student_model_v3.pth",+ "gt": "h36m",+ "split": "test",+ "stride": 1,+ "epoch": 107,+ "source": "ema",+ "n": 35463,+ "n_dropped": 0,+ "results": [+ {+ "joint_set": "J14",+ "num_joints": 14,+ "num_samples": 35463,+ "MPJPE_mm": 105.31958983589064,+ "PA_MPJPE_mm": 68.61191926982534,+ "PCK3D_50mm": 0.38391522754097834,+ "PCK3D_100mm": 0.8224024234514041,+ "AUC_0_150mm": 0.5514124476591491,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 67.17333511415941,+ "right_knee": 47.94372228787508,+ "right_hip": 98.87687339306508,+ "left_hip": 87.5800866771523,+ "left_knee": 46.8765331171045,+ "left_ankle": 69.20124114022532,+ "right_wrist": 72.72554456354305,+ "right_elbow": 59.11847627456244,+ "right_shoulder": 50.7956029353215,+ "left_shoulder": 52.96843907321996,+ "left_elbow": 67.68644517146863,+ "left_wrist": 76.67468336414615,+ "neck": 33.0633611593688,+ "head": 129.8825255063427+ }+ },+ {+ "joint_set": "J12",+ "num_joints": 12,+ "num_samples": 35463,+ "MPJPE_mm": 103.572053244377,+ "PA_MPJPE_mm": 63.41503431210888,+ "PCK3D_50mm": 0.4229102632790984,+ "PCK3D_100mm": 0.8805163127766968,+ "AUC_0_150mm": 0.5829835063593466,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 63.46866831168299,+ "right_knee": 49.84423219735444,+ "right_hip": 98.35840224615846,+ "left_hip": 87.07441880924338,+ "left_knee": 47.862718711425885,+ "left_ankle": 64.21569158868604,+ "right_wrist": 69.26732158409469,+ "right_elbow": 50.22142636256743,+ "right_shoulder": 51.26354789935885,+ "left_shoulder": 51.500077945407234,+ "left_elbow": 54.932207994752424,+ "left_wrist": 72.97169809457472+ }+ },+ {+ "joint_set": "J14+adapter",+ "num_joints": 14,+ "num_samples": 35463,+ "MPJPE_mm": 69.35152614973077,+ "PA_MPJPE_mm": 43.032953201743574,+ "PCK3D_50mm": 0.7107931405368171,+ "PCK3D_100mm": 0.9452286286310481,+ "AUC_0_150mm": 0.713739613858593+ }+ ]+ }+}\ No newline at end of filediff --git a/benchmark/results/gen7_3dpw_val_stride5.json b/benchmark/results/gen7_3dpw_val_stride5.jsonnew file mode 100644index 0000000..6001c01--- /dev/null+++ b/benchmark/results/gen7_3dpw_val_stride5.json@@ -0,0 +1,146 @@+{+ "instanthmr_distill_train/runs/g7r_s0/g7r_s0/best_student_model_v3.pth|h36m": {+ "ckpt": "instanthmr_distill_train/runs/g7r_s0/g7r_s0/best_student_model_v3.pth",+ "gt": "h36m",+ "split": "validation",+ "stride": 5,+ "epoch": 169,+ "source": "ema",+ "n": 1993,+ "n_dropped": 0,+ "results": [+ {+ "joint_set": "J14",+ "num_joints": 14,+ "num_samples": 1993,+ "MPJPE_mm": 103.90234720126412,+ "PA_MPJPE_mm": 63.38082033985036,+ "PCK3D_50mm": 0.44731560461615655,+ "PCK3D_100mm": 0.8547415955845459,+ "AUC_0_150mm": 0.581793188602505,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 56.85948093194728,+ "right_knee": 48.547847304625115,+ "right_hip": 93.48160213603958,+ "left_hip": 79.84831634941624,+ "left_knee": 42.368813230012584,+ "left_ankle": 57.1097939616838,+ "right_wrist": 74.59096379795069,+ "right_elbow": 56.99275884049035,+ "right_shoulder": 46.58418912944933,+ "left_shoulder": 47.12430108487619,+ "left_elbow": 62.35690634119856,+ "left_wrist": 70.64812134640509,+ "neck": 28.415358839382485,+ "head": 122.40303146442776+ }+ },+ {+ "joint_set": "J12",+ "num_joints": 12,+ "num_samples": 1993,+ "MPJPE_mm": 101.33608351059434,+ "PA_MPJPE_mm": 58.47637562965319,+ "PCK3D_50mm": 0.49790934938953,+ "PCK3D_100mm": 0.9057534704800134,+ "AUC_0_150mm": 0.6126064883004495,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 53.655452915405846,+ "right_knee": 50.538598104998165,+ "right_hip": 94.88849772018665,+ "left_hip": 80.98289262973533,+ "left_knee": 42.88079426469913,+ "left_ankle": 54.47031725378426,+ "right_wrist": 68.33861065226719,+ "right_elbow": 49.76684152737039,+ "right_shoulder": 44.36023974855144,+ "left_shoulder": 42.89197693615923,+ "left_elbow": 53.18353818410083,+ "left_wrist": 65.75874761857979+ }+ },+ {+ "joint_set": "J14+adapter",+ "num_joints": 14,+ "num_samples": 1993,+ "MPJPE_mm": 71.46007771292817,+ "PA_MPJPE_mm": 39.93041587262252,+ "PCK3D_50mm": 0.7482976130743316,+ "PCK3D_100mm": 0.9567414522256469,+ "AUC_0_150mm": 0.7317373479991028+ }+ ]+ },+ "instanthmr_distill_train/runs/g7h_s0/g7h_s0/best_student_model_v3.pth|h36m": {+ "ckpt": "instanthmr_distill_train/runs/g7h_s0/g7h_s0/best_student_model_v3.pth",+ "gt": "h36m",+ "split": "validation",+ "stride": 5,+ "epoch": 107,+ "source": "ema",+ "n": 1993,+ "n_dropped": 0,+ "results": [+ {+ "joint_set": "J14",+ "num_joints": 14,+ "num_samples": 1993,+ "MPJPE_mm": 104.55982490458405,+ "PA_MPJPE_mm": 65.93545723714554,+ "PCK3D_50mm": 0.42409146297756434,+ "PCK3D_100mm": 0.8353164647695506,+ "AUC_0_150mm": 0.568342886739533,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 64.19624479582436,+ "right_knee": 50.74390423789055,+ "right_hip": 95.92368380209209,+ "left_hip": 81.13944986939818,+ "left_knee": 45.85929759842022,+ "left_ankle": 62.16279393248126,+ "right_wrist": 80.60291493429548,+ "right_elbow": 59.837420844358356,+ "right_shoulder": 48.020763238307765,+ "left_shoulder": 46.653383851617825,+ "left_elbow": 62.65661110302429,+ "left_wrist": 77.38705180161271,+ "neck": 29.98179263390863,+ "head": 117.93108867680598+ }+ },+ {+ "joint_set": "J12",+ "num_joints": 12,+ "num_samples": 1993,+ "MPJPE_mm": 101.93417681696192,+ "PA_MPJPE_mm": 61.96334827986432,+ "PCK3D_50mm": 0.46483525673189496,+ "PCK3D_100mm": 0.8771951831409934,+ "AUC_0_150mm": 0.5936517057011368,+ "per_joint_PA_MPJPE_mm": {+ "right_ankle": 60.675849979517814,+ "right_knee": 52.61648682866706,+ "right_hip": 96.62411961742293,+ "left_hip": 82.1574260874414,+ "left_knee": 46.535775669858026,+ "left_ankle": 59.28138744913558,+ "right_wrist": 74.83031419970418,+ "right_elbow": 52.28211428433266,+ "right_shoulder": 46.93795907879271,+ "left_shoulder": 43.69254107647294,+ "left_elbow": 54.286340260518216,+ "left_wrist": 73.63986482650833+ }+ },+ {+ "joint_set": "J14+adapter",+ "num_joints": 14,+ "num_samples": 1993,+ "MPJPE_mm": 71.92407096255458,+ "PA_MPJPE_mm": 43.644587072587775,+ "PCK3D_50mm": 0.705684180345495,+ "PCK3D_100mm": 0.9385707117769335,+ "AUC_0_150mm": 0.7105734124736115+ }+ ]+ }+}\ No newline at end of file