Skip to content
Python

docs: settle the SMPL conversion on the fit-free path after finding --fit-iters 400 unconverged by 8 mm, and add the gen6/gen7 results

mohamdev3b6774a84740
diff --git a/benchmark/README.md b/benchmark/README.md
index cea93be..09b0974 100644
--- a/benchmark/README.md
+++ b/benchmark/README.md
@@ -435,9 +435,97 @@ Per-joint, the error is concentrated in the extremities the adapter has to
extrapolate — `left/right_hand` at 97-98 mm and the wrists at 79-82 mm, against
30-40 mm at the collars, neck, pelvis and hips.
+### `--fit-iters 400` is too low by ~4x — every number below it is inflated (2026-09-11)
+
+**The default was not converged**, and it is the reason this repo carried three
+mutually inconsistent conversions. On 3DPW test the fit leaves **16.13 mm** of
+surface residual at 400 iterations and **7.96 mm** at 4000; the metrics move
+with it, by far more than any model change on the roadmap:
+
+| fit-iters | residual | PVE | J14 PA | SMPL24 PA |
+|---|---|---|---|---|
+| 400 | 16.13 | 82.34 | 45.95 | 49.16 |
+| 1500 | 8.94 | 80.96 | 42.71 | 46.56 |
+| 4000 | 7.96 | 81.01 | 42.33 | 45.93 |
+
+Worse, **the sign is not predictable**: on EMDB, PVE gets *worse* as the fit
+converges (92.45 -> 93.84 -> 94.07) because at 400 iterations the fit is
+accidentally regularised toward the SMPL mean shape. A number you cannot
+defend without saying how long Adam ran is not a protocol. Use >= 1500, or
+skip the fit entirely (next section). The EMDB table two sections down was
+produced at 400 and is inflated.
+
+### The conversion, settled: one surface, one operator on both sides
+
+`barycentric_transfer` already returns the prediction **in SMPL topology**,
+vertex i <-> SMPL vertex i. So the SMPL parameter fit is not needed to reach
+either PVE or a regressed joint set — it exists only to recover the 24
+*kinematic* joints, which come off the kinematic chain. Measured on identical
+predictions, a converged fit converges *toward* the fit-free answer, so all it
+adds in those cases is a hyperparameter with a 3-4 mm blast radius.
+
+The protocol, in order of what the ground truth actually *is*:
+
+| metric | GT is | conversion |
+|---|---|---|
+| **PVE / PA-PVE** | vertices | none — compare directly |
+| **3DPW J14** | `J_regressor_h36m @ GT verts` | same regressor on **both** sides, so its bias cancels exactly |
+| **EMDB SMPL-24** | kinematic joints | a vertex regressor approximates these; costs ~1.1 mm (see below) |
+
+Nothing here is fitted by us: only the rig, Meta's published barycentric map,
+and the benchmark's own regressor. There is no optimiser and no free parameter,
+so the failure above cannot recur.
+
+**The one approximation, quantified.** EMDB's 24 kinematic joints are not a
+linear function of posed vertices. Regressing them from the surface carries, on
+EMDB GT bodies, **10.15 mm mid-hip / 7.02 mm Procrustes** of bias. Errors add in
+quadrature, so at a ~50 mm error level that costs **~1.1 mm** of PA-MPJPE:
+sqrt(50.73^2 + 7.02^2) = 51.2 against 51.82 measured. Quote it; do not
+reach for the fit to remove it unless you run >= 1500 iterations.
+
+**Conversion floor, measured on EMDB (2026-09-11).** `make_mhr_gt.py`'s cached
+MHR fit of EMDB's own GT, pushed through this exact forward path — the oracle
+row, the best any MHR-rigged model could score:
+
+| | MPJPE | PA-MPJPE | PVE |
+|---|---|---|---|
+| oracle (conversion floor) | 18.64 | **12.36** | 19.92 |
+
+The oracle's own surface fit leaves 9.40 mm, so this is an **upper bound** on
+conversion cost, not a tight estimate. At a 51.8 mm result, a 12.4 mm floor
+contributes ~1.5 mm in quadrature: **conversion is not what separates this
+model from SOTA.** Do not subtract it — errors do not add linearly.
+
+### The EMDB person-box convention: quote `--bbox annotated` for published tables
+
+Not because it scores better — it scores **8-12 mm worse**, and it changes the
+ranking. Measured over all 24,103 frames, PA-MPJPE penalty for switching from
+projected-GT-joint boxes to EMDB's own:
+
+| run | gt-joints | annotated | penalty |
+|---|---|---|---|
+| b3_s1 | 53.16 | 60.15 | +6.99 |
+| g6bv_s | 52.01 | 60.33 | +8.32 |
+| g6b_s | 54.78 | 63.30 | +8.52 |
+| g6v_s (v2) | 52.50 | 64.36 | **+11.86** |
+| g6vv_s (v2) | 51.81 | 63.81 | **+12.00** |
+
+Published "Oracle: annotated bounding boxes" rows use EMDB's own boxes, so that
+is the only row that may sit beside them. Picking the cheaper convention while
+comparing against papers that used theirs is the same error as picking a
+flattering joint conversion.
+
+**`--preset v2` is markedly more box-sensitive** (~12 mm against ~8.4 mm), which
+reverses the ranking: g6vv_s is best under projected boxes and *fourth* under
+EMDB's. v2 sets `cliff_follows_aug`, so the model leans harder on the CLIFF
+vector describing its crop; EMDB's boxes are 17.5 % larger and 5.7 % off-centre
+against the padded boxes it trained on. Truncation augmentation does not cover
+this mismatch. Check both conventions before claiming a v2 win.
+
### EMDB-1, SMPL space via mesh conversion (2026-09-08)
-All 17 sequences, all 24,103 frames, projected-GT-joint boxes, `--fit-iters 400`.
+All 17 sequences, all 24,103 frames, projected-GT-joint boxes, `--fit-iters 400`
+— **inflated, see the fit-iters section above; kept for provenance only.**
Report in `benchmark/results/emdb1_smplfit_gt-joints.json`.
| run | epoch | MPJPE | **PA-MPJPE** | PVE | PA-PVE | mean fit residual |
@@ -470,6 +558,54 @@ linearly. Treating model and conversion error as independent, sqrt(50^2 +
18.8^2) = 53.4 against sqrt(50^2 + 10.7^2) = 51.1, so ~2.3 mm predicted against
1.8 mm observed. The real win is that **PVE exists at all**.
+### Generation 6 — the `preset x --w-verts` 2x2 (2026-09-11)
+
+Scored through the fit-free conversion above, all frames, `best_student_model_v3.pth`
+(selected on 3DPW validation). All four are seed 0, `--losses rebalanced
+--cliff-focal --bound-scales --anomaly-safe-fallback --crop-centre-fix`.
+
+**3DPW test** — 35,463 person-frames, J14/H36M, published-protocol GT:
+
+| run | preset | w_verts | ep | MPJPE | PA-MPJPE | PVE | PA-PVE | J14+adapter PA |
+|---|---|---|---|---|---|---|---|---|
+| g6vv_s | v2 | 0.35 | 239 | 67.71 | **42.69** | 81.01 | **57.68** | **41.77** |
+| g6v_s | v2 | 0 | 225 | **67.27** | 43.16 | **80.57** | 58.07 | 42.21 |
+| g6bv_s | baseline | 0.35 | 247 | 70.31 | 43.30 | 83.51 | 58.51 | 42.55 |
+| g6b_s | baseline | 0 | 102 | 73.98 | 45.27 | 87.92 | 61.07 | 44.44 |
+| b3_s1 (gen5) | baseline | 0 | 137 | 69.10 | 43.03 | 82.81 | 58.31 | 41.81 |
+| bno_s0 (gen5) | v2 | 0 | 85 | 69.84 | 44.80 | 83.39 | 60.04 | 43.78 |
+
+**EMDB-1** — 24,103 frames, SMPL-24 kinematic, projected-GT-joint boxes (for the
+`--bbox annotated` row that belongs beside published tables, see above):
+
+| run | preset | w_verts | ep | MPJPE | PA-MPJPE | PVE | PA-PVE |
+|---|---|---|---|---|---|---|---|
+| g6vv_s | v2 | 0.35 | 239 | **78.71** | **51.81** | **94.71** | **61.67** |
+| g6bv_s | baseline | 0.35 | 247 | 79.20 | 52.01 | 95.01 | 61.69 |
+| g6v_s | v2 | 0 | 225 | 79.44 | 52.50 | 95.29 | 62.68 |
+| g6b_s | baseline | 0 | 102 | 83.31 | 54.78 | 99.82 | 64.30 |
+| b3_s1 (gen5) | baseline | 0 | 137 | 78.01 | 53.16 | 94.17 | 63.66 |
+| bno_s0 (gen5) | v2 | 0 | 85 | 80.55 | 55.36 | 96.82 | 65.88 |
+
+**`--preset v2` is the win, and it lands where the mechanism says it should.**
+At nearly matched epochs (g6bv_s 247 vs g6vv_s 239), 3DPW MPJPE drops **2.60 mm**
+and PVE **2.50 mm** while PA-MPJPE moves only 0.61 mm. That is the signature of
+v2's absolute-pose supervision — `w_reproj` 0.01 -> 0.5 and the unsquared
+Euclidean `loss_cam` fix *where the body sits*, and Procrustes discards exactly
+that. Read it next to the box-sensitivity finding above before shipping it.
+
+**`--w-verts 0.35` does not deliver what it was added for.** At matched epochs it
+moves PVE by -0.58 mm on EMDB and **+0.44 mm on 3DPW** — the wrong sign, net
+~zero. PVE is the only metric that can see the 45 `shape_params`, so this was
+the row where the surface term should have shown up. It did not, at one seed.
+
+**g6b_s is not a fair member of the 2x2.** Its best checkpoint is epoch 102
+against the others' 225-247 and its run died at 171 of a 300-epoch
+`OneCycleLR`, so it never annealed. Its ~2 mm deficit is maturity.
+
+**One seed per arm.** Every gap above except the v2 MPJPE/PVE effect is under
+1 mm, well inside seed spread. Only the 2.5 mm v2 result is safe to act on.
+
### What these metrics cannot see
Both headline metrics are alignment-invariant, and that hides exactly the
@@ -515,9 +651,11 @@ camera translation never enters the metric.
`good_frames_mask` is set and the subject is at least 60 % inside the image.
Metrics are over the 24 SMPL kinematic joints, aligned at the midpoint of the
two hips (SMPL indices 1 and 2, not the `pelvis` joint), reached through the
-fixed MHR70 → SMPL-24 map fitted on 3DPW train teacher labels. PA-MPJPE is
-Procrustes with uniform scale. Person boxes: say which of the two conventions
-above you used. PVE is not reported — see the EMDB section for why.
+rig mesh and Meta's barycentric map, then a vertex regressor (see "The
+conversion, settled" — the ~1.1 mm kinematic approximation is quoted with the
+result). PA-MPJPE is Procrustes with uniform scale. PVE is vertex-to-vertex
+against the GT SMPL mesh, mid-hip aligned. Person boxes: say which of the two
+conventions you used, and use `--bbox annotated` for any published comparison.
**COCO val2017.** Top-down with **ground-truth boxes**, one crop per annotated
person with `num_keypoints ≥ 1` and `iscrowd = 0`. These AP numbers are *not*
diff --git a/benchmark/eval_smpl_fit.py b/benchmark/eval_smpl_fit.py
index 77e65b7..f10c46e 100644
--- a/benchmark/eval_smpl_fit.py
+++ b/benchmark/eval_smpl_fit.py
@@ -92,7 +92,10 @@ def parse_args():
p.add_argument("--bbox", default="gt-joints", choices=["gt-joints", "annotated"],
help="EMDB only; 3DPW always uses projected-GT-joint boxes")
p.add_argument("--fit-iters", type=int, default=400,
- help="400 is within 0.3 mm of 550 on the round trip")
+ help="USE >= 1500. 400 converges on the round trip but NOT "
+ "on real predictions: 16.1 mm residual on 3DPW vs 8.0 "
+ "at 4000, worth 3.6 mm of J14 PA-MPJPE, and the sign "
+ "differs per dataset. See benchmark/README.md.")
p.add_argument("--fit-batch", type=int, default=64)
p.add_argument("--batch-size", type=int, default=64)
p.add_argument("--num-workers", type=int, default=10)
diff --git a/benchmark/results/gen6_3dpw_j14adapter.json b/benchmark/results/gen6_3dpw_j14adapter.json
new file mode 100644
index 0000000..2049f00
--- /dev/null
+++ b/benchmark/results/gen6_3dpw_j14adapter.json
@@ -0,0 +1,290 @@
+{
+ "instanthmr_distill_train/runs/g6b_s/g6b_s/best_student_model_v3.pth|h36m": {
+ "ckpt": "instanthmr_distill_train/runs/g6b_s/g6b_s/best_student_model_v3.pth",
+ "gt": "h36m",
+ "split": "test",
+ "stride": 1,
+ "epoch": 102,
+ "source": "ema",
+ "n": 35463,
+ "n_dropped": 0,
+ "results": [
+ {
+ "joint_set": "J14",
+ "num_joints": 14,
+ "num_samples": 35463,
+ "MPJPE_mm": 109.31060473532123,
+ "PA_MPJPE_mm": 69.03721010395624,
+ "PCK3D_50mm": 0.39503546956385127,
+ "PCK3D_100mm": 0.8118159369322554,
+ "AUC_0_150mm": 0.5504897620951336,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 69.5568811480596,
+ "right_knee": 47.95772431021306,
+ "right_hip": 99.03357432412425,
+ "left_hip": 88.40061029784397,
+ "left_knee": 47.56725775636462,
+ "left_ankle": 70.29666472194043,
+ "right_wrist": 73.90936250413914,
+ "right_elbow": 60.21047147727324,
+ "right_shoulder": 48.7594881479906,
+ "left_shoulder": 50.23575878992591,
+ "left_elbow": 70.73785149884611,
+ "left_wrist": 77.19405228378567,
+ "neck": 34.421872822977555,
+ "head": 128.23937137190305
+ }
+ },
+ {
+ "joint_set": "J12",
+ "num_joints": 12,
+ "num_samples": 35463,
+ "MPJPE_mm": 107.94474039350453,
+ "PA_MPJPE_mm": 64.11260767952042,
+ "PCK3D_50mm": 0.428681536625027,
+ "PCK3D_100mm": 0.8689455676808693,
+ "AUC_0_150mm": 0.5801218989714861,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 65.42470164585065,
+ "right_knee": 49.69509364988518,
+ "right_hip": 98.15725842851955,
+ "left_hip": 87.51582399401904,
+ "left_knee": 48.39252151040565,
+ "left_ankle": 65.18918021243668,
+ "right_wrist": 70.85586623493876,
+ "right_elbow": 51.488877615927244,
+ "right_shoulder": 50.59903888387248,
+ "left_shoulder": 51.03028577756485,
+ "left_elbow": 57.469193567248524,
+ "left_wrist": 73.53345063357644
+ }
+ },
+ {
+ "joint_set": "J14+adapter",
+ "num_joints": 14,
+ "num_samples": 35463,
+ "MPJPE_mm": 75.0772344122537,
+ "PA_MPJPE_mm": 44.465876009326585,
+ "PCK3D_50mm": 0.696097743724848,
+ "PCK3D_100mm": 0.9355042076047068,
+ "AUC_0_150mm": 0.7058889572840962
+ }
+ ]
+ },
+ "instanthmr_distill_train/runs/g6bv_s/g6bv_s/best_student_model_v3.pth|h36m": {
+ "ckpt": "instanthmr_distill_train/runs/g6bv_s/g6bv_s/best_student_model_v3.pth",
+ "gt": "h36m",
+ "split": "test",
+ "stride": 1,
+ "epoch": 247,
+ "source": "ema",
+ "n": 35463,
+ "n_dropped": 0,
+ "results": [
+ {
+ "joint_set": "J14",
+ "num_joints": 14,
+ "num_samples": 35463,
+ "MPJPE_mm": 107.50022500460784,
+ "PA_MPJPE_mm": 67.88658382068638,
+ "PCK3D_50mm": 0.4046611961762964,
+ "PCK3D_100mm": 0.8177819135436935,
+ "AUC_0_150mm": 0.5560052789491378,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 67.87522395933384,
+ "right_knee": 47.35189113996917,
+ "right_hip": 98.6727272726729,
+ "left_hip": 90.38633017011507,
+ "left_knee": 47.60500718940778,
+ "left_ankle": 67.85544440533677,
+ "right_wrist": 70.28749044470575,
+ "right_elbow": 59.395211074024495,
+ "right_shoulder": 47.97138190216553,
+ "left_shoulder": 49.411469179216006,
+ "left_elbow": 69.10694208638806,
+ "left_wrist": 74.10098938192529,
+ "neck": 33.505073863521076,
+ "head": 126.88699142082751
+ }
+ },
+ {
+ "joint_set": "J12",
+ "num_joints": 12,
+ "num_samples": 35463,
+ "MPJPE_mm": 106.07782437778351,
+ "PA_MPJPE_mm": 63.02085164461351,
+ "PCK3D_50mm": 0.44028282999182244,
+ "PCK3D_100mm": 0.8755886416828808,
+ "AUC_0_150mm": 0.5857787110539867,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 64.46720310312233,
+ "right_knee": 49.029458093319604,
+ "right_hip": 97.94139039788224,
+ "left_hip": 89.66296993519647,
+ "left_knee": 48.356036572418745,
+ "left_ankle": 63.2247706954782,
+ "right_wrist": 67.10022184348587,
+ "right_elbow": 50.488811815830545,
+ "right_shoulder": 49.32164792363375,
+ "left_shoulder": 49.684912271450415,
+ "left_elbow": 56.347339522093506,
+ "left_wrist": 70.62545756145039
+ }
+ },
+ {
+ "joint_set": "J14+adapter",
+ "num_joints": 14,
+ "num_samples": 35463,
+ "MPJPE_mm": 71.7470439611344,
+ "PA_MPJPE_mm": 42.578590821670765,
+ "PCK3D_50mm": 0.7166362526738129,
+ "PCK3D_100mm": 0.9450453390052409,
+ "AUC_0_150mm": 0.716836370379409
+ }
+ ]
+ },
+ "instanthmr_distill_train/runs/g6v_s/g6v_s/best_student_model_v3.pth|h36m": {
+ "ckpt": "instanthmr_distill_train/runs/g6v_s/g6v_s/best_student_model_v3.pth",
+ "gt": "h36m",
+ "split": "test",
+ "stride": 1,
+ "epoch": 225,
+ "source": "raw",
+ "n": 35463,
+ "n_dropped": 0,
+ "results": [
+ {
+ "joint_set": "J14",
+ "num_joints": 14,
+ "num_samples": 35463,
+ "MPJPE_mm": 103.79603864551636,
+ "PA_MPJPE_mm": 67.23530884349267,
+ "PCK3D_50mm": 0.4025342308482483,
+ "PCK3D_100mm": 0.8281629545482011,
+ "AUC_0_150mm": 0.5595563286509688,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 66.38307779824238,
+ "right_knee": 47.103437333772014,
+ "right_hip": 98.13827811820883,
+ "left_hip": 88.11436838234566,
+ "left_knee": 46.94140350787356,
+ "left_ankle": 66.80158151802696,
+ "right_wrist": 68.3841582458417,
+ "right_elbow": 57.80165606918464,
+ "right_shoulder": 49.52095693867013,
+ "left_shoulder": 49.73127411968748,
+ "left_elbow": 68.30390384132103,
+ "left_wrist": 73.84761435117764,
+ "neck": 33.726795140357595,
+ "head": 126.49581844418778
+ }
+ },
+ {
+ "joint_set": "J12",
+ "num_joints": 12,
+ "num_samples": 35463,
+ "MPJPE_mm": 101.60904983902788,
+ "PA_MPJPE_mm": 62.23479546950118,
+ "PCK3D_50mm": 0.44078335166229593,
+ "PCK3D_100mm": 0.8846896765643064,
+ "AUC_0_150mm": 0.5899720108099945,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 62.42316944731556,
+ "right_knee": 48.75024941003139,
+ "right_hip": 97.4505108204137,
+ "left_hip": 87.21530864401828,
+ "left_knee": 47.86222433250393,
+ "left_ankle": 62.25955806480468,
+ "right_wrist": 66.02621371548021,
+ "right_elbow": 50.039525918380654,
+ "right_shoulder": 49.07085543967181,
+ "left_shoulder": 49.70148336401379,
+ "left_elbow": 55.46603484511562,
+ "left_wrist": 70.55241163226455
+ }
+ },
+ {
+ "joint_set": "J14+adapter",
+ "num_joints": 14,
+ "num_samples": 35463,
+ "MPJPE_mm": 67.98746005488917,
+ "PA_MPJPE_mm": 42.234429549831546,
+ "PCK3D_50mm": 0.720356427826185,
+ "PCK3D_100mm": 0.9478188534528945,
+ "AUC_0_150mm": 0.7183568101289705
+ }
+ ]
+ },
+ "instanthmr_distill_train/runs/g6vv_s/g6vv_s/best_student_model_v3.pth|h36m": {
+ "ckpt": "instanthmr_distill_train/runs/g6vv_s/g6vv_s/best_student_model_v3.pth",
+ "gt": "h36m",
+ "split": "test",
+ "stride": 1,
+ "epoch": 239,
+ "source": "ema",
+ "n": 35463,
+ "n_dropped": 0,
+ "results": [
+ {
+ "joint_set": "J14",
+ "num_joints": 14,
+ "num_samples": 35463,
+ "MPJPE_mm": 104.38210751397787,
+ "PA_MPJPE_mm": 67.15630163795679,
+ "PCK3D_50mm": 0.4068445583122852,
+ "PCK3D_100mm": 0.8279494523467115,
+ "AUC_0_150mm": 0.5599351878526994,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 64.7665394538419,
+ "right_knee": 46.58257021084827,
+ "right_hip": 98.5812079766113,
+ "left_hip": 87.86653676233917,
+ "left_knee": 45.38419871281326,
+ "left_ankle": 67.16328284270159,
+ "right_wrist": 69.49749995124274,
+ "right_elbow": 58.21540961885245,
+ "right_shoulder": 48.25533546902176,
+ "left_shoulder": 49.95558925474159,
+ "left_elbow": 68.64531375386449,
+ "left_wrist": 72.17055782128531,
+ "neck": 33.67057865370319,
+ "head": 129.43360244952788
+ }
+ },
+ {
+ "joint_set": "J12",
+ "num_joints": 12,
+ "num_samples": 35463,
+ "MPJPE_mm": 102.11241461195807,
+ "PA_MPJPE_mm": 61.72775478336907,
+ "PCK3D_50mm": 0.4480937878916053,
+ "PCK3D_100mm": 0.8883319704104747,
+ "AUC_0_150mm": 0.5929310239750109,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 60.87709732727048,
+ "right_knee": 48.32575395623139,
+ "right_hip": 97.87117835471858,
+ "left_hip": 87.07298605453178,
+ "left_knee": 46.09251651935203,
+ "left_ankle": 61.71549070086557,
+ "right_wrist": 66.47290693562417,
+ "right_elbow": 49.05797557258036,
+ "right_shoulder": 49.54315937498645,
+ "left_shoulder": 50.0186382492938,
+ "left_elbow": 55.23074208132174,
+ "left_wrist": 68.45461227365254
+ }
+ },
+ {
+ "joint_set": "J14+adapter",
+ "num_joints": 14,
+ "num_samples": 35463,
+ "MPJPE_mm": 68.4703090038315,
+ "PA_MPJPE_mm": 41.78863155958053,
+ "PCK3D_50mm": 0.7237603780197469,
+ "PCK3D_100mm": 0.9499720030132008,
+ "AUC_0_150mm": 0.721090106115662
+ }
+ ]
+ }
+}
\ No newline at end of file
diff --git a/benchmark/results/gen6_3dpw_smplfit.json b/benchmark/results/gen6_3dpw_smplfit.json
new file mode 100644
index 0000000..716954c
--- /dev/null
+++ b/benchmark/results/gen6_3dpw_smplfit.json
@@ -0,0 +1,174 @@
+{
+ "instanthmr_distill_train/runs/g6b_s/g6b_s/best_student_model_v3.pth": {
+ "ckpt": "instanthmr_distill_train/runs/g6b_s/g6b_s/best_student_model_v3.pth",
+ "dataset": "3DPW/test",
+ "bbox": "gt-joints",
+ "stride": 1,
+ "n": 35463,
+ "fit_iters": 400,
+ "epoch": 102,
+ "source": "ema",
+ "fit_residual_mm": 16.407779693603516,
+ "MPJPE_mm": 75.09175109863281,
+ "PA_MPJPE_mm": 51.997389429496,
+ "PVE_mm": 88.99562652986062,
+ "PA_PVE_mm": 62.232839273349775,
+ "J14_h36m_viamesh_MPJPE_mm": 75.06359100341797,
+ "J14_h36m_viamesh_PA_MPJPE_mm": 48.0625726362123,
+ "per_sequence_PA_MPJPE_mm": {
+ "downtown_arguing_00": 52.35380204853086,
+ "downtown_bar_00": 63.43621329400987,
+ "downtown_bus_00": 70.42712580551195,
+ "downtown_cafe_00": 47.011574173008455,
+ "downtown_car_00": 60.77430019284298,
+ "downtown_crossStreets_00": 51.18487757623839,
+ "downtown_downstairs_00": 43.35631228850949,
+ "downtown_enterShop_00": 44.915920302835474,
+ "downtown_rampAndStairs_00": 48.29072450053912,
+ "downtown_runForBus_00": 45.24491591290331,
+ "downtown_runForBus_01": 56.95027485318371,
+ "downtown_sitOnStairs_00": 47.6351770869155,
+ "downtown_stairs_00": 60.041978509870916,
+ "downtown_upstairs_00": 41.888490125483685,
+ "downtown_walkBridge_01": 43.297105145822556,
+ "downtown_walkUphill_00": 39.704988938823426,
+ "downtown_walking_00": 49.266615736123995,
+ "downtown_warmWelcome_00": 56.68671025624492,
+ "downtown_weeklyMarket_00": 46.43459014394701,
+ "downtown_windowShopping_00": 41.19524987284674,
+ "flat_guitar_01": 65.11440430066091,
+ "flat_packBags_00": 57.99867125376623,
+ "office_phoneCall_00": 41.297467198364956,
+ "outdoors_fencing_01": 49.71312080688268
+ }
+ },
+ "instanthmr_distill_train/runs/g6bv_s/g6bv_s/best_student_model_v3.pth": {
+ "ckpt": "instanthmr_distill_train/runs/g6bv_s/g6bv_s/best_student_model_v3.pth",
+ "dataset": "3DPW/test",
+ "bbox": "gt-joints",
+ "stride": 1,
+ "n": 35463,
+ "fit_iters": 400,
+ "epoch": 247,
+ "source": "ema",
+ "fit_residual_mm": 16.44468116760254,
+ "MPJPE_mm": 71.14830780029297,
+ "PA_MPJPE_mm": 49.70935360363883,
+ "PVE_mm": 84.52926939081257,
+ "PA_PVE_mm": 59.69143506594802,
+ "J14_h36m_viamesh_MPJPE_mm": 71.13408660888672,
+ "J14_h36m_viamesh_PA_MPJPE_mm": 46.101878495835884,
+ "per_sequence_PA_MPJPE_mm": {
+ "downtown_arguing_00": 52.031236927354335,
+ "downtown_bar_00": 61.81048529655713,
+ "downtown_bus_00": 62.00489752242751,
+ "downtown_cafe_00": 45.17636336684825,
+ "downtown_car_00": 60.668824113978154,
+ "downtown_crossStreets_00": 49.38730167442858,
+ "downtown_downstairs_00": 41.66461687753154,
+ "downtown_enterShop_00": 40.737916968050165,
+ "downtown_rampAndStairs_00": 45.575119645039635,
+ "downtown_runForBus_00": 43.856374789751726,
+ "downtown_runForBus_01": 56.691850799168535,
+ "downtown_sitOnStairs_00": 46.95034291987287,
+ "downtown_stairs_00": 61.9412683432234,
+ "downtown_upstairs_00": 38.167424639991026,
+ "downtown_walkBridge_01": 38.987812005278904,
+ "downtown_walkUphill_00": 36.832141521119155,
+ "downtown_walking_00": 46.391550816843775,
+ "downtown_warmWelcome_00": 54.93313575074026,
+ "downtown_weeklyMarket_00": 43.59573050730472,
+ "downtown_windowShopping_00": 38.98571115726211,
+ "flat_guitar_01": 62.50786710991815,
+ "flat_packBags_00": 55.29524804866438,
+ "office_phoneCall_00": 39.142479316853695,
+ "outdoors_fencing_01": 48.53746768617269
+ }
+ },
+ "instanthmr_distill_train/runs/g6v_s/g6v_s/best_student_model_v3.pth": {
+ "ckpt": "instanthmr_distill_train/runs/g6v_s/g6v_s/best_student_model_v3.pth",
+ "dataset": "3DPW/test",
+ "bbox": "gt-joints",
+ "stride": 1,
+ "n": 35463,
+ "fit_iters": 400,
+ "epoch": 225,
+ "source": "raw",
+ "fit_residual_mm": 16.19407844543457,
+ "MPJPE_mm": 68.57659149169922,
+ "PA_MPJPE_mm": 49.277110368518564,
+ "PVE_mm": 81.60751473960043,
+ "PA_PVE_mm": 59.19252199670127,
+ "J14_h36m_viamesh_MPJPE_mm": 68.0377197265625,
+ "J14_h36m_viamesh_PA_MPJPE_mm": 45.818179457288885,
+ "per_sequence_PA_MPJPE_mm": {
+ "downtown_arguing_00": 53.654612794436275,
+ "downtown_bar_00": 61.32844290121133,
+ "downtown_bus_00": 58.07648931695738,
+ "downtown_cafe_00": 45.83578195474714,
+ "downtown_car_00": 56.24965576365669,
+ "downtown_crossStreets_00": 48.07396249981064,
+ "downtown_downstairs_00": 41.53538553211249,
+ "downtown_enterShop_00": 38.1628359228303,
+ "downtown_rampAndStairs_00": 47.140114824312974,
+ "downtown_runForBus_00": 44.17973487466733,
+ "downtown_runForBus_01": 55.4910134237619,
+ "downtown_sitOnStairs_00": 47.52558021833354,
+ "downtown_stairs_00": 59.88327898559083,
+ "downtown_upstairs_00": 38.66000085104978,
+ "downtown_walkBridge_01": 37.6729155352188,
+ "downtown_walkUphill_00": 38.12688843232087,
+ "downtown_walking_00": 46.38571317138245,
+ "downtown_warmWelcome_00": 57.24636250782035,
+ "downtown_weeklyMarket_00": 43.718720459737646,
+ "downtown_windowShopping_00": 37.57489380475218,
+ "flat_guitar_01": 62.42108643644976,
+ "flat_packBags_00": 57.026405168890136,
+ "office_phoneCall_00": 40.822180300111086,
+ "outdoors_fencing_01": 46.8167621028375
+ }
+ },
+ "instanthmr_distill_train/runs/g6vv_s/g6vv_s/best_student_model_v3.pth": {
+ "ckpt": "instanthmr_distill_train/runs/g6vv_s/g6vv_s/best_student_model_v3.pth",
+ "dataset": "3DPW/test",
+ "bbox": "gt-joints",
+ "stride": 1,
+ "n": 35463,
+ "fit_iters": 400,
+ "epoch": 239,
+ "source": "ema",
+ "fit_residual_mm": 16.134763717651367,
+ "MPJPE_mm": 68.75614166259766,
+ "PA_MPJPE_mm": 48.85976575938138,
+ "PVE_mm": 82.17483175804935,
+ "PA_PVE_mm": 58.922767700609775,
+ "J14_h36m_viamesh_MPJPE_mm": 68.67670440673828,
+ "J14_h36m_viamesh_PA_MPJPE_mm": 45.700203014070375,
+ "per_sequence_PA_MPJPE_mm": {
+ "downtown_arguing_00": 52.81382585719828,
+ "downtown_bar_00": 59.8867111583646,
+ "downtown_bus_00": 59.6588530827453,
+ "downtown_cafe_00": 45.07045578806903,
+ "downtown_car_00": 55.3646862528783,
+ "downtown_crossStreets_00": 48.26229494702743,
+ "downtown_downstairs_00": 41.648202117137984,
+ "downtown_enterShop_00": 37.82838810971019,
+ "downtown_rampAndStairs_00": 46.62054654021483,
+ "downtown_runForBus_00": 44.48715914045716,
+ "downtown_runForBus_01": 56.257055296433,
+ "downtown_sitOnStairs_00": 46.83417974089869,
+ "downtown_stairs_00": 58.466226055982474,
+ "downtown_upstairs_00": 39.68883644049444,
+ "downtown_walkBridge_01": 38.646604867544205,
+ "downtown_walkUphill_00": 38.29069005784523,
+ "downtown_walking_00": 45.79220479206771,
+ "downtown_warmWelcome_00": 56.37613800716904,
+ "downtown_weeklyMarket_00": 42.11701588308054,
+ "downtown_windowShopping_00": 38.40437632341867,
+ "flat_guitar_01": 57.64387081332988,
+ "flat_packBags_00": 55.160215101019304,
+ "office_phoneCall_00": 39.43539451340168,
+ "outdoors_fencing_01": 48.00674327896801
+ }
+ }
+}
\ No newline at end of file
diff --git a/benchmark/results/gen6_emdb1_smpl24adapter.json b/benchmark/results/gen6_emdb1_smpl24adapter.json
new file mode 100644
index 0000000..66aa961
--- /dev/null
+++ b/benchmark/results/gen6_emdb1_smpl24adapter.json
@@ -0,0 +1,686 @@
+{
+ "instanthmr_distill_train/runs/g6b_s/g6b_s/best_student_model_v3.pth": {
+ "ckpt": "instanthmr_distill_train/runs/g6b_s/g6b_s/best_student_model_v3.pth",
+ "dataset": "EMDB1",
+ "split": "emdb1",
+ "stride": 1,
+ "bbox": "gt-joints",
+ "adapter": "benchmark/results/adapter_smpl24_teacher.npz",
+ "epoch": 102,
+ "source": "ema",
+ "n": 24103,
+ "n_dropped": 0,
+ "num_sequences": 17,
+ "results": [
+ {
+ "joint_set": "SMPL24+adapter",
+ "num_joints": 24,
+ "num_samples": 24103,
+ "MPJPE_mm": 85.24908665569862,
+ "PA_MPJPE_mm": 55.44934350591747,
+ "PCK3D_50mm": 0.6303433874068235,
+ "PCK3D_100mm": 0.8986848110193751,
+ "AUC_0_150mm": 0.6570538000222164,
+ "per_joint_PA_MPJPE_mm": {
+ "pelvis": 40.44276850297125,
+ "left_hip": 41.537323716220456,
+ "right_hip": 40.83889567412325,
+ "spine1": 47.591581757428976,
+ "left_knee": 59.06540487001995,
+ "right_knee": 57.68392632974216,
+ "spine2": 43.522468816932076,
+ "left_ankle": 64.72579890189495,
+ "right_ankle": 67.53222921055465,
+ "spine3": 40.546135936069575,
+ "left_foot": 72.56786270235342,
+ "right_foot": 74.28700017742666,
+ "neck": 36.16823799839183,
+ "left_collar": 30.84593635100392,
+ "right_collar": 30.87846376826569,
+ "head": 42.869070904273045,
+ "left_shoulder": 39.87788877285762,
+ "right_shoulder": 40.93670745505024,
+ "left_elbow": 54.33933161260382,
+ "right_elbow": 51.9918869815113,
+ "left_wrist": 79.99968499743431,
+ "right_wrist": 79.17244427923963,
+ "left_hand": 95.39213276028248,
+ "right_hand": 97.97106166536739
+ }
+ },
+ {
+ "joint_set": "J14",
+ "num_joints": 14,
+ "num_samples": 24103,
+ "MPJPE_mm": 94.87598513934071,
+ "PA_MPJPE_mm": 61.39192918123466,
+ "PCK3D_50mm": 0.5332916471571411,
+ "PCK3D_100mm": 0.8685640791602705,
+ "AUC_0_150mm": 0.6141937701695354,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 69.30459760585951,
+ "right_knee": 54.58202973959393,
+ "right_hip": 51.20044830862761,
+ "left_hip": 48.2350682050327,
+ "left_knee": 57.78033752675744,
+ "left_ankle": 69.22462357276686,
+ "right_wrist": 80.90026764736525,
+ "right_elbow": 46.725279563116594,
+ "right_shoulder": 52.81483639467326,
+ "left_shoulder": 42.86777081428923,
+ "left_elbow": 50.904126458628454,
+ "left_wrist": 84.23369414174194,
+ "neck": 45.221201369742765,
+ "head": 105.49272718908968
+ }
+ },
+ {
+ "joint_set": "J12",
+ "num_joints": 12,
+ "num_samples": 24103,
+ "MPJPE_mm": 89.60147429303947,
+ "PA_MPJPE_mm": 56.762792878143536,
+ "PCK3D_50mm": 0.5970695210831294,
+ "PCK3D_100mm": 0.9003650997801104,
+ "AUC_0_150mm": 0.6466039117961045,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 66.86427842066897,
+ "right_knee": 54.83300212466379,
+ "right_hip": 48.6203023849111,
+ "left_hip": 46.57846367605056,
+ "left_knee": 57.991104920598715,
+ "left_ankle": 65.92114345863513,
+ "right_wrist": 78.82243478171007,
+ "right_elbow": 44.040242793090364,
+ "right_shoulder": 47.426811932820634,
+ "left_shoulder": 42.93378383216155,
+ "left_elbow": 47.067751536020246,
+ "left_wrist": 80.05419467639135
+ }
+ }
+ ],
+ "per_sequence_SMPL24_adapter": {
+ "P1_14_outdoor_climb": {
+ "n": 1270,
+ "PA_MPJPE_mm": 43.66515964403605
+ },
+ "P2_23_outdoor_hug_tree": {
+ "n": 1086,
+ "PA_MPJPE_mm": 53.386934652987286
+ },
+ "P3_31_outdoor_workout": {
+ "n": 1216,
+ "PA_MPJPE_mm": 52.30633511102723
+ },
+ "P3_32_outdoor_soccer_warmup_a": {
+ "n": 1084,
+ "PA_MPJPE_mm": 53.5295522291753
+ },
+ "P3_33_outdoor_soccer_warmup_b": {
+ "n": 1433,
+ "PA_MPJPE_mm": 48.29547818782338
+ },
+ "P5_42_indoor_dancing": {
+ "n": 1291,
+ "PA_MPJPE_mm": 73.83213823491313
+ },
+ "P5_44_indoor_rom": {
+ "n": 1381,
+ "PA_MPJPE_mm": 49.11944288349437
+ },
+ "P6_49_outdoor_big_stairs_down": {
+ "n": 1559,
+ "PA_MPJPE_mm": 64.321551743386
+ },
+ "P6_50_outdoor_workout": {
+ "n": 1532,
+ "PA_MPJPE_mm": 50.815677401932994
+ },
+ "P6_51_outdoor_dancing": {
+ "n": 1427,
+ "PA_MPJPE_mm": 45.324366828245026
+ },
+ "P7_57_outdoor_rock_chair": {
+ "n": 1558,
+ "PA_MPJPE_mm": 49.33170640233391
+ },
+ "P7_59_outdoor_rom": {
+ "n": 1839,
+ "PA_MPJPE_mm": 53.68090116841388
+ },
+ "P7_60_outdoor_workout": {
+ "n": 1693,
+ "PA_MPJPE_mm": 45.94319803020966
+ },
+ "P8_64_outdoor_skateboard": {
+ "n": 1704,
+ "PA_MPJPE_mm": 49.86315457060261
+ },
+ "P8_68_outdoor_handstand": {
+ "n": 1606,
+ "PA_MPJPE_mm": 94.36464376588654
+ },
+ "P8_69_outdoor_cartwheel": {
+ "n": 656,
+ "PA_MPJPE_mm": 62.46249814840102
+ },
+ "P9_76_outdoor_sitting": {
+ "n": 1768,
+ "PA_MPJPE_mm": 53.968853360928975
+ }
+ }
+ },
+ "instanthmr_distill_train/runs/g6bv_s/g6bv_s/best_student_model_v3.pth": {
+ "ckpt": "instanthmr_distill_train/runs/g6bv_s/g6bv_s/best_student_model_v3.pth",
+ "dataset": "EMDB1",
+ "split": "emdb1",
+ "stride": 1,
+ "bbox": "gt-joints",
+ "adapter": "benchmark/results/adapter_smpl24_teacher.npz",
+ "epoch": 247,
+ "source": "ema",
+ "n": 24103,
+ "n_dropped": 0,
+ "num_sequences": 17,
+ "results": [
+ {
+ "joint_set": "SMPL24+adapter",
+ "num_joints": 24,
+ "num_samples": 24103,
+ "MPJPE_mm": 81.39060362181309,
+ "PA_MPJPE_mm": 52.78712376976438,
+ "PCK3D_50mm": 0.6439827683967417,
+ "PCK3D_100mm": 0.9095340828942455,
+ "AUC_0_150mm": 0.6663711160748741,
+ "per_joint_PA_MPJPE_mm": {
+ "pelvis": 40.01883427645608,
+ "left_hip": 41.26715291990504,
+ "right_hip": 40.59560413306814,
+ "spine1": 47.211135495716064,
+ "left_knee": 54.07129993331573,
+ "right_knee": 51.22826390004105,
+ "spine2": 43.47053100257457,
+ "left_ankle": 60.42976835229707,
+ "right_ankle": 60.109835959627475,
+ "spine3": 40.56446121949907,
+ "left_foot": 67.66038088157181,
+ "right_foot": 67.20682151149438,
+ "neck": 35.49749139737654,
+ "left_collar": 30.45434777688604,
+ "right_collar": 29.945759278738805,
+ "head": 41.14971274272008,
+ "left_shoulder": 39.42971880286286,
+ "right_shoulder": 38.60963627394683,
+ "left_elbow": 52.432809884889636,
+ "right_elbow": 48.739740787964216,
+ "left_wrist": 76.5847725330413,
+ "right_wrist": 74.88977793086886,
+ "left_hand": 91.947187695367,
+ "right_hand": 93.37592578411665
+ }
+ },
+ {
+ "joint_set": "J14",
+ "num_joints": 14,
+ "num_samples": 24103,
+ "MPJPE_mm": 91.69099578645202,
+ "PA_MPJPE_mm": 58.58589537201083,
+ "PCK3D_50mm": 0.5510576632428684,
+ "PCK3D_100mm": 0.878559871029688,
+ "AUC_0_150mm": 0.6242627884820733,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 62.9398698320647,
+ "right_knee": 48.70823929264372,
+ "right_hip": 51.26898188028841,
+ "left_hip": 47.340733332433125,
+ "left_knee": 54.47894716026778,
+ "left_ankle": 64.29507565211546,
+ "right_wrist": 76.3910190457949,
+ "right_elbow": 44.26002490301836,
+ "right_shoulder": 51.01331403806369,
+ "left_shoulder": 41.39904010703302,
+ "left_elbow": 48.234218818912936,
+ "left_wrist": 79.76576475431467,
+ "neck": 45.215729070168166,
+ "head": 104.89157732103257
+ }
+ },
+ {
+ "joint_set": "J12",
+ "num_joints": 12,
+ "num_samples": 24103,
+ "MPJPE_mm": 86.34770762458652,
+ "PA_MPJPE_mm": 53.48934341210172,
+ "PCK3D_50mm": 0.6205866489648592,
+ "PCK3D_100mm": 0.9117986695985285,
+ "AUC_0_150mm": 0.6588061362102341,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 60.094435246763915,
+ "right_knee": 48.960518042555194,
+ "right_hip": 48.42810003524638,
+ "left_hip": 45.36082824221826,
+ "left_knee": 54.91487326770962,
+ "left_ankle": 61.44566114113791,
+ "right_wrist": 74.11045153762892,
+ "right_elbow": 41.399519390619325,
+ "right_shoulder": 44.423552162499995,
+ "left_shoulder": 41.47769336689967,
+ "left_elbow": 45.399908223627406,
+ "left_wrist": 75.85658028831402
+ }
+ }
+ ],
+ "per_sequence_SMPL24_adapter": {
+ "P1_14_outdoor_climb": {
+ "n": 1270,
+ "PA_MPJPE_mm": 41.27623425052127
+ },
+ "P2_23_outdoor_hug_tree": {
+ "n": 1086,
+ "PA_MPJPE_mm": 51.30494088711467
+ },
+ "P3_31_outdoor_workout": {
+ "n": 1216,
+ "PA_MPJPE_mm": 51.190737385397
+ },
+ "P3_32_outdoor_soccer_warmup_a": {
+ "n": 1084,
+ "PA_MPJPE_mm": 49.959443277910445
+ },
+ "P3_33_outdoor_soccer_warmup_b": {
+ "n": 1433,
+ "PA_MPJPE_mm": 46.399577689238605
+ },
+ "P5_42_indoor_dancing": {
+ "n": 1291,
+ "PA_MPJPE_mm": 70.33963063922049
+ },
+ "P5_44_indoor_rom": {
+ "n": 1381,
+ "PA_MPJPE_mm": 46.56238898164989
+ },
+ "P6_49_outdoor_big_stairs_down": {
+ "n": 1559,
+ "PA_MPJPE_mm": 61.62643348383337
+ },
+ "P6_50_outdoor_workout": {
+ "n": 1532,
+ "PA_MPJPE_mm": 48.89072501280143
+ },
+ "P6_51_outdoor_dancing": {
+ "n": 1427,
+ "PA_MPJPE_mm": 43.27561230353556
+ },
+ "P7_57_outdoor_rock_chair": {
+ "n": 1558,
+ "PA_MPJPE_mm": 52.00803125854006
+ },
+ "P7_59_outdoor_rom": {
+ "n": 1839,
+ "PA_MPJPE_mm": 51.11736699906316
+ },
+ "P7_60_outdoor_workout": {
+ "n": 1693,
+ "PA_MPJPE_mm": 45.57351587489808
+ },
+ "P8_64_outdoor_skateboard": {
+ "n": 1704,
+ "PA_MPJPE_mm": 49.41187331370503
+ },
+ "P8_68_outdoor_handstand": {
+ "n": 1606,
+ "PA_MPJPE_mm": 77.39830882410666
+ },
+ "P8_69_outdoor_cartwheel": {
+ "n": 656,
+ "PA_MPJPE_mm": 58.65838547226543
+ },
+ "P9_76_outdoor_sitting": {
+ "n": 1768,
+ "PA_MPJPE_mm": 53.32869985598444
+ }
+ }
+ },
+ "instanthmr_distill_train/runs/g6v_s/g6v_s/best_student_model_v3.pth": {
+ "ckpt": "instanthmr_distill_train/runs/g6v_s/g6v_s/best_student_model_v3.pth",
+ "dataset": "EMDB1",
+ "split": "emdb1",
+ "stride": 1,
+ "bbox": "gt-joints",
+ "adapter": "benchmark/results/adapter_smpl24_teacher.npz",
+ "epoch": 225,
+ "source": "raw",
+ "n": 24103,
+ "n_dropped": 0,
+ "num_sequences": 17,
+ "results": [
+ {
+ "joint_set": "SMPL24+adapter",
+ "num_joints": 24,
+ "num_samples": 24103,
+ "MPJPE_mm": 81.67234323853624,
+ "PA_MPJPE_mm": 53.14881633351334,
+ "PCK3D_50mm": 0.6394622384488791,
+ "PCK3D_100mm": 0.9079972755811863,
+ "AUC_0_150mm": 0.6634924533108135,
+ "per_joint_PA_MPJPE_mm": {
+ "pelvis": 39.19292169475212,
+ "left_hip": 41.45500628056827,
+ "right_hip": 40.541136540400686,
+ "spine1": 46.20372459798169,
+ "left_knee": 54.69418407839382,
+ "right_knee": 53.766838428818396,
+ "spine2": 42.712495783690606,
+ "left_ankle": 58.50568266377871,
+ "right_ankle": 59.61915907264363,
+ "spine3": 40.310623689717474,
+ "left_foot": 64.72012099983473,
+ "right_foot": 65.31113701222193,
+ "neck": 35.90498704809899,
+ "left_collar": 30.613988391446586,
+ "right_collar": 31.018642126117832,
+ "head": 42.037296140906605,
+ "left_shoulder": 40.34064854072661,
+ "right_shoulder": 41.83985460570097,
+ "left_elbow": 53.809594392978966,
+ "right_elbow": 50.90747734441213,
+ "left_wrist": 78.22019178792188,
+ "right_wrist": 76.18306708250148,
+ "left_hand": 92.8576913233281,
+ "right_hand": 94.80512237737673
+ }
+ },
+ {
+ "joint_set": "J14",
+ "num_joints": 14,
+ "num_samples": 24103,
+ "MPJPE_mm": 91.36362163829955,
+ "PA_MPJPE_mm": 59.34886674839958,
+ "PCK3D_50mm": 0.54367565389015,
+ "PCK3D_100mm": 0.8759312711517832,
+ "AUC_0_150mm": 0.6205009950575019,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 61.510409617905154,
+ "right_knee": 51.30217662740902,
+ "right_hip": 50.842734490587226,
+ "left_hip": 46.83592032884032,
+ "left_knee": 54.163994918998945,
+ "left_ankle": 62.64579203303455,
+ "right_wrist": 77.96599707863224,
+ "right_elbow": 45.41432359258422,
+ "right_shoulder": 55.00612888634326,
+ "left_shoulder": 42.39492242978502,
+ "left_elbow": 50.2108397276734,
+ "left_wrist": 83.31423575103972,
+ "neck": 45.04362486192491,
+ "head": 104.23303413283618
+ }
+ },
+ {
+ "joint_set": "J12",
+ "num_joints": 12,
+ "num_samples": 24103,
+ "MPJPE_mm": 86.37051494700557,
+ "PA_MPJPE_mm": 54.52220104838302,
+ "PCK3D_50mm": 0.6091012183822208,
+ "PCK3D_100mm": 0.9083447427014618,
+ "AUC_0_150mm": 0.6533335430069609,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 58.69641833400611,
+ "right_knee": 51.3839495031858,
+ "right_hip": 48.12415629259117,
+ "left_hip": 45.04815504463009,
+ "left_knee": 54.59121129051678,
+ "left_ankle": 59.68592516087166,
+ "right_wrist": 75.773909756642,
+ "right_elbow": 43.09055455498249,
+ "right_shoulder": 48.35399819031066,
+ "left_shoulder": 42.37838978201944,
+ "left_elbow": 47.7645840092948,
+ "left_wrist": 79.37516066154522
+ }
+ }
+ ],
+ "per_sequence_SMPL24_adapter": {
+ "P1_14_outdoor_climb": {
+ "n": 1270,
+ "PA_MPJPE_mm": 42.04874761935634
+ },
+ "P2_23_outdoor_hug_tree": {
+ "n": 1086,
+ "PA_MPJPE_mm": 50.26032023685678
+ },
+ "P3_31_outdoor_workout": {
+ "n": 1216,
+ "PA_MPJPE_mm": 51.06371790301442
+ },
+ "P3_32_outdoor_soccer_warmup_a": {
+ "n": 1084,
+ "PA_MPJPE_mm": 52.849367348358705
+ },
+ "P3_33_outdoor_soccer_warmup_b": {
+ "n": 1433,
+ "PA_MPJPE_mm": 49.16156904715849
+ },
+ "P5_42_indoor_dancing": {
+ "n": 1291,
+ "PA_MPJPE_mm": 68.3372732833773
+ },
+ "P5_44_indoor_rom": {
+ "n": 1381,
+ "PA_MPJPE_mm": 48.52030048095535
+ },
+ "P6_49_outdoor_big_stairs_down": {
+ "n": 1559,
+ "PA_MPJPE_mm": 59.71073877006052
+ },
+ "P6_50_outdoor_workout": {
+ "n": 1532,
+ "PA_MPJPE_mm": 48.350753318583045
+ },
+ "P6_51_outdoor_dancing": {
+ "n": 1427,
+ "PA_MPJPE_mm": 43.158471445028894
+ },
+ "P7_57_outdoor_rock_chair": {
+ "n": 1558,
+ "PA_MPJPE_mm": 50.116466258401836
+ },
+ "P7_59_outdoor_rom": {
+ "n": 1839,
+ "PA_MPJPE_mm": 51.02608445976944
+ },
+ "P7_60_outdoor_workout": {
+ "n": 1693,
+ "PA_MPJPE_mm": 43.69734517983646
+ },
+ "P8_64_outdoor_skateboard": {
+ "n": 1704,
+ "PA_MPJPE_mm": 48.708660854338866
+ },
+ "P8_68_outdoor_handstand": {
+ "n": 1606,
+ "PA_MPJPE_mm": 84.31221432789145
+ },
+ "P8_69_outdoor_cartwheel": {
+ "n": 656,
+ "PA_MPJPE_mm": 59.78676368209051
+ },
+ "P9_76_outdoor_sitting": {
+ "n": 1768,
+ "PA_MPJPE_mm": 54.144779093609436
+ }
+ }
+ },
+ "instanthmr_distill_train/runs/g6vv_s/g6vv_s/best_student_model_v3.pth": {
+ "ckpt": "instanthmr_distill_train/runs/g6vv_s/g6vv_s/best_student_model_v3.pth",
+ "dataset": "EMDB1",
+ "split": "emdb1",
+ "stride": 1,
+ "bbox": "gt-joints",
+ "adapter": "benchmark/results/adapter_smpl24_teacher.npz",
+ "epoch": 239,
+ "source": "ema",
+ "n": 24103,
+ "n_dropped": 0,
+ "num_sequences": 17,
+ "results": [
+ {
+ "joint_set": "SMPL24+adapter",
+ "num_joints": 24,
+ "num_samples": 24103,
+ "MPJPE_mm": 80.8388164639782,
+ "PA_MPJPE_mm": 52.492057030998936,
+ "PCK3D_50mm": 0.6409264406920301,
+ "PCK3D_100mm": 0.9122636877843698,
+ "AUC_0_150mm": 0.6665234082760411,
+ "per_joint_PA_MPJPE_mm": {
+ "pelvis": 39.5173001947221,
+ "left_hip": 40.93687239313311,
+ "right_hip": 40.470826420546786,
+ "spine1": 46.292761894118335,
+ "left_knee": 54.5434503733806,
+ "right_knee": 53.1692009948552,
+ "spine2": 42.78351268865345,
+ "left_ankle": 58.67837996388447,
+ "right_ankle": 60.14529867036297,
+ "spine3": 39.88261944112938,
+ "left_foot": 66.37824342178689,
+ "right_foot": 66.60436949815637,
+ "neck": 36.20816598036446,
+ "left_collar": 30.61573052378412,
+ "right_collar": 30.349233402107203,
+ "head": 42.12061096013422,
+ "left_shoulder": 39.739920516958506,
+ "right_shoulder": 39.54386087105362,
+ "left_elbow": 52.105730853592775,
+ "right_elbow": 49.65800015055759,
+ "left_wrist": 75.16283400303837,
+ "right_wrist": 73.57376719343458,
+ "left_hand": 89.72087722264682,
+ "right_hand": 91.6078011115718
+ }
+ },
+ {
+ "joint_set": "J14",
+ "num_joints": 14,
+ "num_samples": 24103,
+ "MPJPE_mm": 91.59636844538235,
+ "PA_MPJPE_mm": 58.58564589932577,
+ "PCK3D_50mm": 0.550325685599303,
+ "PCK3D_100mm": 0.8768588379632648,
+ "AUC_0_150mm": 0.6237037437831608,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 62.70154315537687,
+ "right_knee": 50.64757250784787,
+ "right_hip": 50.828102396842795,
+ "left_hip": 47.34674906877681,
+ "left_knee": 53.83874414824775,
+ "left_ankle": 63.660653499345635,
+ "right_wrist": 74.4958157667914,
+ "right_elbow": 44.5602167982945,
+ "right_shoulder": 51.99381055264517,
+ "left_shoulder": 41.45297960362028,
+ "left_elbow": 48.030263424886854,
+ "left_wrist": 78.53945031747034,
+ "neck": 45.57499282103069,
+ "head": 106.52814852938386
+ }
+ },
+ {
+ "joint_set": "J12",
+ "num_joints": 12,
+ "num_samples": 24103,
+ "MPJPE_mm": 85.66504711722767,
+ "PA_MPJPE_mm": 53.203264963279565,
+ "PCK3D_50mm": 0.6213680178124438,
+ "PCK3D_100mm": 0.9131712511582237,
+ "AUC_0_150mm": 0.6596636790405334,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 59.62621825720753,
+ "right_knee": 50.72520946117408,
+ "right_hip": 48.02264267888712,
+ "left_hip": 45.093007144744185,
+ "left_knee": 54.112639805033346,
+ "left_ankle": 59.93621495766321,
+ "right_wrist": 72.17271131220497,
+ "right_elbow": 41.82290591142253,
+ "right_shoulder": 45.720285663919114,
+ "left_shoulder": 41.50812120327427,
+ "left_elbow": 45.170328955465074,
+ "left_wrist": 74.52889420835932
+ }
+ }
+ ],
+ "per_sequence_SMPL24_adapter": {
+ "P1_14_outdoor_climb": {
+ "n": 1270,
+ "PA_MPJPE_mm": 41.22893034085069
+ },
+ "P2_23_outdoor_hug_tree": {
+ "n": 1086,
+ "PA_MPJPE_mm": 50.10120372897257
+ },
+ "P3_31_outdoor_workout": {
+ "n": 1216,
+ "PA_MPJPE_mm": 51.713349838206234
+ },
+ "P3_32_outdoor_soccer_warmup_a": {
+ "n": 1084,
+ "PA_MPJPE_mm": 50.84240167090533
+ },
+ "P3_33_outdoor_soccer_warmup_b": {
+ "n": 1433,
+ "PA_MPJPE_mm": 46.54020753726515
+ },
+ "P5_42_indoor_dancing": {
+ "n": 1291,
+ "PA_MPJPE_mm": 68.32164948268385
+ },
+ "P5_44_indoor_rom": {
+ "n": 1381,
+ "PA_MPJPE_mm": 47.44759077309669
+ },
+ "P6_49_outdoor_big_stairs_down": {
+ "n": 1559,
+ "PA_MPJPE_mm": 58.96885962140703
+ },
+ "P6_50_outdoor_workout": {
+ "n": 1532,
+ "PA_MPJPE_mm": 46.42842266255204
+ },
+ "P6_51_outdoor_dancing": {
+ "n": 1427,
+ "PA_MPJPE_mm": 43.1381303991415
+ },
+ "P7_57_outdoor_rock_chair": {
+ "n": 1558,
+ "PA_MPJPE_mm": 52.07759183937822
+ },
+ "P7_59_outdoor_rom": {
+ "n": 1839,
+ "PA_MPJPE_mm": 50.28301493840896
+ },
+ "P7_60_outdoor_workout": {
+ "n": 1693,
+ "PA_MPJPE_mm": 44.115564045640156
+ },
+ "P8_64_outdoor_skateboard": {
+ "n": 1704,
+ "PA_MPJPE_mm": 47.02788058784131
+ },
+ "P8_68_outdoor_handstand": {
+ "n": 1606,
+ "PA_MPJPE_mm": 82.59746344528897
+ },
+ "P8_69_outdoor_cartwheel": {
+ "n": 656,
+ "PA_MPJPE_mm": 59.80553886673358
+ },
+ "P9_76_outdoor_sitting": {
+ "n": 1768,
+ "PA_MPJPE_mm": 53.78672892188069
+ }
+ }
+ }
+}
\ No newline at end of file
diff --git a/benchmark/results/gen6_emdb1_smplfit.json b/benchmark/results/gen6_emdb1_smplfit.json
new file mode 100644
index 0000000..d2f5dea
--- /dev/null
+++ b/benchmark/results/gen6_emdb1_smplfit.json
@@ -0,0 +1,146 @@
+{
+ "instanthmr_distill_train/runs/g6b_s/g6b_s/best_student_model_v3.pth": {
+ "ckpt": "instanthmr_distill_train/runs/g6b_s/g6b_s/best_student_model_v3.pth",
+ "dataset": "EMDB1",
+ "bbox": "gt-joints",
+ "stride": 1,
+ "n": 24103,
+ "fit_iters": 400,
+ "epoch": 102,
+ "source": "ema",
+ "fit_residual_mm": 14.30030345916748,
+ "MPJPE_mm": 82.50424194335938,
+ "PA_MPJPE_mm": 53.630448317554475,
+ "PVE_mm": 97.47888544609019,
+ "PA_PVE_mm": 63.253926476830515,
+ "J14_h36m_viamesh_MPJPE_mm": 80.97623443603516,
+ "J14_h36m_viamesh_PA_MPJPE_mm": 49.348192690589,
+ "per_sequence_PA_MPJPE_mm": {
+ "P1_14_outdoor_climb": 40.19883884313969,
+ "P2_23_outdoor_hug_tree": 52.456288460241744,
+ "P3_31_outdoor_workout": 51.53924413457358,
+ "P3_32_outdoor_soccer_warmup_a": 52.70549120145435,
+ "P3_33_outdoor_soccer_warmup_b": 48.09691879414547,
+ "P5_42_indoor_dancing": 72.86494091057435,
+ "P5_44_indoor_rom": 48.81177007852985,
+ "P6_49_outdoor_big_stairs_down": 62.43381219712345,
+ "P6_50_outdoor_workout": 49.38750120275361,
+ "P6_51_outdoor_dancing": 44.805854253346425,
+ "P7_57_outdoor_rock_chair": 46.358417588952314,
+ "P7_59_outdoor_rom": 52.27356134260238,
+ "P7_60_outdoor_workout": 43.69644338518449,
+ "P8_64_outdoor_skateboard": 47.828347816320175,
+ "P8_68_outdoor_handstand": 92.90519698038229,
+ "P8_69_outdoor_cartwheel": 59.74083776717741,
+ "P9_76_outdoor_sitting": 48.22672952341287
+ }
+ },
+ "instanthmr_distill_train/runs/g6bv_s/g6bv_s/best_student_model_v3.pth": {
+ "ckpt": "instanthmr_distill_train/runs/g6bv_s/g6bv_s/best_student_model_v3.pth",
+ "dataset": "EMDB1",
+ "bbox": "gt-joints",
+ "stride": 1,
+ "n": 24103,
+ "fit_iters": 400,
+ "epoch": 247,
+ "source": "ema",
+ "fit_residual_mm": 14.43234634399414,
+ "MPJPE_mm": 78.12178039550781,
+ "PA_MPJPE_mm": 50.73391808179524,
+ "PVE_mm": 92.54210270906181,
+ "PA_PVE_mm": 60.60177938772959,
+ "J14_h36m_viamesh_MPJPE_mm": 76.23255157470703,
+ "J14_h36m_viamesh_PA_MPJPE_mm": 46.21968662656892,
+ "per_sequence_PA_MPJPE_mm": {
+ "P1_14_outdoor_climb": 37.38836410475635,
+ "P2_23_outdoor_hug_tree": 50.25822391648926,
+ "P3_31_outdoor_workout": 50.2125611592255,
+ "P3_32_outdoor_soccer_warmup_a": 48.83342154213949,
+ "P3_33_outdoor_soccer_warmup_b": 46.20071574026429,
+ "P5_42_indoor_dancing": 69.61155737449016,
+ "P5_44_indoor_rom": 46.18514740454893,
+ "P6_49_outdoor_big_stairs_down": 59.273861728340805,
+ "P6_50_outdoor_workout": 46.88291877013638,
+ "P6_51_outdoor_dancing": 42.430497456679575,
+ "P7_57_outdoor_rock_chair": 48.84798872367035,
+ "P7_59_outdoor_rom": 49.12946709631032,
+ "P7_60_outdoor_workout": 42.909592200731446,
+ "P8_64_outdoor_skateboard": 46.96549114523738,
+ "P8_68_outdoor_handstand": 75.75563453564564,
+ "P8_69_outdoor_cartwheel": 55.808674554177585,
+ "P9_76_outdoor_sitting": 47.93093974219468
+ }
+ },
+ "instanthmr_distill_train/runs/g6v_s/g6v_s/best_student_model_v3.pth": {
+ "ckpt": "instanthmr_distill_train/runs/g6v_s/g6v_s/best_student_model_v3.pth",
+ "dataset": "EMDB1",
+ "bbox": "gt-joints",
+ "stride": 1,
+ "n": 24103,
+ "fit_iters": 400,
+ "epoch": 225,
+ "source": "raw",
+ "fit_residual_mm": 14.628873825073242,
+ "MPJPE_mm": 78.38782501220703,
+ "PA_MPJPE_mm": 51.342255464859115,
+ "PVE_mm": 92.74704889821241,
+ "PA_PVE_mm": 61.62021675354329,
+ "J14_h36m_viamesh_MPJPE_mm": 76.76594543457031,
+ "J14_h36m_viamesh_PA_MPJPE_mm": 47.25285211533647,
+ "per_sequence_PA_MPJPE_mm": {
+ "P1_14_outdoor_climb": 38.18086105192671,
+ "P2_23_outdoor_hug_tree": 48.9477478015161,
+ "P3_31_outdoor_workout": 50.25096136567123,
+ "P3_32_outdoor_soccer_warmup_a": 52.17091963663792,
+ "P3_33_outdoor_soccer_warmup_b": 48.89497629299315,
+ "P5_42_indoor_dancing": 67.59165316745444,
+ "P5_44_indoor_rom": 48.250051509854664,
+ "P6_49_outdoor_big_stairs_down": 58.111135330682956,
+ "P6_50_outdoor_workout": 46.77052387379077,
+ "P6_51_outdoor_dancing": 42.87896974838975,
+ "P7_57_outdoor_rock_chair": 46.755298978881,
+ "P7_59_outdoor_rom": 49.44025848980838,
+ "P7_60_outdoor_workout": 41.04483850742212,
+ "P8_64_outdoor_skateboard": 46.89091605881439,
+ "P8_68_outdoor_handstand": 83.20208888949294,
+ "P8_69_outdoor_cartwheel": 57.45923317591712,
+ "P9_76_outdoor_sitting": 48.82811972679905
+ }
+ },
+ "instanthmr_distill_train/runs/g6vv_s/g6vv_s/best_student_model_v3.pth": {
+ "ckpt": "instanthmr_distill_train/runs/g6vv_s/g6vv_s/best_student_model_v3.pth",
+ "dataset": "EMDB1",
+ "bbox": "gt-joints",
+ "stride": 1,
+ "n": 24103,
+ "fit_iters": 400,
+ "epoch": 239,
+ "source": "ema",
+ "fit_residual_mm": 14.366242408752441,
+ "MPJPE_mm": 77.56647491455078,
+ "PA_MPJPE_mm": 50.68995444446009,
+ "PVE_mm": 92.34008350832515,
+ "PA_PVE_mm": 60.63477876512061,
+ "J14_h36m_viamesh_MPJPE_mm": 76.6056900024414,
+ "J14_h36m_viamesh_PA_MPJPE_mm": 46.800030606742794,
+ "per_sequence_PA_MPJPE_mm": {
+ "P1_14_outdoor_climb": 37.348505120306996,
+ "P2_23_outdoor_hug_tree": 48.915155503100486,
+ "P3_31_outdoor_workout": 51.1337024534537,
+ "P3_32_outdoor_soccer_warmup_a": 50.384480748001124,
+ "P3_33_outdoor_soccer_warmup_b": 46.83623959506515,
+ "P5_42_indoor_dancing": 68.04583433850948,
+ "P5_44_indoor_rom": 47.43597349329044,
+ "P6_49_outdoor_big_stairs_down": 57.029334946014046,
+ "P6_50_outdoor_workout": 44.73937441685114,
+ "P6_51_outdoor_dancing": 42.55079609281225,
+ "P7_57_outdoor_rock_chair": 48.73104939849944,
+ "P7_59_outdoor_rom": 48.61240233840695,
+ "P7_60_outdoor_workout": 41.175174065305455,
+ "P8_64_outdoor_skateboard": 45.14990130797402,
+ "P8_68_outdoor_handstand": 81.86023152094495,
+ "P8_69_outdoor_cartwheel": 57.25147003355788,
+ "P9_76_outdoor_sitting": 47.962357497378235
+ }
+ }
+}
\ No newline at end of file
diff --git a/benchmark/results/gen7_3dpw_test.json b/benchmark/results/gen7_3dpw_test.json
new file mode 100644
index 0000000..31ed650
--- /dev/null
+++ b/benchmark/results/gen7_3dpw_test.json
@@ -0,0 +1,146 @@
+{
+ "instanthmr_distill_train/runs/g7r_s0/g7r_s0/best_student_model_v3.pth|h36m": {
+ "ckpt": "instanthmr_distill_train/runs/g7r_s0/g7r_s0/best_student_model_v3.pth",
+ "gt": "h36m",
+ "split": "test",
+ "stride": 1,
+ "epoch": 169,
+ "source": "ema",
+ "n": 35463,
+ "n_dropped": 0,
+ "results": [
+ {
+ "joint_set": "J14",
+ "num_joints": 14,
+ "num_samples": 35463,
+ "MPJPE_mm": 106.55963232427057,
+ "PA_MPJPE_mm": 67.59828859909312,
+ "PCK3D_50mm": 0.3942298008789845,
+ "PCK3D_100mm": 0.8283099890831893,
+ "AUC_0_150mm": 0.5574437873913111,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 64.46382356533427,
+ "right_knee": 47.25597372496897,
+ "right_hip": 98.07144410741707,
+ "left_hip": 87.49522052231794,
+ "left_knee": 44.323743383557606,
+ "left_ankle": 66.46594863836347,
+ "right_wrist": 69.61139208366498,
+ "right_elbow": 58.25602058897865,
+ "right_shoulder": 51.48491089262547,
+ "left_shoulder": 53.19574911798813,
+ "left_elbow": 67.50110591724483,
+ "left_wrist": 73.81250672134334,
+ "neck": 31.457780983702975,
+ "head": 132.9804201397962
+ }
+ },
+ {
+ "joint_set": "J12",
+ "num_joints": 12,
+ "num_samples": 35463,
+ "MPJPE_mm": 104.86066023996102,
+ "PA_MPJPE_mm": 61.927791610931955,
+ "PCK3D_50mm": 0.4436619387342676,
+ "PCK3D_100mm": 0.8896525956630855,
+ "AUC_0_150mm": 0.5917538164114106,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 61.39738917874813,
+ "right_knee": 49.284650222721915,
+ "right_hip": 98.12497192706117,
+ "left_hip": 86.9643206519134,
+ "left_knee": 45.27319245312406,
+ "left_ankle": 61.848608069967995,
+ "right_wrist": 65.83881379194949,
+ "right_elbow": 49.28868611126632,
+ "right_shoulder": 50.777514327694306,
+ "left_shoulder": 50.06590186895298,
+ "left_elbow": 54.691430452746104,
+ "left_wrist": 69.57802027503759
+ }
+ },
+ {
+ "joint_set": "J14+adapter",
+ "num_joints": 14,
+ "num_samples": 35463,
+ "MPJPE_mm": 70.8794869952138,
+ "PA_MPJPE_mm": 41.55189456354803,
+ "PCK3D_50mm": 0.728433256391974,
+ "PCK3D_100mm": 0.9495832678727527,
+ "AUC_0_150mm": 0.7225466771299639
+ }
+ ]
+ },
+ "instanthmr_distill_train/runs/g7h_s0/g7h_s0/best_student_model_v3.pth|h36m": {
+ "ckpt": "instanthmr_distill_train/runs/g7h_s0/g7h_s0/best_student_model_v3.pth",
+ "gt": "h36m",
+ "split": "test",
+ "stride": 1,
+ "epoch": 107,
+ "source": "ema",
+ "n": 35463,
+ "n_dropped": 0,
+ "results": [
+ {
+ "joint_set": "J14",
+ "num_joints": 14,
+ "num_samples": 35463,
+ "MPJPE_mm": 105.31958983589064,
+ "PA_MPJPE_mm": 68.61191926982534,
+ "PCK3D_50mm": 0.38391522754097834,
+ "PCK3D_100mm": 0.8224024234514041,
+ "AUC_0_150mm": 0.5514124476591491,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 67.17333511415941,
+ "right_knee": 47.94372228787508,
+ "right_hip": 98.87687339306508,
+ "left_hip": 87.5800866771523,
+ "left_knee": 46.8765331171045,
+ "left_ankle": 69.20124114022532,
+ "right_wrist": 72.72554456354305,
+ "right_elbow": 59.11847627456244,
+ "right_shoulder": 50.7956029353215,
+ "left_shoulder": 52.96843907321996,
+ "left_elbow": 67.68644517146863,
+ "left_wrist": 76.67468336414615,
+ "neck": 33.0633611593688,
+ "head": 129.8825255063427
+ }
+ },
+ {
+ "joint_set": "J12",
+ "num_joints": 12,
+ "num_samples": 35463,
+ "MPJPE_mm": 103.572053244377,
+ "PA_MPJPE_mm": 63.41503431210888,
+ "PCK3D_50mm": 0.4229102632790984,
+ "PCK3D_100mm": 0.8805163127766968,
+ "AUC_0_150mm": 0.5829835063593466,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 63.46866831168299,
+ "right_knee": 49.84423219735444,
+ "right_hip": 98.35840224615846,
+ "left_hip": 87.07441880924338,
+ "left_knee": 47.862718711425885,
+ "left_ankle": 64.21569158868604,
+ "right_wrist": 69.26732158409469,
+ "right_elbow": 50.22142636256743,
+ "right_shoulder": 51.26354789935885,
+ "left_shoulder": 51.500077945407234,
+ "left_elbow": 54.932207994752424,
+ "left_wrist": 72.97169809457472
+ }
+ },
+ {
+ "joint_set": "J14+adapter",
+ "num_joints": 14,
+ "num_samples": 35463,
+ "MPJPE_mm": 69.35152614973077,
+ "PA_MPJPE_mm": 43.032953201743574,
+ "PCK3D_50mm": 0.7107931405368171,
+ "PCK3D_100mm": 0.9452286286310481,
+ "AUC_0_150mm": 0.713739613858593
+ }
+ ]
+ }
+}
\ No newline at end of file
diff --git a/benchmark/results/gen7_3dpw_val_stride5.json b/benchmark/results/gen7_3dpw_val_stride5.json
new file mode 100644
index 0000000..6001c01
--- /dev/null
+++ b/benchmark/results/gen7_3dpw_val_stride5.json
@@ -0,0 +1,146 @@
+{
+ "instanthmr_distill_train/runs/g7r_s0/g7r_s0/best_student_model_v3.pth|h36m": {
+ "ckpt": "instanthmr_distill_train/runs/g7r_s0/g7r_s0/best_student_model_v3.pth",
+ "gt": "h36m",
+ "split": "validation",
+ "stride": 5,
+ "epoch": 169,
+ "source": "ema",
+ "n": 1993,
+ "n_dropped": 0,
+ "results": [
+ {
+ "joint_set": "J14",
+ "num_joints": 14,
+ "num_samples": 1993,
+ "MPJPE_mm": 103.90234720126412,
+ "PA_MPJPE_mm": 63.38082033985036,
+ "PCK3D_50mm": 0.44731560461615655,
+ "PCK3D_100mm": 0.8547415955845459,
+ "AUC_0_150mm": 0.581793188602505,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 56.85948093194728,
+ "right_knee": 48.547847304625115,
+ "right_hip": 93.48160213603958,
+ "left_hip": 79.84831634941624,
+ "left_knee": 42.368813230012584,
+ "left_ankle": 57.1097939616838,
+ "right_wrist": 74.59096379795069,
+ "right_elbow": 56.99275884049035,
+ "right_shoulder": 46.58418912944933,
+ "left_shoulder": 47.12430108487619,
+ "left_elbow": 62.35690634119856,
+ "left_wrist": 70.64812134640509,
+ "neck": 28.415358839382485,
+ "head": 122.40303146442776
+ }
+ },
+ {
+ "joint_set": "J12",
+ "num_joints": 12,
+ "num_samples": 1993,
+ "MPJPE_mm": 101.33608351059434,
+ "PA_MPJPE_mm": 58.47637562965319,
+ "PCK3D_50mm": 0.49790934938953,
+ "PCK3D_100mm": 0.9057534704800134,
+ "AUC_0_150mm": 0.6126064883004495,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 53.655452915405846,
+ "right_knee": 50.538598104998165,
+ "right_hip": 94.88849772018665,
+ "left_hip": 80.98289262973533,
+ "left_knee": 42.88079426469913,
+ "left_ankle": 54.47031725378426,
+ "right_wrist": 68.33861065226719,
+ "right_elbow": 49.76684152737039,
+ "right_shoulder": 44.36023974855144,
+ "left_shoulder": 42.89197693615923,
+ "left_elbow": 53.18353818410083,
+ "left_wrist": 65.75874761857979
+ }
+ },
+ {
+ "joint_set": "J14+adapter",
+ "num_joints": 14,
+ "num_samples": 1993,
+ "MPJPE_mm": 71.46007771292817,
+ "PA_MPJPE_mm": 39.93041587262252,
+ "PCK3D_50mm": 0.7482976130743316,
+ "PCK3D_100mm": 0.9567414522256469,
+ "AUC_0_150mm": 0.7317373479991028
+ }
+ ]
+ },
+ "instanthmr_distill_train/runs/g7h_s0/g7h_s0/best_student_model_v3.pth|h36m": {
+ "ckpt": "instanthmr_distill_train/runs/g7h_s0/g7h_s0/best_student_model_v3.pth",
+ "gt": "h36m",
+ "split": "validation",
+ "stride": 5,
+ "epoch": 107,
+ "source": "ema",
+ "n": 1993,
+ "n_dropped": 0,
+ "results": [
+ {
+ "joint_set": "J14",
+ "num_joints": 14,
+ "num_samples": 1993,
+ "MPJPE_mm": 104.55982490458405,
+ "PA_MPJPE_mm": 65.93545723714554,
+ "PCK3D_50mm": 0.42409146297756434,
+ "PCK3D_100mm": 0.8353164647695506,
+ "AUC_0_150mm": 0.568342886739533,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 64.19624479582436,
+ "right_knee": 50.74390423789055,
+ "right_hip": 95.92368380209209,
+ "left_hip": 81.13944986939818,
+ "left_knee": 45.85929759842022,
+ "left_ankle": 62.16279393248126,
+ "right_wrist": 80.60291493429548,
+ "right_elbow": 59.837420844358356,
+ "right_shoulder": 48.020763238307765,
+ "left_shoulder": 46.653383851617825,
+ "left_elbow": 62.65661110302429,
+ "left_wrist": 77.38705180161271,
+ "neck": 29.98179263390863,
+ "head": 117.93108867680598
+ }
+ },
+ {
+ "joint_set": "J12",
+ "num_joints": 12,
+ "num_samples": 1993,
+ "MPJPE_mm": 101.93417681696192,
+ "PA_MPJPE_mm": 61.96334827986432,
+ "PCK3D_50mm": 0.46483525673189496,
+ "PCK3D_100mm": 0.8771951831409934,
+ "AUC_0_150mm": 0.5936517057011368,
+ "per_joint_PA_MPJPE_mm": {
+ "right_ankle": 60.675849979517814,
+ "right_knee": 52.61648682866706,
+ "right_hip": 96.62411961742293,
+ "left_hip": 82.1574260874414,
+ "left_knee": 46.535775669858026,
+ "left_ankle": 59.28138744913558,
+ "right_wrist": 74.83031419970418,
+ "right_elbow": 52.28211428433266,
+ "right_shoulder": 46.93795907879271,
+ "left_shoulder": 43.69254107647294,
+ "left_elbow": 54.286340260518216,
+ "left_wrist": 73.63986482650833
+ }
+ },
+ {
+ "joint_set": "J14+adapter",
+ "num_joints": 14,
+ "num_samples": 1993,
+ "MPJPE_mm": 71.92407096255458,
+ "PA_MPJPE_mm": 43.644587072587775,
+ "PCK3D_50mm": 0.705684180345495,
+ "PCK3D_100mm": 0.9385707117769335,
+ "AUC_0_150mm": 0.7105734124736115
+ }
+ ]
+ }
+}
\ No newline at end of file