Automatically rendered from the repository data. Each panel below links to the latest plots produced during the GitHub Pages build.
Validation loss, pairing efficiency, and DeltaD precision across training sizes.


| model | effective_step | val_loss |
|---|---|---|
| Nominal | 253.6 | 1.11 |
| Nominal | 1310 | 0.87 |
| Nominal | 5672 | 0.86 |
| Nominal | 8643 | 0.86 |
| Sup(Cls) | 194.1 | 1.39 |
| Sup(Cls) | 2376 | 1.06 |
| Sup(Cls) | 2.224e+04 | 0.92 |
| Sup(Cls) | 2.227e+04 | 0.91 |
| SSL | 214.2 | 1.46 |
| SSL | 2547 | 1.02 |
| SSL | 1.539e+04 | 0.91 |
| SSL | 1.891e+04 | 0.9 |
| Scratch | 181.3 | 1.87 |
| Scratch | 2303 | 1.03 |
| Scratch | 7832 | 0.91 |
| Scratch | 9903 | 0.89 |

| model | effective_step | val_loss |
|---|---|---|
| Nominal | 253.6 | 1.11 |
| Nominal | 1310 | 0.87 |
| Nominal | 5672 | 0.86 |
| Nominal | 8643 | 0.86 |
| Sup(Cls) | 194.1 | 1.39 |
| Sup(Cls) | 2376 | 1.06 |
| Sup(Cls) | 2.224e+04 | 0.92 |
| Sup(Cls) | 2.227e+04 | 0.91 |
| SSL | 214.2 | 1.46 |
| SSL | 2547 | 1.02 |
| SSL | 1.539e+04 | 0.91 |
| SSL | 1.891e+04 | 0.9 |
| Scratch | 181.3 | 1.87 |
| Scratch | 2303 | 1.03 |
| Scratch | 7832 | 0.91 |
| Scratch | 9903 | 0.89 |

| model | train_size | pairing | error |
|---|---|---|---|
| Nominal | 15 | 48.28 | 0.005873428 |
| Nominal | 148 | 82.17 | 0.005110662 |
| Nominal | 1475 | 82.38 | 0.00504423 |
| Sup(Cls) | 15 | 53.4 | 0.009233723 |
| Sup(Cls) | 148 | 79.66 | 0.006299541 |
| Sup(Cls) | 1475 | 82.15 | 0.00536138 |
| SSL | 15 | 45.25 | 0.009398122 |
| SSL | 148 | 79.33 | 0.00596527 |
| SSL | 1475 | 81.99 | 0.005375401 |
| Scratch | 15 | 24.32 | 0.008487499 |
| Scratch | 148 | 79.63 | 0.005974764 |
| Scratch | 1475 | 81.83 | 0.005209769 |

| model | train_size | pairing |
|---|---|---|
| Nominal | 1475 | 82.38 |
| Sup(Cls) | 1475 | 82.15 |
| SSL | 1475 | 81.99 |
| Scratch | 1475 | 81.83 |

| model | train_size | deltaD | error |
|---|---|---|---|
| Nominal | 15 | 1.85 | 0.005873428 |
| Nominal | 148 | 1.61 | 0.005110662 |
| Nominal | 1475 | 1.59 | 0.00504423 |
| Sup(Cls) | 15 | 2.91 | 0.009233723 |
| Sup(Cls) | 148 | 1.99 | 0.006299541 |
| Sup(Cls) | 1475 | 1.69 | 0.00536138 |
| SSL | 15 | 2.96 | 0.009398122 |
| SSL | 148 | 1.88 | 0.00596527 |
| SSL | 1475 | 1.69 | 0.005375401 |
| Scratch | 15 | 2.68 | 0.008487499 |
| Scratch | 148 | 1.88 | 0.005974764 |
| Scratch | 1475 | 1.64 | 0.005209769 |

| model | train_size | deltaD |
|---|---|---|
| Nominal | 1475 | 1.59 |
| Sup(Cls) | 1475 | 1.69 |
| SSL | 1475 | 1.69 |
| Scratch | 1475 | 1.64 |

| model | metric | 68% CI | 95% CI |
|---|---|---|---|
| Nominal | Pairing efficiency (normalized) (JES) | -0.0385 – 0.0338 | -0.0611 – 0.0672 |
| Scratch | Pairing efficiency (normalized) (JES) | -0.0543 – 0.0776 | -0.175 – 0.134 |

| model | metric | 68% CI | 95% CI |
|---|---|---|---|
| Nominal | Pairing efficiency (normalized) (MET) | -0.0385 – 0.0338 | -0.0611 – 0.0672 |
| Scratch | Pairing efficiency (normalized) (MET) | -0.0543 – 0.0776 | -0.175 – 0.134 |

| model | metric | 68% CI | 95% CI |
|---|---|---|---|
| Nominal | Precision (normalized) (JES) | -0.000577 – 0.00054 | -0.00108 – 0.00111 |
| Scratch | Precision (normalized) (JES) | -0.0029 – 0.00241 | -0.00382 – 0.00495 |

| model | metric | 68% CI | 95% CI |
|---|---|---|---|
| Nominal | Precision (normalized) (MET) | -0.000577 – 0.00054 | -0.00108 – 0.00111 |
| Scratch | Precision (normalized) (MET) | -0.0029 – 0.00241 | -0.00382 – 0.00495 |
Loss curves, pairing efficiency, and SIC summary for the BSM study.


| model | head | effective_step | val_loss |
|---|---|---|---|
| Nominal | Cls | 24.41 | 0.534 |
| Nominal | Cls | 43.95 | 0.478 |
| Nominal | Cls | 109.9 | 0.4501 |
| Nominal | Cls | 695.8 | 0.407 |
| Nominal | Cls | 854.5 | 0.4087 |
| Nominal | Cls+Asn | 24.41 | 3.148 |
| Nominal | Cls+Asn | 43.95 | 2.84 |
| Nominal | Cls+Asn | 109.9 | 2.574 |
| Nominal | Cls+Asn | 695.8 | 2.289 |
| Nominal | Cls+Asn | 854.5 | 2.294 |
| Nominal | Cls+Asn+Seg | 106.2 | 4.106 |
| Nominal | Cls+Asn+Seg | 207.5 | 3.471 |
| Nominal | Cls+Asn+Seg | 1794 | 3.099 |
| Nominal | Cls+Asn+Seg | 2563 | 3.018 |
| Nominal | Cls+Seg | 68.36 | 2.062 |
| Nominal | Cls+Seg | 106.2 | 1.746 |
| Nominal | Cls+Seg | 207.5 | 1.483 |
| Nominal | Cls+Seg | 1794 | 1.218 |
| Nominal | Cls+Seg | 2563 | 1.217 |
| Sup(Cls) | Cls | 28.08 | 0.5559 |
| Sup(Cls) | Cls | 58.59 | 0.5091 |
| Sup(Cls) | Cls | 109.9 | 0.4698 |
| Sup(Cls) | Cls | 732.4 | 0.4113 |
| Sup(Cls) | Cls | 854.5 | 0.4083 |
| Sup(Cls) | Cls+Asn | 28.08 | 3.164 |
| Sup(Cls) | Cls+Asn | 58.59 | 2.719 |
| Sup(Cls) | Cls+Asn | 109.9 | 2.538 |
| Sup(Cls) | Cls+Asn | 732.4 | 2.252 |
| Sup(Cls) | Cls+Asn | 854.5 | 2.288 |
| Sup(Cls) | Cls+Asn+Seg | 118.4 | 5.423 |
| Sup(Cls) | Cls+Asn+Seg | 139.2 | 3.912 |
| Sup(Cls) | Cls+Asn+Seg | 293 | 3.439 |
| Sup(Cls) | Cls+Asn+Seg | 1355 | 3.077 |
| Sup(Cls) | Cls+Asn+Seg | 1831 | 3.133 |
| Sup(Cls) | Cls+Seg | 118.4 | 2.01 |
| Sup(Cls) | Cls+Seg | 139.2 | 1.893 |
| Sup(Cls) | Cls+Seg | 293 | 1.5 |
| Sup(Cls) | Cls+Seg | 1355 | 1.237 |
| Sup(Cls) | Cls+Seg | 1831 | 1.23 |
| SSL | Cls | 36.62 | 0.6262 |
| SSL | Cls | 51.27 | 0.577 |
| SSL | Cls | 134.3 | 0.5196 |
| SSL | Cls | 1099 | 0.4326 |
| SSL | Cls | 1465 | 0.4229 |
| SSL | Cls+Asn | 36.62 | 3.379 |
| SSL | Cls+Asn | 51.27 | 3.235 |
| SSL | Cls+Asn | 134.3 | 2.744 |
| SSL | Cls+Asn | 1099 | 2.313 |
| SSL | Cls+Asn | 1465 | 2.304 |
| SSL | Cls+Asn+Seg | 74.46 | 4.931 |
| SSL | Cls+Asn+Seg | 95.21 | 4.352 |
| SSL | Cls+Asn+Seg | 244.1 | 3.927 |
| SSL | Cls+Asn+Seg | 1794 | 3.15 |
| SSL | Cls+Asn+Seg | 2808 | 3.164 |
| SSL | Cls+Seg | 74.46 | 2.175 |
| SSL | Cls+Seg | 95.21 | 1.859 |
| SSL | Cls+Seg | 244.1 | 1.653 |
| SSL | Cls+Seg | 1794 | 1.263 |
| SSL | Cls+Seg | 2808 | 1.259 |
| Scratch | Cls | 29.3 | 0.6222 |
| Scratch | Cls | 54.93 | 0.5877 |
| Scratch | Cls | 183.1 | 0.576 |
| Scratch | Cls | 878.9 | 0.5332 |
| Scratch | Cls | 3296 | 0.4831 |
| Scratch | Cls+Asn | 29.3 | 4.009 |
| Scratch | Cls+Asn | 54.93 | 3.396 |
| Scratch | Cls+Asn | 183.1 | 2.724 |
| Scratch | Cls+Asn | 878.9 | 2.279 |
| Scratch | Cls+Asn | 3296 | 2.333 |
| Scratch | Cls+Asn+Seg | 1.221 | 8.224 |
| Scratch | Cls+Asn+Seg | 201.4 | 4.11 |
| Scratch | Cls+Asn+Seg | 378.4 | 3.688 |
| Scratch | Cls+Asn+Seg | 1721 | 3.144 |
| Scratch | Cls+Asn+Seg | 3296 | 3.323 |
| Scratch | Cls+Seg | 1.221 | 4.445 |
| Scratch | Cls+Seg | 201.4 | 1.982 |
| Scratch | Cls+Seg | 378.4 | 1.682 |
| Scratch | Cls+Seg | 1721 | 1.413 |
| Scratch | Cls+Seg | 3296 | 1.346 |
| SPANet | Cls | nan | nan |
| SPANet | Cls | nan | nan |
| SPANet | Cls | nan | nan |
| SPANet | Cls | nan | nan |
| SPANet | Cls | nan | nan |
| SPANet | Cls+Asn | nan | nan |
| SPANet | Cls+Asn | nan | nan |
| SPANet | Cls+Asn | nan | nan |
| SPANet | Cls+Asn | nan | nan |
| SPANet | Cls+Asn | nan | nan |

| model | head | effective_step | val_loss |
|---|---|---|---|
| Nominal | Cls | 24.41 | 0.534 |
| Nominal | Cls | 43.95 | 0.478 |
| Nominal | Cls | 109.9 | 0.4501 |
| Nominal | Cls | 695.8 | 0.407 |
| Nominal | Cls | 854.5 | 0.4087 |
| Nominal | Cls+Asn | 24.41 | 3.148 |
| Nominal | Cls+Asn | 43.95 | 2.84 |
| Nominal | Cls+Asn | 109.9 | 2.574 |
| Nominal | Cls+Asn | 695.8 | 2.289 |
| Nominal | Cls+Asn | 854.5 | 2.294 |
| Nominal | Cls+Asn+Seg | 106.2 | 4.106 |
| Nominal | Cls+Asn+Seg | 207.5 | 3.471 |
| Nominal | Cls+Asn+Seg | 1794 | 3.099 |
| Nominal | Cls+Asn+Seg | 2563 | 3.018 |
| Nominal | Cls+Seg | 68.36 | 2.062 |
| Nominal | Cls+Seg | 106.2 | 1.746 |
| Nominal | Cls+Seg | 207.5 | 1.483 |
| Nominal | Cls+Seg | 1794 | 1.218 |
| Nominal | Cls+Seg | 2563 | 1.217 |
| Sup(Cls) | Cls | 28.08 | 0.5559 |
| Sup(Cls) | Cls | 58.59 | 0.5091 |
| Sup(Cls) | Cls | 109.9 | 0.4698 |
| Sup(Cls) | Cls | 732.4 | 0.4113 |
| Sup(Cls) | Cls | 854.5 | 0.4083 |
| Sup(Cls) | Cls+Asn | 28.08 | 3.164 |
| Sup(Cls) | Cls+Asn | 58.59 | 2.719 |
| Sup(Cls) | Cls+Asn | 109.9 | 2.538 |
| Sup(Cls) | Cls+Asn | 732.4 | 2.252 |
| Sup(Cls) | Cls+Asn | 854.5 | 2.288 |
| Sup(Cls) | Cls+Asn+Seg | 118.4 | 5.423 |
| Sup(Cls) | Cls+Asn+Seg | 139.2 | 3.912 |
| Sup(Cls) | Cls+Asn+Seg | 293 | 3.439 |
| Sup(Cls) | Cls+Asn+Seg | 1355 | 3.077 |
| Sup(Cls) | Cls+Asn+Seg | 1831 | 3.133 |
| Sup(Cls) | Cls+Seg | 118.4 | 2.01 |
| Sup(Cls) | Cls+Seg | 139.2 | 1.893 |
| Sup(Cls) | Cls+Seg | 293 | 1.5 |
| Sup(Cls) | Cls+Seg | 1355 | 1.237 |
| Sup(Cls) | Cls+Seg | 1831 | 1.23 |
| SSL | Cls | 36.62 | 0.6262 |
| SSL | Cls | 51.27 | 0.577 |
| SSL | Cls | 134.3 | 0.5196 |
| SSL | Cls | 1099 | 0.4326 |
| SSL | Cls | 1465 | 0.4229 |
| SSL | Cls+Asn | 36.62 | 3.379 |
| SSL | Cls+Asn | 51.27 | 3.235 |
| SSL | Cls+Asn | 134.3 | 2.744 |
| SSL | Cls+Asn | 1099 | 2.313 |
| SSL | Cls+Asn | 1465 | 2.304 |
| SSL | Cls+Asn+Seg | 74.46 | 4.931 |
| SSL | Cls+Asn+Seg | 95.21 | 4.352 |
| SSL | Cls+Asn+Seg | 244.1 | 3.927 |
| SSL | Cls+Asn+Seg | 1794 | 3.15 |
| SSL | Cls+Asn+Seg | 2808 | 3.164 |
| SSL | Cls+Seg | 74.46 | 2.175 |
| SSL | Cls+Seg | 95.21 | 1.859 |
| SSL | Cls+Seg | 244.1 | 1.653 |
| SSL | Cls+Seg | 1794 | 1.263 |
| SSL | Cls+Seg | 2808 | 1.259 |
| Scratch | Cls | 29.3 | 0.6222 |
| Scratch | Cls | 54.93 | 0.5877 |
| Scratch | Cls | 183.1 | 0.576 |
| Scratch | Cls | 878.9 | 0.5332 |
| Scratch | Cls | 3296 | 0.4831 |
| Scratch | Cls+Asn | 29.3 | 4.009 |
| Scratch | Cls+Asn | 54.93 | 3.396 |
| Scratch | Cls+Asn | 183.1 | 2.724 |
| Scratch | Cls+Asn | 878.9 | 2.279 |
| Scratch | Cls+Asn | 3296 | 2.333 |
| Scratch | Cls+Asn+Seg | 1.221 | 8.224 |
| Scratch | Cls+Asn+Seg | 201.4 | 4.11 |
| Scratch | Cls+Asn+Seg | 378.4 | 3.688 |
| Scratch | Cls+Asn+Seg | 1721 | 3.144 |
| Scratch | Cls+Asn+Seg | 3296 | 3.323 |
| Scratch | Cls+Seg | 1.221 | 4.445 |
| Scratch | Cls+Seg | 201.4 | 1.982 |
| Scratch | Cls+Seg | 378.4 | 1.682 |
| Scratch | Cls+Seg | 1721 | 1.413 |
| Scratch | Cls+Seg | 3296 | 1.346 |
| SPANet | Cls | nan | nan |
| SPANet | Cls | nan | nan |
| SPANet | Cls | nan | nan |
| SPANet | Cls | nan | nan |
| SPANet | Cls | nan | nan |
| SPANet | Cls+Asn | nan | nan |
| SPANet | Cls+Asn | nan | nan |
| SPANet | Cls+Asn | nan | nan |
| SPANet | Cls+Asn | nan | nan |
| SPANet | Cls+Asn | nan | nan |

| model | head | train_size | pairing | error |
|---|---|---|---|---|
| Nominal | Cls | 10 | nan | nan |
| Nominal | Cls | 30 | nan | nan |
| Nominal | Cls | 100 | nan | nan |
| Nominal | Cls | 300 | nan | nan |
| Nominal | Cls+Asn | 10 | 57.8 | 0.1252 |
| Nominal | Cls+Asn | 30 | 64.64 | 0.1212 |
| Nominal | Cls+Asn | 100 | 72.24 | 0.1135 |
| Nominal | Cls+Asn | 300 | 77.1 | 0.1066 |
| Nominal | Cls+Seg | 10 | nan | nan |
| Nominal | Cls+Seg | 30 | nan | nan |
| Nominal | Cls+Seg | 100 | nan | nan |
| Nominal | Cls+Seg | 300 | nan | nan |
| Sup(Cls) | Cls | 10 | nan | nan |
| Sup(Cls) | Cls | 30 | nan | nan |
| Sup(Cls) | Cls | 100 | nan | nan |
| Sup(Cls) | Cls | 300 | nan | nan |
| Sup(Cls) | Cls+Asn | 10 | 58.99 | 0.1247 |
| Sup(Cls) | Cls+Asn | 30 | 68.53 | 0.1178 |
| Sup(Cls) | Cls+Asn | 100 | 72.09 | 0.1137 |
| Sup(Cls) | Cls+Asn | 300 | 77.17 | 0.1064 |
| Sup(Cls) | Cls+Seg | 10 | nan | nan |
| Sup(Cls) | Cls+Seg | 30 | nan | nan |
| Sup(Cls) | Cls+Seg | 100 | nan | nan |
| Sup(Cls) | Cls+Seg | 300 | nan | nan |
| SSL | Cls | 10 | nan | nan |
| SSL | Cls | 30 | nan | nan |
| SSL | Cls | 100 | nan | nan |
| SSL | Cls | 300 | nan | nan |
| SSL | Cls+Asn | 10 | 55.76 | 0.1259 |
| SSL | Cls+Asn | 30 | 65.74 | 0.1203 |
| SSL | Cls+Asn | 100 | 71.17 | 0.1149 |
| SSL | Cls+Asn | 300 | 76.63 | 0.1073 |
| SSL | Cls+Seg | 10 | nan | nan |
| SSL | Cls+Seg | 30 | nan | nan |
| SSL | Cls+Seg | 100 | nan | nan |
| SSL | Cls+Seg | 300 | nan | nan |
| Scratch | Cls | 10 | nan | nan |
| Scratch | Cls | 30 | nan | nan |
| Scratch | Cls | 100 | nan | nan |
| Scratch | Cls | 300 | nan | nan |
| Scratch | Cls+Asn | 10 | 24.9 | 0.1096 |
| Scratch | Cls+Asn | 30 | 58.23 | 0.1251 |
| Scratch | Cls+Asn | 100 | 70.87 | 0.1152 |
| Scratch | Cls+Asn | 300 | 75.2 | 0.1095 |
| Scratch | Cls+Seg | 10 | nan | nan |
| Scratch | Cls+Seg | 30 | nan | nan |
| Scratch | Cls+Seg | 100 | nan | nan |
| Scratch | Cls+Seg | 300 | nan | nan |
| SPANet | Cls | 10 | nan | nan |
| SPANet | Cls | 30 | nan | nan |
| SPANet | Cls | 100 | nan | nan |
| SPANet | Cls | 300 | nan | nan |
| SPANet | Cls+Asn | 10 | 26.38 | 0.1118 |
| SPANet | Cls+Asn | 30 | 55.68 | 0.126 |
| SPANet | Cls+Asn | 100 | 55.72 | 0.126 |
| SPANet | Cls+Asn | 300 | 66.79 | 0.1194 |

| model | head | train_size | pairing |
|---|---|---|---|
| Nominal | Cls+Asn | 300 | 77.1 |
| Sup(Cls) | Cls+Asn | 300 | 77.17 |
| SSL | Cls+Asn | 300 | 76.63 |
| Scratch | Cls+Asn | 300 | 75.2 |
| SPANet | Cls+Asn | 300 | 66.79 |


| model | head | train_size | sic | error |
|---|---|---|---|---|
| Nominal | Cls | 300 | 4.062 | 0.5676 |
| Nominal | Cls+Asn | 300 | 4.136 | 1.099 |
| Nominal | Cls+Seg | 300 | 4.475 | 0.695 |
| Sup(Cls) | Cls | 300 | 3.935 | 0.4655 |
| Sup(Cls) | Cls+Asn | 300 | 4.331 | 0.6802 |
| Sup(Cls) | Cls+Seg | 300 | 4.294 | 0.9087 |
| SSL | Cls | 300 | 3.655 | 0.5253 |
| SSL | Cls+Asn | 300 | 3.352 | 0.4017 |
| SSL | Cls+Seg | 300 | 3.801 | 0.6301 |
| Scratch | Cls | 300 | 1.616 | 0.05496 |
| Scratch | Cls+Asn | 300 | 2.3 | 0.1242 |
| Scratch | Cls+Seg | 300 | 2.619 | 0.4235 |
| SPANet | Cls | 300 | 1.424 | 0.04937 |
| SPANet | Cls+Asn | 300 | 1.53 | 0.05176 |

| model | head | train_size | sic | error |
|---|---|---|---|---|
| Nominal | Cls | 10 | 1.672 | 0.05865 |
| Nominal | Cls | 30 | 1.997 | 0.07655 |
| Nominal | Cls | 100 | 2.531 | 0.1423 |
| Nominal | Cls | 300 | 4.062 | 0.5676 |
| Nominal | Cls+Asn | 10 | 1.653 | 0.0591 |
| Nominal | Cls+Asn | 30 | 1.97 | 0.07792 |
| Nominal | Cls+Asn | 100 | 2.527 | 0.1246 |
| Nominal | Cls+Asn | 300 | 4.136 | 1.099 |
| Nominal | Cls+Seg | 10 | 1.535 | 0.04202 |
| Nominal | Cls+Seg | 30 | 1.916 | 0.07413 |
| Nominal | Cls+Seg | 100 | 2.597 | 0.1425 |
| Nominal | Cls+Seg | 300 | 4.475 | 0.695 |
| Sup(Cls) | Cls | 10 | 1.518 | 0.04515 |
| Sup(Cls) | Cls | 30 | 1.833 | 0.06851 |
| Sup(Cls) | Cls | 100 | 2.329 | 0.109 |
| Sup(Cls) | Cls | 300 | 3.935 | 0.4655 |
| Sup(Cls) | Cls+Asn | 10 | 1.565 | 0.05583 |
| Sup(Cls) | Cls+Asn | 30 | 1.87 | 0.07748 |
| Sup(Cls) | Cls+Asn | 100 | 2.291 | 0.09485 |
| Sup(Cls) | Cls+Asn | 300 | 4.331 | 0.6802 |
| Sup(Cls) | Cls+Seg | 10 | 1.567 | 0.04788 |
| Sup(Cls) | Cls+Seg | 30 | 1.848 | 0.07621 |
| Sup(Cls) | Cls+Seg | 100 | 2.34 | 0.1165 |
| Sup(Cls) | Cls+Seg | 300 | 4.294 | 0.9087 |
| SSL | Cls | 10 | 1.18 | 0.02953 |
| SSL | Cls | 30 | 1.323 | 0.03436 |
| SSL | Cls | 100 | 1.774 | 0.06548 |
| SSL | Cls | 300 | 3.655 | 0.5253 |
| SSL | Cls+Asn | 10 | 1.172 | 0.03582 |
| SSL | Cls+Asn | 30 | 1.524 | 0.04558 |
| SSL | Cls+Asn | 100 | 1.902 | 0.07075 |
| SSL | Cls+Asn | 300 | 3.352 | 0.4017 |
| SSL | Cls+Seg | 10 | 1.161 | 0.02717 |
| SSL | Cls+Seg | 30 | 1.591 | 0.04656 |
| SSL | Cls+Seg | 100 | 2.036 | 0.0841 |
| SSL | Cls+Seg | 300 | 3.801 | 0.6301 |
| Scratch | Cls | 10 | 1.163 | 0.03 |
| Scratch | Cls | 30 | 1.314 | 0.03819 |
| Scratch | Cls | 100 | 1.416 | 0.04256 |
| Scratch | Cls | 300 | 1.616 | 0.05496 |
| Scratch | Cls+Asn | 10 | 1.013 | 0.03534 |
| Scratch | Cls+Asn | 30 | 1.415 | 0.04414 |
| Scratch | Cls+Asn | 100 | 1.676 | 0.0547 |
| Scratch | Cls+Asn | 300 | 2.3 | 0.1242 |
| Scratch | Cls+Seg | 10 | 1.274 | 0.4891 |
| Scratch | Cls+Seg | 30 | 1.416 | 0.04172 |
| Scratch | Cls+Seg | 100 | 1.697 | 0.06073 |
| Scratch | Cls+Seg | 300 | 2.619 | 0.4235 |
| SPANet | Cls | 10 | 1.297 | 0.03841 |
| SPANet | Cls | 30 | 1.346 | 0.04905 |
| SPANet | Cls | 100 | 1.366 | 0.04195 |
| SPANet | Cls | 300 | 1.424 | 0.04937 |
| SPANet | Cls+Asn | 10 | 1.216 | 0.0314 |
| SPANet | Cls+Asn | 30 | 1.34 | 0.04046 |
| SPANet | Cls+Asn | 100 | 1.445 | 0.04336 |
| SPANet | Cls+Asn | 300 | 1.53 | 0.05176 |

| model | metric | 68% CI | 95% CI |
|---|---|---|---|
| Nominal | SIC (normalized) | -0.112 – 0.0964 | -0.221 – 0.122 |
| Scratch | SIC (normalized) | -0.401 – 0.313 | -0.964 – 0.455 |

| model | metric | 68% CI | 95% CI |
|---|---|---|---|
| Nominal | Pairing efficiency (normalized) | -0.06 – 0.0517 | -0.0966 – 0.0646 |
| Scratch | Pairing efficiency (normalized) | -0.033 – 0.038 | -0.0587 – 0.154 |
Unrolled grid plots for the mX/mY scan with max SIC and uncertainties.


Significance summaries, calibration metrics, and mass-distribution bump-hunting panels.

| model | channel | calibrated | median | lower_error | upper_error |
|---|---|---|---|---|---|
| SSL | train-OS-test-OS | True | 7.412 | 0.4561 | 0.4401 |
| SSL | train-OS-test-SS | True | 0.6344 | 0.6344 | 0.848 |
| SSL | train-SS-test-OS | True | 1.326 | 1.252 | 1.218 |
| SSL | train-SS-test-SS | True | 0.8886 | 0.4653 | 0.4996 |
| Nominal | train-OS-test-OS | True | 7.608 | 0.4268 | 0.4268 |
| Nominal | train-OS-test-SS | True | 0.6445 | 0.6445 | 0.9184 |
| Nominal | train-SS-test-OS | True | 2.155 | 1.186 | 1.3 |
| Nominal | train-SS-test-SS | True | 0.5488 | 0.4893 | 0.4919 |
| EveNet-f.t.(Cls+Gen+Assign)-calibrated | train-OS-test-OS | True | 6.863 | 0.6183 | 0.6113 |
| EveNet-f.t.(Cls+Gen+Assign)-calibrated | train-OS-test-SS | True | 0.2301 | 0.2301 | 0.8901 |
| EveNet-f.t.(Cls+Gen+Assign)-calibrated | train-SS-test-OS | True | 1.268 | 1.268 | 1.614 |
| EveNet-f.t.(Cls+Gen+Assign)-calibrated | train-SS-test-SS | True | 0.7687 | 0.5096 | 0.4764 |
| Sup(Cls) | train-OS-test-OS | True | 1.87 | 0.4229 | 0.3433 |
| Sup(Cls) | train-OS-test-SS | True | 1.424 | 0.5717 | 0.5321 |
| Sup(Cls) | train-SS-test-OS | True | 0 | 0 | 0.4028 |
| Sup(Cls) | train-SS-test-SS | True | 0.963 | 0.2138 | 0.2122 |
| Scratch | train-OS-test-OS | True | 1.451 | 0.2184 | 0.2378 |
| Scratch | train-OS-test-SS | True | 0.9246 | 0.535 | 0.5789 |
| Scratch | train-SS-test-OS | True | 0.03777 | 0.03777 | 0.8138 |
| Scratch | train-SS-test-SS | True | 1.132 | 0.1998 | 0.1975 |

| metric | model | group | calibrated | value | lower_error | upper_error |
|---|---|---|---|---|---|---|
| mmd | Nominal | OS | False | nan | nan | nan |
| mmd | Nominal | SS | False | nan | nan | nan |
| mmd | Nominal | OS | True | 0.8726 | 0.004285 | 0.006339 |
| mmd | Nominal | SS | True | 0.8878 | 0 | 0 |
| mmd | SSL | OS | False | nan | nan | nan |
| mmd | SSL | SS | False | nan | nan | nan |
| mmd | SSL | OS | True | 0.8693 | 0.01061 | 0.01019 |
| mmd | SSL | SS | True | 0.8878 | 0 | 0 |
| mmd | Sup(Cls) | OS | False | nan | nan | nan |
| mmd | Sup(Cls) | SS | False | nan | nan | nan |
| mmd | Sup(Cls) | OS | True | 0.8542 | 0.00275 | 0.005383 |
| mmd | Sup(Cls) | SS | True | 0.8878 | 0 | 0 |
| mmd | Scratch | OS | False | nan | nan | nan |
| mmd | Scratch | SS | False | nan | nan | nan |
| mmd | Scratch | OS | True | 0.8572 | 0.005539 | 0.001855 |
| mmd | Scratch | SS | True | 0.8878 | 0 | 0 |
| mean_calibration_difference | Nominal | OS | False | nan | nan | nan |
| mean_calibration_difference | Nominal | SS | False | nan | nan | nan |
| mean_calibration_difference | Nominal | OS | True | 0.1156 | 0.006317 | 0.005587 |
| mean_calibration_difference | Nominal | SS | True | 0.7906 | 0 | 0 |
| mean_calibration_difference | SSL | OS | False | nan | nan | nan |
| mean_calibration_difference | SSL | SS | False | nan | nan | nan |
| mean_calibration_difference | SSL | OS | True | 0.1619 | 0.03657 | 0.1267 |
| mean_calibration_difference | SSL | SS | True | 0.7906 | 0 | 0 |
| mean_calibration_difference | Sup(Cls) | OS | False | nan | nan | nan |
| mean_calibration_difference | Sup(Cls) | SS | False | nan | nan | nan |
| mean_calibration_difference | Sup(Cls) | OS | True | 0.7219 | 0.01664 | 0.02233 |
| mean_calibration_difference | Sup(Cls) | SS | True | 0.7906 | 0 | 0 |
| mean_calibration_difference | Scratch | OS | False | nan | nan | nan |
| mean_calibration_difference | Scratch | SS | False | nan | nan | nan |
| mean_calibration_difference | Scratch | OS | True | 0.7442 | 0.01065 | 0.003986 |
| mean_calibration_difference | Scratch | SS | True | 0.7906 | 0 | 0 |

| metric | model | group | calibrated | value | lower_error | upper_error |
|---|---|---|---|---|---|---|
| mmd | Nominal | OS | False | nan | nan | nan |
| mmd | Nominal | SS | False | nan | nan | nan |
| mmd | Nominal | OS | True | 0.8726 | 0.004285 | 0.006339 |
| mmd | Nominal | SS | True | 0.8878 | 0 | 0 |
| mmd | SSL | OS | False | nan | nan | nan |
| mmd | SSL | SS | False | nan | nan | nan |
| mmd | SSL | OS | True | 0.8693 | 0.01061 | 0.01019 |
| mmd | SSL | SS | True | 0.8878 | 0 | 0 |
| mmd | Sup(Cls) | OS | False | nan | nan | nan |
| mmd | Sup(Cls) | SS | False | nan | nan | nan |
| mmd | Sup(Cls) | OS | True | 0.8542 | 0.00275 | 0.005383 |
| mmd | Sup(Cls) | SS | True | 0.8878 | 0 | 0 |
| mmd | Scratch | OS | False | nan | nan | nan |
| mmd | Scratch | SS | False | nan | nan | nan |
| mmd | Scratch | OS | True | 0.8572 | 0.005539 | 0.001855 |
| mmd | Scratch | SS | True | 0.8878 | 0 | 0 |
| mean_calibration_difference | Nominal | OS | False | nan | nan | nan |
| mean_calibration_difference | Nominal | SS | False | nan | nan | nan |
| mean_calibration_difference | Nominal | OS | True | 0.1156 | 0.006317 | 0.005587 |
| mean_calibration_difference | Nominal | SS | True | 0.7906 | 0 | 0 |
| mean_calibration_difference | SSL | OS | False | nan | nan | nan |
| mean_calibration_difference | SSL | SS | False | nan | nan | nan |
| mean_calibration_difference | SSL | OS | True | 0.1619 | 0.03657 | 0.1267 |
| mean_calibration_difference | SSL | SS | True | 0.7906 | 0 | 0 |
| mean_calibration_difference | Sup(Cls) | OS | False | nan | nan | nan |
| mean_calibration_difference | Sup(Cls) | SS | False | nan | nan | nan |
| mean_calibration_difference | Sup(Cls) | OS | True | 0.7219 | 0.01664 | 0.02233 |
| mean_calibration_difference | Sup(Cls) | SS | True | 0.7906 | 0 | 0 |
| mean_calibration_difference | Scratch | OS | False | nan | nan | nan |
| mean_calibration_difference | Scratch | SS | False | nan | nan | nan |
| mean_calibration_difference | Scratch | OS | True | 0.7442 | 0.01065 | 0.003986 |
| mean_calibration_difference | Scratch | SS | True | 0.7906 | 0 | 0 |

| source | channel | fit | SR_bins | SB_range_GeV | SR_range_GeV | FPR | significance | selected_events | bonus_significance |
|---|---|---|---|---|---|---|---|---|---|
| bump_hunting_12bins_quintic_fit_seed192041.npz | OS | Quintic | 12 | 5-16 | 9-10.6 | -1 | 57.37 | 12332 | 7.575 |
| bump_hunting_12bins_quintic_fit_seed192041.npz | OS | Quintic | 12 | 5-16 | 9-10.6 | 1 | 1.597 | 12332 | 7.575 |
| bump_hunting_12bins_quintic_fit_seed192041.npz | OS | Quintic | 12 | 5-16 | 9-10.6 | 0.3 | 3.141 | 3762 | 7.575 |
| bump_hunting_12bins_quintic_fit_seed192041.npz | OS | Quintic | 12 | 5-16 | 9-10.6 | 0.1 | 6.011 | 1326 | 7.575 |

| source | channel | fit | SR_bins | SB_range_GeV | SR_range_GeV | FPR | significance | selected_events | bonus_significance |
|---|---|---|---|---|---|---|---|---|---|
| bump_hunting_12bins_quintic_fit_no_signal_seed192041.npz | SS | Quintic | 12 | 5-16 | 9-10.6 | -1 | 0.09478 | 7168 | 0.3079 |
| bump_hunting_12bins_quintic_fit_no_signal_seed192041.npz | SS | Quintic | 12 | 5-16 | 9-10.6 | 1 | 0.5263 | 7168 | 0.3079 |
| bump_hunting_12bins_quintic_fit_no_signal_seed192041.npz | SS | Quintic | 12 | 5-16 | 9-10.6 | 0.3 | 1.036 | 2177 | 0.3079 |
| bump_hunting_12bins_quintic_fit_no_signal_seed192041.npz | SS | Quintic | 12 | 5-16 | 9-10.6 | 0.1 | 0 | 710 | 0.3079 |