03 / Independent work by Kush Rishi

TrueMargin

Can disagreement between image registrations reveal alignment error?

In brief

Experiments on whether variation between image alignments helps identify spatial error. The study compares error estimates with known deformations and simpler methods.

03 / TrueMarginRecorded experiment

Same anatomy.
Different signals.

Does registration disagreement track alignment error?

Anatomy-level association with known spatial errorTen anatomy-level median Spearman correlations. Blue dots show ensemble spread; orange dots show the selected comparator. A full data table follows.-0.50.00.51.0aaa0044aaa0051aaa0053aaa0060aaa0064aaa0069aaa0071aaa0072aaa0086aaa0087Rank correlation with error (Spearman ρ)
Ensemble spreadInverse-consistency error

0.880spread0.725comparator

30 controlled cases · 10 anatomies. Correlation measures ordering, not error in millimetres. These data do not establish an advantage over inverse-consistency error.

Data and provenance
Median case correlation within each anatomy
AnatomySpreadICEResidualJacobian
aaa00440.88040.72480.30130.6581
aaa00510.61000.71580.56020.3026
aaa00530.89020.91650.54560.6571
aaa00600.22440.28290.09120.0353
aaa00640.79240.90640.78310.6758
aaa00690.0334-0.09760.2008-0.3014
aaa00710.70480.79510.28430.8000
aaa00720.66340.58980.2715-0.4307
aaa00860.77630.78320.2167-0.4467
aaa00870.30480.34630.2860-0.3671
Source CSV

Display rounding only. Comparator failures and valid-case counts are retained in the source record.

The question

Image registration aligns two scans. This study asks whether variation between registrations identifies local spatial error. Error ranking, blind spots and calibrated bounds are evaluated separately.

Method

A fixed nine-setting ensemble produces displacement fields. Their local spread is compared with known error from synthetic deformations, inverse-consistency error, image residual and Jacobian deviation.

  1. 01Align images with fixed parameter settings
  2. 02Measure displacement disagreement
  3. 03Compare with known error and baselines

The controlled study contains 30 cases across 10 anatomies and 1,500 sampled locations. Anatomy-level summaries avoid counting spatial samples as independent subjects.

Experiments

The first study measured associations and failure cases. A separate calibration study used 30 calibration and 30 evaluation anatomies across two sources. The interactive plot shows retained comparator data, not simulated results.

Results

Median anatomy-level Spearman correlation
SignalCorrelation
Ensemble spread0.6841
Inverse-consistency error0.7203
Image residual0.2851
Jacobian deviation0.1689

All ten anatomy-level spread/error associations were positive. The median correlation confidence interval was [0.3048, 0.8284]. No advantage over inverse-consistency error was established: the paired difference interval crossed zero.

Controlled study10 anatomies

Registration spread and alignment error

Each anatomy has three synthetic deformations with known alignment errors.

Anatomy-level correlation

Each dot shows an anatomy’s median Spearman correlation with known error.

Ten anatomy-level correlations for registration spread and inverse-consistency error
Registration spread
Median 0.6841
Inverse-consistency error
Median 0.7203

Spread did not show an advantage over inverse-consistency error. The comparator’s valid-case counts vary by anatomy.

Case-level correlations

Spread/error correlations for all 30 deformation cases.

Thirty case correlations, including six below zero

Six correlations were negative.

39 of 1,500 sampled locations had high error despite low spread. Locations are not independent patients.

A separate calibration study produced conservative, sometimes very large error bounds. These are controlled experiments, not clinical validation.
Exact retained values and sampling units

Ten anatomies × three deformations × 50 locations. The source tables preserve exact values and case ordering.

Anatomy-level results and valid-case counts · Case-level results

Original technical figure. Calibration results below use a separate cohort.

Failures and bounds

Six of 30 case-level correlations were negative. Thirty-nine of 1,500 observations had high error despite low spread; these failures remain in the analysis.

At nominal 90% coverage, the separate evaluation reached 97.73% and 99.73% mean anatomy-level coverage, with median anatomy radii of 3.93 mm and 4.36 mm. One anatomy had a 70.69 mm median radius. The 95% thresholds were infinite with fifteen calibration groups per source. Reverse-registration failures prevented the planned full-cohort calibrated baseline comparison.

Limitations

These studies do not establish clinical validity, external generalization or uniformly useful bounds. A later calibration-only analysis found source-dependent effects, not a consistent improvement. The work has a technical report, not an accepted peer-reviewed publication.

Reproducibility

From a checkout with Python 3.12, check the saved calibration and evaluation records without imaging data:

python scripts/verify_m6_phase_a_result.py results/m6_phase_a
python scripts/verify_m6_phase_b_result.py results/m6_phase_b

These checks do not rerun registrations. Full experiments require the source data and documented imaging dependencies.

Reproduction guide · Protocols and results

Deferred external study

An independent lung-CT protocol and initial image checks were prepared. Two retained Case7 fields were almost identical after a tolerance change; both reached the iteration cap. This establishes neither convergence nor useful ensemble diversity. Numerical landmarks remain sealed and external landmark validation has not run.

External protocol · Historical execution record