Calibration Calculator

Offline · Local calculations

A new version is ready.
Adjust B only.
#Sensor readingReference reading

Current coefficients

Raw multi-point fits do not use existing coefficients. No existing values are assumed.

Advanced

Use raw input only for confirmed uncorrected sensor values.

The existing quadratic correction needs a confirmed raw interval on one monotonic branch. Do not guess the branch.

Single-point A and C retain their entered numeric values. Unit labels do not convert readings. Confirm the coefficient precision your device accepts.

Formulas and calculation basis

The supplied OCEAView guide (p. 159) gives y = Ax + B and y = Cx² + Ax + B. This tool interprets x as raw input and y as corrected output.

Single point: Bnew = Bold + reference − displayed As Found. Raw input is corrected with the existing coefficients first. A and C stay fixed.

Multi-point: unweighted least squares of reference against raw input. Linear needs 2 distinct raw points and fixes C = 0; quadratic needs 3. Centered/scaled QR fitting and inverse reconstruction are implementation choices, not guide-prescribed algorithms. Repeated rows have equal weight.

Corrected inputs use the existing curve to reconstruct raw values. Quadratic reconstruction requires a confirmed monotonic interval. Rounded displayed readings introduce uncertainty. No tolerance, drift allowance, uncertainty, or extrapolation assessment is calculated.

New B
Keep A and C unchanged.

Replacement coefficients

Calculated predictions only. These are not post-adjustment measurements.

Advanced · calculation details and fit diagnostics

PointRaw xReferencePredictedResidual

Recent calculations

Last 10 calculations · This browser only.

Calculation records only. They do not prove coefficients were applied, calibration was performed, or verification passed.