Metrics Tools
Browse all available metrics tools.
Available tools
- Absolute Error Rounding Uncertainty Envelope Tool Compute absolute error rounding uncertainty envelope from explicit bounded inputs.
- Absolute Log Error Single Pair Tool Calculate absolute log error single pair from explicit caller-supplied inputs.
- Asymmetric Error Cost Breakeven Ratio Tool Compute asymmetric error cost breakeven ratio from explicit bounded inputs.
- Binary Log Loss Logit Stable Term Tool Compute binary log loss logit stable term from explicit bounded inputs.
- Brier Reference Class Contribution Compare one explicit class Brier contribution with a supplied reference probability under the same binary observation.
- Brier Score Calculator Compute mean squared probability error for binary outcomes. Probabilities must lie in [0,1], outcomes must be 0 or 1; lower scores are better.
- Concordance One Tied Pair Credit Tool Calculate concordance one tied pair credit from explicit caller-supplied inputs.
- Counter Reset Lower Bound Tool Infer a minimum increment with a zero-reset assumption when a nonnegative counter decreases; unseen resets cannot be reconstructed.
- Error Metric Unit Scaling Exponent Tool Calculate error metric unit scaling exponent from explicit caller-supplied inputs.
- Forecast Bias Cancellation One Pair Tool Calculate forecast bias cancellation one pair from explicit caller-supplied inputs.
- Forecast Delta Revision One Horizon Tool Calculate forecast delta revision one horizon from explicit caller-supplied inputs.
- Forecast Error Quantum Tie Policy Tool Round a signed forecast error to an explicit quantum with binary64 exact-half detection.
- Forecast Overlap Horizon Weight Tool Compute forecast overlap horizon weight from explicit bounded inputs.
- Forecast Skill Baseline Equality Point Tool Calculate forecast skill baseline equality point from explicit caller-supplied inputs.
- Gauge Sample Age Fraction Tool Calculate gauge sample age fraction from explicit caller-supplied inputs.
- Histogram Bin Exposure Share Tool Report one histogram bin’s explicitly supplied exposure share, with an undefined flag for no exposure.
- Histogram Open Bucket Count Tool Count finite histogram buckets plus the one conventional unbounded final bucket from strictly increasing finite bounds.
- Huber Loss Calculator Compute the mean Huber loss, a quadratic-to-linear blend robust to outlier residuals.
- Huber Loss Transition Continuity Gap Tool Calculate huber loss transition continuity gap from explicit caller-supplied inputs.
- Interval Coverage Boundary Convention Tool Compute interval coverage boundary convention from explicit bounded inputs.
- Interval Midpoint Bias Contribution Compare the explicit midpoint of an ordered prediction interval with an actual observation.
- Interval Score Missing Endpoint Case Tool Central interval score with missing endpoints explicitly flagged rather than treated as zero bounds.
- Interval Width Reference Normalization Tool Calculate interval width reference normalization from explicit caller-supplied inputs.
- Logcosh Loss Small Residual Limit Tool Return the second- and fourth-order small-residual Taylor terms for log(cosh(residual)).
- Mae Denominator Weight Sum Tool Sum nonnegative observation weights for a weighted MAE denominator, requiring positive total weight.
- Mae Single Observation Gradient Tool Compute mae single observation gradient from explicit bounded inputs.
- Mae Subgradient Zero Policy Tool Compute mae subgradient zero policy from explicit bounded inputs.
- Mape Absolute Vs Signed Actual Policy Calculate one absolute prediction-error ratio with an explicit absolute or signed actual-denominator policy.
- Matthews Correlation Coefficient Calculator Compute binary-classification MCC from TP, TN, FP, FN. An undefined zero-denominator case is rejected rather than silently scored as zero.
- Mean Absolute Error Calculator Calculate mean absolute prediction error.
- Mean Error From Signed Sum Tool Recover mean signed prediction error from an explicitly supplied signed error sum and observation count.
- Mean Squared Error Calculator Calculate mean squared prediction error.
- Metric Normalizer Support Intersection Tool Intersect explicit observation-support masks before using a metric denominator.
- Metrics: Forecast Error Sign Convention Tool Evaluate signed forecast residual only under an explicit forecast-minus-actual or actual-minus-forecast convention; no fitted forecast.
- Metrics: Forecast Error Underprediction Weight Tool Weight one actual-minus-forecast absolute residual with explicit under/overprediction costs; no fitted asymmetric forecasting model.
- Metrics: Interval Score Observation Tool Score one central (1-alpha) predictive interval using the interval width and two outside penalties; no calibration inference.
- Metrics: Log Loss Probability Term Tool Return an explicitly weighted single-observation log-loss contribution by invoking the existing strict binary log-loss calculator, not a copied log formula.
- Metrics: Nrmse Reference Scale Choice Tool Normalize a supplied nonnegative RMSE by explicitly selected reference range or absolute arithmetic mean; zero scale is rejected and no population reference inferred.
- Metrics: Percentage Error Zero Actual Label Tool Compute signed percentage forecast error with an explicit undefined flag and unused zero when actual is zero; does not silently claim zero error.
- Metrics: Pinball Residual Term Tool Compute one pinball/quantile-loss contribution for residual actual-minus-prediction at a supplied open-unit quantile.
- Metrics: Quantile Crossing Two Output Flag Tool Detect crossing between two explicitly ordered quantile forecasts; no rearrangement, calibration test or full quantile curve.
- Metrics: Rank Discount Position Tool Return a single DCG logarithmic position discount under one-based rank indexing; no relevance gains or ranking metric aggregation.
- Metrics: Ranked Gain Tie Average Term Tool Compute expected DCG contribution of one tied rank block by averaging supplied nonnegative gains across its explicit rank positions; no whole ranking metric.
- Metrics: Rmsle Single Pair Domain Check Tool Return the one-pair log1p residual and squared contribution behind RMSLE for nonnegative values, not an aggregated metric or silent clipping.
- Metrics: Smape Single Pair Zero Policy Tool Compute a single symmetric absolute percentage-error fraction using absolute magnitudes, with explicit zero/reject policy for an all-zero pair.
- Monotone Counter Rate Unit Factor Tool Rescale a non-reset monotone counter increment to caller-supplied target time units.
- Mse Single Observation Gradient Tool Compute mse single observation gradient from explicit bounded inputs.
- Multiclass Brier Single Observation Range Tool Give the simplex one-hot multiclass Brier range for sum-of-squares or class-averaged normalization.
- Pinball Loss Quantile Parameter Slope Tool Differentiate pinball loss with respect to its quantile parameter, holding the residual fixed.
- Pinball Quantile Derivative Residual Tool Compute pinball quantile derivative residual from explicit bounded inputs.
- Quantile Loss Zero Residual Subgradient Tool Return the pinball-loss subgradient interval with respect to the residual at exactly zero.
- Rankloss One Inverted Pair Term Tool Calculate rankloss one inverted pair term from explicit caller-supplied inputs.
- Rate Window Boundary Weight Tool Split a uniform rate-window exposure at an explicit boundary; point membership has zero duration.
- Rate Window Exposure Factor Tool Calculate rate window exposure factor from explicit caller-supplied inputs.
- Ratio Metric Sensitivity Tool Return local partial derivatives of numerator/denominator with respect to its two supplied components.
- Relative Skill Zero Baseline Policy Tool Compute relative skill zero baseline policy from explicit bounded inputs.
- Relative Squared Error One Pair Term Tool Calculate relative squared error one pair term from explicit caller-supplied inputs.
- Residual Sum of Squares Calculator Calculate the sum of squared residuals between actual and predicted values.
- Rmsle Log Offset Domain Check Tool Calculate rmsle log offset domain check from explicit caller-supplied inputs.
- Root Mean Squared Error Calculator Calculate the square root of mean squared prediction error.
- Scaled Error Seasonal Denominator Tag Qualify an explicit scaled-error denominator by seasonal-period wording and source without calculating or inferring the denominator.
- Scaled Error Seasonal Denominator Zero Tool Calculate scaled error seasonal denominator zero from explicit caller-supplied inputs.
- Skill Score Sign Reference Choice Tool Calculate skill score sign reference choice from explicit caller-supplied inputs.
- Squared Error Weight Sensitivity Tool Differentiate an unnormalized weighted squared-error term with respect to its weight.
- Symmetric Mape Denominator Convention Tool Evaluate a caller-scaled absolute symmetric percentage-error term, explicitly flagging the 0/0 convention.
- Symmetric Mean Absolute Percentage Error Calculator Calculate symmetric mean absolute percentage error.
- Symmetric Percentage Error Local Slope Tool Differentiate 2*abs(predicted-actual)/(actual+predicted) on the strictly positive unequal-value domain.
- Threshold Hit Miss Single Forecast Tool Calculate threshold hit miss single forecast from explicit caller-supplied inputs.
- Weighted Absolute Error Missing Weight Term Tool Calculate weighted absolute error missing weight term from explicit caller-supplied inputs.
- Weighted Error Denominator Missing Case Tool Calculate weighted error denominator missing case from explicit caller-supplied inputs.
- Weighted Mae One Weight Sensitivity Tool Calculate weighted mae one weight sensitivity from explicit caller-supplied inputs.
- Weighted Pinball Zero Weight Flag Tool Calculate weighted pinball zero weight flag from explicit caller-supplied inputs.
- Winkler Score Width Penalty Split Tool Calculate winkler score width penalty split from explicit caller-supplied inputs.