{ "schema": "auturnal.deep-research-review.v2", "slug": "calibration-decision-quality", "title": "Calibrated Probabilities Are Not Yet Good Decisions", "category": "Reliability & Interpretation", "dek": "Reliability diagrams, proper scores, and decision costs answer different questions; a useful probability estimate must survive all three.", "abstract": "A deep classifier can be accurate but overconfident, calibrated but uninformative, or well calibrated in aggregate while misleading a subgroup. This article develops these distinctions through explicit population constructions. A two-group Bernoulli model separates irreducible uncertainty from avoidable probability error and shows how a constant calibrated forecast loses decision value. Temperature scaling and multiclass calibration are situated within this decision-theoretic analysis, with attention to binning, finite-sample uncertainty, and deployment shift. Exact enumeration of a small population checks calibration, Brier loss, and Bayes action costs. The proposed neural-model protocol is distinct from those executed examples and does not claim a new calibration benchmark.", "english": "A deep classifier can be accurate but overconfident, calibrated but uninformative, or well calibrated in aggregate while misleading a subgroup. This article develops these distinctions through explicit population constructions. A two-group Bernoulli model separates irreducible uncertainty from avoidable probability error and shows how a constant calibrated forecast loses decision value. Temperature scaling and multiclass calibration are situated within this decision-theoretic analysis, with attention to binning, finite-sample uncertainty, and deployment shift. Exact enumeration of a small population checks calibration, Brier loss, and Bayes action costs. The proposed neural-model protocol is distinct from those executed examples and does not claim a new calibration benchmark.", "refs": [ "dl-17-1", "dl-17-2", "dl-17-3" ], "sections": [ [ "1. Probability is a claim about repeated outcomes", "A probability forecast is useful because it supports decisions whose costs differ across outcomes. Its interpretation is therefore more demanding than a ranking score. If cases assigned probability one fifth systematically exhibit the event two fifths of the time, a downstream threshold based on the forecast can be wrong even when the classifier ranks many cases correctly. Calibration asks about this correspondence between forecast values and conditional outcome frequencies.\n\nThere are several possible conditioning events. One can examine the probability of a particular class, the confidence of the selected class, the entire predictive vector, or a subgroup within any of these. These are not interchangeable evaluations. Our constructions use binary event probabilities so every quantity can be calculated exactly. The same logical distinctions matter for deep multiclass predictors, but a scalar curve cannot certify their full probability vector. The conditioning information and decision use should be written down before choosing a metric.", [] ], [ "2. A scalar correction has a specific expressive limit", "Guo and colleagues study calibration in modern neural networks and evaluate temperature scaling, which rescales all logits by one positive parameter before softmax. Their reported effectiveness motivates an economical postprocessing baseline; it is not a theorem that one temperature repairs every network or distribution.\n\nA positive common temperature preserves the ordering of logits, including ties. Consequently it changes confidence without changing a deterministic top-class rule. This is valuable when ranking is trusted and confidence is distorted approximately by a common scale. It cannot repair a systematic class interchange, add a missing feature, or assign different corrections to two inputs with identical logits. If a subgroup needs a larger correction and another needs a smaller one, fitting one temperature compromises between them. A held-out calibration objective may favor that compromise while a particular deployment decision remains poor. Temperature is therefore a model of the error pattern, not a universal reliability switch.", [ "dl-17-1" ] ], [ "3. Perfect aggregate calibration can hide useful structure", "Construct two equally frequent groups. In group A the event probability is one tenth; in group B it is nine tenths. A predictor that always reports one half is perfectly calibrated on the combined population: among all cases receiving one half, half experience the event. Yet it ignores the group information. The predictor reporting the two true conditional probabilities is also calibrated and supports much better classification under equal error costs.\n\nThe constant forecast illustrates why calibration alone does not reward resolution. It also illustrates why a subgroup can be miscalibrated even when a population-level statement is exact. Within group A, the half-probability forecast overestimates by four tenths; within group B, it underestimates by the same amount. The errors cancel only after aggregation. This construction is intentionally transparent: it does not say that real demographic groups have these event rates, nor that using any particular protected attribute is automatically appropriate.", [] ], [ "4. Proper scoring separates information from a calibration slogan", "For a Bernoulli outcome with true conditional probability q, the expected squared probability loss at prediction p equals q times one minus q, plus the squared difference between p and q. Expanding the square gives the identity directly. The first term is irreducible conditional outcome variation; the second is the avoidable cost of an inaccurate probability. This local identity requires no neural architecture assumption.\n\nIn our two-group example the irreducible term is nine hundredths in both groups. The constant half forecast adds sixteen hundredths, giving a Brier loss of one quarter. The informative true-probability forecast attains nine hundredths. Interpolating between these forecasts produces the first figure. Its curve declines smoothly even though the constant endpoint is already calibrated in the aggregate. A report can therefore include both calibration and a proper score without treating one as redundant. Logarithmic scoring adds stronger penalties near confidently incorrect endpoints, but requires careful handling of exact zeros.", [] ], [ "5. Binning can erase the error being measured", "Vaicenavicius and colleagues develop a probabilistic framework for calibration evaluation and distinguish conditioning notions that scalar summaries can conflate. Their analysis supports treating an evaluation statistic as a measurement procedure with a particular target.\n\nOur own example makes the issue concrete. Give half the population predicted event probability one quarter and outcome frequency one half; give the other half probability three quarters and the same outcome frequency one half. Separate forecast bins reveal absolute probability errors of one quarter in each group. Merging them into one bin yields average prediction one half and average outcome one half, hiding the discrepancy entirely. This is a probability-calibration illustration; a conventional top-confidence ECE applies to a different variable. Finite samples add another complication: observed bin errors fluctuate even under true calibration. More bins improve resolution but leave fewer observations per bin. A single low ECE with unspecified binning and sample size cannot establish a population property.", [ "dl-17-2" ] ], [ "6. The decision threshold comes from costs", "Suppose action one incurs cost C_FP when the event is absent, while action zero incurs cost C_FN when it is present. If p is the true event probability conditional on the information used, the expected costs are C_FP times one minus p and C_FN times p. Choose action one when p exceeds C_FP divided by the sum of the two costs; ties can be resolved by either action without changing expected cost.\n\nWith equal costs, the constant forecast cannot distinguish our two groups and incurs error one half. Using their conditional probabilities yields error one tenth. The second figure varies the false-positive cost while holding the false-negative cost at one. It compares decisions based on the constant information set with decisions based on group information. Both forecasts are calibrated relative to what they reveal, yet their attainable costs differ. This is an information comparison, not evidence that a specific neural calibrator achieves such gains.", [] ], [ "7. Multiclass flexibility must pay its estimation cost", "Kull and colleagues introduce Dirichlet calibration, which transforms log probabilities through a learned linear map and softmax. Compared with a single temperature, this allows class-specific corrections and interactions among probability coordinates. Their work is a multiclass calibration method, not a guarantee that additional flexibility always improves held-out reliability.\n\nThe extra parameters create an ordinary estimation problem. A small calibration set may not identify a useful correction for rare classes, and unconstrained flexibility can fit sampling noise. Regularization, class support, and separate evaluation data therefore belong in the method description. Changing the highest-probability class can improve or worsen classification; unlike a common positive temperature, a general map need not preserve rankings. Any downstream workflow that assumed unchanged decisions must be retested. Calibration training should also be isolated from repeated test-set tuning, since selecting a map on the same examples used for its final reliability diagram biases the apparent result.", [ "dl-17-3" ] ], [ "8. Selection and shift change the relevant population", "A probability statement is indexed by a population. If a service routes low-confidence cases to a human, the retained distribution differs from the original test set. Calibration conditional only on the reported score survives selection determined solely by that score, provided the selection mechanism introduces no further outcome information. It need not survive selection that also uses an unmodeled subgroup, acquisition channel, or hidden difficulty signal. Stating the selection rule makes this distinction testable.\n\nA changed class prevalence can also alter the interpretation of a fixed score. Recalibrating after every detected input shift is not automatically justified: an input change need not change the conditional outcome mechanism, and lack of input change does not exclude a label change. The deployment record should distinguish an alarm about distributional difference from evidence of probability error. Delayed labels, missing outcomes, and selective feedback complicate that evidence and should remain visible in reliability dashboards.", [] ], [ "9. What the executed finite checks establish", "The accompanying code represents twenty equally weighted cases: ten in each constructed group, with one and nine positive outcomes respectively. It verifies the constant forecast's aggregate calibration, its subgroup discrepancies, and the exact Brier losses of the constant and informative forecasts. A separate bin-merging example verifies that a coarser grouping can suppress an error statistic. All frequencies are deliberately assigned; they are not estimates from an external dataset.\n\nFor the cost sweep, exact conditional expectations select the lower-cost action independently in each information group. The checks compare these decisions with direct enumeration over the finite outcomes at selected costs. The temperature check confirms ordering preservation for representative non-tied logits and positive temperatures. These tests catch algebra, implementation, and figure mismatches. They cannot validate calibration on real users or demonstrate that a postprocessing method generalizes from a finite validation set. That latter claim requires the proposed held-out study.", [] ], [ "10. Build an evaluation around decisions and uncertainty", "A practical calibration report should begin with the output probability being interpreted and the decision it will inform. It should then provide a proper scoring rule, explicit reliability conditioning, uncertainty intervals, and decision costs or a justified range of costs. Coverage after abstention and class-specific support belong beside the headline metric. A comparison is stronger when it shows the same held-out population before and after a calibration map, including cases where performance worsens.\n\nThe resulting standard is demanding but concrete. Aggregate calibration is a useful constraint, not a complete objective. Flexible correction can improve a misspecified probability map, but must be estimated and evaluated separately. Better probability information can reduce decision cost even when both competing forecasts satisfy a calibration statement. These are analytical conclusions supported by the disclosed constructions. The article proposes, but has not run, a neural calibration trial across acquisition domains, class prevalences, and operational thresholds.", [] ] ], "section_kinds": [ "author_analysis_or_verification_proposal", "source_based_review", "author_analysis_or_verification_proposal", "author_analysis_or_verification_proposal", "source_based_review", "author_analysis_or_verification_proposal", "source_based_review", "author_analysis_or_verification_proposal", "author_analysis_or_verification_proposal", "author_analysis_or_verification_proposal" ], "equations": [ { "tex": "p_k^{(T)}(x)=\\frac{\\exp(z_k(x)/T)}{\\sum_j\\exp(z_j(x)/T)},\\qquad T>0", "explanation": "Positive temperature scaling preserves logit order; a temperature is fitted on separate calibration data and evaluated on untouched examples." }, { "tex": "\\operatorname{ECE}_{\\mathcal B}=\\sum_{B\\in\\mathcal B}P(B)\\left|\\mathbb E[Y\\mid B]-\\mathbb E[p\\mid B]\\right|", "explanation": "Population bin-based event-probability calibration error for binary Y. It is not automatically the conventional selected-class confidence ECE; bins are part of the definition." }, { "tex": "\\mathbb E[(p-Y)^2\\mid q]=q(1-q)+(p-q)^2", "explanation": "For fixed p and Bernoulli Y with probability q. In the constructed groups q is 0.1 or 0.9; Brier loss is 0.09+0.16(1-alpha)^2 under the stated interpolation." }, { "tex": "a^*(p)=\\mathbf 1\\!\\left\\{p>\\frac{C_{\\rm FP}}{C_{\\rm FP}+C_{\\rm FN}}\\right\\}", "explanation": "Binary action with nonnegative error costs and a positive sum; p must represent the conditional event probability for the information available to the decision." } ], "table": { "headers": [ "Evaluation", "Useful question", "Blind spot" ], "rows": [ [ "Top-class confidence", "How often is the selected class correct at this confidence?", "Other coordinates of the probability vector" ], [ "Classwise reliability", "Does each class probability match its event frequency?", "All possible joint or subgroup conditions" ], [ "Brier or log score", "Are informative accurate probabilities rewarded?", "Which subgroup accounts for an aggregate error" ], [ "Expected action cost", "Does the probability support this decision?", "Other decisions with different costs" ] ] }, "protocol": [ "Freeze the probability target, action space, cost range, and deployment population.", "Separate model training, calibration fitting, method selection, and final evaluation examples.", "Compare uncalibrated predictions, a positive temperature baseline, and a regularized flexible map.", "Report proper scores and reliability curves with explicit bin rules, support counts, and uncertainty.", "Evaluate subgroup and selected-population reliability without hiding abstentions or rare classes.", "Measure cost and coverage under prespecified thresholds, then repeat on genuinely held-out shifts." ], "limitations": [ "The twenty-case population is constructed and is not evidence about any real subgroup.", "Exact population calculations avoid sampling noise that a real calibration study must quantify.", "Three foundational sources do not constitute an exhaustive comparison of modern calibration methods.", "The cost model assumes binary actions and known costs; complex decisions need their own utility model." ], "evidence": [ { "source": "dl-17-1", "result": "Studies neural-network miscalibration and temperature scaling as a postprocessing method.", "boundary": "Empirical effectiveness is dataset-dependent; temperature preserves class order.", "locator": "Sections 2 and 4, temperature scaling." }, { "source": "dl-17-2", "result": "Formalizes different probabilistic calibration notions and their evaluation.", "boundary": "A scalar summary does not characterize every conditioning event.", "locator": "Sections on calibration definitions and evaluation." }, { "source": "dl-17-3", "result": "Introduces a multiclass calibration map based on log probabilities and a linear-softmax transformation.", "boundary": "Additional expressivity requires adequate fitting and independent evaluation.", "locator": "Dirichlet calibration definition and parameterizations." } ], "research_questions": [ "Which calibration conditioning events are necessary for a particular downstream decision?", "How can rare-group reliability be estimated without hiding its statistical uncertainty?", "When does a flexible multiclass map improve expected decision cost beyond a well-fitted scalar temperature?" ], "kind": "ai_assisted_research_guide", "author": "Codex (AI)", "original_language": "en", "created_date": "2026-10-22", "published_date": "2026-10-22T13:02:56+00:00", "publication_status": "published_commissioned_review", "version": 5, "previous_version": "/guides/calibration-decision-quality/v4/", "analytic": "calibration-decision-quality", "peer_reviewed": false, "journal_publication": false, "disclosure": { "authorship": "Written and technically self-reviewed by Codex (AI). References identify the original researchers; the analytical constructions and proposed evaluation designs are attributed to this article.", "figures": "Covers are conceptual ImageGen illustrations. Technical figures are computed from declared models or finite examples, with Python and CSV supplied. They are not measurements of deployed products or reproduced performance benchmarks.", "review": "This local draft has no independent peer-review or journal-acceptance record. Bounded executable examples check the stated small models; they are not formal verification of the cited systems." }, "review_scope": "A focused analytical review of three selected foundational primary sources, with original worked examples. This is not an exhaustive or systematic survey of the literature through 2026. Source access and version notes are recorded with the bibliography.", "revision_note": "Initial local English manuscript; no server upload or publication action.", "source_slug": "calibration-decision-quality", "source_revision": "41dc5ea7bf1db9868e2ee5b121f7021c823cc018", "source_article_sha256": "e4d4e96d56456ea47dc168b662e93c24350a4d1fd33f3a02f1d0c71da78a0e3b", "sources": [ { "id": "dl-17-1", "key": "Temperature", "title": "On Calibration of Modern Neural Networks", "authors": [ { "given": "Chuan", "family": "Guo" }, { "given": "Geoff", "family": "Pleiss" }, { "given": "Yu", "family": "Sun" }, { "given": "Kilian Q.", "family": "Weinberger" } ], "journal": "Proceedings of the 34th International Conference on Machine Learning", "year": 2017, "doi": "", "url": "https://proceedings.mlr.press/v70/guo17a.html", "verified_date": "2026-10-22", "metadata_source": "Primary author or proceedings record and author list on the accessed paper", "author_list_complete": true, "csl_type": "paper-conference", "access_scope": "Primary record and selected accessible full-text sections inspected; no exhaustive supplementary-material audit.", "version_note": "", "article_slug": "calibration-decision-quality", "source_article_slug": "calibration-decision-quality" }, { "id": "dl-17-2", "key": "CalibrationEval", "title": "Evaluating model calibration in classification", "authors": [ { "given": "Juozas", "family": "Vaicenavicius" }, { "given": "David", "family": "Widmann" }, { "given": "Carl", "family": "Andersson" }, { "given": "Fredrik", "family": "Lindsten" }, { "given": "Jacob", "family": "Roll" }, { "given": "Thomas B.", "family": "Schön" } ], "journal": "Proceedings of the Twenty-Second International Conference on Artificial Intelligence and Statistics", "year": 2019, "doi": "", "url": "https://proceedings.mlr.press/v89/vaicenavicius19a.html", "verified_date": "2026-10-22", "metadata_source": "Primary author or proceedings record and author list on the accessed paper", "author_list_complete": true, "csl_type": "paper-conference", "access_scope": "Primary record and selected accessible full-text sections inspected; no exhaustive supplementary-material audit.", "version_note": "", "article_slug": "calibration-decision-quality", "source_article_slug": "calibration-decision-quality" }, { "id": "dl-17-3", "key": "DirichletCalibration", "title": "Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibration", "authors": [ { "given": "Meelis", "family": "Kull" }, { "given": "Miquel", "family": "Perello-Nieto" }, { "given": "Markus", "family": "Kängsepp" }, { "given": "Telmo", "family": "Silva Filho" }, { "given": "Hao", "family": "Song" }, { "given": "Peter", "family": "Flach" } ], "journal": "Advances in Neural Information Processing Systems 32", "year": 2019, "doi": "", "url": "https://papers.neurips.cc/paper_files/paper/2019/hash/8ca01ea920679a0fe3728441494041b9-Abstract.html", "verified_date": "2026-10-22", "metadata_source": "Primary author or proceedings record and author list on the accessed paper", "author_list_complete": true, "csl_type": "paper-conference", "access_scope": "Primary record and selected accessible full-text sections inspected; no exhaustive supplementary-material audit.", "version_note": "", "article_slug": "calibration-decision-quality", "source_article_slug": "calibration-decision-quality" } ], "original_source_url": "/guides/assets/v9-deep-learning-articles-calibration-decision-quality-json-e4d4e96d56456ea4.json", "pdf": { "document_id": "1e9a14fa-edf3-53ce-91bf-03cadc5bd19a", "version_id": "3fb5079b-281b-5de6-a376-6367433aa704", "media_type": "application/pdf", "authentication_required": true, "download_audited": true }, "presentation_change": "Complete version-bound translated reading views and selectable authenticated original/translated PDFs; original scientific text and evidence retained.", "source_locale": "en", "source_version_id": "e488c243-c752-5ff3-8057-9fadb7841c7f", "translations": [ { "locale": "zh", "translation_id": "d320f2fa-8fc6-51e5-b13d-3fb54c272c86", "translated_content_sha256": "3131f9342162915149f6b2df51ac12ff0d0b5265cb2c4eff62b7df4b1e9a1a20", "sha256": "263249ff086d1ea9fd171ddbf8ec75099574aa22accaf910a5a13e1e15e6f4aa", "byte_length": 904661 }, { "locale": "es", "translation_id": "4270bb8a-6f4b-5578-a380-e7e363951028", "translated_content_sha256": "23a0d8450fe9b9545f552e0c635e6e674468394def8a60e08fc07bb3ffca5351", "sha256": "5aa92bbe4baa5f8f4fff3acfd632909fe4877bd83151143f7ea01c76b8044450", "byte_length": 671203 }, { "locale": "ja", "translation_id": "5f435907-93d5-59c7-9e6e-94783dc65045", "translated_content_sha256": "3d3e6b865dc97c6f963ad0744234ff6313eddfea3d9005a0676c8529f8212a6c", "sha256": "9bd14f8ed03b518a47c2413c5583240242ffccd8971c74918ad9d723b45299a2", "byte_length": 860290 }, { "locale": "ar", "translation_id": "96f33bd1-aa1d-52c7-8aea-e7a2807d0102", "translated_content_sha256": "01a7767f9aa21b561e12db5639890c202a91b65a34d42f919c09c84d5336d6e2", "sha256": "0ba7dad8f672e69e39374fdc11970a68d45b1fec1a895c0c00bfdeb081000f9e", "byte_length": 667412 } ] }