Journal Article
Discussion on the paper by Spiegelhalter, Best, Carlin and van der Linde
Gelfand, A. E.2002
Trevisani, M.
Top 5% · 95th percentile
12,821 citations · Statistics and Probability

TLDR

This paper talks about a way to check how well a statistical model fits data and how complicated it is, using a method that helps people compare different models more fairly.

Summary

1 Study Aim

The main aim of this discussion paper is to examine and comment on the approach proposed by Spiegelhalter, Best, Carlin, and van der Linde for measuring how well Bayesian statistical models fit data. The authors focus on the use of the posterior mean deviance (the average difference between observed and predicted data, calculated using Bayesian methods) as a measure of model adequacy, and they discuss how individual data points contribute to both the fit and complexity of a model. The paper's goal is to explore and clarify a new way to judge if a statistical model is good enough.

2 Study Design

This work is a discussion paper, not an original research study with experiments or data collection. The authors analyze and critique the methodology introduced by Spiegelhalter and colleagues. They focus on the mathematical and conceptual aspects of using the posterior mean deviance in Bayesian model assessment. The discussion includes how to break down the overall fit into contributions from each observation and how to visualize these using diagnostic plots of deviance residuals (differences between observed and predicted values) against leverages (a measure of each observation's influence on the model). The authors review and discuss a new statistical method, explaining its parts and how it can be used to check models.

3 Findings

The authors highlight that the posterior mean deviance can serve as a useful Bayesian measure for checking how well a model fits the data. They point out that by examining the contributions of individual observations to both the fit and the complexity of the model, researchers can create diagnostic plots that help identify which data points have the most influence or may not fit well. This approach provides a more nuanced understanding of model performance and can guide improvements in model selection and assessment. The discussion suggests that these tools make it easier to compare models and spot potential problems in the data or the model itself. The paper shows that this method helps people see which parts of their data or model might need more attention, making it easier to choose the best model.

Abstract

no abstract