Mathematical Statistics II · Bayesian inference and decision rules
Choosing a model and then reporting its conditional credible interval can discard a…
Problem
Choosing a model and then reporting its conditional credible interval can discard a substantial part of the posterior uncertainty. Quantify the effect in a small example. Suppose \[ \theta\sim0.8\,\delta_0+0.2\,N(0,1), \qquad Y\mid\theta\sim N(\theta,1), \] where \(\delta_0\) denotes a point mass at zero. You observe \(Y=3\). You may use the following full posterior without rederiving it: \[ \Pi(\,\cdot\mid Y=3) =(1-w)\delta_0+wN(m,s^2), \quad m=\frac32,\quad s^2=\frac12,\quad w=\frac{e^{9/4}/\sqrt2}{4+e^{9/4}/\sqrt2}. \] Let \(\Phi\) be the standard normal CDF and \(z=\Phi^{-1}(0.975)\). An analyst selects whichever posterior component has the larger probability. Identify the selected component, construct its conditional central \(95\%\) interval, and calculate that interval's probability under the **full** posterior. Next, let \(F\) be the CDF of the full posterior and define its left quantile by \[ Q(u)=\inf\{x:F(x)\ge u\},\qquad 0<u<1. \] Find the central quantile interval \([Q(0.025),Q(0.975)]\) and its actual full-posterior probability. Account explicitly for the atom at zero. Compare the two intervals, keeping posterior probability distinct from frequentist coverage.
Hint
First check which component is selected and whether its central interval includes zero.
Check your work
Work the problem yourself first. Then open it in Training to check your answer and read the full worked solution.
The answer check and full solution for this problem come with ProofAnvil Practice membership ($19 USD monthly). See membership. Or start with the free Mathematical Statistics II sample problem: Try the free sample problem.
More Mathematical Statistics II practice problems
- A multiple-testing procedure makes R rejections, of which V are rejections of true null…Neyman-Pearson testing and power
- A list can have a controlled expected fraction of false discoveries while a shorter…Neyman-Pearson testing and power
- Let X₁,X₂,… be iid with mean μ and variance 0<σ²<∞Consistency, asymptotic normality, and delta methods
- Let X₁,…,Xₙ be iid N(θ²,1), with parameter θ ≥ 0Consistency, asymptotic normality, and delta methods
- A categorical probability vector (P₁,P₂,P₃) has a Dirichlet prior with parameters (1,2,3)Bayesian inference and decision rules
- Let X be a fixed n×p matrix with linearly independent columns, and let y ∈ ℝⁿLinear models and projection geometry
- Let X₁,…,Xₙ be iid from an arbitrary continuous distributionRank and distribution-free methods
- All random variables below are square-integrable and centered: 𝔼[x]=𝔼[z]=𝔼[y]=0Linear models and projection geometry
- The sample is x=(1,2,4) with n=3Bootstrap, permutation, and simulation-based inference