Mathematical Statistics I · Bias, risk, consistency, and point estimation
Invariance moves the MLE but not the UMVUE
Problem
Let $X_1,\ldots,X_n$ be independent $\operatorname{Bernoulli}(p)$ observations, $0\le p\le1$, $n\ge2$, and let $g:[0,1]\to\mathbb R$ be any function, not necessarily injective. Let $\hat p$ be a maximizer of the Bernoulli likelihood. Prove that $g(\hat p)$ maximizes the induced likelihood for the target $\tau=g(p)$. State the induced-likelihood definition you use so that the claim remains valid when $g$ is not one-to-one. Take $g(p)=p(1-p)$. Write the MLE of $p(1-p)$ explicitly in terms of $\bar X$. Then compute $\mathbb E_p[\bar X(1-\bar X)]$ and produce an unbiased estimator of $p(1-p)$. Explain why invariance does not force that unbiased estimator to equal the MLE, and why a UMVUE need not be a function $g(\hat p)$ of the MLE of $p$. Do not treat this as a test of $H_0:p=p_0$, and do not Rao–Blackwellize a Poisson zero count.
Hint
If $L(\hat\theta)\ge L(\theta)$ for every $\theta$, then the supremum of $L$ over each $g$-fiber is attained at a fiber containing $\hat\theta$.
Check your work
Work the problem yourself first. Then open it in Training to check your answer and read the full worked solution.
The answer check and full solution for this problem come with ProofAnvil Practice membership ($19 USD monthly). See membership. Or start with the free Mathematical Statistics I sample problem: Try the free sample problem.
More Mathematical Statistics I practice problems
- A parametric model is a collection of probability laws indexed by a parameterParametric models and sampling distributions
- For a family of densities or mass functions with respect to one fixed dominating…Sufficiency, completeness, and exponential families
- An iid Bernoulli sample of size n ≥ 1 contains K successesLikelihood, score, and Fisher information
- A hidden state θ is either zero or oneLoss, risk, and introductory decision theory
- A Cauchy mean is another Cauchy, so the average does not settleParametric models and sampling distributions
- A complete exponential sum yields the survival UMVUESufficiency, completeness, and exponential families
- The unbiased sample variance is not the MSE winnerBias, risk, consistency, and point estimation
- Bernoulli information identities hold, then the bound can vanishLikelihood, score, and Fisher information
- A known-scale normal mean has a nonrandom interval lengthPivots and confidence sets