- Suppose are iid and
are iid .
- Find complete and sufficient statistics.
- Find UMVUE's of and .
- Now suppose you know that . Find UMVUE's of
and of . (You have already found
the UMVUE for .)
- Now suppose and are unknown but that you
know that . Prove there is no UMVUE for .
(Hint: Find the UMVUE if you knew with a known.
Use the fact that the solution depends on a to finish the proof.)
- Why doesn't the Lehmann-Scheffé theorem apply?
- Suppose iid Poisson( ). Find the
UMVUE for and for .
- Suppose iid with
for . For n=1 and 2
find the UMVUE of .
(Hint: The expected value of any function of X is a power series in
divided by . Set this equal to
and deduce that two power series
are equal. Since this implies their coefficients are the same you can see what
the estimate must be. )
- Suppose are independent
random variables. (This is the
usual set-up for the one-way layout.)
- Find the MLE's for and .
- Find the expectations and variances of these estimators.
- Let be the error sum of squares in the ith cell in the
previous question.
- Find the joint density of the .
- Find the best estimate of of the form in the sense of mean squared error.
- Do the same under the condition that the estimator must be unbiased.
- If only are observed what is the MLE of ?
- Find the UMVUE of for the usual one-way layout model,
that is, the model of the last two questions.
- Exponential families: Suppose are iid with density
- Find minimal sufficient statistics.
- If are the minimal sufficient statistics show
that setting and solving gives the
likelihood equations. (Note the connection to the method of moments.)
- In question ? take for all i and let . What happens to
the MLE of ?
- Suppose that are independent random variables
and that are the corresponding values of some covariate.
Suppose that the density of is
where , and are unknown parameters.
- Find the log-likelihood, the score function and the Fisher information.
- For the data set in /home/math/lockhart/teaching/801/data1 fit the
model and produce a contour plot of the log-likelihood surface, the profile
likelihood for and an approximate 95% confidence interval for
.
- Consider the random effects one way layout. You have data
and a model where the 's are iid
and the 's are iid .
- Write down the likelihood.
- Find minimal sufficient statistics.
- Are they complete?
- Find method of moments estimates of the three parameters.
- Can you find the MLE's?
- For each of the doses a number of animals are treated with the corresponding dose of some drug. The
number dying at dose d is Binomial with parameter h(d). A common model
for h(d) is
- Find the likelihood equations for estimating and .
- Find the Fisher information matrix.
- Define the parameter LD50 as the value of d for which h(d)= 1/2;
express LD50 as a function of and .
- Use a Taylor expansion to find large sample confidence limits for LD50.
- At each of the doses -3.204, -2.903, 2.602, -2.301 and -2.000 a sample
of 40 mice were exposed to antipneumonococcus serum. The numbers surviving
were 7, 18, 32, 35, and 38 respectively. Get numerical values for the theory
above. You can use glm or get preliminary estimates based on linear
regression of the MLE of against dose.
- Suppose are a sample of size n from the density
In the following question
the digamma function is defined by
and the trigamma
function is the derivative of the digamma function. From
the identity you can deduce
recurrence relations for the digamma and trigamma functions.
- For known find the mle for .
- When both and are unknown what equation must be
solved to find , the mle of ?
- Evaluate the Fisher information matrix.
- A sample of size 20 is in the file
/home/math/lockhart/teaching/801/gamma.
Use this data in the following questions. First take and find
the mle of subject to this restriction. - Now use and to
get method of moments estimates and for
the parameters.
- Do two steps of Newton Raphson to get MLEs.
- Use Fisher's scoring idea to redo the previous question.
- Compute standard errors for the MLEs and compare the difference
between the estimates in the previous 2 questions to the SEs.
- Do a likelihood ratio test of .