The usual local central limit theorem provides an approximation for the probability for an iid sequence . The approximation is proportional to the lattice size of the underlying distribution of the and is not a continuous function of the underlying distribution. The probability in question is a continuous function of this underlying distribution and so the approximation cannot be good uniformly in the class of possible distributions for the . Approximate likelihood methods demand uniform approximations; in this section we provide such an approximation. We are unable to handle the case of distributions nearly concentrated on a single point gracefully. Moreover, it is convenient to impose the stringent hypothesis that all distributions studied be supported on a fixed finite set of indices for some fixed . Fix and let be the set of all probability distributions supported on the integers such that and such that for and . The conditions guarantee that the variance (where it seems convenient we indicate explicitly the dependence of the mean and variance on the underlying distribution in question) of the distribution is bounded away from over and that each in has a lattice size dividing . (Note that could be replaced throughout by the least common multiple of .) If are independent integer valued random variables write where are integer valued random variables and . That is, is the residue class modulo of the sum. Our theorem is that is approximately normal and that and are approximately independent, uniformly for probabilities in . The distribution of is available via an expression which may be computed analytically for small values of and approximately in some other cases. Let be the characteristic function of . Let for . Then
In later sections the computability of the approximation is of less importance than the formal nature of the approximation.
We begin with the weaker form of the theorem
For a single fixed the asymptotic distribution of is uniform on the set of possible residue classes and so the result can be converted to an approximation of the conditional distribution of given - a trivial consequence of the usual local central limit theorem. However, under the condition that the variates are bounded the conditional form of the result is also valid uniformly in .
The local central limit theorem is established by analyzing the inversion formula for the characteristic function. We prove Theorem 1 following Petrov(??) taking care to make error estimates uniform.
The Fourier inversion formula is
where is the characteristic function of and . We will split the range of integration into a number of pieces and bound some and expand others. Define for and let where
It follows from the lemma that
for every
such that
.
The integral over
will be broken into two pieces, integrating separately over
and the complement
where
is the sequence
Over
we will expand the function
about
. Over
we will use the following extension of Cramér's lemma.
It follows from the lemma that
In the usual proof of the local central limit theorem either the quantity
less than 1 and therefore the integral over
is exponentially small or
and the integral over
is identical to that over
where a standard Taylor expansion is used. To get a uniform result, however, we must contemplate the
where
is slightly less than 1 so that neither of the two cases just mentioned is applicable.
Thus for any
such that
we have
Consider now a
for which
. Define
(For
the ratios in the logarithm are uniformly close to 1 permitting use of the principal branch of the logarithm throughout the following.) We can write, for
, using a Taylor expansion
where
where
and, for all
so large that
,
Define
and
Then since
we have
for all
larger than some integer
depending only on
and
.
On
the quantity
is bounded by
so that On the set
we have the Taylor expansion
where
for every
.