J
OURNAL DE
T
HÉORIE DES
N
OMBRES DE
B
ORDEAUX
M
AURICE
M. D
ODSON
Shannon’s sampling theorem, incongruent residue
classes and Plancherel’s theorem
Journal de Théorie des Nombres de Bordeaux, tome
14, n
o2 (2002),
p. 425-437
<http://www.numdam.org/item?id=JTNB_2002__14_2_425_0>
© Université Bordeaux 1, 2002, tous droits réservés.
L’accès aux archives de la revue « Journal de Théorie des Nombres de Bordeaux » (http://jtnb.cedram.org/) implique l’accord avec les condi-tions générales d’utilisation (http://www.numdam.org/conditions). Toute uti-lisation commerciale ou impression systématique est constitutive d’une infraction pénale. Toute copie ou impression de ce fichier doit conte-nir la présente mention de copyright.
Article numérisé dans le cadre du programme Numérisation de documents anciens mathématiques
Shannon’s
sampling
theorem,
incongruent
residue
classes and
Plancherel’s theorem
par MAURICE M. DODSON
Dedicated to Michel Mendis F’rance for his 65th birthday
RÉSUMÉ. On montre que la théorie de
l’échantillonnage
pour lessignaux
multi-canaux a une structurelogique
qui s’apparente
à celle del’analyse
de Fourier.ABSTRACT.
Sampling
theory
for multi-bandsignals
is shown tohave a
logical
structure similar to that of Fourieranalysis.
1. Introduction
In the rich and varied
landscape
ofmathematics,
Fourieranalysis
occu-pies
agrand
and formalgarden
(see
Figure
1).
There is a corner of thisgarden,
which bordersinterpolation theory
andPaley-Wiener theory,
calledsampling
theory.
This is not concerned with statistics but with informa-tiontheory,
moreprecisely
with Shannon’s second orsampling
theorem.Sometimes known as the Whittaker-Kotel’nikov-Shannon
theorem,
it is acornerstone of communication
theory, providing
a mathematical basis for anequivalence
betweenanalogue
(or continuous)
signals
and discretesig-nals.
In
applications,
the main purpose of Shannon’ssampling
theorem is to reconstruct asignal
from discretesamples.
The theorem fallsnaturally
into thetheory
ofsquare-integrable
functions and isclosely
related toPaley-Wiener
theory.
Adisjoint
translates condition on the Fourier transformof the
signal
underlies Shannon’ssampling
theorem and leads to a moregeneral
theory
sometimes called multibandsignal
theory
(see §3) .
Plancherel’s theorem is one of the fundamental results in Fourier
analysis
and
implies
Parseval’stheorem,
which in turnimplies
the convolutionthe-orem. These three results are,
however, logically equivalent
and each could beregarded
as thestarting
point
of thetheory
of Fourieranalysis.
Themultiband
theory
has a similarlogical
structure in whichhybrid
versions of the above threetheorems,
together
with the null intersection conditionFIGURE 1. The three fundamental results in Fourier
analy-sis with Plancherel’s theorem at the ’entrance’.
(see
(5) below)
and a reconstruction orrepresentation
formula(see (4)
be-low),
are alsoequivalent.
This isproved
fortrigonometric polynomials
which are a finite dimensional
counterpart
of continuoussignals.
2. Shannon’s
sampling
theoremAn
analogue
signal
can be modelledby
a functionf :
R - C(when
f
is a real
signal,
f(R)
CR).
Forphysical
reasons, it is assumed thatf
issquare-integrable
or has finite energy,i.e.,
= oo. Thespectrum
off
isgiven by
the Fourier transformf ^ :
C,
whereand where
f^
is defined as a limit iff 0
L1(lI2).
It is usual to assume thatvibrations in a
physical
system
cannot be infinite and so thefrequencies
of
analogue signals
are taken to be bounded above.Signals
with boundedspectra
are called band-limited and have therepresentation
where W is the maximum
frequency
(strictly
speaking
W is thesupre-mum of the
frequencies,
atechnicality
which isusually
disregarded).
Thesampling
theoremgives
thefollowing
formula for the reconstruction of aband-limited
signal
f
with maximumfrequency
W in terms of the discrete values orsamples
f (k/2W).
For each t E1R,
The formula
(1)
corresponds
to asampling
rate of 2W(often
called theNyquist
rate,
twice the maximumfrequency
of thesignall).
As well as its
significance
in informationtheory
andengineering
[17],
thetheorem has a
long history
and has beenproved
manytimes,
forexample
by
E.Borel,
E. T.Whittaker,
V. A.Kotel’nikov,
K. S.Krishnan,
H.Raabe,
I.Someya
to name a selection(more
names can be found in the articles citedbelow).
However,
Shannon was the first toappreciate
thesignificance
of the result in his fundamental and definitive papers[23,
24]
on thetheory
ofcommunication
(more
details can be found in the survey articles[6,
8,
10,
14]
and the books
[15,
21]).
The article[10]
establishes theequivalence
of thesampling
theorem toCauchy’s
theorem and includes other results fromanalysis;
see[16]
also for further results.Whittaker
proved
the result from thepoint
of view ofinterpolation
the-ory[25]
andessentially
established formula(1)
for a class ofanalytic
func-tions
(which
he called the Cardinal function orseries).
This assumedgiven
values at
regular
intervals and was free of’rapid
oscillations’. As well asthe connection with
interpolation
theory,
there are also connections withPaley-Wiener
theory
and Fourieranalysis
(for
example
(1)
isequivalent
to the Poisson summation formula and the result also arisessurprisingly
often in other branches of mathematics[8,
19,
22]).
3. A
generalisation
of Shannon’ssampling
theoremThe formula
(1)
can beproved using
the observation that translates[-W, W]
+2Wk,
k EZ,
of thesupport
[-W, W]
of the Fourier transformfA
off essentially
tessellate III This leads to a multibandgeneralisation
ofthe
sampling
theorem to functionsf
with Fourier transforms which vanish outside a measurable set A that satisfies thedisjoint
translates conditionThis condition
implies
that theLebesgue
measure of A is at mostI /s
[11] (see §4).
For such functionsf
a moregeneral
version ofShan-non’s
sampling
theorem holds.Theorem 1. Let A be a measurable subset
of
R and suppose that there exists an s > 0 such that(2)
holds. Letf
E be continuous and suppose that the Fouriertransform
f ^
of
f
vanishes outside A. Then1 That a signal can be reconstructed from samples taken at this rate was referred to by Shannon
and
for
each te ll§
where the series converges
absolutely
anduniformly.
A
proof
of this theorem and further references to earlier results aregiven
in
[11]
where theapproach
is based on squareintegrable
functions cp : R -+ Cwhich vanish outside A. A more
general
result for stochastic processes wasobtained
by
S. P.Lloyd
who showed that thedisjoint
translates conditionwas
equivalent
to a random variablebeing
determinedby
a linearcombina-tion of the
sample
values[20].
For ageneralisation
of Theorem 1 to abstract harmonicanalysis,
see[1,
12,
18].
P. L. Butzer and A.Gessinger
note in[7]
that the formula(3)
with A =(-W, W)
implies
the Shannon’ssampling
theorem.
Equally,
one can first prove the formula(1)
and then deduce(3)
with s =
1/2W,
as in[24]
or in the abstract harmonicanalysis
version[18].
When
f
is notcontinuous,
convergence in norm can be deduced from anorthogonality
argument
[18].
A commonapproach
is to use the fact thatthe set k E
7G}
is anorthogonal
basis forL2(-W,W)
and thatfor almost
all q
E(-W,W).
The result follows ontaking
the inverseFourier transform and
observing
that ak =f (k/2W)/2W.
The form of(4),
however,
suggests
convolution. This observation is the basis of theparallel
between thelogical
structures ofsampling
theory
and Fourieranalysis.
4.
Spectral
translatesThe set A considered here need not be an interval but any measurable set such that distinct translates have null
intersection,
i. e.,
for each non-zeroThe
possibility
of Acontaining
unboundedfrequencies
is not excluded. For this reason, thePaley-Wiener setting,
although
closely related,
is not suitable.The
translation -y
Hy + kls
can beregarded
as an actionby
the additivegroup
Z/ son
k Orbits or cosets =Z}
aredisjoint
and thefactor group
R/(Z/s)
has(0,1/s)
as acomplete
set of cosetrepresentatives
where
ka
is theunique integer
such that a +ka/s
E(0,1/s).
Thenv(y)
is theunique
element in the orbit+ 7
which falls in(0,1/s).
Thus v iswell
defined,
= andThe restriction map
viA:
A -(0,1/s)
is one-one almostalways by
(5)
since
v(a)
=v(a’)
implies
thata-a’
EZ /s.
The functionVIA
is translationby
aninteger multiple
of1/s
and so5.
Plancherel-type
theorems and thegeneral sampling
theorem When the set A satisfies(5)
for some s >0,
the map 1,: ~4 -~(0,1)
given
by
where
fxl
= x -[x]
is the fractionalpart
of x(~~)
is theinteger
part
ofx),
is aninjection
which preserves innerproducts
for almost all a E A. IfIAI
=1/s,
then t is abijection
for almost all a E A. Thus the set(which
will be denotedL2(A))
of cp
Ewith cp vanishing
almosteverywhere
outside A isisomorphic
toL~([0,1)).
In the case of Shannon’stheorem,
the
isomorphism
issimply
arescaling.
When1/s,
one can consider anauxiliary
set A which satisfies(5)
withJAI
and 6:h -
[0, 1)
anisomorphism
almosteverywhere.
The naturalembedding
ofL2(A)
(C
L2 (A) )
intoL 2([0,1))
iswhy
results insampling theory
are a mixture ofFourier series and transforms.
Plancherel’s theorem asserts that the Fourier transform is an
isometry
onL (R) ;
(3)
alsoimplies
that the map p:L (R)
-3£2(sZ)
given by
where is the restriction of
f :
to is also anisometry.
Fromthe
point
of view ofsignals,
the norm can beregarded
as energy and thepreservation
of norm can beinterpreted
as conservation of energy betweenthe
original
signal
and its values(samples)
on sZ. The factor s is the timeinterval between
samples
and sokeeps
the dimensions of the two sides of(3)
consistent.From now on the set A C R will be assumed to have
positive Lebesgue
measure. The functions
f :
1R --i- C will be restricted tobeing
continuous,
as otherwise
nothing
can be said about values on sets of measure zero. Theinverse Fourier transform
of cp
EL2(JR)
will be denotedby
cpv,
i. e.,
where if
L1(JR),
cp
is defined as the usual limit. IfIAI
oo, then thetransform
given
by
is continuous. Let
for almost
all y / A}.
The
equivalence
of the null intersection translates condition to theana-logues
of the three classical results of Fourieranalysis
is now stated(a
proof
is in[2]).
Theorem 2. Let A be a
Lebesgue
measurable subset and s be apositive
real number. Then the
following
areequivalent.
(1)
For each non-zeroanteger
kwhere the series converges to
f
* gabsolutely
anduniformly.
Note that
(II)
canregarded
as a’hybrid’
version of the classicalPlancherel theorem since
by
(11),
and
similarly
(III)
and(IV)
are versions of the Parseval and convolutiontheorems.
The
proof
that(I)
implies
(II)
relies ongoing
a littledeeper
andcon-sidering
the setA
which contains A and hasLebesgue
measure1/5,
to obtain theorthogonality
necessary for(11).
Theproof
that(II)
implies
(III)
is on the same lines as the standard treatment in functionalanalysis
in which Plancherel’s theorem isregarded
as fundamental and the precursorto Parseval’s theorem and the convolution theorem
(they
are of course allequivalent).
Recall thatf
E is assumed to be continuous and thatfA
E vanishes almosteverywhere
outside A. Condition(I)
implies
that1/s
but noexplicit
use is made of this in Theorem 2.5.1. The reconstruction formula and the translates condition. The
equivalence
of the reconstruction formula and the translates condition fol-lows from Theorem2;
the estimate1/s
implied by
(10)
is usedexplicitly.
Lloyd
hasproved
a similar but moregeneral
result forstochas-tic processes
[20,
Theorem1].
Thenecessity
of the translates condition is related to thephenomenon
of’aliasing’
[5].
Theorem 3. Let A be a measurable subset
of
R and s E Then thefollowirag
areequivalent.
(I)
For each non-zerointeger
k(II)
lls
andfor
eachf
ESA,
(III)
X’
ESA
and eachf
ESA
isgiven by
where the series converges to
f
absolutely
anduniformly.
Since
1/s
implies
that(III)
follows from(II)
and so XA EL (R)
n L (R),
whencex i
is continuous andxi
Ei.e.,
XA
ESA.
Therepresentation
(4)
now follows fromthe
hybrid
convolution theoremapplied
to theequation
6.
Trigonometric
polynomials
Trigonometric polynomials
are the finite dimensionalcounterpart
ofsquare
integrable
functions. The version of Shannon’ssampling
theorem for such functions isgiven
in[13]
and is as follows.Theorem 4. Let
f :
lE8 ~ ~ be1-periodic
and letwhere cn = 0
for
Inj
> 0. ThenThe
counterpart
ofparts
(I)
and(III)
of Theorem 3 is a moregeneral
formof Theorem
4,
which will be stated andproved
to illustrate thearguments
withoutanalytic
technicalities.Theorem 5. Let p, q be
positive
integers,
let J ={jI,... ,
jp}
C Z and letwhere cj = 0
for j §
J. Then thefollowing
areequivalent:
(I)
For each non-zerointeger
n,.
where the inverse Fourier
transforms
X’
of
Xj isgiven by
Proof.
First(I)
implies
(II).
Forgiven m~Z,0~m~~20131,
considerThen
where
1p X p
is the p x p unit matrix. Butby
(18),
whenk l ,
and the formula in
(II)
follows onsubstituting
for c; in(17)
andusing
thedefinition of
Xvj.
Next
(II)
implies
(I).
By definition,
fA
isgiven by
Each r E Z can be
expressed
as r = p + nq, forunique n
E Z and p,0
p q. Then sincef
satisfies(19)
and since the Fourier transform off (t -
c)
is k EZ,
it follows thatTake
f
=Xv
so that for each t E R and k EZ,
Now for k E
J,
Xj(k)
= 1.Suppose
ko
=lo
+ qno E J. ThenOf course the coefficients cj could be determined
by
solving
the q linearequations in p
(~ q)
unknowns but theequal spacing
of thesamples
m/q
and theincongruence
condition allows the use of thesimpler
Hermitianconjugate
instead ofsolving
asystem
of linearequations.
Theorem 4 followsby putting
J ={-N,
... ,
N}
and p = q = 2N + 1.To prove the
hybrid trigonometric polynomial analogue
of Plancherel’s theorem(corresponding
topart
(II)
in Theorem3),
further consideration must begiven
to the set J which has to be extended to acomplete
set J of residues mod q, so that(J)
= q. Since J CJ,
the Fourier transformf
of the
1-periodic
functionf certainly
also vanishes outside J. Consider=
0, ... , q -
1 runs over acomplete
set of residues modulo where Jk i
-q and M =
(e21ri3km/q)
is a q x q matrix. The aboveargument
and theRiesz-Fischer theorem
give
The usual
argument
involving
thepolarisation
identity
can be used to prove that thisimplies
(II).
It is
implicit
in Theorem 2 and 3 above that if thesampling
theorem holds for all functionsf
ESA
with Fourier transformsupported
throughout
A,
then the null measure translates condition holds and thesampling
theoremholds for each
f
ESA. However,
it is shown in[2]
that there exist sets A7. Conclusion
Instead of the usual
spectral
translates conditions(2)
or(5)
infrequency
space, the
hybrid
Plancherel theorem(15)
can beregarded
as a basis forthe
general
sampling theorem,
allowing
sampling theory
to begiven
alog-ical structure similar to that of Fourier
analysis,
with thehybrid
versions of Plancherel’stheorem,
Parseval’s theorem and the convolution theorem at the centre(note
that the theorems must hold for all functions inS’A).
Thus insampling theory,
each of the theorems inFigure
1 isreplaced by
itshybrid
version,
so that in thisapproach,
thetheory
begins
with thehy-brid Plancherel theorem which
by
Theorem 2 leads to and from thehybrid
Parseval theorem and thehybrid
convolution theorem. This leadsby
The-orem 3 to the translates condition and to the
general
sampling
theorem. The translates condition and thegeneral sampling
theorem lead back to thehybrid
Plancherel theorem(15),
completing
theequivalence.
In addition Shannon’s theoremtogether
with the finiteness of the measure of Aimply
the translates
condition,
which in turnimplies
thehybrid
Planchereltheo-rem. The conventional view of
sampling theory
wouldplace
the translatescondition at the entrance of the
garden.
As has been
pointed
out,
providing
thesampling
interval s satisfies(5),
the formula(3)
can beinterpreted
as the energy of theoriginal
signal being
conserved in the
samples
(the
information is alsoconserved,
in the sensethat the
original signal
can be recovered - inprinciple -
from thesamples) .
The
step
functionapproximation a:
R - C tof
isgiven by
It is immediate that its energy
and
hence,
providing s
satisfies(5),
Thus the energy of the
original
signal
and that of a are the same,although
the
support
of~^
is R(for
non-zerosignals)
and so contains A. Moreoverthe information is
preserved
aswell, again
in the sense that theoriginal
signal
can be recovered inprinciple
from the values of ~.However,
for agiven
signal,
conservation of energy alone is not sufficient to allow itscomplete
reconstructionusing
thesampling
formula(4).
Shannon’s theorem can be viewed as the result of
passing
a train ofan ideal
low-pass
filter. Inpractice, however,
perfect impulses
and idealfilters do not exist and the theorem cannot be
implemented;
thus the for-mula(1)
is not often useddirectly.
Forexample,
digital-to-analogue
con-version in
signal
processing replaces
theweighted
impulses
indicatedby
the theorem with astep
function in which successivesteps
haveamplitude
of successive
sample
values. Thestep
functionapproximation a
is used inpassing
from adigital signal
to ananalogue signal
aA =produced by
filtering
out allfrequencies
except
those in A(see
[4]).
This reduces the energy of thesignal
but when A is an intervalsymmetric
aboutthe
origin,
Shannon’ssampling
theorem can be used to show that that theerror is
negligible
when exceeds theNyquist
rate.Placing
thesampling
theorem in the abstract harmonicanalysis setting
reveals moreclearly
theunderlying
groupstructure,
thereciprocal
characterof the discrete
sampling subgroup
and the discrete group oftranslates,
aswell as the
relationship
between thesupport
of the Fourier transform andthe
sampling
interval[1,
3,
12].
8.
Acknowledgements
Thanks are due to Jean-Paul
Allouche,
Christophe
Doche andJean-Jaques
Ruch fororganising
a veryinteresting
andenjoyable colloquium
in honour of
Michel,
agifted
mathematician ofgreat
humanity
andabili-ties,
with agentle
wit and interests wider thansimply
mathematics. I amgrateful
to him for his interest in thistopic.
I am alsograteful
to MichaelBeaty
and RowlandHiggins
for manyhelpful
discussions,
to acommend-ably
thorough
referee and to Simon Kristensen formaking
thefigure
somuch better.
References
[1] M. G. BEATY, M. M. DODSON, Abstract harmonic analysis and the sampling theorem. In
Sampling theory in Fourier and signal analysis:Advanced topics (eds. J. R. Higgins and R. L.
Stens), Oxford University Press, 1999, 233-265.
[2] M. G. BEATY, M. M. DODSON, Shannon’s sampling theorem, Plancherrel’s theorem and
spectral translates, preprint, University of York, 2002.
[3] M. G. BEATY, M. M. DODSON, Shannon’s sampling theorem and abstract harmonic analysis,
preprint, University of York, 2002.
[4] M. G. BEATY, M. M. DODSON, J. R. HIGGINS, Approximating Paley-Wiener functions by
smoothed step functions. J. Approx. Theory 78 (1994), 433-445.
[5] M. G. BEATY, J. R. HIGGINS, Aliasing and Poisson summation in the sampling theory of
Paley-Wiener spaces. J. Fourier Anal. Appl. 1 (1994), 67-85.
[6] P. L. BUTZER, A survey of the Whittaker-Shannon sampling theorem and some of its
ex-tensions. J. Math. Res. Exposition 3 (1983), 185-212.
[7] P. L. BUTZER, A. GESSINGER, The approximate sampling theorem, Poisson’s sum formula, a decomposition theorem for Parseval’s equation and their interconnections. In The Heritage of P. L. Chebyshev: a Festschrift in honor of the 70th birthday of T. J. Rivlin, Ann. Numer. Math. 4 (1997), 143-160.
[8] P. L. BUTZER, M. HAUSS, R. L. STENS, The sampling theorem and its unique role in various
[9] P. L. BUTZER, J. R. HIGGlNS, R. L. STENS, Sampling theory of signal analysis. In:
Devel-opment of mathematics 1950-2000, Birkhäuser, Basel, 2002, 193-234.
[10] P. L. BUTZER, G. SCHMEISSER, R. L. STENS, An Introduction to Sampling Analysis. In:
Nonuniform Sampling, Theory and Practice (ed. F. Marvasti), Kluwer Academic/Plenum
Publishers, New York, 2000, Chapter 2, 17-121.
[11] M. M. DODSON, A. M. SILVA, Fourier analysis and the sampling theorem, Proc. Royal Irish Acad. 85A (1985), 81-108.
[12] M. M. DODSON, A. M. SILVA, V. SOUCEK, A note on Whittaker’s cardinal series in harmonic
analysis. Proc. Edinb. Math. Soc. 29 (1986), 349-357. [13] S. GOLDMAN, Information Theory. Dover, New York, 1968.
[14] J. R. HIGGINS, Five short stories about the cardinal series, Bull. Amer. Math. Soc. 12 (1985), 45-89.
[15] J. R. HIGGINS, Sampling theory in Fourier and signal analysis: Foundations. Clarendon
Press, Oxford, 1996.
[16] J. R. HIGGINS, G. SCHMEISSER, J. J. VOSS, The sampling theorem and several equivalent
results in analysis. J. Comput. Anal. Appl. 2 (2000) 333-371.
[17] A. J. JERRI, The Shannon sampling theorem - its various extensions and applications: a
tutorial review. Proc. IEEE 65 (1977), 1565-1596.
[18] I. KLUVÁNEK, Sampling theorem in abstract harmonic analysis. Mat.-Fyz.
Gasopis
Sloven. Akad. Vied. 15 (1965), 43-48.[19] K. S. KRISHNAN, A simple result in quadrature. Nature 162 (1948), 215.
[20] S. P. LLOYD, A sampling theorem for stationary (wide sense) stochastic processes. Trans.
Amer. Math. Soc. 92 (1959), 1-12.
[21] R. J. MARKS II (ed.), Advanced topics in Shannon sampling and interpolation theory.
Springer-Verlag, New York, 1993.
[22] Q. I. RAHMAN, G. SCHMEISSER, The summation formulae of Poisson, Plana, Euler-Maclaurin and their relationship. J. Math. Sci. 28 (1994), 151-171.
[23] C. E. SHANNON, A mathematical theory of communication. Bell System Tech. J. 27 (1948),
379-423, 623-656.
[24] C. E. SHANNON, Communication in the presence of noise. Proc. IRE 37 (1949), 10-21. [25] E. T. WHITTAKER, On the functions which are represented by the expansions of the
inter-polation theory. Proc. Roy. Soc. Edinburgh, 35 (1915), 181-194. Maurice M. DODSON Department of Mathematics University of York York Y010 5DD United Kingdom E mail : mm.d1Iyork.ac . uk