• Aucun résultat trouvé

A Sharp Discrepancy Bound for Jittered Sampling

N/A
N/A
Protected

Academic year: 2021

Partager "A Sharp Discrepancy Bound for Jittered Sampling"

Copied!
28
0
0

Texte intégral

(1)

HAL Id: hal-03203695

https://hal.archives-ouvertes.fr/hal-03203695v2

Preprint submitted on 12 Nov 2021

HAL is a multi-disciplinary open access archive for the deposit and dissemination of sci- entific research documents, whether they are pub- lished or not. The documents may come from

L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de

A Sharp Discrepancy Bound for Jittered Sampling

Benjamin Doerr

To cite this version:

Benjamin Doerr. A Sharp Discrepancy Bound for Jittered Sampling. 2021. �hal-03203695v2�

(2)

arXiv:2103.15712v2 [math.NA] 10 Nov 2021

A Sharp Discrepancy Bound for Jittered Sampling

Benjamin Doerr

Laboratoire d’Informatique (LIX) CNRS

Ecole Polytechnique ´

Institut Polytechnique de Paris Palaiseau

France

November 11, 2021

Abstract

Form, d∈N, a jittered (or stratified) sampling point setP having N = md points in [0,1)d is constructed by partitioning the unit cube [0,1)d into mdaxis-aligned cubes of equal size and then placing one point independently and uniformly at random in each cube. We show that there are constants c >0 andC such that for all dand all m≥dthe expected non-normalized star discrepancy of a jittered sampling point set satisfies

c dmd−21 q

1 + log(md)≤ED(P)≤C dmd−21 q

1 + log(md).

This discrepancy is thus smaller by a factor of Θ 1+log(m/d)m/d 1/2

than the one of a uniformly distributed random point set (Monte Carlo point set) of cardinalitymd. This result improves both the upper and the lower bound for the discrepancy of jittered sampling given by Pausinger and Steinerberger (Journal of Complexity (2016)). It also removes the asymptotic requirement thatm is sufficiently large compared to d.

(3)

1 Introduction

1.1 Star Discrepancy

Thestar discrepancy D(P) of a setP of N points in thed-dimensional unit cube [0,1)d is a measure for the uniformity of the distribution of these points. It is defined by

D(P) := sup

B∈B

|P ∩B| −Nλ(B)

, (1) where λ(·) denotes the Lebesgue measure and B is the set of all axis-parallel rectangles [0, x) := Qd

i=1[0, xi),x= (x1, . . . , xd)∈[0,1)d. We call [0, x) a rectangle anchored in the origin or a box. The star discrepancy thus is a worst-case measure for how well P satisfies the target of having the fair number Nλ(B) of points in each box B.

Evenly distributed points sets and the star discrepancy have found applications in various areas such as machine learning [ASYM16], heuristic search [KM05, OT05, TG07], statistics [FW93], and computer graphics [Owe03]. Most promi- nent is its role in numerical integration, where the Koksma-Hlawka inequal- ity [Kok43, Hla61] bounds the integration error in terms of the star discrepancy:

For all functionsf : [0,1]d→Rhaving variation in the sense of Hardy and Krause bounded by 1, we have

Z

[0,1]d

f(x)dx− 1

|P| X

pP

f(p) ≤ 1

|P|D(P).

We remark that in this work we use the non-normalized version of the star discrepancy as defined above, which is more common in those areas of discrepancy theory that aim at a unified view on discrepancies and exploit connections between different discrepancy notions, e.g., between geometric discrepancies like the star discrepancy and combinatorial discrepancies like hypergraph discrepancies. See the books of Matouˇsek [Mat99] and Chazelle [Cha00] for an introduction to this field. In contexts closer related to numerical integration, motivated by results like the Koksma-Hlawka inequality, a normalized version of the star discrepancy is more common. The normalized star discrepancy is exacty the notion of (1) multiplied by a factor of |P1|. There is little risk of confusion since the normalized version is always at most one and usually far less than one, whereas our notion is at least 1/2 and usually much larger than 1.

1.2 Estimates for the Star Discrepancy

The interest in discrepancies from various research communities has led to a huge body of research (see, e.g., [Cha00, DP10, DT97, Mat99, Nie92]), which we cannot

(4)

fully review here. The classic view on geometric discrepancies is to treat the dimension d as a constant and investigate the asymptotic behavior for growing numbers N of points. In this view, a large number of constructions of point sets has been exhibited that have a discrepancy of D(P) = O(log(N)d1). It is also known that such a polylogarithmic discrepancy cannot be avoided, though the optimal exponent is not known and finding it is a famous open problem, see, e.g., [BL13]. As a side remark, we note that axis-parallel regular grids have a discrepancy of order Θ(N(d1)/d) and uniformly distributed random point sets (Monte Carlo point sets) have a discrepancy of order Θ(√

N), both in expectation and with high probability. Thus both are not competitive when treating d as a constant and looking for asymptotic discrepancy guarantees in terms on N.

From the viewpoint of numerical integration in high dimension, a behavior ex- ponential indlike (logN)d1is not very desirable, since such bounds become inter- esting often only for numbersN of points that are far beyond any practical mean- ing. For this reason, Heinrich, Novak, Wasilkowski, and Wo´zniakowski [HNWW01]

started the quest for discrepancy bounds that both make the dependence ondfully explicit and that give reasonable discrepancy guarantees also when N is only of moderate size compared to d. Interestingly, this brought random constructions back on stage, and in fact, they are at the moment the best constructions in the regime where N is not very large (say exponential) compared to d.

In [HNWW01], Heinrich et al. prove that random point sets have an expected discrepancy of order √

dN, that is, there is a constant C such that for all d and N a set P of N points chosen independently and uniformly at random in [0,1)d satisfiesED(P)≤C√

dN. This is asymptotically tight [Doe14] in the sense that there is a constant c > 0 such that for all d and all N ≥ d the corresponding random point set satisfies ED(P)≥c√

dN.

Determining the leading constant C remains a major open problem. For the upper bound, the original proof of Heinrich et al. does not easily reveal information on C. Aistleitner [Ais11] gave an alternative, more direct proof that also shows that with positive probability,D(P)≤10√

dN. The currently strongest estimate, lowering the 10 to 2.525, is due to Gnewuch and Hebbinghaus [GH21]. For the lower bound, the elementary proof of [Doe14] clearly can be made more precise and then give a reasonable constant, but this has not been done so far.

1.3 Jittered Sampling

Given the success of random point sets, it is natural to think of constructions that employ randomness in a more clever way than just by taking all decisions indepen- dently and uniformly at random. The two most prominent dependent randomized constructions are Latin hypercube samplings [MBC79] and jittered sampling (also calledstratified sampling) [Bel81, CPC84]. While the discrepancy of Latin hyper-

(5)

cube samples was analyzed only recently [DDG18, GH21] in the paradigm of not treatingdas a constant, the first such analysis for jittered sampling was conducted already in 2004.

Assume that we can write N = md for some integer m. To obtain a random N-point setP via jittered sampling, we partition the unit cube [0,1)dintomdaxis- parallel cubes of identical size and, independently, place a uniformly distributed random point in each cube.

We formulate all results in the following in terms ofmandd, and recall that the number N of points isN =md. To ease comparing the different results, we write all bounds with an explicit term √

dmd (or √

md when dis treated as a constant), which is the order of magnitude of the discrepancy of a uniform random point set.

For constantd, Beck [Bec87] showed that the expected discrepancy of such a point set P satisfies

ED(P) =O √ md

rlogm m

! .

In the technical report [DGS04] (also described in [Gne12, (28)]), an upper bound of

O √

dmd

slogN m/d

!

=O √

dmd s

dlogm m/d

!

was shown. This bound extends the result of Beck [Bec87] to non-constant d, but the dependence of the discrepancy on d is weak due to use of the (as we know from [Gne08]) non-optimal δ-covers from [DGS05] and the absence of Aistleit- ner’s [Ais11] dyadic chaining method.

A significant improvement of the dependence ondand the first lower bound was presented by Pausinger and Steinerberger [PS16], who proved that for all d ∈ N and m sufficiently large relative to d,

1 10

√dmd s 1

m/d ≤ED(P)≤√ dmd

slogm

m/d . (2)

It is not stated in the paper for which values ofm and d this bound is valid, that is, what “m sufficiently large compared to d” precisely means, and the authors state it as an open problem to overcome this asymptotic requirement.

Concerning the lower bound, Pausinger and Steinerberger conjecture that it is not tight and speculate that a lower bound of

Ω √

dmd1 +p

log(m)/d pm/d

(3)

(6)

“might actually be very close to the truth.” Note that this bound is asymptotically stronger than the previous lower bound only for m superexponential in d, that is, m= 2ω(d).

1.4 Our Result: A Tight Discrepancy Estimate for Jit- tered Sampling

We show that both the conjectured lower bound (3), and thus also the proven lower bound in (2), and the proven upper bound in (2) are not tight, but that instead the true order of magnitude is

Θ √

dmd

s1 + log(m/d) m/d

!

for all m and d such that m ≥d.

Our result shows that it is the ratio of m and d that describes by how much better jittered sampling is compared to uniform random sampling. Form= Θ(d), the expected star discrepancies are asymptotically the same, namely Θ(√

dmd).

Whenm =ω(d), jittered sampling is superior, leading to discrepancies smaller by a factor of Θq

log(m/d) m/d

. Note that the upper bound of [PS16] shows an advantage of jittered sampling only form =ω(dlogd) and “m large enough compared tod”.

In this article, we did not aim at making the leading constant or any lower order terms precise, though in principle we do not see any obstacles for obtaining reasonable absolute bounds for both the lower bound (mainly relying on an esti- mate on the maximum of independent binomial random variables) and the upper bound (mainly relying on Aistleitner’s dyadic chaining method).

Our result suggests (but we do not prove this) that form < d, jittered sampling does not lead to discrepancies of asymptotic order smaller than those of indepen- dent random point sets. Since there is good reason to believe that jittered sampling nevertheless has some (small, but gratuitous) advantage, we discuss briefly in Sec- tion 5 how to use jittered sampling also for smaller number of points (including less than 2d) and what can be said about the discrepancy of such point sets.

2 Notation and Preliminaries

Throughout this work, we use the following notation: Given an N-point set P ⊆[0,1)d, we denote for each Lebesgue-measurable set A by λ(A) its Lebesgue measure and by

disc(A) := discP(A) := |P ∩A| −Nλ(A)

(7)

the signed non-normalized discrepancy of the set A.

The (non-normalized) star discrepancy of the point set P is D(P) :=

supB|disc(B)|, where B runs over all axis-aligned rectangles (boxes) with lower left corner in the origin, that is, all sets [0, x) := Qd

i=1[0, xi),x∈[0,1)d.

For a positive integer n, we use [n] := {1, . . . , n} as shorthand for the set of the first n positive integers. We also write [a..b] :={z ∈Z|a≤z ≤b}.

For givenmand (usually suppressed) d, we callGm :={0,m1, . . . ,mm1}dthem- grid (in dimension d). For x∈Gm, we call Cx := [x, x+m11m) =Qd

i=1[xi, xi+m1) an m-cube (or cube) in dimension d. A jittered sampling point set of N = md points is obtained from taking independently and uniformly at random one point from each m-cube.

We now prove an elementary lower bound for tail probabilities of the binomial distribution in the special case p= 1/2. Such estimates can be proven via normal approximations and the Berry-Esseen theorem, see, e.g., [Fel71, XVI.5]. To avoid such deep methods in this otherwise elementary combinatorial paper, we now show the following estimate.

Lemma 1. Let k ∈ N. Let X1, . . . , Xk be independent random variables each having a binomial distribution with parametersn and 12. We denote the maximum of these by Xmax := max{Xi |i∈[k]}. If c∈R is such that

α(c) :=

sn(lnk− 12ln lnk−c) 2(1 +p

2 ln(k)/n) is at least

n and small enough to satisfy α(c) + α(c)nn2, then

Pr[Xmaxn2 +α(c)]≥1−exp

− 1

1.5e169/6√ πec

.

Consequently, for e6 ≤k≤en/2, we have

E[max{0, Xmaxn2}]≥

s n(lnk−ln lnk) 2(1 +p

2 ln(k)/n)

1−exp

√lnk 1.5e169/6

π

. Proof. LetXbe a random variable having a binomial distribution with parameters n and 12. Let α ≥ 0 be such that n2 +α ∈ N. We first give a lower bound for the probability that X exceeds its expectation by exactly α. Using Stirling’s approximation in the version

√2πnn+12ene12n+11 < n!<√

2πnn+12ene121n

(8)

for alln≥1 due to Robbins [Rob55] and the elementary estimate 1 +x≤ex valid for all x∈R, we compute for α < n2 that

Pr[X = n2 +α] = 2n n

n 2

= 2n n!

(n2 +α)! (n2 −α)!

≥ 1

√2π√

n(1 + n)n/2+α+1/2(1− n)n/2α+1/2

exp(12n+11 ) exp(12(n1

2+α)) exp(12(n1 2α))

≥ 1

√2π

√ 1

n(1 + n)(1−(n)2)n/2α+1/2

1

exp(121) exp(121)

≥ 1 e1/6

√ 1

nexp((2α)2/n) exp(−(2α/n)2(n/2−α+ 1/2))

≥ 1 e1/6

√1

ne2/n3/n2.

Note that the lower bound in the last line is also valid for α= n2, simply because it is less than 2n.

Letα ≥√

n with α+nαn2. We now estimate the probability thatX exceeds its expectation by at least α via the probability that X ∈[EX+α,EX+α+nα].

Using that nn 2

and thus Pr[X = n2 +α] is decreasing in α for integral α ≥ 0, we compute

Pr[X ≥ n2 +α]≥Pr[n2 +α≤X ≤ n2 +α+αn]

≥ ⌊nα⌋Pr[X =⌊n2 +α+αn⌋]

≥ 1

e1/6√ 2π

nα

√ne2(α+n/α)2/n4(α+n/α)3/n2 (4)

≥ 1

1.5e169/6√ 2π

√n

α e2/n3/n2, where the last inequality uses α ≥ √

n, α ≤ n2, and α ≥ 1, which give the estimates 2(α + n/α)2/n = 2αn2 + 4 + 2αn2 ≤ 2αn2 + 6 and 4(α +n/α)3/n2 = 4αn23 + 12αn + 12α1 + 4αn3 ≤4αn23 + 6 + 12 + α4 ≤4αn32 + 22.

Consequently, the probability that all of X1, . . . , Xk are below n2 +α is Pr[Xmax < n2 +α] = Pr[∀i∈[k] :Xi< n2 +α]

1− 1

1.5e169/6√ 2π

√n

α e2/n3/n2 k

≤exp

− k

1.5e169/6√ 2π

√n

α e2/n3/n2

.

(9)

Let c∈R be such that

α=α(c) = s1

2n(lnk− 12ln lnk−c) 1 +p

2 ln(k)/n satisfies α ≥ √

n and α+ nαn2. With α ≤ q

1

2nlnk, we continue the previous estimate and compute

exp

− k

1.5e169/6√ 2π

√n

α e(2α2/n)(1+2α/n)

≤exp

− k

1.5e169/6√ 2π

√n q1

2nlnk exp

− (lnk− 12ln lnk−c)(1 + 2α/n) 1 +p

2 ln(k)/n

≤exp

− k

1.5e169/6√ π

√1

lnk exp(−(lnk−12 ln lnk−c))

= exp

− 1

1.5e169/6√ πec

.

To prove the second claim, where e6 ≤k ≤en/2, let ck = 12ln lnk and α =αk=α(ck) =

s1

2n(lnk−ln lnk) 1 +p

2 ln(k)/n . We note that fork ∈[e6, en/2], we have αk

r1

2n(lne6ln lne6) 1+

2 ln(en/2)/n ≥√

n; here we used that k 7→ lnk−ln lnk is increasing for k ≥e. For α ≥√

n, the expression α+ nα is increasing in α. Hence noting that αk

r 1

2nlnk 1+

2 ln(k)/n = n2

r 2 ln(k)/n 1+

2 ln(k)/n

n 2

r 2 ln(en/2)/n

1+

2 ln(en/2)/nn8 when k ≤ en/2 – here we used the fact that x 7→ 1+xx is increasing inR0 –, we estimate αk+αn

kn8+n/n8n8+√

8, which is at most

n

2 when n≥20. Hence forn ≥20 and anyk∈[e6, en/2], we can use the first claim of this lemma and compute

E[max{0, Xmaxn2}]≥αk·Pr[Xmaxn2k]

s n(lnk−ln lnk) 2(1 +p

2 ln(k)/n)

1−exp

√lnk 1.5e169/6

π

. For n < 20, the second claim is trivially fulfilled as the following two estimates show (where the latter again uses ex ≥1 +x, valid for all x∈R).

E[max{0, Xmaxn2}]≥E[max{0, X1n2}]≥ n2 Pr[X1 =n] = 2n n2 ≥219n2.

(10)

s n(lnk−ln lnk) 2(1 +p

2 ln(k)/n)

1−exp

√lnk 1.5e169/6

π

rnlnk 2

1−1−

√ lnk 1.5e169/6

π

≤q

1

2nlnen/2

√lnen/2 1.5e169/6

π < n2

8e28 <219n2.

3 Proof of the Lower Bound

In this section, we prove that for all m≥d the discrepancy of a jittered sampling point set having md point in [0,1)d is at least of order √

dmdq

1+log(m/d) m/d .

Theorem 2. There is a constant C >0 such that for all m, d∈N2 with m ≥d, the expected discrepancy of a jittered sampling point set P ⊂ [0,1)d, |P|= md, is at least

ED(P)≥C√ dmd

s1 + log(m/d)

m/d .

To ease the presentation, we treat the “small” case thatmis at most a constant factor larger than d separately in Lemma 6. The more interesting case, naturally, is that m is of larger order than d. For this, we prove the following result, which we state in a non-asymptotic fashion, noting again that in this work we did not optimize the leading constant or the lower order terms.

Lemma 3. Let m, d ∈ N2 withmd⌋ ≥ e6, and N = md. Let P be a random N-point set in [0,1)d obtained from jittered sampling. Then

ED(P)≥(2e)12dmd−21 q

ln(⌊md⌋)−ln ln(⌊md⌋) 1 +

s 2 ln(⌊md⌋) (m− ⌊md⌋)d1

!12

1−exp −

pln⌊md⌋ 1.5e169/6√ π

!!

.

In particular, there is aC >0such that for all m, d∈N2 withmd⌋ ≥e6 a jittered sampling point set P with N =md points satisfiesED(P)≥C√

dmdq

1+log(m/d) m/d . While we did not optimize for the leading constant, our result can be written as ED(P) ≥ (1−f(md))(2e)12

dmdq

ln(m/d)

m/d , where f is a function tending to

(11)

zero when the argument tends to infinity. Consequently, our leading constant of (2e)12 ≥0.4288 is not too bad. We note that Pausinger and Steinerberger [PS16]

state a constant of 1/10 in their theorem. An inspection of their proof shows that they actually prove their result with a leading constant of 0.5p

π/2 ln(2) = 0.4343....

In the proof of Lemma 3, we use the elementary observation that any measur- able set has expected signed discrepancy zero when all cubes intersecting it contain exactly one random point distributed uniformly in the cube.

Lemma 4. Let A ⊆ [0,1)d be a measurable set. Let P be a set of N = md ran- dom points such that each m-cube having non-empty intersection with A contains exactly one point of P and this point is uniformly distributed in this cube. Then Edisc(A) = 0.

Proof. Let Q be the set of all cubes and QA the set of cubes having non-empty intersection with A. Then

disc(A) = X

Q∈Q

disc(A∩Q) = X

Q∈QA

disc(A∩Q).

LetQ∈ QA. With probability λ(A∩Q)/λ(Q), the random point inQlies also in A and we have disc(A∩Q) = 1−Nλ(A∩Q). Otherwise, P ∩(A∩Q) is empty, giving disc(A∩Q) =−Nλ(A∩Q). Consequently,

Edisc(A∩Q) = λ(A∩Q)

λ(Q) (1−Nλ(A∩Q))−

1− λ(A∩Q) λ(Q)

Nλ(A∩Q)

= λ(A∩Q)

λ(Q) −Nλ(A∩Q) = 0,

where the last equality follows from λ(Q) = 1/N. By linearity of expectation, Edisc(A) =P

Q∈QAEdisc(A∩Q) = 0.

We shall use the above observation to combine certain rectangles with known signed discrepancy into an anchored box with expected discrepancy signed equal to the sum of the discrepancies of these rectangles.

Lemma 5. Let r1, . . . , rd ∈ [0,1) be integer multiples of 1/m. Let B0 := [0, r), where r= (r1, . . . , rd). Let P be a random set ofmd points in [0,1)d obtained from jittered sampling. For each i ∈ [d], let Si = Si(P) be a random variable taking values in [ri,1) and let Ri = Qi1

j=1[0, rj)×[ri, Si)×Qd

j=i+1[0, rj). Assume that each Ri, i.e., the number Si, is independent of the position of all points outsidei := Qi1

j=1[0, rj)× [ri,1)× Qd

j=i+1[0, rj). Let B = Qd

i=1[0, Si) be the smallest anchored box containing the Ri. Then

ED(P)≥Edisc(B) =

d

X

i=1

Edisc(Ri).

(12)

Note that the lemma in particular covers the case that the Si are chosen as to maximize the signed discrepancy of theRi. Consequently, with this lemma we can construct a box with large (expected) discrepancy by finding Ri with large signed discrepancy. We speculate that this construction principle can be useful in other lower bound proofs for jittered sampling as well.

Proof of Lemma 5. Let us first condition on a fixed outcome of theSi, that is, let si ∈ [ri,1) for all i ∈ [1..d] and we condition on Si = si for all i ∈ [1..d]. In this conditional probability space, by construction, all points in cubes not contained in ¯R := S

i[d]i are uniformly distributed in their cube. Also, no cube inter- sects both A := B \S

i[d]Ri and ¯R. Hence all points in cubes with non-empty intersection with Aare distributed uniformly in their cube. By Lemma 4 we have E[disc(A)|S1 =s1, . . . , Sd=sd] = 0. We thus have

E[ disc(B)|S1 =s1, . . . , Sd=sd]

=E

"

disc(A) +

d

X

i=1

disc(Ri)

S1 =s1, . . . , Sd=sd

#

=

d

X

i=1

E[disc(Ri)|S1 =s1, . . . , Sd=sd].

Hence the law of total expectation gives

Edisc(B) =E[E[disc(B)|S1 =s1, . . . , Sd=sd]]

=E

" d X

i=1

E[disc(Ri)|S1 =s1, . . . , Sd=sd]

#

=

d

X

i=1

E[E[disc(Ri)|S1 =s1, . . . , Sd=sd]]

=

d

X

i=1

Edisc(Ri).

We thus have ED(P)≥E|disc(B)| ≥Edisc(B) = Pd

i=1Edisc(Ri).

Before giving the precise proof of Lemma 3, let us give a brief outline of the main ideas and compare them to the proof of Pausinger and Steinerberger [PS16].

The main argument of [PS16] is the following. Let x1, . . . , xd ∈ [mm1,1) and x= (x1, . . . , xd). If m is sufficiently large compared to d, then the discrepancy of the boxB = [0, x) is very close to the discrepancy of the union R:=R1∪ · · · ∪Rd

of the slices Ri :=Ri(xi) := [0,mm1)i1 ×[mm1, xi)×[0,mm1)di. Note that here

(13)

the above lemma would have directly shown that the expected star discrepancy of P is at least the discrepancy of R. By construction, the discrepancy of Ri(xi) has the same distribution as the discrepancy of the interval [0, m(ximm1)) in a one- dimensional uniformly distributed random set of (m−1)d1 points in [0,1). This one-dimensional discrepancy problem can be analyzed quite well, in particular, the expected maximum discrepancy (over all choices of xi) can be determined.

Consequently, the expected maximum discrepancy of a suitable choice of B is at least d/2 times this number (the factor of 1/2 stems from the fact that we need the discrepancies of the Ri to have the same sign).

From a broader perspective, the main idea of [PS16] is to regard all boxes B = [0, x) with x lying in the upper right sub-cube C+ := [mm1,1)d – and only these – and to then exploit that for these the discrepancy is well described by one-dimensional discrepancies, which can be analyzed very precisely. While the reduction to the one-dimensional discrepancy problem allow a very precise analysis of the maximum discrepancy of a box [0, x),x∈C+, this approach carries the risk that the restricted choice of boxes underestimates the star discrepancy significantly.

For this reason, we follow a different road. We do not restrict ourselves to boxes [0, x), x ∈ C+, but overcome the increased complexity of the larger range for x by restricting ourselves to a suitable discrete set of choices for x. Taking r= 1− m1md⌋ ≈1− 1d, our x will be such that all xi are in [r,1) and are integral multiples of 2m1 . Clearly, with this relatively small discrete set of boxes, our bounds will necessarily be off the truth by constant factors. However, the more diverse set of boxes together with the right (not very difficult) combinatorial way of selecting a large-discrepancy box among them will enable us to prove the stronger (and in fact asymptotically tight) lower bound.

The main combinatorial observation is that for all j = 0, . . . ,⌊md⌋ − 1, the rectangleR1 = [r+mj, r+mj +2m1 )×[0, r)d1 has the same discrepancy distribution, which is the deviation of a binomial random variable with parameters NemN and p = 12 from its expectation. Consequently, by elementary properties of the maximum of ⌊md⌋ independent binomial random variables (Lemma 1), with good probability there is a choice for j such that the signed discrepancy of R1 satisfies disc(R1) ≥ Cp

Nlog(md) for some absolute constant C. By construction, the discrepancy of R1 is identical to the one of R1 := [r, r + mj + 2m1 )× [0, r)d1. Repeating this argument in each dimension and taking asB the smallest anchored box that contains all Ri, with Lemma 5 again we obtain a box with Edisc(B) ≥ Cdp

Nlog(md) as desired.

Proof of Lemma 3. Let k :=⌊md⌋ and r = mmk ≥1− 1d. For each i∈ [d] let Si ∈ [ri,1) be (maximal, in case of ambiguity) such thatRi := [0, r)i1×[r, Si)×[0, r)di has maximum signed discrepancy disc(Ri) := |P∩Ri|−Nλ(Ri). Note that disc(Ri) can only be maximal when Si coincides with the i-th coordinate of some point of

(14)

P, which shows that Si is a well-defined random variable. Note further that disc(Ri)≥0 since taking Si = 1 would give a rectangle containing only full cubes, and hence, having discrepancy zero.

Let B := Q

i[d][0, Si) be the smallest box containing all Ri. Note that the value of the Si depends only on the position of the points in the cubes in ¯Ri :=

[0, r)i1×[r,1)×[0, r)di. By Lemma 5, we have ED(P)≥

d

X

i=1

Edisc(Ri) =dEdisc(R1), (5) where the last equality exploits the symmetry between the Ri.

So it suffices to analyze disc(R1). For j = 0, . . . , k−1, let yj := r+ mj and zj :=yj+2m1 . Let Uj := [r, zj)×[0, r)d1 andTj = [yj, zj)×[0, r)d1. SinceUj\Tj can be written as union of cubes, we have disc(Uj) = disc(Tj). Now each Tj is composed of the “left” halves of exactlyN = (m−k)d1 ≥(1−1d)d1md11emd1 cubes. Consequently, |P ∩Tj| follows a binomial distribution with parameters N andp= 12. Since no cube intersects non-trivially two differentTj, the discrepancies of the Tj (and thus of the Uj) are independent. Let Xj, j = 0, . . . , k− 1, be independent random variables with binomial distribution with parametersN and p = 12. Then disc(R1) ≥ max{0,disc(Uj) | j = 0, . . . , k −1} and the latter is distributed as max{0, Xj −EXj |j = 0, . . . , k−1}.

Sincek ≥e6 by assumption and furtherk ≤m−k ≤N ≤eN/2, by the second part of Lemma 1 we have

Edisc(R1)≥

s N(lnk−ln lnk) 2(1 +p

2 ln(k)/N)

1−exp

√lnk 1.5e169/6

π

≥(2e)12md−21q

ln(⌊md⌋)−ln ln(⌊md⌋) 1 +

s 2 ln(⌊md⌋) (m− ⌊md⌋)d1

!12

1−exp

pln(⌊md⌋) 1.5e169/6

π

.

Together with (5), this proves the main claim. The last claim follows from the following three estimates.

• We note that f :x 7→√

x−lnx has its global minimum (in R>0) at x= 4.

Since f(4) > 0, we have √

x > ln(x) for all x ∈ R>0. Consequently, ln ln(⌊md⌋) ≤ 12ln(⌊md⌋) and thus p

ln(⌊md⌋)−ln ln(⌊md⌋) ≥ q

1

2ln(⌊md⌋).

Since ⌊md⌋ ≥ e6, we can continue with q

1

2ln(⌊md⌋) = q

1

4ln(⌊md2) ≥

1 2

p1 + ln(md).

(15)

• From d≥2 and ⌊md⌋ ≥e6, we conclude 1 +

s 2 ln(⌊md⌋)

(m− ⌊md⌋)d1 ≤1 +

s 2 ln(⌊md⌋) (2⌊md⌋ − ⌊md⌋)d1

≤1 +

s2 ln(⌊md⌋)

md

≤1 +

r2 ln(e6)

e6 ≤1.18.

Here we used thatx7→ ln(x)x is decreasing for x≥e.

• Finally, ⌊md⌋ ≥e6 implies that 1−exp

pln(⌊md⌋) 1.5e169/6

π

≥1−exp

pln(e6) 1.5e169/6

π

is at least some positive constant.

We now discuss the case that m is of similar order of magnitude as d. The following result, in particular, extends the Ω(dmd−21) lower bound of Lemma 3 to arbitrary m = Θ(d) and shows that in this case, apart from constant factors, jittered sampling point sets have an expected discrepancy not smaller than uni- formly distributed random point sets. In other words, only forN =ω(d)d jittered sampling has a super-constant discrepancy advantage over fully random points.

Lemma 6. Let m, d∈N2. Let N =md andP be a randomN-point set obtained from jittered sampling. Then

ED(P)≥ 4 5e8+1/6

2π exp

− 32 (m−1)d−21

d(m−1)d−21.

In particular, if m ≥ γd for some constant γ > 0, then ED(P) ≥ Cdmd−21 for some constant C >0 which depends only on γ.

If Γd≥m ≥γd for some constants Γ≥ γ >0, then ED(P)≥C

dN for a constant C >0 which depends only on γ and Γ.

Proof. We use a simplified version of the proof of Lemma 3. Letr= mm1. For each i∈[d], choosexi ∈[r,1) such that Ri := [0, r)i1×[r, xi)×[0, r)di has maximum signed discrepancy disc(Ri) = |P ∩Ri| −Nλ(Ri). Let x = (x1, . . . , xd) and B :=

(16)

Q

i[d][0, xi). As in the proof of Lemma 3, we have ED(P) ≥ dEdisc(R1), so again it only remains to estimate Edisc(R1).

Clearly, we have Edisc(R1) ≥ Emax{0,disc(R1)} with R1 := [r, r + 2m1 )× [0, r)d1. Now disc(R1) follows a binomial distribution with parameters N = (m−1)d1 andp= 12. IfN ≥16, then forα =√

N we haveα+N/α≤N/2 and thus equation (4) shows that with probability at least 5e8+14/6

e32/N we have a discrepancy of√

N or more. Consequently, Edisc(R1)≥Emax{0,disc(R1)} ≥

4 5e8+1/6

e32/N√ N.

IfN <16, then we note thatR1 := [r, r+2N1m]×[0, r)d1 with probability 1− (1−2N1)N ≥1−exp(−12)≥0.39 contains at least one point. Hence Edisc(R1)≥ Emax{0,disc(R1)} ≥0.39(1−0.5)≥0.19≥ 5e8+1/64

·4≥ 5e8+1/64

e32/N√ N. Hence in either case,

ED(P)≥dEdisc(R1)≥d 4 5e8+1/6

2πe32/N√ N

= 4

5e8+1/6

2πexp

− 32 (m−1)d−21

d(m−1)d−21.

If m ≥γd for some constant γ >0, then using m≥2 we further estimate the above bound to ED(P) ≥ 5e8+1/64e32

dmd−21(1− m1)d−21. Noting that (1− m1)m is increasing in m and, again, thatm ≥2, we estimate (1− m1)d−21 ≥(1−m1)m/2γ ≥ 21/γ. Hence there is a constant C >0 depending on γ only such that ED(P)≥ Cdmd−21. When also m ≤ Γd for some constant Γ, then estimating dmd−21 ≥ d1/2(mΓ)1/2md−21 = Γ1/2

dN shows that we also haveED(P)≥C

dN for some constant C which only depends on γ and Γ.

4 Proof of the Upper Bound

We now show that the lower bound proven above is tight (apart from constant factors independent of m and d).

Theorem 7. Let m, d∈N with m ≥d ≥2. Let N :=md. LetP be a random set of N points in [0,1)d obtained from jittered sampling. Then

ED(P)≤60.9984√ dmd

pln(4em/d) + 2.9599 pm/d .

The main reason why the upper bound proof of Pausinger and Steiner- berger [PS16] does not give the right order of magnitude is the following. Using a similar reduction to one-dimensional discrepancies as in their lower bound proof,

(17)

Pausinger and Steinerberger again are able to give a strong bound (including an exponentially decreasing tail) for the maximum discrepancy among all boxes with upper right corner lying in the same m-cube. To obtain an upper bound valid for all boxes, a union bound is employed. Such a union bound, naturally, ignores any positive correlation between the discrepancies of boxes with corner point in differ- ent, but close-by m-cubes. So from a broader perspective, the proof again does a very precise analysis inside the m-cubes, but ignores the overall combinatorial structure of the problem.

Two arguments have been used in the past to better exploit the positive cor- relation of similar boxes. Heinrich et al. [HNWW01] used deep results of Tala- grand and Haussler from the theory of empirical processes to give the first proof of the O(√

dN) discrepancy bound forN independent uniformly distributed ran- dom points in [0,1)d. With a non-trivial, purely combinatorial decomposition argument called dyadic chaining, Aistleitner [Ais11] and later Gnewuch and Heb- binghaus [GH21] reproved this bound and gave explicit (and small) values for the leading constant

In the following, we show that Aistleitner’s dyadic chaining technique can also be used for the non-uniformly distributed point sets stemming from jittered sam- pling. The main difference, and reason for the stronger discrepancy bound, comes from noting that the grid points Γ0 ={0,m1,m2, . . . ,1}dform a md-cover (see below for a definition) such that each grid point x ∈ Γ0 defines a rectangle [0, x) with discrepancy 0. Consequently, we can start the dyadic chaining construction with these grid points as coarsest cover. Note that this is not a very efficient (that is, small) cover, but this has no influence on the overall efficiency of the construction as one can verify from the proof below.

The stochastic dependencies in the jittered sampling random experiment, inter- estingly, impose no additional difficulties. Still the number of points in an arbitrary measurable set can be written as sum of independent 0,1 random variables. Un- like in the proof of [Ais11], these are not identically distributed, but this has no influence on the applicability of most Chernoff-type large deviation bounds.

Of course, in addition to these observations, it remains to estimate the expected star discrepancy in an analogous way as done in [Ais11], which requires some care.

As for the lower bound in the previous section, in this article we do not take great care for obtaining a small leading constant, thus simplifying some calculations as compared to [Ais11] and [GH21]. The reader familiar with Aistleitner’s proof will also note that we prefer to work with half-open rectangles, but clearly this makes no difference.

We recall the definitions of δ-covers and δ-bracketing covers. We use the no- tation [x, y) := [0, y)\[0, x) for all x, y ∈ [0,1)d with x ≤ y. Let δ > 0. A set Γ ⊆ [0,1]d is called δ-cover if for each y ∈ [0,1)d there are x, z ∈ Γ∪ {0} such

(18)

that x ≤ y ≤ z and λ([x, z)) ≤ δ. In particular, and this is what we will need only, we have λ([x, y)) ≤ δ. A set ∆ ⊆ ([0,1]d)2 is called δ-bracketing cover if for each x ∈ [0,1)d there is a pair (vKx, wKx) ∈ ∆ such that vxK ≤ x ≤ wKx and λ([vKx, wKx))≤δ.

Proof of Theorem 7. We start by defining a sequence ofδ-covers of increasing pre- cision. Let δ0 := md and Γ0 := {0,m1,m2, . . . ,1}d. Then Γ0 is a δ0-cover. Let K := ⌊d21 log2m⌋. For i = 1, . . . , K −1, let δi := 2i dm and let Γi be a δi-cover with |Γi| ≤ (4e/δi)d = (4e2i md)d =:γi. Finally, let δK := 2K dm and let ∆K be a δK-bracketing cover with |∆K| ≤ (4e/δK)d =:γK. Such covers exist by Theorem 1.15 of [Gne08], see also Lemma 1 of [Ais11].

By definition of bracketing covers, for eachx∈[0,1)dthere is a pair (vKx, wKx)∈

K such that vxK ≤x ≤ wxK and λ([vxK, wKx))≤ δK. By elementary properties of the discrepancy function, we have

|disc([0, x))| ≤max

|disc([0, vKx))|,|disc([0, wKx))| +NδK. Consequently,

D(P)≤NδK + max

|disc([0, vKx))|,|disc([0, wxK))|

x∈[0,1)d . (6) Note that NδK ≤ √dN

m/d is of asymptotic order not larger than the bound we aim at. Consequently, it suffices in the following to analyze

max

|disc([0, vKx))|,|disc([0, wKx))|

x∈[0,1)d .

To this aim, note that for each i ∈ [0..K −1] and each x ∈ [0,1)d there is a vi(x)∈Γi∪ {0} such thatvi(x)≤x and λ([vi(x), x))≤δi.

For each x ∈ [0,1)d we define pxK+1 := wxK, pxK := vKx, and recursively for i = K−1, . . . ,0, we define pxi :=vi(pxi+1). By construction, the sets Bix := [pxi1, pxi), i= 1, . . . , K+1, are disjoint. By the additivity of disc(·) and thus the subadditivity of |disc(·)|, we obtain

|disc([0, vKx))| ≤

K

X

i=1

|disc(Bxi)|, (7)

|disc([0, wKx))| ≤

K+1

X

i=1

|disc(Bix)|. (8)

For this reason, we now proceed by analyzing the discrepancies of the sets Bix. To this aim, keep in mind that (i) we have λ(Bix)≤δi1 for all i and x, and that

(19)

(ii) for fixedi, the number of differentBix 6=∅is at mostγi = (4e2i md)d, fori∈[K], and γK+1 :=γK wheni=K+ 1.

Let us first regard an arbitrary measurable setS ⊆[0,1)d. LetQbe the set of all elementary cubesQd

j=1[qjm1,qmj), q1, . . . , qd∈[m]. For each Q∈ Q, we have E[|P ∩S∩Q|] = Pr[P ∩S∩Q6=∅] = λ(S∩Q)

λ(Q) =Nλ(S∩Q).

Consequently, we may write

disc(S) =|P ∩S| −Nλ(S)

= X

Q∈Q

|P ∩S∩Q| −Nλ(S∩Q)

= X

Q∈Q

|P ∩S∩Q| −E[|P ∩S∩Q|]

as a sum of N independent random variables ZQ :=|P ∩S∩Q| −E[|P ∩S∩Q|], each taking values in the interval [−1,1], each having expectationE[ZQ] = 0, and each having variance Var[ZQ] = Var[|P ∩S∩Q|]≤E[|P ∩S∩Q|] =Nλ(S∩Q).

Consequently, Bernstein’s inequality gives Pr[|disc(S)| ≥t]≤2 exp

− t2

2P

QVar[ZQ] + 2t/3

≤2 exp

− t2

2Nλ(S) + 2t/3

. For all i∈[K+ 1] andℓ∈R1 let ti,ℓ := 2Cℓd

qN m

ln(22i4e(m/d))

2i−1 for some C≥1.

Letx∈[0,1)dand i∈[K + 1]. By the above, we have Pr[|disc(Bix)| ≥ti,ℓ]

≤2 exp

− t2i,ℓ

2Nδi1+ 2ti,ℓ/3

≤2 exp

− t2i,ℓ

2 max{2Nδi1,2ti,ℓ/3}

≤2 max

exp

− t2i,ℓ 4Nδi1

,exp

− t2i,ℓ 4ti,ℓ/3

≤2

exp

− t2i,ℓ 4Nδi1

+ exp

− t2i,ℓ 4ti,ℓ/3

= 2 exp

− 4C2dm22N2i+1ln(22i4e(m/d)) 4N2i+1(d/m)

+ 2 exp

32Cℓd rN

m

ln(22i4e(m/d)) 2i1

Références

Documents relatifs