HAL Id: hal-01842351
https://hal.archives-ouvertes.fr/hal-01842351
Submitted on 18 Jul 2018
HAL is a multi-disciplinary open access
archive for the deposit and dissemination of
sci-entific research documents, whether they are
pub-lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.
L’archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d’enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.
Fast iterative tomographic wavefront estimation with
recursive Toeplitz reconstructor structure for large-scale
systems
Yoshito H. Ono, Carlos Correia, Rodolphe Conan, Leonardo Blanco, Benoit
Neichel, Thierry Fusco
To cite this version:
Yoshito H. Ono, Carlos Correia, Rodolphe Conan, Leonardo Blanco, Benoit Neichel, et al.. Fast
iterative tomographic wavefront estimation with recursive Toeplitz reconstructor structure for
large-scale systems. Journal of the Optical Society of America. A Optics, Image Science, and Vision,
Optical Society of America, 2018, 35 (8), pp.1330-1345. �10.1364/JOSAA.35.001330�. �hal-01842351�
Fast Iterative Tomographic Wave-front Estimation with
Recursive Toeplitz Reconstructor Structure for Large
Scale Systems
Y
OSHITO
H. O
NO1,2
, C
ARLOS
C
ORREIA2
, R
ODOLPHE
C
ONAN3
, L
EONARDO
B
LANCO4
, B
ENOIT
N
EICHEL2
,
AND
T
HIERRY
F
USCO2,4
1
Subaru Telescope, National Astronomical Observatory of Japan, 650 North A’ohoku Place, Hilo, HI 96720, U.S.A.
2
Aix Marseille Univ, CNRS, LAM, Laboratoire d’Astrophysique de Marseille, Marseille, France
3
GMTO Corporation, 465 N. Halstead Street, Suite 250. Pasadena, CA 91107
4
ONERA, the French Aerospace Laboratory, F-92322 Chatillon, France
*
Corresponding author: [email protected]
Compiled June 22, 2018
Tomographic wave-front reconstruction is the main computational bottleneck to realize real-time
correc-tion for turbulence-induced wave-front aberracorrec-tions in future laser-assisted tomographic adaptive-optics
(AO) systems for ground-based Giant Segmented Mirror Telescopes (GSMT), because of its
unprece-dented number of degrees of freedom, N, i.e. the number of measurements from wave-front sensors
(WFS). In this paper, we provide an efficient implementation of the minimum-mean-square error (MMSE)
tomographic wave-front reconstruction mainly useful for some classes of AO systems not requiring a
multi-conjugation, such as laser-tomographic AO (LTAO), multi-objcet AO (MOAO) and ground-layer
AO (GLAO) systems, but also applicable to multi-conjugate AO (MCAO) systems. This work expands
that by R. Conan [ProcSPIE, 9148, 91480R (2014)] to the multi-wave-front, tomographic case using natural
and laser guide stars. The new implementation exploits the Toeplitz structure of covariance matrices used
in a MMSE reconstructor, which leads to an overall O
(
N log N
)
real-time complexity compared to O
(
N
2
)
of the original implementation using straight vector-matrix multiplication. We show that the
Toeplitz-based algorithm leads to 60 nm rms wave-front error improvement for the European Extremely Large
Telescope Laser-Tomography AO system over a well-known sparse-based tomographic reconstruction,
but the number of iterations required for suitable performance is still beyond what a real-time system
can accommodate to keep up with the time-varying turbulence.
© 2018 Optical Society of America
OCIS codes: (010.1080) Active or adaptive optics; (100.3190) Inverse problems
http://dx.doi.org/10.1364/ao.XX.XXXXXX
1. INTRODUCTION
The tomographic wave-front reconstruction (WFR) in
adaptive-optics (AO) systems using multiple guide-stars (GS) and
wave-front sensors (WFS) represents a computational challenge for
real-time atmospheric turbulence correction at a few hundreds
to thousands Hertz frame-rates. This is especially so for AO
systems in future giant segmented mirror telescopes (GSMT)
with primary diameters in the 20 m–40 m range, because of its
unprecedented number of degrees of freedom, N, i.e. the
num-ber of measurements from WFSs. A flurry of methods has been
developed, providing reduced complexity algorithms that could
accelerate simulation of large systems and later be mapped onto
real-time computers [
1
–
6
].
The tomographic WFR problem can be divided into two steps:
i) the estimation of the wave-front in the pupil plane along GS
directions and ii) the three-dimensional estimation in the
turbu-lence volume from its projections. Efficient methods to solve for
the first step are for instance the Fourier-domain reconstructor
[
1
,
2
] and more recently [
3
] that promise to decrease the
com-putational complexity from its original O
(
N
2
)
to respectively
O
(
N log
(
N
))
and O
(
N
)
. Work reviewed in Ramlau et al [
4
] falls
under this category.
A somewhat different path has been followed by others in
that an explicit minimum-mean-square error (MMSE) residual
cost-functional is solved for leading to formulations that are
amenable to sparse representations under some reasonable
ap-proximations (and therefore to efficient computational
recon-struction methods). The most representative examples are
re-viewed in Ellerbroek et al [
5
], with some more additions along
the same lines from [
6
] using a fractal approximation of the
regularizing stratified phase covariance term.
More recently, for some classes of AO systems not requiring
multi-conjugation, it has been noted that the MMSE
reconstruc-tion can be further simplified if we skip the explicit estimareconstruc-tion
of the 3D wave-front profiles to estimate instead the pupil-plane
wave-front in the directions of interest only [
7
–
10
] (hereinafter,
referred to as spatio-angular WFR), which is suitable for
multi-object AO (MOAO), laser-tomography AO (LTAO) and
option-ally ground-layer AO (GLAO) systems. The spatio-angular WFR
doesn’t require any approximation and thus can provide more
accurate estimation than the sparse reconstructor. However, for
large-scale systems, this explicit formulation requires
instan-tiating huge covariance matrices with the overall complexity
remaining O(N
2
) which is still a cause of computational
bottle-neck.
An efficient implementation of the spatio-angular WFR is
pro-posed by R. Conan [
10
] for a natural GS (NGS) based classical
single-conjugate AO system (SCAO). This implementation
re-duces the computational complexity to O
(
N log
(
N
))
from its
original O
(
N
2
)
by exploiting the Toeplitz structure of the
covari-ance matrices. In this paper we generalize this method to the
tomographic system using NGSs and laser GSs (LGS). Especially
for tomographic systems with multiple LGSs, we develop a way
to deal with the spatial sampling change at high altitudes due to
the cone effect of LGSs and the removal of low-order modes not
measurable by LGSs, whilst keeping the Toeplitz structure of the
covariance matrices. In passing, although this is not the main
motivation of this paper, in doing so we can show that MCAO
systems are also covered by the implementation presented here.
This paper is organized as follows. In §
2
we review the
re-construction formulations and the fast implementations they are
amenable to when considering large systems for GSMT. We give
a thorough account of the development of a spatio-angular WFR
algorithm exploiting the Toeplitz block structure of the
recon-structor matrices. In §
3
we compare performance on 8 m class
telescopes by analytic and Monte-Carlo, physical-optics
simu-lations and extend to the European Extremely Large Telescope
in §
4
. In §
5
, the real time readiness of the Toeplitz algorithm
using parallel computing with graphical processing unit (GPU)
is discussed. Final discussion and remarks are laid out in §
6
.
2. TOMOGRAPHIC WAVE-FRONT RECONSTRUCTION
We assume a situation shown in Fig.
1
, where the atmospheric
turbulence is expressed as N
layer
thin turbulent layers at
mul-tiple altitudes h
k
(
k
=
1,
· · ·
, N
layer
)
, and the phase aberration
on the atmospheric layer grids (circle symbols in Fig.
1
) is noted
as ϕ. This term is referred to as the layered phase. The
tomo-graphic computation is made based on N
gs
GSs in directions
of α
j
= (α
x
j
, α
y
j
) (
j
=
1,
· · ·
, N
gs)
using measurements from N
gs
WFSs with DM corrections applied over N
target
target directions
Layered
Phase
'
<latexit sha1_base64="VryCK5FYQg7cbqq9I54R5x9Hvck=">AAACj3ichVG7SgNBFD1Z3+9EG8FGDIpVuCuCYiFBG+2SaEzAiOyukzhkX+xuAjH4A36AFhY+wEL8AD/Axh+w8BPEUsHGwpvNgqiod5mdM2fuuXNmru6a0g+IHmNKR2dXd09vX//A4NDwSDwxuuU7Nc8QecMxHa+oa74wpS3ygQxMUXQ9oVm6KQp6dbW1X6gLz5eOvRk0XLFjaRVblqWhBUyVSrrVLNU1z92Xh7vxJKUojMmfQI1AElFknPgtStiDAwM1WBCwETA2ocHnbxsqCC5zO2gy5zGS4b7AIfpZW+MswRkas1X+V3i1HbE2r1s1/VBt8CkmD4+Vk5imB7qmF7qnG3qi919rNcMaLS8NnvW2Vri7I0fjG2//qiyeA+x/qv70HKCMxdCrZO9uyLRuYbT19YOTl42l3HRzhi7pmf1f0CPd8Q3s+qtxlRW50z/86OyFX4wbpH5vx0+wNZdSKaVm55PplahVvZjAFGa5HwtIYw0Z5Lm+i2Oc4VxJKAvKspJupyqxSDOGL6GsfwBACpTu</latexit><latexit sha1_base64="VryCK5FYQg7cbqq9I54R5x9Hvck=">AAACj3ichVG7SgNBFD1Z3+9EG8FGDIpVuCuCYiFBG+2SaEzAiOyukzhkX+xuAjH4A36AFhY+wEL8AD/Axh+w8BPEUsHGwpvNgqiod5mdM2fuuXNmru6a0g+IHmNKR2dXd09vX//A4NDwSDwxuuU7Nc8QecMxHa+oa74wpS3ygQxMUXQ9oVm6KQp6dbW1X6gLz5eOvRk0XLFjaRVblqWhBUyVSrrVLNU1z92Xh7vxJKUojMmfQI1AElFknPgtStiDAwM1WBCwETA2ocHnbxsqCC5zO2gy5zGS4b7AIfpZW+MswRkas1X+V3i1HbE2r1s1/VBt8CkmD4+Vk5imB7qmF7qnG3qi919rNcMaLS8NnvW2Vri7I0fjG2//qiyeA+x/qv70HKCMxdCrZO9uyLRuYbT19YOTl42l3HRzhi7pmf1f0CPd8Q3s+qtxlRW50z/86OyFX4wbpH5vx0+wNZdSKaVm55PplahVvZjAFGa5HwtIYw0Z5Lm+i2Oc4VxJKAvKspJupyqxSDOGL6GsfwBACpTu</latexit><latexit sha1_base64="VryCK5FYQg7cbqq9I54R5x9Hvck=">AAACj3ichVG7SgNBFD1Z3+9EG8FGDIpVuCuCYiFBG+2SaEzAiOyukzhkX+xuAjH4A36AFhY+wEL8AD/Axh+w8BPEUsHGwpvNgqiod5mdM2fuuXNmru6a0g+IHmNKR2dXd09vX//A4NDwSDwxuuU7Nc8QecMxHa+oa74wpS3ygQxMUXQ9oVm6KQp6dbW1X6gLz5eOvRk0XLFjaRVblqWhBUyVSrrVLNU1z92Xh7vxJKUojMmfQI1AElFknPgtStiDAwM1WBCwETA2ocHnbxsqCC5zO2gy5zGS4b7AIfpZW+MswRkas1X+V3i1HbE2r1s1/VBt8CkmD4+Vk5imB7qmF7qnG3qi919rNcMaLS8NnvW2Vri7I0fjG2//qiyeA+x/qv70HKCMxdCrZO9uyLRuYbT19YOTl42l3HRzhi7pmf1f0CPd8Q3s+qtxlRW50z/86OyFX4wbpH5vx0+wNZdSKaVm55PplahVvZjAFGa5HwtIYw0Z5Lm+i2Oc4VxJKAvKspJupyqxSDOGL6GsfwBACpTu</latexit><latexit sha1_base64="VryCK5FYQg7cbqq9I54R5x9Hvck=">AAACj3ichVG7SgNBFD1Z3+9EG8FGDIpVuCuCYiFBG+2SaEzAiOyukzhkX+xuAjH4A36AFhY+wEL8AD/Axh+w8BPEUsHGwpvNgqiod5mdM2fuuXNmru6a0g+IHmNKR2dXd09vX//A4NDwSDwxuuU7Nc8QecMxHa+oa74wpS3ygQxMUXQ9oVm6KQp6dbW1X6gLz5eOvRk0XLFjaRVblqWhBUyVSrrVLNU1z92Xh7vxJKUojMmfQI1AElFknPgtStiDAwM1WBCwETA2ocHnbxsqCC5zO2gy5zGS4b7AIfpZW+MswRkas1X+V3i1HbE2r1s1/VBt8CkmD4+Vk5imB7qmF7qnG3qi919rNcMaLS8NnvW2Vri7I0fjG2//qiyeA+x/qv70HKCMxdCrZO9uyLRuYbT19YOTl42l3HRzhi7pmf1f0CPd8Q3s+qtxlRW50z/86OyFX4wbpH5vx0+wNZdSKaVm55PplahVvZjAFGa5HwtIYw0Z5Lm+i2Oc4VxJKAvKspJupyqxSDOGL6GsfwBACpTu</latexit>
Directional Phase
j
th
GS
↵
i
<latexit sha1_base64="2Lk+3VCFtTcFl+SourUF8GQT+5A=">AAACmXichVHLSsNAFD2N73d9LIRuxKK4KjciKK58bMSVtlYFKyGJox3MiyQtaOgP+AMu3KjgQv0AP8CNP+CinyAuFdy48DYNiIp6w2TOnLnnzpm5hmfJICSqp5SW1rb2js6u7p7evv6B9ODQZuBWfFMUTddy/W1DD4QlHVEMZWiJbc8Xum1YYss4XG7sb1WFH0jX2QiPPLFr6weO3JemHjKlpUdKhh2VvLLUopJueWVdk7Wals5SjuIY+wnUBGSRxJqbvkMJe3BhogIbAg5CxhZ0BPztQAXBY24XEXM+IxnvC9TQzdoKZwnO0Jk95P8Br3YS1uF1o2YQq00+xeLhs3IME/RI1/RCD3RLT/T+a60ortHwcsSz0dQKTxs4GS28/auyeQ5R/lT96TnEPuZir5K9ezHTuIXZ1FePT18K8/mJaJIu6Zn9X1Cd7vkGTvXVvFoX+bM//BjshV+MG6R+b8dPsDmdUymnrs9kF5aSVnUig3FMcT9msYAVrKHI9Y9xjmvcKBllUVlRVpupSirRDONLKIUPAcqYpw==</latexit><latexit sha1_base64="2Lk+3VCFtTcFl+SourUF8GQT+5A=">AAACmXichVHLSsNAFD2N73d9LIRuxKK4KjciKK58bMSVtlYFKyGJox3MiyQtaOgP+AMu3KjgQv0AP8CNP+CinyAuFdy48DYNiIp6w2TOnLnnzpm5hmfJICSqp5SW1rb2js6u7p7evv6B9ODQZuBWfFMUTddy/W1DD4QlHVEMZWiJbc8Xum1YYss4XG7sb1WFH0jX2QiPPLFr6weO3JemHjKlpUdKhh2VvLLUopJueWVdk7Wals5SjuIY+wnUBGSRxJqbvkMJe3BhogIbAg5CxhZ0BPztQAXBY24XEXM+IxnvC9TQzdoKZwnO0Jk95P8Br3YS1uF1o2YQq00+xeLhs3IME/RI1/RCD3RLT/T+a60ortHwcsSz0dQKTxs4GS28/auyeQ5R/lT96TnEPuZir5K9ezHTuIXZ1FePT18K8/mJaJIu6Zn9X1Cd7vkGTvXVvFoX+bM//BjshV+MG6R+b8dPsDmdUymnrs9kF5aSVnUig3FMcT9msYAVrKHI9Y9xjmvcKBllUVlRVpupSirRDONLKIUPAcqYpw==</latexit><latexit sha1_base64="2Lk+3VCFtTcFl+SourUF8GQT+5A=">AAACmXichVHLSsNAFD2N73d9LIRuxKK4KjciKK58bMSVtlYFKyGJox3MiyQtaOgP+AMu3KjgQv0AP8CNP+CinyAuFdy48DYNiIp6w2TOnLnnzpm5hmfJICSqp5SW1rb2js6u7p7evv6B9ODQZuBWfFMUTddy/W1DD4QlHVEMZWiJbc8Xum1YYss4XG7sb1WFH0jX2QiPPLFr6weO3JemHjKlpUdKhh2VvLLUopJueWVdk7Wals5SjuIY+wnUBGSRxJqbvkMJe3BhogIbAg5CxhZ0BPztQAXBY24XEXM+IxnvC9TQzdoKZwnO0Jk95P8Br3YS1uF1o2YQq00+xeLhs3IME/RI1/RCD3RLT/T+a60ortHwcsSz0dQKTxs4GS28/auyeQ5R/lT96TnEPuZir5K9ezHTuIXZ1FePT18K8/mJaJIu6Zn9X1Cd7vkGTvXVvFoX+bM//BjshV+MG6R+b8dPsDmdUymnrs9kF5aSVnUig3FMcT9msYAVrKHI9Y9xjmvcKBllUVlRVpupSirRDONLKIUPAcqYpw==</latexit><latexit sha1_base64="2Lk+3VCFtTcFl+SourUF8GQT+5A=">AAACmXichVHLSsNAFD2N73d9LIRuxKK4KjciKK58bMSVtlYFKyGJox3MiyQtaOgP+AMu3KjgQv0AP8CNP+CinyAuFdy48DYNiIp6w2TOnLnnzpm5hmfJICSqp5SW1rb2js6u7p7evv6B9ODQZuBWfFMUTddy/W1DD4QlHVEMZWiJbc8Xum1YYss4XG7sb1WFH0jX2QiPPLFr6weO3JemHjKlpUdKhh2VvLLUopJueWVdk7Wals5SjuIY+wnUBGSRxJqbvkMJe3BhogIbAg5CxhZ0BPztQAXBY24XEXM+IxnvC9TQzdoKZwnO0Jk95P8Br3YS1uF1o2YQq00+xeLhs3IME/RI1/RCD3RLT/T+a60ortHwcsSz0dQKTxs4GS28/auyeQ5R/lT96TnEPuZir5K9ezHTuIXZ1FePT18K8/mJaJIu6Zn9X1Cd7vkGTvXVvFoX+bM//BjshV+MG6R+b8dPsDmdUymnrs9kF5aSVnUig3FMcT9msYAVrKHI9Y9xjmvcKBllUVlRVpupSirRDONLKIUPAcqYpw==</latexit>
i
th
Target
↵
j
<latexit sha1_base64="/vknflwXoAF01V0jbg43kNju5Ko=">AAACkHichVHNLgNRFP6M//ppsZHYNBpi1ZwRCbFRbMRKW0WiTTMzLh2dPzPTJtX0BbxAFzZILMQDeAAbL2DRRxBLEhsLp9NJBMGZ3Lnf/e75zv3uPapj6J5P1OqSunt6+/oHBiNDwyOj0djY+I5nV1xN5DTbsN09VfGEoVsi5+u+IfYcVyimaohdtbze3t+tCtfTbWvbrzmiYCpHln6oa4rPVCGvmvW8YjglpXjcKMYSlKQg4j+BHIIEwtiyY3fI4wA2NFRgQsCCz9iAAo+/fcggOMwVUGfOZaQH+wINRFhb4SzBGQqzZf4f8Wo/ZC1et2t6gVrjUwweLivjmKFHuqEXeqBbeqL3X2vVgxptLzWe1Y5WOMXo2WT27V+VybOP0qfqT88+DrEUeNXZuxMw7VtoHX31tPmSXc7M1Gfpip7Z/yW16J5vYFVfteu0yJz/4UdlL/xi3CD5ezt+gp35pExJOb2QSK2FrRrAFKYxx/1YRAob2EKO65+giQtcSuPSkrQirXZSpa5QM4EvIW1+APySlT0=</latexit><latexit sha1_base64="/vknflwXoAF01V0jbg43kNju5Ko=">AAACkHichVHNLgNRFP6M//ppsZHYNBpi1ZwRCbFRbMRKW0WiTTMzLh2dPzPTJtX0BbxAFzZILMQDeAAbL2DRRxBLEhsLp9NJBMGZ3Lnf/e75zv3uPapj6J5P1OqSunt6+/oHBiNDwyOj0djY+I5nV1xN5DTbsN09VfGEoVsi5+u+IfYcVyimaohdtbze3t+tCtfTbWvbrzmiYCpHln6oa4rPVCGvmvW8YjglpXjcKMYSlKQg4j+BHIIEwtiyY3fI4wA2NFRgQsCCz9iAAo+/fcggOMwVUGfOZaQH+wINRFhb4SzBGQqzZf4f8Wo/ZC1et2t6gVrjUwweLivjmKFHuqEXeqBbeqL3X2vVgxptLzWe1Y5WOMXo2WT27V+VybOP0qfqT88+DrEUeNXZuxMw7VtoHX31tPmSXc7M1Gfpip7Z/yW16J5vYFVfteu0yJz/4UdlL/xi3CD5ezt+gp35pExJOb2QSK2FrRrAFKYxx/1YRAob2EKO65+giQtcSuPSkrQirXZSpa5QM4EvIW1+APySlT0=</latexit><latexit sha1_base64="/vknflwXoAF01V0jbg43kNju5Ko=">AAACkHichVHNLgNRFP6M//ppsZHYNBpi1ZwRCbFRbMRKW0WiTTMzLh2dPzPTJtX0BbxAFzZILMQDeAAbL2DRRxBLEhsLp9NJBMGZ3Lnf/e75zv3uPapj6J5P1OqSunt6+/oHBiNDwyOj0djY+I5nV1xN5DTbsN09VfGEoVsi5+u+IfYcVyimaohdtbze3t+tCtfTbWvbrzmiYCpHln6oa4rPVCGvmvW8YjglpXjcKMYSlKQg4j+BHIIEwtiyY3fI4wA2NFRgQsCCz9iAAo+/fcggOMwVUGfOZaQH+wINRFhb4SzBGQqzZf4f8Wo/ZC1et2t6gVrjUwweLivjmKFHuqEXeqBbeqL3X2vVgxptLzWe1Y5WOMXo2WT27V+VybOP0qfqT88+DrEUeNXZuxMw7VtoHX31tPmSXc7M1Gfpip7Z/yW16J5vYFVfteu0yJz/4UdlL/xi3CD5ezt+gp35pExJOb2QSK2FrRrAFKYxx/1YRAob2EKO65+giQtcSuPSkrQirXZSpa5QM4EvIW1+APySlT0=</latexit><latexit sha1_base64="/vknflwXoAF01V0jbg43kNju5Ko=">AAACkHichVHNLgNRFP6M//ppsZHYNBpi1ZwRCbFRbMRKW0WiTTMzLh2dPzPTJtX0BbxAFzZILMQDeAAbL2DRRxBLEhsLp9NJBMGZ3Lnf/e75zv3uPapj6J5P1OqSunt6+/oHBiNDwyOj0djY+I5nV1xN5DTbsN09VfGEoVsi5+u+IfYcVyimaohdtbze3t+tCtfTbWvbrzmiYCpHln6oa4rPVCGvmvW8YjglpXjcKMYSlKQg4j+BHIIEwtiyY3fI4wA2NFRgQsCCz9iAAo+/fcggOMwVUGfOZaQH+wINRFhb4SzBGQqzZf4f8Wo/ZC1et2t6gVrjUwweLivjmKFHuqEXeqBbeqL3X2vVgxptLzWe1Y5WOMXo2WT27V+VybOP0qfqT88+DrEUeNXZuxMw7VtoHX31tPmSXc7M1Gfpip7Z/yW16J5vYFVfteu0yJz/4UdlL/xi3CD5ezt+gp35pExJOb2QSK2FrRrAFKYxx/1YRAob2EKO65+giQtcSuPSkrQirXZSpa5QM4EvIW1+APySlT0=</latexit> <latexit sha1_base64="eF7Z1mp4biZIFQF2BTy5rqnnNEU=">AAACj3ichVG7SgNBFD1ZXzG+ojaCjRgUq3BXBMVCgjba+YoKRsLuOurgvtidBGLID/gBWlj4AAvxA/wAG3/Awk8Qywg2Ft5sFkRFvcvsnDlzz50zc03flqEiekpoLa1t7R3JzlRXd09vX7p/YCP0SoEl8pZne8GWaYTClq7IK6lsseUHwnBMW2yahwuN/c2yCELpueuq4osdx9h35Z60DMVUoWA61YIplFGUtWI6Q1mKYuQn0GOQQRzLXvoOBezCg4USHAi4UIxtGAj524YOgs/cDqrMBYxktC9QQ4q1Jc4SnGEwe8j/fV5tx6zL60bNMFJbfIrNI2DlCMbokW6oTg90S8/0/mutalSj4aXCs9nUCr/Ydzy09vavyuFZ4eBT9adnhT3MRF4le/cjpnELq6kvH53W12ZXx6rjdEUv7P+Snuieb+CWX63rFbF69ocfk73wi3GD9O/t+Ak2JrM6ZfWVqUxuPm5VEsMYxQT3Yxo5LGIZea7v4wTnuND6tWltTss1U7VErBnEl9CWPgDuoJTI</latexit><latexit sha1_base64="eF7Z1mp4biZIFQF2BTy5rqnnNEU=">AAACj3ichVG7SgNBFD1ZXzG+ojaCjRgUq3BXBMVCgjba+YoKRsLuOurgvtidBGLID/gBWlj4AAvxA/wAG3/Awk8Qywg2Ft5sFkRFvcvsnDlzz50zc03flqEiekpoLa1t7R3JzlRXd09vX7p/YCP0SoEl8pZne8GWaYTClq7IK6lsseUHwnBMW2yahwuN/c2yCELpueuq4osdx9h35Z60DMVUoWA61YIplFGUtWI6Q1mKYuQn0GOQQRzLXvoOBezCg4USHAi4UIxtGAj524YOgs/cDqrMBYxktC9QQ4q1Jc4SnGEwe8j/fV5tx6zL60bNMFJbfIrNI2DlCMbokW6oTg90S8/0/mutalSj4aXCs9nUCr/Ydzy09vavyuFZ4eBT9adnhT3MRF4le/cjpnELq6kvH53W12ZXx6rjdEUv7P+Snuieb+CWX63rFbF69ocfk73wi3GD9O/t+Ak2JrM6ZfWVqUxuPm5VEsMYxQT3Yxo5LGIZea7v4wTnuND6tWltTss1U7VErBnEl9CWPgDuoJTI</latexit><latexit sha1_base64="eF7Z1mp4biZIFQF2BTy5rqnnNEU=">AAACj3ichVG7SgNBFD1ZXzG+ojaCjRgUq3BXBMVCgjba+YoKRsLuOurgvtidBGLID/gBWlj4AAvxA/wAG3/Awk8Qywg2Ft5sFkRFvcvsnDlzz50zc03flqEiekpoLa1t7R3JzlRXd09vX7p/YCP0SoEl8pZne8GWaYTClq7IK6lsseUHwnBMW2yahwuN/c2yCELpueuq4osdx9h35Z60DMVUoWA61YIplFGUtWI6Q1mKYuQn0GOQQRzLXvoOBezCg4USHAi4UIxtGAj524YOgs/cDqrMBYxktC9QQ4q1Jc4SnGEwe8j/fV5tx6zL60bNMFJbfIrNI2DlCMbokW6oTg90S8/0/mutalSj4aXCs9nUCr/Ydzy09vavyuFZ4eBT9adnhT3MRF4le/cjpnELq6kvH53W12ZXx6rjdEUv7P+Snuieb+CWX63rFbF69ocfk73wi3GD9O/t+Ak2JrM6ZfWVqUxuPm5VEsMYxQT3Yxo5LGIZea7v4wTnuND6tWltTss1U7VErBnEl9CWPgDuoJTI</latexit><latexit sha1_base64="eF7Z1mp4biZIFQF2BTy5rqnnNEU=">AAACj3ichVG7SgNBFD1ZXzG+ojaCjRgUq3BXBMVCgjba+YoKRsLuOurgvtidBGLID/gBWlj4AAvxA/wAG3/Awk8Qywg2Ft5sFkRFvcvsnDlzz50zc03flqEiekpoLa1t7R3JzlRXd09vX7p/YCP0SoEl8pZne8GWaYTClq7IK6lsseUHwnBMW2yahwuN/c2yCELpueuq4osdx9h35Z60DMVUoWA61YIplFGUtWI6Q1mKYuQn0GOQQRzLXvoOBezCg4USHAi4UIxtGAj524YOgs/cDqrMBYxktC9QQ4q1Jc4SnGEwe8j/fV5tx6zL60bNMFJbfIrNI2DlCMbokW6oTg90S8/0/mutalSj4aXCs9nUCr/Ydzy09vavyuFZ4eBT9adnhT3MRF4le/cjpnELq6kvH53W12ZXx6rjdEUv7P+Snuieb+CWX63rFbF69ocfk73wi3GD9O/t+Ak2JrM6ZfWVqUxuPm5VEsMYxQT3Yxo5LGIZea7v4wTnuND6tWltTss1U7VErBnEl9CWPgDuoJTI</latexit>
i
h
1
<latexit sha1_base64="AJfed1VDbn8feRjLCNiNP3Dq0AM=">AAACi3ichVHNSgJRFD5Of2aZVpugjSRGKzlTQSEtpAha+pM/oCIz01UH54+ZUbDBF2jZpoVtClpED9ADtOkFWvgI0dKgTYuO40CUZGe4c7/73fOd+917REORLRux7+Ompmdm5/zzgYXF4FIovLySt/SWKbGcpCu6WRQFiymyxnK2bCusaJhMUEWFFcTm0XC/0GamJevaqd0xWEUV6ppckyXBJqpYFlWnUeW71XAU4+hGZBzwHoiCFyk9/AhlOAMdJGiBCgw0sAkrIIBFXwl4QDCIq4BDnElIdvcZdCFA2hZlMcoQiG3Sv06rksdqtB7WtFy1RKcoNExSRiCGL3iPA3zGB3zFzz9rOW6NoZcOzeJIy4xq6GIt+/GvSqXZhsa3aqJnG2qw73qVybvhMsNbSCN9+/xqkE1kYs4m3uIb+b/BPj7RDbT2u3SXZpneBD8ieaEXowbxv9sxDvLbcR7jfHo3mjz0WuWHddiALerHHiThBFKQc/twCT245oLcDpfgDkapnM/TrMKP4I6/AH/Mktg=</latexit><latexit sha1_base64="AJfed1VDbn8feRjLCNiNP3Dq0AM=">AAACi3ichVHNSgJRFD5Of2aZVpugjSRGKzlTQSEtpAha+pM/oCIz01UH54+ZUbDBF2jZpoVtClpED9ADtOkFWvgI0dKgTYuO40CUZGe4c7/73fOd+917REORLRux7+Ompmdm5/zzgYXF4FIovLySt/SWKbGcpCu6WRQFiymyxnK2bCusaJhMUEWFFcTm0XC/0GamJevaqd0xWEUV6ppckyXBJqpYFlWnUeW71XAU4+hGZBzwHoiCFyk9/AhlOAMdJGiBCgw0sAkrIIBFXwl4QDCIq4BDnElIdvcZdCFA2hZlMcoQiG3Sv06rksdqtB7WtFy1RKcoNExSRiCGL3iPA3zGB3zFzz9rOW6NoZcOzeJIy4xq6GIt+/GvSqXZhsa3aqJnG2qw73qVybvhMsNbSCN9+/xqkE1kYs4m3uIb+b/BPj7RDbT2u3SXZpneBD8ieaEXowbxv9sxDvLbcR7jfHo3mjz0WuWHddiALerHHiThBFKQc/twCT245oLcDpfgDkapnM/TrMKP4I6/AH/Mktg=</latexit><latexit sha1_base64="AJfed1VDbn8feRjLCNiNP3Dq0AM=">AAACi3ichVHNSgJRFD5Of2aZVpugjSRGKzlTQSEtpAha+pM/oCIz01UH54+ZUbDBF2jZpoVtClpED9ADtOkFWvgI0dKgTYuO40CUZGe4c7/73fOd+917REORLRux7+Ompmdm5/zzgYXF4FIovLySt/SWKbGcpCu6WRQFiymyxnK2bCusaJhMUEWFFcTm0XC/0GamJevaqd0xWEUV6ppckyXBJqpYFlWnUeW71XAU4+hGZBzwHoiCFyk9/AhlOAMdJGiBCgw0sAkrIIBFXwl4QDCIq4BDnElIdvcZdCFA2hZlMcoQiG3Sv06rksdqtB7WtFy1RKcoNExSRiCGL3iPA3zGB3zFzz9rOW6NoZcOzeJIy4xq6GIt+/GvSqXZhsa3aqJnG2qw73qVybvhMsNbSCN9+/xqkE1kYs4m3uIb+b/BPj7RDbT2u3SXZpneBD8ieaEXowbxv9sxDvLbcR7jfHo3mjz0WuWHddiALerHHiThBFKQc/twCT245oLcDpfgDkapnM/TrMKP4I6/AH/Mktg=</latexit><latexit sha1_base64="AJfed1VDbn8feRjLCNiNP3Dq0AM=">AAACi3ichVHNSgJRFD5Of2aZVpugjSRGKzlTQSEtpAha+pM/oCIz01UH54+ZUbDBF2jZpoVtClpED9ADtOkFWvgI0dKgTYuO40CUZGe4c7/73fOd+917REORLRux7+Ompmdm5/zzgYXF4FIovLySt/SWKbGcpCu6WRQFiymyxnK2bCusaJhMUEWFFcTm0XC/0GamJevaqd0xWEUV6ppckyXBJqpYFlWnUeW71XAU4+hGZBzwHoiCFyk9/AhlOAMdJGiBCgw0sAkrIIBFXwl4QDCIq4BDnElIdvcZdCFA2hZlMcoQiG3Sv06rksdqtB7WtFy1RKcoNExSRiCGL3iPA3zGB3zFzz9rOW6NoZcOzeJIy4xq6GIt+/GvSqXZhsa3aqJnG2qw73qVybvhMsNbSCN9+/xqkE1kYs4m3uIb+b/BPj7RDbT2u3SXZpneBD8ieaEXowbxv9sxDvLbcR7jfHo3mjz0WuWHddiALerHHiThBFKQc/twCT245oLcDpfgDkapnM/TrMKP4I6/AH/Mktg=</latexit>
h
<latexit sha1_base64="2wUvEggzsl8KMUzkfhxLhymXyT0=">AAACi3ichVHNSgJRFD5Of2aZVpugjSRGKzlTQSEtpAha+pM/oCIz01UH54+ZUbDBF2jZpoVtClpED9ADtOkFWvgI0dKgTYuO40CUZGe4c7/73fOd+917REORLRux7+Ompmdm5/zzgYXF4FIovLySt/SWKbGcpCu6WRQFiymyxnK2bCusaJhMUEWFFcTm0XC/0GamJevaqd0xWEUV6ppckyXBJqpYFlWnUW12q+EoxtGNyDjgPRAFL1J6+BHKcAY6SNACFRhoYBNWQACLvhLwgGAQVwGHOJOQ7O4z6EKAtC3KYpQhENukf51WJY/VaD2sablqiU5RaJikjEAMX/AeB/iMD/iKn3/WctwaQy8dmsWRlhnV0MVa9uNflUqzDY1v1UTPNtRg3/Uqk3fDZYa3kEb69vnVIJvIxJxNvMU38n+DfXyiG2jtd+kuzTK9CX5E8kIvRg3if7djHOS34zzG+fRuNHnotcoP67ABW9SPPUjCCaQg5/bhEnpwzQW5HS7BHYxSOZ+nWYUfwR1/AftGkxI=</latexit><latexit sha1_base64="2wUvEggzsl8KMUzkfhxLhymXyT0=">AAACi3ichVHNSgJRFD5Of2aZVpugjSRGKzlTQSEtpAha+pM/oCIz01UH54+ZUbDBF2jZpoVtClpED9ADtOkFWvgI0dKgTYuO40CUZGe4c7/73fOd+917REORLRux7+Ompmdm5/zzgYXF4FIovLySt/SWKbGcpCu6WRQFiymyxnK2bCusaJhMUEWFFcTm0XC/0GamJevaqd0xWEUV6ppckyXBJqpYFlWnUW12q+EoxtGNyDjgPRAFL1J6+BHKcAY6SNACFRhoYBNWQACLvhLwgGAQVwGHOJOQ7O4z6EKAtC3KYpQhENukf51WJY/VaD2sablqiU5RaJikjEAMX/AeB/iMD/iKn3/WctwaQy8dmsWRlhnV0MVa9uNflUqzDY1v1UTPNtRg3/Uqk3fDZYa3kEb69vnVIJvIxJxNvMU38n+DfXyiG2jtd+kuzTK9CX5E8kIvRg3if7djHOS34zzG+fRuNHnotcoP67ABW9SPPUjCCaQg5/bhEnpwzQW5HS7BHYxSOZ+nWYUfwR1/AftGkxI=</latexit><latexit sha1_base64="2wUvEggzsl8KMUzkfhxLhymXyT0=">AAACi3ichVHNSgJRFD5Of2aZVpugjSRGKzlTQSEtpAha+pM/oCIz01UH54+ZUbDBF2jZpoVtClpED9ADtOkFWvgI0dKgTYuO40CUZGe4c7/73fOd+917REORLRux7+Ompmdm5/zzgYXF4FIovLySt/SWKbGcpCu6WRQFiymyxnK2bCusaJhMUEWFFcTm0XC/0GamJevaqd0xWEUV6ppckyXBJqpYFlWnUW12q+EoxtGNyDjgPRAFL1J6+BHKcAY6SNACFRhoYBNWQACLvhLwgGAQVwGHOJOQ7O4z6EKAtC3KYpQhENukf51WJY/VaD2sablqiU5RaJikjEAMX/AeB/iMD/iKn3/WctwaQy8dmsWRlhnV0MVa9uNflUqzDY1v1UTPNtRg3/Uqk3fDZYa3kEb69vnVIJvIxJxNvMU38n+DfXyiG2jtd+kuzTK9CX5E8kIvRg3if7djHOS34zzG+fRuNHnotcoP67ABW9SPPUjCCaQg5/bhEnpwzQW5HS7BHYxSOZ+nWYUfwR1/AftGkxI=</latexit><latexit sha1_base64="2wUvEggzsl8KMUzkfhxLhymXyT0=">AAACi3ichVHNSgJRFD5Of2aZVpugjSRGKzlTQSEtpAha+pM/oCIz01UH54+ZUbDBF2jZpoVtClpED9ADtOkFWvgI0dKgTYuO40CUZGe4c7/73fOd+917REORLRux7+Ompmdm5/zzgYXF4FIovLySt/SWKbGcpCu6WRQFiymyxnK2bCusaJhMUEWFFcTm0XC/0GamJevaqd0xWEUV6ppckyXBJqpYFlWnUW12q+EoxtGNyDjgPRAFL1J6+BHKcAY6SNACFRhoYBNWQACLvhLwgGAQVwGHOJOQ7O4z6EKAtC3KYpQhENukf51WJY/VaD2sablqiU5RaJikjEAMX/AeB/iMD/iKn3/WctwaQy8dmsWRlhnV0MVa9uNflUqzDY1v1UTPNtRg3/Uqk3fDZYa3kEb69vnVIJvIxJxNvMU38n+DfXyiG2jtd+kuzTK9CX5E8kIvRg3if7djHOS34zzG+fRuNHnotcoP67ABW9SPPUjCCaQg5/bhEnpwzQW5HS7BHYxSOZ+nWYUfwR1/AftGkxI=</latexit>k
h
N
layer
<latexit sha1_base64="SHpl7qO+uqi3ENtBqNZ6AFoz33M=">AAACl3ichVHLSsNAFD3Gd3201o3iRiyKq3IjguJGUZCupFWrgkpI4qiheZGkxRr6A/6AC0FQEBU/wA9w4w+48BPEpYIbF96mAVFRb5jMmTP33DkzV3NNww+IHpuk5pbWtvaOzkRXd09vMtWXXvOdsqeLou6Yjrehqb4wDVsUAyMwxYbrCdXSTLGulRbq++sV4fmGY68GVVdsW+qebewauhowpaTSW5oV7ivhkhKaalV4tVpNSWUoS1EM/wRyDDKII++kbrGFHTjQUYYFARsBYxMqfP42IYPgMreNkDmPkRHtC9SQYG2ZswRnqMyW+L/Hq82YtXldr+lHap1PMXl4rBzGKD3QNb3QPd3QE73/WiuMatS9VHnWGlrhKsmjgZW3f1UWzwH2P1V/eg6wi+nIq8He3Yip30Jv6CuHxy8rM8uj4Rid0zP7P6NHuuMb2JVX/aIglk/+8KOxF34xbpD8vR0/wdpEVqasXJjMzM3HrerAEEYwzv2YwhxyyKPI9Q9wiktcSYPSrLQo5RqpUlOs6ceXkAofWgmX9g==</latexit><latexit sha1_base64="SHpl7qO+uqi3ENtBqNZ6AFoz33M=">AAACl3ichVHLSsNAFD3Gd3201o3iRiyKq3IjguJGUZCupFWrgkpI4qiheZGkxRr6A/6AC0FQEBU/wA9w4w+48BPEpYIbF96mAVFRb5jMmTP33DkzV3NNww+IHpuk5pbWtvaOzkRXd09vMtWXXvOdsqeLou6Yjrehqb4wDVsUAyMwxYbrCdXSTLGulRbq++sV4fmGY68GVVdsW+qebewauhowpaTSW5oV7ivhkhKaalV4tVpNSWUoS1EM/wRyDDKII++kbrGFHTjQUYYFARsBYxMqfP42IYPgMreNkDmPkRHtC9SQYG2ZswRnqMyW+L/Hq82YtXldr+lHap1PMXl4rBzGKD3QNb3QPd3QE73/WiuMatS9VHnWGlrhKsmjgZW3f1UWzwH2P1V/eg6wi+nIq8He3Yip30Jv6CuHxy8rM8uj4Rid0zP7P6NHuuMb2JVX/aIglk/+8KOxF34xbpD8vR0/wdpEVqasXJjMzM3HrerAEEYwzv2YwhxyyKPI9Q9wiktcSYPSrLQo5RqpUlOs6ceXkAofWgmX9g==</latexit><latexit sha1_base64="SHpl7qO+uqi3ENtBqNZ6AFoz33M=">AAACl3ichVHLSsNAFD3Gd3201o3iRiyKq3IjguJGUZCupFWrgkpI4qiheZGkxRr6A/6AC0FQEBU/wA9w4w+48BPEpYIbF96mAVFRb5jMmTP33DkzV3NNww+IHpuk5pbWtvaOzkRXd09vMtWXXvOdsqeLou6Yjrehqb4wDVsUAyMwxYbrCdXSTLGulRbq++sV4fmGY68GVVdsW+qebewauhowpaTSW5oV7ivhkhKaalV4tVpNSWUoS1EM/wRyDDKII++kbrGFHTjQUYYFARsBYxMqfP42IYPgMreNkDmPkRHtC9SQYG2ZswRnqMyW+L/Hq82YtXldr+lHap1PMXl4rBzGKD3QNb3QPd3QE73/WiuMatS9VHnWGlrhKsmjgZW3f1UWzwH2P1V/eg6wi+nIq8He3Yip30Jv6CuHxy8rM8uj4Rid0zP7P6NHuuMb2JVX/aIglk/+8KOxF34xbpD8vR0/wdpEVqasXJjMzM3HrerAEEYwzv2YwhxyyKPI9Q9wiktcSYPSrLQo5RqpUlOs6ceXkAofWgmX9g==</latexit><latexit sha1_base64="SHpl7qO+uqi3ENtBqNZ6AFoz33M=">AAACl3ichVHLSsNAFD3Gd3201o3iRiyKq3IjguJGUZCupFWrgkpI4qiheZGkxRr6A/6AC0FQEBU/wA9w4w+48BPEpYIbF96mAVFRb5jMmTP33DkzV3NNww+IHpuk5pbWtvaOzkRXd09vMtWXXvOdsqeLou6Yjrehqb4wDVsUAyMwxYbrCdXSTLGulRbq++sV4fmGY68GVVdsW+qebewauhowpaTSW5oV7ivhkhKaalV4tVpNSWUoS1EM/wRyDDKII++kbrGFHTjQUYYFARsBYxMqfP42IYPgMreNkDmPkRHtC9SQYG2ZswRnqMyW+L/Hq82YtXldr+lHap1PMXl4rBzGKD3QNb3QPd3QE73/WiuMatS9VHnWGlrhKsmjgZW3f1UWzwH2P1V/eg6wi+nIq8He3Yip30Jv6CuHxy8rM8uj4Rid0zP7P6NHuuMb2JVX/aIglk/+8KOxF34xbpD8vR0/wdpEVqasXJjMzM3HrerAEEYwzv2YwhxyyKPI9Q9wiktcSYPSrLQo5RqpUlOs6ceXkAofWgmX9g==</latexit>