Data Allocation Strategies for Dense Linear Algebra Kernels on Heterogeneous Two-dimensional Grids

Texte intégral

(1)Data Allocation Strategies for Dense Linear Algebra Kernels on Heterogeneous Two-dimensional Grids Vincent Boudet, Antoine Petitet, Fabrice Rastello, Yves Robert. To cite this version: Vincent Boudet, Antoine Petitet, Fabrice Rastello, Yves Robert. Data Allocation Strategies for Dense Linear Algebra Kernels on Heterogeneous Two-dimensional Grids. [Research Report] LIP RR-1999-31, Laboratoire de l’informatique du parallélisme. 1999, 2+24 p. �hal-02102033�. HAL Id: hal-02102033 https://hal-lara.archives-ouvertes.fr/hal-02102033 Submitted on 17 Apr 2019. HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers.. L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés..

(2) Laboratoire de l’Informatique du Parallélisme. SPI. ´ Ecole Normale Supérieure de Lyon Unité Mixte de Recherche CNRS-INRIA-ENS LYON no 5668.

(3)

(4)

(5) .

(6) . .

(7) . ´ Ecole Normale Supérieure de Lyon 46 Allée d’Italie, 69364 Lyon Cedex 07, France Téléphone : +33(0)4.72.72.80.37 Télécopieur : +33(0)4.72.72.80.80 Adresse e´ lectronique :

(8).

(9)

(10)

(11)

(12) .

(13) .

(14)

(15)

(16) !"

(17) # $

(18) ! % Æ # & %

(19)

(20)

(21)

(22)

(23) #

(24)

(25) !

(26)

(27)

(28) # &

(29)

(30) % % #.

(31) . % '

(32)

(33) #. !

(34)

(35) ( )

(36) (

(37) )* ( +

(38) ( * ( (( *

(39) # ,

(40) * ! ( (# - + . +/ ( ( ) *

(41) (

(42) (( * *

(43)

(44) # -)(

(45) + ( 01(

(46)

(47) ' ( ( (( *#. .

(48) (( * (( *

(49) '( ( (+ #.

(50) 2 % % 23" +

(51)

(52) # &

(53)

(54)

(55) )

(56)

(57) 4 ,56 6,7

(58)

(59) "

(60)

(61)

(62) # & % # 7

(63) 234 '

(64) '

(65)

(66)

(67)

(68)

(69)

(70) #

(71)

(72) 8 %# & 0

(73)

(74) Æ

(75) '

(76) # 7

(77)

(78)

(79)

(80)

(81) % 23#

(82) 23 "

(83)

(84)

(85) 9: ;<# =

(86)

(87) Æ # &

(88)

(89) 4 "

(90) ! > " %

(91) # & 0

(92)

(93)

(94) Æ

(95)

(96) + % ? -=,=@A 9B<

(97)

(98) 23

(99) # &

(100)

(101) C # 7 ? %

(102) % D # 7 ? C

(103) ! " # 7 ? E

(104)

(105)

(106)

(107) % ! # 7 ? F

(108)

(109)

(110) 23# 1 % ? B#. .

(111)

(112) . G )

(113)

(114)

(115)

(116) # 7

(117) "

(118) # 3 % . %

(119)

(120)

(121) %

(122) % 0

(123) # 2

(124)

(125)

(126)

(127) # 3

(128)

(129) C" # $

(130) Æ # 2 . 1 % . 4

(131) +

(132)

(133) '

(134) #. . . 3 % % '

(135)

(136) .

(137)

(138) # 7 ' '

(139)

(140)

(141) 23 "# 7 %# $ 23? 8 % + 6 %

(142) %

(143)

(144) # 7

(145)

(146) +#. .

(147) 7 1 23 " ! 9<# %

(148) ? % %

(149) -H I

(150) #. . . D

(151) % 9: ;< #

(152) #. &

(153) .

(154)

(155)

(156)

(157)

(158) 9 <# & Æ

(159) C

(160)

(161) 4

(162) %

(163) + % %

(164)

(165) J 7

(166)

(167) 4 . . K K " . . . . . %# &

(168) . .

(169) . . + # $

(170) 9;<4.

(171)

(172)

(173) !" #

(174) L L L

(175) K

(176)

(177) L L L K K L L L L " K L "" . . . . K L . . . . . . . . . . . . . . @

(178)

(179) K K F K ;# & K M % = ## F % % % #. . . . $ %&

(180) ' ( & %" -H I

(181) % 4

(182)

(183)

(184)

(185)

(186)

(187) % "

(188)

(189) # $

(190)

(191)

(192) .

(193)

(194) # &

(195) 3 "

(196)

(197)

(198) .

(199) # @ 1

(200) # = C 1 %

(201)

(202) %4 %

(203) % # 7 C K %# = ##

(204) %# & C %

(205) # =

(206) %

(207) # 7 %

(208) 1

(209) %

(210)

(211) # %

(212)

(213)

(214) #

(215)

(216) 4 %

(217) %" .

(218) '

(219) "#. .

(220) . - % .

(221) % L

(222)

(223) # 2 0 1 %

(224)

(225)

(226)

(227)

(228)

(229) # & .

(230)

(231)

(232) 4. . . . & 4

(233)

(234) 4 % M E F B : ; M. M E F F F. M M . . = . M M M M . K K F K ;#. ?

(235) . #F. . #; #B: #: #;: #B: #B. . . 7 &

(236)

(237) K M# & .?

(238) / %

(239) # =

(240) .?

(241) / .

(242) C# &

(243) 4 K " %

(244) " % . . " K. . . . . . . $

(245) E ## % % ## " K M"#

(246) % ## J &

(247) L " K M" L " K M" L " K "

(248) " " "# 2 K " K "# G % -H I

(249) . %

(250) $ #

(251)

(252) # $ C K .

(253) K ## 1 # G

(254) 1 K M

(255)

(256)

(257)

(258)

(259)

(260) C#

(261) K M K . / # @

(262)

(263) K K F K ;# &

(264) %

(265) & # & %

(266) & 4 " $ "# = $

(267) % % 1

(268)

(269) %

(270) 1 % "# 7

(271)

(272) 1 .

(273) 4 1

(274) M %

(275) "

(276) ;

(277) # &

(278) . C %

(279) K M# ? $

(280) #. . . . . . . . . . . . . . . . . . . . . .

(281) & 4 ? @ % , . . . E . K M %# F . B. : . ; . . M . r. done. Bxr. $ 4 = . . . %#. !. &

(282)

(283)

(284) "

(285) # 6

(286)

(287) +

(288)

(289)

(290) ##

(291)

(292) %4

(293)

(294) G 9E<

(295) C 9 < # ?

(296)

(297)

(298)

(299)

(300) %

(301) 23 9 E F <# ? ,

(302) 9 B< =

(303)

(304) -? 9E<

(305)

(306) 9 <"# &

(307)

(308) % # & %

(309)

(310) A - % 9 M< 0 # & -H

(311) ! ! # &

(312)

(313) . % /

(314) % '

(315)

(316) # &

(317) 9<

(318) ! ! 1 1 "# 7 . % / . / !

(319) E # . % ? ## #. .

(320)

(321) . 7 D

(322) ? -=,=@A 9B< ! # & % ? -=,=@A

(323) ! #. . " "

(324) #. ) *

(325) . . . . . $ %

(326)

(327) K + # 7 ? -=,=@A

(328) 9 B <# @ !

(329) C # = 1 K K # 7 ! 4

(330) # &

(331) .

(332) " C

(333) #

(334) "

(335) # . . . . . . E.

(336) . . . . . .

(337) .

(338) . ½ ¿. ¾. ¾. ½. ¿.

(339)

(340) .

(341)

(342) . $ 4 @

(343) ' -H

(344)

(345)

(346) F ;# & 1 # & % K M#. . . . .

(347)

(348)

(349) L K # & ? -=,=@A Æ

(350) % @ ) 9 <"# 6

(351)

(352) " .

(353)

(354) # 3 ? -=,=@A % +C

(355)

(356)

(357) 9F <# 8 Æ

(358)

(359) + %

(360)

(361) .

(362)

(363) # $ C 4 %

(364) # & %

(365)

(366)

(367) %

(368) # =

(369) $ K K E K M#. . . 1. 2. 3. 4. 1. 2. 3. 4. 1. 2. 5. 6. 7. 8. 5. 6. 7. 8. 5. 6. 9 10 11 12 9 10 11 12 9 10 13 14 15 16 13 14 15 16 13 14 1. 2. 3. 4. 1. 2. 3. 4. 1. 2. 5. 6. 7. 8. 5. 6. 7. 8. 5. 6. 9 10 11 12 9 10 11 12 9 10 13 14 15 16 13 14 15 16 13 14 1. 2. 3. 4. 1. 2. 3. 4. 1. 2. 5. 6. 7. 8. 5. 6. 7. 8. 5. 6. $ 4 , B# & 1

(370) M M % E E

(371) #. F.

(372) ) *

(373) . . . ?

(374)

(375)

(376) # 7 % # = %

(377) KE %# ? $ E

(378) K 4

(379) % ! # &

(380)

(381) K K # %

(382)

(383) # $ F %

(384) ! #. . . . . . 1. 1. 2. 1. 1. 2. 1. 1. 2. 3. 3. 6. . . . . $ E4 = %

(385) K E K # 8

(386) # C"

(387) %4

(388) %

(389) #. 1. 1. 2. 1. 1. 2. 1. 1. 2. 1. 1. 1. 2. 1. 1. 2. 1. 1. 2. 1. 1. 1. 2. 1. 1. 2. 1. 1. 2. 1. 3. 3. 6. 3. 3. 6. 3. 3. 6. 3. 1. 1. 2. 1. 1. 2. 1. 1. 2. 1. 1. 1. 2. 1. 1. 2. 1. 1. 2. 1. 1. 1. 2. 1. 1. 2. 1. 1. 2. 1. 3. 3. 6. 3. 3. 6. 3. 3. 6. 3. 1. 1. 2. 1. 1. 2. 1. 1. 2. 1. 1. 1. 2. 1. 1. 2. 1. 1. 2. 1. $ F4 = E

(390) M M %#. .

(391) "# & . . 2 %

(392)

(393) J 7 %

(394) ## %

(395)

(396) "

(397)

(398) # 7

(399) $ E

(400)

(401) K K K K B# & K E K %

(402)

(403)

(404) # &

(405) %

(406) %

(407) #

(408) # &

(409)

(410) # ?

(411) . # 7 . $ B#. . . . . B. .

(412) . . . & %

(413) %# ? %# &

(414) $ F

(415) # H .

(416)

(417)

(418)

(419) # @ % $ E

(420)

(421) % K B . . . . . . $ K F# 7 %

(422) $ E

(423) #

(424) %# 7 % # ,

(425) % # &

(426) 1 + 4 K K K K K K B K K K # % . L " L " K % %

(427) 4 . . . . . . . . . . . .

(428)

(429) % C

(430) # 7

(431)

(432) 4 1

(433)

(434) ">

(435) "# & . % / A - % 9 M< $ B# G

(436)

(437) C #. . 1. 2. 1. 5. 1. 2. 3. 2. 1. 2. 1. 2. 1. 2. 3. 5. $ B4 & A - %# &

(438) # , #

(439)

(440) % A - % 9 M< %# $

(441)

(442) # 7

(443)

(444) 1 . K K # ? K " F : K F" # J & 1

(445)

(446) K # &

(447) . . . . . . . . :. .

(448)

(449) K # ? B EM 1

(450)

(451) # G )

(452)

(453) C .

(454)

(455) # $ C

(456)

(457) A - %)

(458)

(459) #

(460)

(461) " C. # &

(462)

(463) Æ

(464) C

(465) % Æ

(466) # ?

(467) C

(468) 0 ? E#. . $ % # . 1 ? -=,=@A -H I

(469) ! #

(470) ! #. ) *

(471) 7 D

(472) C % -H

(473) # "

(474) #

(475) # & %

(476) C D 4 @ # !

(477) -H C 1

(478) M .

(479)

(480) #

(481)

(482)

(483) # &

(484) C 0

(485)

(486)

(487)

(488)

(489)

(490) C

(491) # &

(492)

(493)

(494)

(495) %

(496) # &

(497)

(498) # 7

(499)

(500) N

(501) # & %

(502) %

(503) N

(504) N

(505) 4. . . . . . . # &

(506) " # &

(507) . ". . . . C

(508) .

(509) . # 8

(510)

(511)

(512)

(513) &

(514) N

(515)

(516) %

(517)

(518) C "# - # &

(519)

(520) C

(521)

(522)

(523) % ? -=,=@A 9<# ? 9E F<

(524) %

(525)

(526) # &

(527) C I

(528) 9 M<. . ) *

(529) $

(530) -H I

(531) ! ? -=,=@A "

(532)

(533) # & 4

(534) -H I

(535) %

(536) +

(537)

(538)

(539) # %

(540)

(541) %# & %

(542) . # & 1 % %

(543)

(544) #. . . ;.

(545) @

(546)

(547)

(548) . . . K F . . . . 4. . ?

(549) K ; K B ##

(550)

(551) E; %# H ? E" % 4.

(552) 1

(553) B %

(554) % 3 B

(555) 1 E . &

(556) $ :#

(557)

(558) # $

(559)

(560) %

(561)

(562) .

(563)

(564) "

(565)

(566) # $ -H I

(567) +

(568) 4

(569) ? ## C %

(570)

(571) # ? ##

(572) !

(573) # 7

(574) 1

(575) .

(576) % B

(577)

(578) + >

(579)

(580) % B

(581)

(582) .

(583) F +

(584) # &

(585) $ :#. . . .

(586). . . . . . $ :4 = % %

(587) #. . . . K ; . K B# 8

(588) . . & Æ

(589) # $ % .

(590) ## Æ ! # 7 % " %

(591) # %

(592) %

(593) # = %

(594) '

(595) # $

(596) # &

(597)

(598) Æ

(599) #. .

(600) . . & '

(601) . . . . @

(602)

(603) # &

(604)

(605) C

(606)

(607) K

(608) # 0 # @

(609) C # -

(610) # =

(611) . . . . . . . . . .

(612) %

(613)

(614) 4 $ ;

(615) # . . . . .

(616).

(617) .

(618) .

(619) . .

(620) .

(621) .

(622) .

(623) . .

(624) .

(625) .

(626) .

(627) . $ ;4 =

(628)

(629) E & +"

(630) Æ 4. . . , % C

(631) # & %

(632) 4. . . . K C

(633) 4

(634) K K # K " % +

(635) #

(636)

(637) "

(638) "4 +# 4 O

(639) C

(640) 1 #

(641)

(642) K K # ?

(643) ##

(644)

(645) # . . . . . . . . . . . . . . . . . = %

(646) 4 .

(647) J =

(648) % #

(649) % # ?

(650) " +"

(651) C

(652) 4. +# 4 " =

(653) C

(654) 1 # = L L 4

(655) ) # 7

(656) K #. . . . . . . . M. .

(657) 4 K " .

(658) . . . . . K K K K . . . " . . . " " ¢ " " . . . . . . . .

(659) "# &

(660) % # ?

(661) C

(662)

(663) 0 ? E##. $ (

(664) . 7 !

(665) 4 K

(666) ! C

(667) %

(668)

(669)

(670) #

(671)

(672) # &

(673) Æ %

(674) C

(675)

(676) #

(677) "

(678)

(679) C

(680) # #

(681) C

(682) 1 " # !

(683)

(684) # 8 1

(685) # &

(686) !

(687) #. . . . . . . . .

(688) ( ). . &

(689)

(690) # $

(691) 6 % 9< 1

(692) 1 "

(693) # 2 1 %

(694)

(695) # 7

(696) > . /# = 1 4 4 # ? . 4 #. . $

(697) , &

(698) % 4 # - . . . . . . . . . . # @

(699) # &

(700) # # ? . /

(701)

(702)

(703)

(704)

(705) # &

(706) % . / 1 4. .

(707) (- . . ! 4 . . . " " " . . . ! . . . . "K ". . . .

(708) .

(709)

(710) . !

(711) ¼ ¼ . . . . / ! . ! "!. # $ ". " " " " . !. !. !. . " . !. O

(712) 1 # &

(713) +1 . /

(714) %4

(715)

(716)

(717) # P 4 ". %. %. . !. . %!. P

(718)

(719) " .

(720) "" "# . $ % $ ! "% ! % !" K L " . . % ! . . . !. " # $ $ " # -. & %

(721)

(722) " " K "4

(723)

(724) K ¼ ¼ # - K K Æ # . ! $ !. ! . % ! ". % !" L ¼ ¼ " L " L ¼ ¼ ¼ " L " K % ! " " L "" ¼ ¼ " " % ! " @

(725) !

(726) C

(727) # ? +

(728) # 7 ! # 3 " " " " " " # &

(729) " # - K ! " K ! L "4

(730)

(731) $ K $ " # - ! K $ !# ! ! + K 0 " # " . Æ K Æ K & !

(732) % ! " " % ! "# 7 !

(733)

(734) . K. . . . . . . . . . . . . . . . Æ. . . . . . . . . 1

(735) 1 #. .

(736) * ). . . . . 7

(737) C

(738) # $ C

(739)

(740)

(741) !

(742) # -

(743) C

(744) . . . . !. . .

(745) 0 1 $. . . @

(746) C

(747) # C +