A Proposal for a Heterogeneous Cluster ScaLAPACK (Dense Linear Solvers)
23
0
0
Texte intégral
(2) Laboratoire de l’Informatique du Parall´elisme. SPI. ´ Ecole Normale Sup´erieure de Lyon Unit´e Mixte de Recherche CNRS-INRIA-ENS LYON no 5668. .
(3).
(4)
(5)
(6) . .
(7) . ´ Ecole Normale Sup´erieure de Lyon 46 All´ee d’Italie, 69364 Lyon Cedex 07, France T´el´ephone : +33(0)4.72.72.80.37 T´el´ecopieur : +33(0)4.72.72.80.80 Adresse e´ lectronique :
(8).
(9) .
(10).
(11)
(12)
(13)
(14) .
(15) . .
(16) .
(17)
(18)
(19)
(20) ! . Æ
(21)
(22) " #$%$&' ( )
(23) . * + ,,.
(24) ) - . , ,
(25) " .
(26) . , Æ ,
(27) . . *
(28)
(29)
(30) *
(31)
(32) . . /
(33) -
(34) 01
(35)
(36) 2 ,
(37) " #$%$&'
(38) #3 4 .
(39)
(40) .
(41) 1 1 * . 1
(42) 1 1 . ) 1 5. 6 6
(43) +. 5 6 .5 . 5
(44) 556
(45) 6 , & 5
(46) 51 6 Æ 1 . . " #$%$&'( " 5
(47) .
(48) 556 1 + + 5. , 1 5 6 , - 3 + . 6 61 6 7 5 6 5 78 6 5 . . 3 + 5 6 .5 . +
(49) . , .
(50) +1 +
(51) . , 1 , 5
(52) 5 $ 1 . * 5. 9 *5 +
(53) 5 6 5 . " #$%$&'1 . . 5 #3 4. .
(54) 5561 5 51 . ,. *5 1 1 1 5+. 9.
(55) ! + , .
(56)
(57) : %;< <%= . .
(58)
(59) ,
(60)
(61) , 1
(62) .
(63) >
(64)
(65) -
(66)
(67) . * =
(68) 1 . , .
(69) ?/ ?
(70) -
(71) @& " #$%$&'A , , :
(72) Æ #3 4
(73) ?/( &
(74) ?/:
(75) ,
(76)
(77)
(78)
(79) , . 1
(80)
(81)
(82) . , +
(83) )
(84)
(85)
(86)
(87) .
(88) 1 .
(89) $ -
(90) 1
(91)
(92) 1
(93)
(94) 1
(95) 1 . >
(96)
(97) !,1 1 ,
(98)
(99)
(100) .
(101)
(102) . . ?
(103)
(104)
(105) 1 . 2 ,
(106) . . 1 -
(107) :
(108) . +
(109) . *.
(110)
(111)
(112) ,
(113) ?/
(114) >
(115) ,
(116)
(117)
(118) 2 = " 9 .
(119) . /
(120) 1 ,
(121) . * . / 2
(122) .
(123)
(124) . : " B %;< . #3 4 *
(125) ?/.
(126) .
(127) .
(128) = " C1 , . , ,
(129) . ?/ ?
(130)
(131)
(132) 1 -. . / , - " D.
(133) . =
(134) . , " #$%$&'
(135) ?/ " .
(136) Æ ,
(137) ,
(138)
(139) . .
(140)
(141) , 1
(142) . /
(143)
(144)
(145) . 1
(146) " 9 /
(147)
(148) , / .
(149) " 9 9 .
(150)
(151) .
(152)
(153) 1
(154) : ,
(155) 1
(156) + 2
(157) +
(158) 1
(159) .
(160)
(161)
(162) . 1 1 1 , . . 1 1 1 1
(163)
(164) ( !
(165) . .
(166)
(167) $ Æ
(168) .
(169) :
(170)
(171) . (
(172)
(173) . ( / . 1 .
(174)
(175)
(176) . .
(177)
(178)
(179)
(180)
(181)
(182) . (
(183)
(184)
(185)
(186) , "
(187) 1
(188)
(189) ,
(190) :.
(191)
(192)
(193) !
(194)
(195) E E E .
(196) F
(197)
(198) E E E F F E E E E F E F E . . . . . . "
(199) . . & 1
(200)
(201) ,
(202) .
(203)
(204) 1 ,
(205) ,. " . . : . . $
(206) 21 /
(207) , F ! 1 1 &
(208) . / ,
(209) &
(210)
(211) "
(212) , G
(213) 1 1
(214)
(215) . .
(216)
(217) /
(218) , E 1
(219)
(220) .
(221) E E & &
(222)
(223) 1
(224)
(225)
(226)
(227)
(228) . 1 ¼. ¼. ¼. ¼. ¼. ¼. ¼. ¼. " 1 E E E 1
(229) 1.
(230)
(231) . $
(232) 9
(233)
(234)
(235)
(236)
(237)
(238)
(239)
(240) . # $
(241) . 9.
(242) .
(243) .. . =1
(244)
(245) . ,
(246)
(247) .
(248) . H
(249)
(250)
(251)
(252) $
(253) 9 & .
(254) B . , F B1 F D F I /
(255) F 1
(256) 2 9CJ 9CJ
(257) I I + 2 B9 B9 B9 2
(258) K9L ! 1 F I
(259) ,
(260) . 1 F I
(261) .
(262) $
(263) 9
(264) $ * . ? . + Æ . 1
(265) ". =1 FJ B 9B C F CM 9B C F<FI CM 9C C. . 9M 9M. : "
(266) 9 B .
(267) F B1 F D F I1 111111 000000 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 111111 000000. . . . 1111111 0000000 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111 0000000 1111111. . . :. . . 111111 000000 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111. IL. . 111111 000000 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111. . : K JD : ILE F K JDL. 111111 000000 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111. . . : K : CMLE F K L K : CMLN : K C : JCLE F K CL KC C : JCL. F I. 111111 000000 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111 000000 111111. . B : : K : CMLE F K BL. KJD JD :. KB : CML. : )* . B
(268) . . , F B1 F D F I $
(269) - . /
(270) .
(271) . 1
(272) ,
(273) ,
(274) .
(275) . # .
(276) ,
(277)
(278)
(279) :. %
(280)
(281)
(282) .
(283) , 1 , .
(284)
(285)
(286) B.
(287)
(288)
(289)
(290)
(291) & KCL1 1
(292)
(293) , . , 1
(294) ,
(295) . #
(296) H,
(297)
(298) 1
(299)
(300)
(301) >
(302) >
(303) . . @ A:
(304)
(305) 1
(306)
(307) 1
(308)
(309)
(310) . "
(311) , G KL
(312) . = 1 .
(313)
(314)
(315) / . -
(316) 1
(317)
(318) ,
(319) -
(320) )
(321) -
(322)
(323)
(324)
(325) $
(326)
(327)
(328)
(329) ,
(330) 1
(331) ,
(332)
(333)
(334) 1 ?
(335)
(336) 1 1
(337)
(338) ,
(339)
(340)
(341)
(342)
(343) . H
(344)
(345)
(346) 1
(347)
(348)
(349) *:
(350) 1
(351) ,
(352) 1
(353)
(354)
(355) / . " C D . . /
(356)
(357) ,. . 1 Æ #3
(358) 1
(359) #3
(360)
(361) ?/: .
(362)
(363) . 1
(364)
(365) F B9 F JC K9L $
(366) 1
(367) .
(368)
(369) ,
(370) . 1
(371)
(372)
(373) $
(374) . 1
(375) .
(376) , 1
(377) .
(378)
(379) . ?/ 1
(380)
(381) F B9 F JC G
(382)
(383)
(384) 1
(385)
(386)
(387) &
(388) - $
(389) 2
(390) - 1
(391) :
(392)
(393)
(394) =
(395) . 2 F 1
(396)
(397) / $
(398) 9
(399)
(400) . G
(401) 2
(402) .
(403)
(404) $
(405) 1
(406) 9 =
(407)
(408)
(409) - . 1
(410) ,
(411) 1
(412)
(413) 1
(414) .
(415)
(416)
(417)
(418)
(419) 1
(420) . /
(421)
(422)
(423) $ 91
(424) ,
(425) .
(426) .
(427) , * #
(428) . , 1
(429) . E ! > , -
(430)
(431)
(432) 9 1
(433) , . . ,
(434)
(435)
(436) C.
(437) . . ! . . ! . Í Ä. 111 000 000 111 000 111 000 111 000 111 000 111 000 111 000 111 000 111 000 111 000 111 000 111 000 111 000 111 000 111. ". 9: BB #3 :
(438)
(439) 1
(440) . !1 BB1 .
(441) . B F 9 1
(442) . 9 9C D F 9M . ,
(443) 1
(444)
(445)
(446) .
(447) . :
(448) . M 9 B C D J I M. . M 9 9 B B C D D D. . . M M 9 9 9 B B. M M M M 9. & " . B 9 9D 9 B 9 I 9 J I 9 J B J. 9:
(449)
(450)
(451) B . : F I. . . F B1. . . F D1 .
(452) = 91
(453)
(454)
(455) F M
(456) @" . A
(457)
(458) .
(459)
(460) . $
(461) 1 @" . A
(462)
(463)
(464) 2
(465)
(466) :
(467) . 1 F .
(468) . , . . 1
(469)
(470) , .
(471) . . F . . . . C1
(472)
(473) 1
(474)
(475)
(476) 1 D.
(477) &
(478) 9 B C D J I M % . 9 B 9 9 B B: " F M
(479) . F 9 M /
(480)
(481) .
(482) ,
(483)
(484)
(485) 1
(486)
(487)
(488) (
(489)
(490) . E F B M 1 E F 9 9 M E F 9 ,
(491) 1
(492) 1
(493) ! F B
(494) F 9 ? 1 M
(495) 1 $
(496) 9 -
(497) D
(498) .
(499) , . B 9 G
(500)
(501) .
(502)
(503) 1
(504)
(505) :. " . . .
(506) .
(507)
(508) 1
(509)
(510) . 1
(511)
(512)
(513)
(514)
(515)
(516) . . &'
(517) #3 . 1 B
(518) . . 2 F 1 F 1 - /
(519)
(520) 1
(521)
(522) F M F @, A &
(523) .
(524) B . , F B1 F D F I
(525)
(526)
(527) . .
(528) B
(529)
(530) .
(531) B
(532) : B 9 9 B 9 C
(533)
(534) $ B1 ,
(535) ,
(536) 1
(537)
(538) .
(539) -
(540) .
(541)
(542) -
(543)
(544)
(545)
(546) 1 =
(547) . 1
(548) ,
(549)
(550) -
(551) :
(552) -
(553)
(554)
(555) M
(556) 1
(557)
(558) I . 1
(559)
(560)
(561) 1
(562) 2
(563) 1
(564) F M " C
(565)
(566) 1
(567)
(568)
(569)
(570) . r. done. Bxr. B: $
(571) . J.
(572) . . #. #. !. !
(573) .
(574) . . . .
(575) . C: & *
(576) #3
(577)
(578) B . , B1 D I
(579) -
(580) ,
(581) 1
(582)
(583)
(584)
(585) F M . . / -
(586) " #$%$&' , ,.
(587) #3 4 2 =
(588)
(589) ,.
(590)
(591) . 1
(592) . ,
(593) .
(594)
(595)
(596) :
(597) . N
(598)
(599) , . 1
(600)
(601) " C
(602)
(603) :
(604)
(605) 1 .
(606) . .
(607) H
(608)
(609)
(610) , .
(611) , -
(612)
(613) F 1 -
(614)
(615) . G
(616) ,
(617) . 2: -. ,1
(618)
(619) , . 1 /
(620) .
(621)
(622) . .
(623) " C D $ > ,
(624) -.
(625)
(626) " #$%$&'
(627) * =
(628)
(629)
(630) . 1
(631) . 1 - %;< . . =
(632)
(633) 1
(634) 1 - %;< .
(635)
(636)
(637)
(638) . .
(639) .
(640) .
(641)
(642)
(643) . + . .
(644) . . =
(645) . , %;< .
(646)
(647) .
(648) .
(649) . " 9 9. ( . =
(650) . 1 . *
(651) ?/ . C D
(652) - J *
(653) #=% 1
(654) H
(655) O=%
(656)
(657) B . 1
(658) <O=%
(659) /
(660) " #$%$&'
(661)
(662) %;<
(663) F / * .
(664) 1 #3 4 < 2 1
(665) , F B9 . $ 1
(666) .
(667) ,
(668) *1
(669)
(670) " #$%$&' / , %;< .
(671) /
(672)
(673) ,
(674)
(675) .
(676)
(677) .
(678) :
(679)
(680) , F F 1
(681)
(682)
(683) , $ - <%= . / " 9
(684) . , . , 1
(685) ,
(686) ! 1
(687)
(688) 1
(689) ,
(690) * . 2
(691) . . #3
(692) D −8. 9. x 10. Processors speed for LU decomposition on a network (myrinet/IP) of 3 processors.. 8. Ratio (execution time)/(N*N*N). 7 approximated speed for lhpci 6. 5. 4. 3. approximated speed for lhpcf. 2 approximated speed for lhpcb 1. 0. 200. 400. 600 800 1000 Value of N. Matrix of size NxN.. 1200. 1400. 1600. D:
(693) #31 4 1
(694) , ,
(695) * .
(696) * . 2 /
(697) F BDB1
(698) F CB
(699) F MM 1 ,
(700) ,
(701) @ A
(702)
(703) . /
(704) . #3
(705) % . C ?
(706)
(707) ?/1 1
(708) #3
(709)
(710) . ! 1
(711) . 1 J I.
(712) #3 . * + .. GF GF9 GFB GFC GFD GFJ GF GFI GF GF
(713) & J . 3 " D " D " D " 9M H#& + .. . * + . . . $, MM B9J BMB 9 J 9IC MM IM JJ D DM CB CM BJ BC DC. C: % .
(714) J
(715) ,
(716) #3
(717)
(718)
(719)
(720)
(721) , MM
(722)
(723)
(724)
(725)
(726) . . .
(727) #3
(728) . $,
(729) % G% MM
(730) % CB
(731) % BDB GF
(732) MM GF9
(733) GFB
(734) JJ GFC
(735) GFD
(736) JM GFJ
(737) D GF
(738) D GFI
(739) DC GF
(740) DD GF
(741) DM & B I D: % .
(742) B
(743) ,
(744) #3
(745)
(746)
(747)
(748)
(749)
(750) , MM
(751)
(752)
(753)
(754)
(755) . .
(756) .
(757) J . M #
(758) . 1
(759)
(760)
(761)
(762) ,
(763)
(764) ?/
(765)
(766)
(767)
(768) ! 1 . 1
(769) ? .
(770)
(771) .
(772)
(773)
(774)
(775) F
(776) . . . %$
(777)
(778) #31 4 1
(779)
(780)
(781) . :
(782) :
(783) " #$%$&'O%;< .
(784) : . * .
(785) ,
(786)
(787)
(788)
(789) " #$%$&'O%;<
(790) B9
(791) . . :
(792) 1
(793) .
(794) , . . ( . $ 1
(795) <
(796)
(797) H
(798) = .
(799)
(800)
(801) @ A
(802) M.
(803) LU decomposition. Execution time on a Network (myrinet/IP) of 3 processors. 1500. Execution time (seconds). cyclic distribution (+). 1000. 500. heterogeneous distribution (x). "optimal" algorithm (d). 0. 0. 500. 1000. 1500 2000 2500 3000 Squarred matrix of size NxN. Value of N.. 3500. 4000. 4500. J: #3 1
(804) ,
(805) .
(806) , :
(807) :MJM1
(808) :CBM1
(809) :BMM ! 1
(810)
(811)
(812) .
(813) 1 1111 11 1
(814)
(815)
(816)
(817)
(818) , 9B
(819)
(820) F 9B . LU decomposition. Execution time on a Network (ethernet/IP) of 6 workstations. 1000. 900. 800. cyclic distribution (+). Execution time (seconds). 700. 600. 500. 400. 300 heterogeneous distribution (x) 200. 100 "optimal" algorithm (d) 0 500. 1000. 1500 2000 2500 Squarred matrix of size NxN. Value of N.. 3000. 3500. : #3 1
(821) ,
(822) .
(823) : :M1 *: C1 . :M1 :91 + :DM1 :B ! 1
(824)
(825) 1 + 1 *1 1 1 . 1 1 + 1
(826) .
(827)
(828)
(829)
(830)
(831) , J
(832)
(833) F D . .
(834) QR decomposition. Execution time on a Network (myrinet/IP) of 3 processors. 1800. 1600 cyclic distribution (+). Execution time (seconds). 1400. 1200. 1000. 800. "optimal" algorithm (d). 600. 400. 200. 0. heterogeneous distribution (x). 0. 500. 1000. 1500 2000 2500 3000 Squarred matrix of size NxN. Value of N.. 3500. 4000. I: 4 1
(835) ,
(836) .
(837) :
(838) :JM1
(839) :91
(840) :D ! 1
(841)
(842)
(843) 111 1111 1 .
(844)
(845)
(846)
(847)
(848)
(849) ,
(850)
(851) F C . QR decomposition. Execution time on a Network (ethernet/IP) of 6 workstations. 1800. 1600. Execution time (seconds). 1400. cyclic distribution (+). 1200. 1000. 800. heterogeneous distribution (x). 600. 400. "optimal" algorithm (d). 200. 0 500. 1000. 1500 2000 2500 Squarred matrix of size NxN. Value of N.. 3000. 3500. : 4 1
(852) ,
(853) .
(854) : :9MM1 *:M1 . :JD1 :J1 + :M1 :9 ! 1
(855)
(856) 1+ 1 1 *1. 1 1 1+ 1
(857) .
(858)
(859)
(860)
(861)
(862) , D
(863)
(864) F C . 9.
(865)
(866)
(867) ! 1
(868) 1 . ,
(869) 1
(870)
(871)
(872)
(873) *
(874) 21
(875) ,
(876)
(877)
(878)
(879) . =
(880)
(881)
(882) * . ,
Documents relatifs
falciparum a été significativement favorisée par le séchage au four à micro-ondes avec une prévalence de 8 % en séchage normal contre 12 % En conclusion, l'usage du four à
While collecting lexical data from various semantic fields along the way, conversational questionnaires can help document a fair portion of a language’s
In this work, we present a heterogeneous cluster architecture extending a traditional parallel processor cluster with a reconfigurable Integrated Programmable Array (IPA)
Abstract—Overlays are reconfigurable architectures synthe- sized on commercial of the shelf (COTS) FPGAs. Overlays bring some advantages such as portability, resources abstraction,
Page 28 Dialogue Rimes en « é » … parce que nous les manchots avons tous affreusement chaud?. Page 30 Dialogue Rimes en « oir » … mais où va nous mener
Dense Linear Algebra Kernels on Heterogeneous Platforms: Redistribution Issue Olivier Beaumont, Arnaud Legrand, Fabrice Rastello, Yves Robert.. To cite this version: Olivier
Cluster expansions are presented for the collision bracket integrals for transport coefficients of a dense simple fluid which appear in the kinetic theory of dense fluid
In the CPU/GPU hybrid computing environment, the cost of sending short message between two nodes can be predicted as o s1 + l +o r1 ( LogP), where l is the latency of communi-
