A Design/Study of a Self-Aware Codelet Runtime System

Transcription

1 A Design/Study f a Self-Aware Cdelet Runtime System Prfessr Guang R. Ga Mentrs: Dr. Stephane Zuckerman, Aarn Landwehr, Jshua Suetterlein Spring 2014 Laura Rz Chuanzhen Wu Puya Ftuhi 1

2 Agenda Mtivatin Backgrund Cntrl Thery Cdelet Self-aware System fr Exascale Architectures Prblem Frmulatin Slutin Related wrk Cnclusin References 2

3 Mtivatin T meet cnstrains defined by user: Time, energy, reliability, etc. Increasing demand fr higher perfrmance and mre cmplex functinality in exascale systems: Increasing number f cres implies: Increasing energy cnsumptin. Mre surce f failures. Shrinking device size: mre sensitive t envirnmental issues T tackle these challenges, systems need t have the ability t: Act practively and adapt themself based n current cnditins. Apply the crrespnding schemes that ptimize desired gals (i.e. perfrmance, reliability, energy cnsumptin). 3

4 Backgrund (Cntrl Thery) Includes: Observatin Decisin Actin The system bserves the perfrmance, use the bserved result t mdify the system resurces allcatin in rder t reach the applicatin s desired gal. Applicatins Observe Katsuhik Ogata, Mdern Cntrl Engineering Decide Cntrl Engine System Act 4

5 Backgrund (Self-aware system fr Exascale Architectures) Aarn et al. has prpsed a self-aware system: based n extreme scale architectures. With ne level f parallelism. Clusters cntains blcks, including: XEs (executin Engines). CEs (Cntrl Engines). PMU (Perfrmance Mnitring Unit). Memry and Net. Accrding t results frm PMU, system will adapt fr ptimizatin. 5 Aarn Landwehr et al, ROME 2013, 2013.

6 Backgrund (Cdelet Mdel) Data Flw Inspired Executin Mdel. Tree f Threaded Prcedures Pl f Threaded Prcedures A a Prgram Cdelet E bb c C Dependencies inside the TP D d A Threaded F Prcedure A (TP) Stéphane Zuckerman et al, EXADAPT '11,

7 Nde Chip Intercnnect Chip Cluster Cluster Intercnnect DRAM DRAM Cluster Cluster INT Nde SU Intercnnect Lcal Memry ALU FPU RF Lcal Memry 7

8 Prblem Frmulatin Cmbine self aware cycle and cdelet mdel and analyze the interactin between: Perfrmance Energy Cnsumptin Resiliency Optimize Resurce Management and Scheduling Plicies, cnsidering the trade-ff between: Maximizing perfrmance. Minimizing energy cnsumptin. Enhancing reliability. 8

9 Slutin Energy cnsumptin Threshlds Priritizatin System Requirements Energy Perfrmance cnsmptin Observe Reliability Act Decide Schedule plicies Hardware level plicies Fault detectin & recvery schemes

10 Nde Chip Intercnnect Chip Cluster Cluster Intercnnect DRAM DRAM Cluster Cluster INT Nde SU Intercnnect MU Lcal Memry PMU EMU RMU Histry. PMU: Perfrmance Mnitring Unit EMU: Energy Mnitring Unit RMU: Resiliency Mnitring Unit 10

11 Cdelet s Meta-data ADDITIONAL CODELET PROPERTIES Criticality Vulnerability Deadline In rder t minimize cmputatins at runtime, sme useful infrmatin can be cmputed ffline fr each f the cdelets. Criticality fr perfrmance ptimizatin. Vulnerability fr resiliency. Time cnstrains based n system requirements. 11

12 Observe cycle Observe Mnitring unit Hardware sensrs Cre 1 Cre 2 Cre n Histry Histry Histry Instructin cunts System fault rate Cycles cunt Cre reliability level Temperature Damaged cres Mnitring unit cllects data frm hardware sensrs and frm cres and recrds a histry f them. Energy cnsumptin Temperature Instructin cunts Perfrmance Instructin cunts Cycles cunts Bandwidth usage Reliability Temperature System Fault rate Cre diagnsis Unhealthy and healthy cres Reliability level fr each cre 12

13 MU and SU keep updating the status f each cluster. Status inf includes currently executing TPs, energy cnsumptin, fault rate etc. Clusters Status Cluster 1 Clusters Status Cluster 2 Clusters Status Cluster n SU SU SU MU MU MU Lcal Memry Lcal Memry Lcal Memry INTERCONNECTION INTERCONNECTION INTERCONNECTION

14 SU Decide Threshlds MU Decide Decide Based n cllected data and threshlds define which schemes t apply fr each gal. Fr this step, tw elements are ging t be invlved: Synchrnizatin Unit Mnitring unit 14

15 Decide Decide Energy cnsumptin Energy budgets fr each cluster are defined: Initializatin Based n number f unhealthy cres energy budgets shuld be updated Based n current energy cnsumptin f the whle cluster, decide the apprpriate energy ptimizatin schemes Clck gate Pwer gate Dynamic Vltage and Frequency Scaling (DVFS) 15

16 FP intensive Critical Lad and Stre ALU intensive Decide Decide Perfrmance Meet deadlines by using frequency switching methds. Based n the meta-data f each cdelet and histry f each cre : Chse the right Cluster/Cre fr scheduling the cdelet n. DVFS accrdingly. 16

17 Decide System Fault rate Cre reliability level SU Decide Resiliency Tw schemes: cdelet level and threaded prcedure level. Based n the system fault rate decide which scheme is better. High fault rate -> cdelet level Lw fault rate -> threaded prcedure Task allcatin based n cre diagnsis Reliability scheme Task allcatin 17

18 SU Fault detectin and recvery scheme Deadlines and criticality assurance Act MU Re-distributin f energy budgets Frequency switching Energy threshlds assurance Act Decide Apply schemes selected in previus step Energy Cnsumptin Perfrmance Reliability 18

19 Observe cycle Observe Mnitring unit Hardware sensrs Cre 1 Cre 2 Cre n Histry Histry Histry Instructin cunts System fault rate Cycles cunt Cre reliability level Temperature Damaged cres Mnitring unit cllects data frm hardware sensrs and frm cres and recrds a histry f them. Energy cnsumptin Temperature Instructin cunts Perfrmance Instructin cunts Cycles cunts Bandwidth usage Reliability Temperature System Fault rate Cre diagnsis Unhealthy and healthy cres Reliability level fr each cre 19

20 When a cluster is idle, SU will chse a threaded prcedures frm the pl. Then, enabled cdelets will be allcated t different cres. App s Threshlds Accrding t the threshlds and the cluster s SU status, finds the suitable threaded Clusters prcedure t executestatus CDG a c b Pl f Threaded prcedures Cluster d e f A B C SU D E F MU Lcal Memry INTERCONNECTION

21 Practive: Based n cdelets meta-data (ffline cmputatins): Number f Dependents Criticality Vulnerability Intensity and... And histrical infrmatin: The system will update the resurce management and scheduling plicies. Cluster Maximum Width: 32 Criticality: Cdelet c SU a b 2 MU c 1 Lcal Memry INTERCONNECTION 3 s are pwer-gated and 3 s keep wrking. d e f 3 C C Pwer-gated Clck-gated U U 21

22 Self-aware: SU and MU will tune the wrk accrding t the hardware r OS events: Temperature rises Incrrect behavirs and Example: Cluster SU MU Predefined Threshlds Enable anther Deciding and clck-gate what this t DECIDE after d accrdingly current Cdelet finished Lcal Memry INTERCONNECTION A s temperature Keep is OBSERVE increasing, bserving may has fault. Adjustment ACT applied C C Pwer-gated Clck-gated U U 22

23 Related wrk (SEEC) Uses ODA lp t meet perfrmance and energy cnsumptin gals. Heartbeat, A methd f bserving perfrmance. Uses Machine Learning techniques. Cns: One priritizatin fr ptimizatin. Nt designed fr extreme scale machines. Henry Hffmann et al, MIT-CSAIL-TR , 2011 Martina Maggi et al, FeBID 2011

24 Cnclusin Set f gals t be ptimized Priritizatin f thse gals Threshlds fr each gal Additinal infrmatin need t be specified. Based n this infrmatin the system will be able t priritize sme gals ver ther nes. 24

25 Thank yu! 25

26 References Shekhar Brkar, Thusand Cre Chips A Technlgy Perspective, Prceedings f the 44th Annual Design Autmatin Cnference, San Dieg, Califrnia, DAC '07, 2007 Henry Hffmann, Martina Maggi, Marc D. Santambrgi, Albert Leva, and Anant Agarwal, SEEC: A General and Extensible Framewrk fr Self-Aware Cmputing, MIT CSAIL Technical Reprt, MIT-CSAIL-TR , Nvember Henry Hffmann, Jim Hlt, Gerge Kurian, Eric Lau, Martina Maggi, Jasn E. Miller, Sabrina M. Neuman, Mahmut Sinangil, Yildiz Sinangil, Anant Agarwal, Anantha P. Chandrakasan, Srinivas Devadas, Self-aware Cmputing in the Angstrm Prcessr, Prceedings f the 49th Design Autmatin Cnference (DAC), June Tm St. Jhn, Benit Meister, Andres Marquez, Jseph B. Manzan, Guang R. Ga, and Xiaming Li, ASAFESSS: A Scheduler-driven Adaptive Framewrk fr Extreme Scale Sftware Stacks, In Prceedings f the 4th Internatinal Wrkshp n Adaptive Self-Tuning Cmputing Systems (ADAPT'14), Vienna, Austria. January 20-22, Aarn Landwehr, Stephane Zuckerman, and Guang R. Ga, Tward a Self-aware System fr Exascale Architectures, the 1st Wrkshp n Runtime and Operating Systems fr the Many-cre Era (ROME 2013), Aachen, Germany. August 26th, Martina Maggi, Henry Hffmann, Anant Agarwal, and Albert Leva, Cntrl-theretical CPU allcatin: Design and Implementatin with Feedback Cntrl, The 6th Internatinal Wrkshp n Feedback Cntrl Implementatin and Design in Cmputing Systems and Netwrks (FeBID 2011). Stéphane Zuckerman, Jshua Suetterlein, Rb Knauerhase and Guang R. Ga, Using a Cdelet Prgram Executin Mdel fr Exascale Machines, the 1st Internatinal Wrkshp n Adaptive Self-Tuning Cmputing Systems fr the Exaflp Era. 26

27 Interactin between different gals Gal\ Impact Perfrmance Energy Reliability Perfrmance Energy Reliability The less energy the slwer tasks are executed. Additinal tasks that will cause the applicatin t run slwer. The faster tasks are executed, higher energy levels are reached. Mre tasks t be executed, higher energy cnsumptin. Additinal tasks can be executed faster. Additinal cmputatins are delayed. Hence, the questin is hw t deal with this interactin? 27