Grid Activities in KISTI. March 11, 2010 Soonwook Hwang KISTI, Korea

Transcription

1 Grid Activities in KISTI March 11, 2010 Soonwook Hwang KISTI, Korea 1

2 Outline Grid Operation and Infrastructure KISTI ALICE Tier2 Center FKPPL VO: Production Grid Infrastructure Grid Developments in collaboration with EGEE AMGA Ganga WISDOM

3 Evolution of KISTI-ALICE Collaboration September, 2006 Dr. Federico Carminati visited KISTI to discuss the construction of ALICE Tier2 Center in KISTI February, 2007 Approved as an ALICE-LCG site October, 2007 WLCG MoU signed between KICOS and CERN KISTI becoming an official Tier2 site for ALICE experiment July, 2008 International Summer School on Grid computing and e-science Tutorial on ALICE computing (AliEn, ROOT, PROOF) October, 2009 KISTI developers visited CERN ALICE Computing Group to extend our collaboration to include development work for ALICE computing framework Since then, 1FTE from KISTI has been allocated to the joint development of PROOF (Parallel ROOt Facility)

4 Major Changes to KISTI ALICE T2 in 2009 Some major changes in Operation CREAM-CE was introduced in the early 2009 DPM was replaced with the xrootd in September 2009 Both VOBOX and WNs were migrated to SL5-64bit in October 2009 Not in good shape in the year of 2009 Some problems with Cream CE & xrootd configurations

5 KISTI s contribution to ALICE computing 1.21 % 1.2 % Currently, 128 CPU cores and 30 TB storage dedicated to the ALICE distributed computing Grid About 1.2% contribution to ALICE computing in the total job execution Processing near 8000 jobs per month in average

6 FKPPL VO: Production Grid Infrastructure

7 FKPPL VO Grid built based on glite Background Collaborative work between KISTI in Korea and CC-IN2P3 in France in the area of Grid computing Objective Foster the adoption of grid technology and provide researchers in Korea and France with production Grid Infrastructure Operation Has been up and running since October 2008, providing about 7,000 CPU cores and 2 TBytes of disk storage As of now, 50 users have joined the FKPPL VO membership LFC IN2P3 CE SE CE SE KISTI VOMS WMS WIKI UI

8 Application porting Support on FKPPL VO Deployment of Geant4 applications Used extensively by the National Cancel Center in Korea to carry out compute-intensive simulations relevant to cancer treatment planning In collaboration with Dr. Jungwook Shin and Se Byeong Lee of National Cancer Center in Korea Deployment of two-color QCD (Quantum ChromoDynamics) simulations in theoretical Physics Several hundreds or thousands of QCD jobs are required to be run on the Grid, with each jobs taking about 10 days. In collaboration with Prof. Seyong Kim of Sejong University

9 Training Activities on top of FKPPL VO In February, we organized Geant4 and Grid tutorial 2010 for Korean medical physics community About 30 participants from major hospitals in Korea About 20 Grid Certificates issued and joined the FKPPL VO membership

10 Application-level level checkpointing/restarting scheme developed for the QCD simulation on the Grid (Re)Submit QCD job (executable + small inputs) WMS Retrieve status & (small) output files Retrieve the latest Intermediate result Retrieve output IN2P3 Submit QCD job Computing Element Storage Element Checkpoint Server send intermediate result Check status & Intermediate Result Su2.x Input file(s) Heartbeat Monitor Output file(s) 10

11 Grid Development Activities in collaboration with EGEE

12 AMGA An official EGEE glite middleware component for a metadata catalogue service on the grid AMGA provides: Access to metadata for files distributed on the grid A simplified general access to relational data stored in database systems KISTI has taken over the leadership of AMGA development since the July of 2009 AMGA 2.0 supporting the OGF WS-DAIR was successfully released in October in 2009 in collaboration with CERN and INFN Currently, KISTI is one of the partners of open glite collaboration, and working with EMI, contributing to the evolution and maintenance of AMGA Drug Discovery High Energy Physics High Energy Physics Digital Library Climate Research

13 The Use of AMGA for Belle-II Metadata Service

14 Belle-II Metadata Service Scenario metadata access metadata replication metadata redirection Tier 0 : KEK Tier 1 : KISTI LV1 AMGA server 1 local LV2 AMGA server1 R s0 s1 s2 s2 LV2 AMGA LV1 AMGA server 2 s1 server 1 s2 s3 s4 s7 s0 s2 LV1 AMGA server 3 s1 s5 s6 s7 s3 s1 Personal AMGA local LV2 AMGA server2 R s0 R s9 Web Service LV1 AMGA server 4 s8 s9 s5 s6 Metadata publish Metadata download

15 Ganga easy-to-use user interface for job submission and management to Specification, submission, bookkeeping, and post processing of computational tasks on a wide set of distributed resources Provides a homogeneous environment for processing data on heterogeneous resources ROOT GAUDI Grid Athena G a n g a Executable LCG/gLite Backend PBS or SGE Backend Local Backend LCG/gLite Cmd or Lib PBS or SGE Cmd or Lib Local Cmd or Lib Batch Localhost

16 The Development of GangaKISTI Modules in Collaboration with the CERN Ganga Team GangaKISTI Modules developed and integrated into the official release of Ganga in July, 2009 GridWay backend InterGrid backend AutoDock LCG/gLite Backend LCG/gLite Cmd or Lib BioMed FKPPL ROOT GAUDI G a n g a InterGrid Backend GridWay Backend PBS or SGE Backend Local Backend GridWay Cmd or Lib PBS or SGE Cmd or Lib Local Cmd or Lib PRAGMA PBS or SGE Athena

17 The WISDOM Project International initiative to deploy large-scale in-silico docking on a public grid infrastructure An attempt to find potential drugs against neglected or emerging diseases e.g., Malaria, Avian Flu KISTI has been involved in the world-wider data challenge of the WISDOM project

18 Data Challenge against Diabetes Type II in 2009 Conducted a Data challenge to maltase, a target protein of diabetes type 2, with chemical compounds Grid Infrastructure used Number of Ligands docked CPU years Execution Time Average number of CPU used Data size produced EGEE Biomed VO 308, days GB

19 Concluding Remarks KISTI has participated in the EGEE project since 2006 As the EGEE project is coming to an end, with the last four years of our participation to it, we have gained a lot of experiences in many areas Production Grid Operation ALICE Tier2 Application Porting on the Grid Geant4 and QCD simulation High-level Grid tools Ganga Grid core middleware services AMGA Even, production grid infrastructure of our own FKPPL VO

20 Thank you for your attention!