MetaCentrum, CERIT-SC and you (cont d.)

Size: px

Start display at page:

Download "MetaCentrum, CERIT-SC and you (cont d.)"

Beverley Hawkins
6 years ago
Views:

1 MetaCentrum, CERIT-SC and you (cont d.) Tomáš Rebok MetaCentrum, CESNET z.s.p.o. CERIT-SC, Masaryk University

2 General research infrastructures CESNET research infrastructure network, distributed computing and storage coordination of the computing/storage environment (MetaCentrum) National Grid Infrastructure (NGI) infrastructure development AAI, clouds, scheduling, etc. CERIT-SC research infrastructure distributed computing and storage resources integrated into National Grid Infrastructure more experimental usage including disruptive experiments focuses on deep research collaboration with users/partners besides its own infrastructure research => resources available through MetaCentrum NGI membership 2

3 Talk structure 1. Brief information about available MetaCentrum NGI resources computing & storage resources 2. General information about available NGI services which one can use for computations computing & storage services 3

4 available to all academic users from Czech universities, Academy of Science, research institutes, etc. MetaCentrum NGI commercial bodies just for public research infrastructure offers: computing resources storage resources application software after registration, resources available free of charge users pay via publications with acknowledgements no applications for computing time once registered, the resources are directly available (based on actual usage) 4

MetaCentrum NGI computing resources ca 12256 computing cores (x86_64) high-density (HD) nodes 2x4-8 cores symmetric multiprocessing (SMP) nodes 32-80 cores large SMP nodes: 2x SGI UV 2000 (provided

5 MetaCentrum NGI computing resources ca computing cores (x86_64) high-density (HD) nodes 2x4-8 cores symmetric multiprocessing (SMP) nodes cores large SMP nodes: 2x SGI UV 2000 (provided by CERIT-SC) 288 cores, 6 TB RAM 384 cores, 6 TB RAM other computing HW News: ScaleMP (virtual SMP) cluster, GPU cards, SSD disks, SGI UV 2000 (384 cores, CERIT-SC) ScaleMP cluster at University of West Bohemia (ZČU) several other new/upgraded/extended clusters clusters relocation (Ostrava -> Brno, Jihlava -> Brno) cluster s relocation and rename: zewura -> zebra (Brno) 5

6 MetaCentrum NGI computing resources 6

7 MetaCentrum NGI computing resources Distributed infrastructure Integrates resources from several owners 7

8 ca 3 PB for operational data MetaCentrum NGI storage resources centralized storage systems located at various cities of the CR storage capacity distributed to various computing services see later ca 21 PB for archival/back-up data integration of large CESNET Storage Systems to the infrastructure 8

9 MetaCentrum NGI application software ~ 300 different applications see structural biology, bioinformatics CLC Genomics Workbench, Geneious, Turbomole, Molpro, many open-source/free tools development tools GNU, Intel, and PGI compilers, profiling and debugging tools (TotalView, Allinea), mathematical software Matlab, Maple, Mathematica, gridmathematica, application chemistry Gaussian 09, Gaussian-Linda, Gamess, Gromacs, material simulations Wien2k, ANSYS Fluent CFD, Ansys Mechanical, Ansys HPC applications installed per request (or by users on their own) 9

10 MetaCentrum NGI active users 10

11 MetaCentrum NGI user acknowledgements 11

12 MetaCentrum NGI services 12

13 MetaCentrum NGI services Computing services grid computing cloud computing Hadoop specialized frontends/environments Storage services NGI storage systems CESNET infrastructure storage systems & services Collaboration & Support services interdisciplinary and infrastructure research (CERIT-SC) user support activities 13

14 MetaCentrum NGI services Computing services 14

15 Suitable for: long-term and/or large-scale computations (primarily batch processing) applications not requiring special OSs (features) pre-installed or users ones How to compute? batch jobs the work described by job scripts interactive jobs text interface graphical user interface (VNC) Grid computing 15

16 Grid computing news (2015) News (2015): Torque scheduler development sandboxes with restricted resources (currently selected application programs) enforcement of requested resources distributed schedulers cooperation (e.g., Meta & CERIT-SC backfill queue) infrastructure development Debian 8 deployment (deploying first clusters) etc. 16

17 Plans: Grid computing plans new Torque version (v. 6) adaptation & deployment provides many new/useful features requires long-term deployment process several modifications affect end-users several features (our modifications) have to be added a development/testing installation will be available container-based computing LXC, OpenVZ or Docker based one should be able to run applications provided as e.g. Docker sandbox or using different Linux distribution enforcing the requested resources etc. 17

18 Cloud computing Suitable for: applications requiring special environment (OS) and/or features one can run various operating systems (incl. Windows OS) and/or application equipment administrator/root access is provided How to compute? OpenNebula GUI for deployed nodes management nodes simply created based on predefined templates interact via: cloud/vm console internal OS services (SSH, VNC, Rdesktop, ) 18

19 Cloud computing 19

20 Cloud computing news & plans News (2015): infrastructure upgrades and maintenance upgrading the infrastructure resources OpenNebula upgrades and cloud images maintenance (upgrades of popular OSs) Plans: significant OpenNebula upgrade new version provides many significant features (like VXLANs) should be transparent to users creation of pre-installed cloud images with popular applications/services 20

21 Hadoop computing Hadoop: an open-source framework for distributed storage and distributed processing of large volumes of data large data blocks splitted and distributed amongst nodes a MapReduce-based algorithm (= data processing code) is distributed over the distributed blocks and processed in parallel Suitable for: huge datasets to be processed but NOT suitable for arbitrary data processing one can imagine just for the processing meeting the MapReduce programming model e.g., counting the number of times words occur in a corpus 21

22 Hadoop computing news & plans News (2015): a Hadoop cluster (hador) deployed into production ready for your usage you can use our consultations/training e.g., whether your processing goal is suitable for Hadoop Plans (2016): especially obtaining experience i.e., collaboration with users we are interested in your feedback to be able to reflect it in the infrastructure 22

23 Specialized frontends/environments Suitable for: user communities with well-defined processing needs workload & computing pipeline orchestrators available via GUI usually adapted to user needs and/or because of interoperability with our infrastructure in background, the proper computing method is used (grid, cloud, etc.) How to compute? Galaxy, Chipster, etc. more details provided in Pavel Fibich s presentation 23

24 MetaCentrum NGI services Storage services 24

25 MetaCentrum NGI Several storages, each suitable for different use: storages ( /storage/[city] ) central storage systems, holding user homes dedicated for short-term / mid-term data storage NOT suitable for: long-term data archival or back-ups use archival storage systems (HSMs) instead data under processing scratches ( /scratch, /scratch.ssd, /scratch.shared ) local, SSD, shared fastest storages, dedicated for storing data under processing once the processing finishes, the data have to be removed further details in Martin Kuba s presentation 25

26 MetaCentrum NGI Several storages, each suitable for different use: archival storage systems (/storage/*-archive ) integration of large storage systems available within the CESNET R&D infrastructure ~ 21 PB (physical capacity) hierarchical storage systems (HSMs) consist of several layers (online disks / offline disks / tapes) automatic data transfers among layers (transparent to users) suitable for long-term data archival and back-ups please, REGULARLY MOVE unused data (from your homes) to HSMs and make more space available for /storage (= user homes) 26

27 News: MetaCentrum NGI upgraded storage arrays increased capacity Brno (+262 TB) Pilsen (60 -> 350 TB) Plans (2015): principal review of storage systems Do we still need a POSIX filesystem for semi-permanent user data? Or, can we benefit from non-posix ones without limitations? like dcache, DPM storage, OwnCloud, etc. we are exploring possibilities and will discuss with you 27

28 Long-term data archival/storage: ~ 21 PBs of physical capacity Pilsen, Jihlava and Brno useful for: Storage CESNET back-ups data archival big data sharing etc. can be used without the need to be NGI member see more at 28

29 Storage CESNET FileSender: (~ e.g. LeteckaPosta) web service for transferring large volumes of data large = up to 500 GB OwnCloud: (~ Dropbox) cloud storage space for storing and sharing data among user devices space = ~ 100 GB per user clients for all the popular OSs, mobile phones, etc. 29

30 MetaCentrum NGI services Collaboration & Support services 30

31 Research support & collaborations research support and collaborations an inherent part of the provided infrastructure the interdisciplinary research collaborations performed primarily by CERIT-SC aiming to overcome limits in partners research and opening the closed doors (an application of top-level ICT in the science) the infrastructure support performed by both Cesnet & CERIT-SC infrastructure support of various projects, communities, etc. several international projects: ELIXIR, WestLife, SDI4apps, etc. we also perform our own infrastructure research clouds, grid schedulers, security, identity management, etc. e.g. Perun our identity management system employed in ELIXIR international projects: ENGAGE, INDIGO, Magic, AARC, etc. 31

Training & supporting users NGI hands-on seminars intensive practically-oriented seminars being held at the user group location limited number of participants (<10 people) adapted to specific needs

32 Training & supporting users NGI hands-on seminars intensive practically-oriented seminars being held at the user group location limited number of participants (<10 people) adapted to specific needs of the particular user group specialized seminars SGI UV2000 architecture, GALAXY hands-on usage, etc. individual consultations if you don t know how to effectively use the infrastructure, feel free to ask us infrastructure & application documentation 32

33 To conclude two research infrastructures under MetaCentrum NGI: CESNET and CERIT-SC CESNET s main focus (in terms of computing): NGI coordination, infrastructure support CERIT-SC s main focus: close interdisciplinary research collaboration with users/partners, infrastructure support significant resources available (computing + storage) includes SW applications portfolio as well several computing/storage/support services available the most effective computing service depends on your (your application s) needs we can consult the best processing methods with you, and/or we can provide you with a practical training infrastructure/research support is inherently available 33

34 metavo.metacentrum.cz 34

High Performance Research Computing. An introduction to the Oxford Supercomputing Centre

High Performance Research Computing An introduction to the Oxford Supercomputing Centre Dr Mark Hylton Oxford e-research Centre Administrator & Research Facilitator Introduction to OSC Four questions Who