The Hipercambio project. Manuela Pereira, Przemysław Lenkiewicz University of Beira Interior

Transcription

1 The Hipercambio project Manuela Pereira, Przemysław Lenkiewicz University of Beira Interior

2 Introduction What is the project about? HIPERCAMBIO: High Performance Computing Applied to Medical Data and Bioinformatics HPC Breast Cancer Research

3 Traditional mammography

4 3D acquisition devices

5 3D acquisition devices

6 Deformable models segmentation

7 What is the project about Take into account breast ultrasound and mammography images Use 3D and 4D images obtained from the newest high resolution medical acquisition devices Consider existing 2D image segmentation algorithms Develop a parallel and scalable algorithms for processing huge volumes of medical data Allow the automatic identification of breast cancer

8 Introducing HPC HPC High Performance Computing Significant computational power (calculations, data processing) Cutting edge problems in science, engineering and business Required capabilities beyond those of standalone computers

9 Introducing HPC HPC belonged to a breed of supercomputers that were Expensive proprietary solutions Difficult to learn, install, maintain and use Limited mostly to research communities The market for HPC was small & niche This situation has changed dramatically in the last few years due to improvement in: Hardware price Hardware performance

10 HPC Infrastructure Requirements Application Requirements Rapid application development Transparent parallelism support Support for SOA design patterns Business process workflow Web services Applications Development Environment Cluster Requirements Policy-based security management Rapid system provisioning Large scale system management Flexible job to resource scheduling Interoperability among platforms Security Job Scheduling Management System Requirements 64-bit and multi- and many-core scalability Low latency, high bandwidth networking Scalable, reliable storage Virtualization for maximum efficiency Efficient power management Compute Clusters Networking Storage

11 Integrated Microsoft HPC Solution Application Benefits Requirements The Rapid most application productive development distributed Transparent parallelism application support Support for SOA design patterns development environment Business process workflow Web services Applications Development Environment Cluster Benefits Requirements Policy-based security management Rapid system provisioning Large scale system management enterprise Flexible job to management resource scheduling Interoperability among platforms Complete HPC cluster platform integrated with the rest of the infrastructure Security Job Scheduling Management System Benefits Requirements Cost-effective, reliable and high 64-bit and multi- and many-core scalability Low latency, high bandwidth networking performance server operating Scalable, reliable storage system Virtualization for maximum efficiency Efficient power management Compute Clusters Networking Storage

12 Introducing HPC Simple to setup and manage in a familiar environment Management tools Comprehensive diagnostics, troubleshooting and monitoring Familiar, flexible and pivotal management interface Scale deployment and administration Possible to integrate within existing infrastructure

13 HPC Server Deployment Available with WS2K8 Rapidly deploy Windows operating systems Image-based deployment Efficient and scalable (supports multicast) Windows Server 2008 Windows Vista

14 Compute Node Templates Model for repeatable deployment of a compute node to a known state. Encapsulates tasks to deploy the compute node Starting from bare-metal Culminating in compute node in offline state Head node uses WDS to orchestrate compute node provisioning based on node template. Used for operating system, application driver deployment and patching

15 Reporting tools How/When/By whom is the cluster used? Are compute nodes down? How often? How many jobs are completed in the last week? Who has been running the jobs? How long do jobs wait? Trend Analysis Group and Filter by User, Project, Service, and Job Template

16 Diagnostic tools I just got my cluster up and running is it ready to schedule jobs? What SOA services are running? Where? What applications are installed on what nodes? Are my cluster services running? Recent errors reported? Can these nodes ping each other? Latency? MPI ping? Why are those jobs hanging? Why is job throughput lower than expected?

17 MPI.Net programming Modern implementation of parallel programming standard Provides an easy, high level way of constructing parallel applications Allows to fully take advantage of the resources available on the HPC infrastructure

18 MPI.Net example using System; using MPI; class MPIHello { static void Main(string[] args) { using (new MPI.Environment(ref args)) { // MPI program goes here! Console.WriteLine( Hello World ); } } }

19 MPI.Net example 2 using (new MPI.Environment(ref args)) { Communicator.world.Broadcast(data, rootprocess);.. (Perform some operations).. Communicator.world.Gather(data, rootprocess); }

20 Summary Windows HPC Server 2008 Easy to deploy Easy to manage and maintain Easy to develop applications Provides an integrated solution allowing introduction of an extraordinary computational power with affordable costs (both in hardware and software)

21 Thank you Thank you for your attention. Any questions?

22 Resources hipercambio.ovh.org windowshpc.net