ACCESS, CONTROL, AND OPTIMIZE HPC WITH PBS WORKS. Bill Nitzberg CTO, PBS Works 2018

Transcription

1 ACCESS, CONTROL, AND OPTIMIZE HPC WITH PBS WORKS Bill Nitzberg CTO, PBS Works 2018

2 OUR VISION Altair transforms design and decision making by applying simulation, machine learning and optimization throughout product lifecycles.

3 ALTAIR AT A GLANCE Founded 1985 Headquartered in Troy, MI US 69offices in 24 countries $313M 2016 Revenue 50+ ISV partners under our unique, patented licensing model Engineers, scientists and creative thinkers Customer installations globally 60,000+ Users

4 ALTAIR IS HYPERWORKS TOO Broad portfolio of solvers across multiple physics types Systems Simulation Manufacturing Simulation Electromagnetics Structural Analysis Crash, Safety, Impact & Blast Thermal Analysis Fluid Dynamics Everything Altair does leverages HPC

5 HPC IMPROVES PEOPLE S LIVES

6 PBS WORKS SOFTWARE & SOLUTIONS FOR HPC April 4, 2018 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved. Engineers & Researchers Clusters & Clouds Admins & Managers ACCESS HPC resources naturally (no IT expertise): run solvers, view progress, manage data, and use 3D remote visualization OPTIMIZE HPC clusters and clouds: manage policies, speed turnaround, maximize utilization, ensure availability, stay within budget, maintain security CONTROL HPC resources and provide 360 o visibility and agility: configure, deploy, monitor, troubleshoot, report, simulate, analyze, tune

7 PBS Works Engineers & Researchers Access Optimize PBS Pro Control HPC Admins

8 FOCUS #1: HPC CLOUD & EXASCALE ECOSYSTEMS April 4, 2018 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved. Cloud Computing Big Data Exascale Open Source Power Management GPUs & Xeon Phi

9 FOCUS #2: REIMAGINED USER EXPERIENCE Dashboard Hardware Cluster Cloud Account Topology Instance Dashboard Instance Instance_1 Instance Instance_3 12 July 2016 Running for 5d 12h 35m 12s 30 June 2016 Stopped since 3d 11h 35m 12 RADIOSS Running RADIOSS Stopped Critical Instance Instance_4 Instance Instance_2 23 October 2015 Running for 3d 3h 30m 12s 03 June 2016 Paused for 2d 14h 25m 10s RADIOSS Running RADIOSS Paused Safe Instance Instance_5 30 November 2015 Running for 7d 3h 45m 15s RADIOSS Running Safe

10 Clouds PBS Works Optimize PBS Pro Clusters

11 PBS WORKS: OPTIMIZE (PBS PROFESSIONAL) Workload management & job scheduling Ubiquity: Open Source and commercial licensing Performant: faster time-to-results, better throughput and utilization Secure: EAL3+ security certification and MLS (SELinux) support Intelligent: policy-driven and topology-aware scheduling Scalable: proven to run millions of jobs per day Green Provisioning : power management and control Robust: known in the industry for stability and support Open Architecture: implement virtually any new policy Modern: dockerization, cloud bursting, parallel scheduling NASA s workload manager of choice for all NAS HPC resources 250k+ cores scheduled by one PBS Pro Efficient and effective utilization of expensive HPC resources

12 THE BIGGEST SYSTEMS IN THE WORLD RUN PBS DoD HPCMP ~800k Cores Customer Cores Notes NSCC 30, ,000 jobs/minute Energy Company 70,000+ One of largest in Europe Pleiades ~200K Cores NASA Ames 300,000+ Single system with 11,000+ hosts & 1,000s of users KMA ~100,000 Weather ECMWF 250,000+ Two system fail-over configuration ECMWF ~250K Cores ACCMS (Kyoto U) 100,000+ Custom policies with hooks NCI 50,000+ Originally #1 in Southern hemisphere

13 April 4, 2018 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved. PBS Professional offers the best scalability in the industry Without its flexibility, it wouldn t have been able to handle what we re doing. NEC Corporation NASA Ames

14 WHY PBS PRO DUAL LICENSED? April 4, 2018 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.

15 THE HPC WORLD Public Sector Private Sector Risk takers Early adopters PBS Pro Dual-licensing Risk avoiders Later adopters Natural collaborators Natural competitors Open Source Commercial

16 April 4, 2018 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved. PBS Pro for the Whole HPC World

17 We optimized one of our analysis pipelines with PBS Professional, and we managed to make it run in 50 hours instead of the previous 130 hours Franck Pignard, IT Manager at Biogemma

18 Clouds PBS Works Control HPC Admins Clusters

19 PBS WORKS: CONTROL Admin tools to manage clusters & cloud appliances Single pane of glass: configure, deploy, monitor, burst, manage, troubleshoot, simulate, analyze, tune Real-time monitoring: simplify troubleshooting and maintenance Reporting: PBS Analytics powered by Carriots Analytics Workload simulator: simulate and optimize infrastructure sizing Multi-cloud bursting: burst to any cloud for peak loads One-click appliance deployment: effortless for public, hybrid, and on-premise / private clouds Modern UX: drag-and-drop simplicity HPC Administrators control center for managing, optimizing and forecasting HPC Resources

20 The cost savings to the government is huge reduced hardware costs, staffing requirements, security maintenance and other costs... Lockheed Martin

21 PBS WORKS: MONITORING April 4, 2018 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.

22

23 PBS WORKS: WORKLOAD ANALYTICS April 4, 2018 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.

24 Altair exceeded our expectations. With PBS Analytics we are able to get the types of reports we were looking for but could not get with another scheduler Dorah Thobye, Technical Manager, CHPC

25 April 4, 2018 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.

26 PBS WORKS: WORKLOAD SIMULATION April 4, 2018 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.

27 SIMULATOR ARCHITECTURE April 4, 2018 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved. PBS Works: Configuration PBS Snapshot Policies Infrastructure Workload Simulator Solver PBS Pro Scheduler Core PBS Snapshot PBS Works: Analytics

28 PBS Works: Cloud Bursting April 4, 2018 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved. On-demand use of cloud resources to maximize efficiency Improve responsiveness, adding capacity exactly when needed Automatic governance and cost controls via site-defined policy and quotas Understands on-premise utilization, ensuring bursting only when cost-efficient Vendor-agnostic: no lock-in Fast: +1,000 nodes in minutes PBS Works Microsoft Azure Amazon Web Services

29 Clouds PBS Works Engineers & Researchers Access Clusters

30 PBS WORKS: ACCESS Portals for engineers & researchers Novice to Expert: simple and powerful Same UX: desktop, web, and mobile Secure: protected access to HPC resources End-to-end: submit, monitor progress, steer, fix, and rerun jobs Collaborate: shared 3D analysis 3D Remote Visualization Gateway to collaborative innovation Instant on experience

31 PBS Access Display Manager is our most significant functionality update since the move to HPC itself. In most cases we are saving a full day of time or more. Eric Morales, PING, Inc. PBS Access Display Manager represents a major milestone in the path toward complete simulation lifecycle management in the cloud. NVIDIA

32 PBS WORKS ACCESS DESKTOP April 4, 2018 Altair Engineering, Inc. Proprietary and Confidential. All rights reserved.

33

34

35 Cloud UX Accelerating Innovation AI Exascale