HPC Adoption in the Enterprise October Addison Snell

Transcription

1 HPC Adoption in the Enterprise October 2014 Addison Snell

2 Technical vs. Enterprise Computing Technical Computing Top-line missions: Find the oil Design the minivan Cure the disease Driven by price/performance Fast adoption of new technologies, algorithms, and approaches Enterprise Computing Keeps business running Communicate/collaborate Market and sell the product Accounting, HR, finance, Driven by RAS: reliability, availability, serviceability Slow adoption of new technologies, algorithms, and approaches

3 Where We Find HPC High Performance Technical Computing (HPTC) Applications in science and engineering Top markets: academia, government labs, defense, manufacturing, bio/life science, oil/gas exploration High Performance Business Computing (HPBC) Applications include trading, pricing, risk management, logistics, fraud detection, online games, analytics, Top markets: financial services, ultrascale internet, online games, retail, entertainment

4 HPTC and HPBC Vertical Markets HPTC Total Market (2012 rev., 70%) by Vertical HPBC Total Market (2012 rev., 30%) by Vertical 24% Acad. 41% Comm. 35% Govt. Financial services and manufacturing (auto/aero plus consumer) are about equal HPBC is >95% commercial (exceptions: Fannie Mae, Federal Reserve Bank, ) Worldwide, private sector is growing faster than public sector

5 Q: Why hasn t industry adopted HPC? A: It has. And usage is growing.

6 Total HPC Market Revenue ($K) Cloud small ($613M in 2013), but fast-growing (18.6% CAGR) $38.1B in 2018 $30.5B in % CAGR Servers largest segment ($10.9B in 2013), followed by software ($6.5B)

7 2013 Market Performance Table 3: 2013 vs Comparison Total HPC Market Revenue ($, millions) by Product Class Product Class Change Growth Servers 10,744 10, % Storage 4,735 4,625 (110) -2.3% Services 3,238 3, % Software 6,333 6, % Networks 2,084 2, % Cloud % Other 2,034 2, % Total 29,749 30, % Source: Intersect360 Research, was fourth consecutive year of growth for the market but shows a marked decline in growth rate. By segment: Government : Down 2.4% Academia: Up 2.9% Commercial: Up 4.6% HPBC: Up 4.5% HPTC: Up 1.6% Note on Storage: 2013 is the first normal year after the flooding in Southeast Asia in the second half of 2011, which caused a significant amount of revenue to be deferred from 2011 and recognized in Therefore, 2011 storage revenue was artificially low, and 2012 was artificially high. Storage revenue has seen 7.4% CAGR since 2010.

8 Focus: HPC in the Cloud Major focus of research, included in Budget Map, Site Census, and Big Data surveys, qualitative interviews, and comprehensive research studies. Percentage of users doing some (>0%) HPC in public cloud has grown to 35% in most recent surveys, but the proportion of workload they run in the cloud is typically low, about 5% on average. This is consistent with Budget Map data showing ~3% of budget consumed by cloud. Cloud adoption is greater in public sector than private. Commercial users weight drivers the same on average, but higher barriers.

9 Focus: HPC in the Cloud The Cloud portion of the HPC market is $613 million in 2013, growing to $1.4 billion in This includes public cloud as well as certain private cloud installations, in which the HPC budget rents infrastructure from central IT as if it were a separate organization. Users in surveys indicate their cloud usage will grow over two years. We assume cloud usage will go up, both as a percentage of users and as a proportion of workloads, but it will not become pervasive. Cloud spending is not a net new revenue generator. It is effectively deducted from other forecast segments. (There are some documented cases of new HPC users enabled by cloud computing, but these are small enough and few enough as to have no measurable effect on the market at this time.)

10 Q: If commercial HPC isn t new, then what s the big deal? A: Big Data trends mean even more HPC.

11 269 total respondents New Survey Data 177 Technical (HPCwire and HPC500 user group) 92 Enterprise (Gabriel Consulting) 150 commercial, 70 academic, 49 government Surveys completed summer 2013 early 2014 Builds on original survey from early 2012 (306 respondents: 204 Technical, 102 Business) End users discuss their environments, challenges, solutions, and satisfaction gaps in addressing Big Data challenges

12 Key Insights 1. There is a real Big Data opportunity Money being spent Investment in new technologies and solutions Non-HPC enterprises will look at HPC solutions 2. Much broader than Hadoop Many different faces to Big Data Primarily in-house applications and algorithms 3. Scalable I/O performance most important area Top satisfaction gap for all segments Conversely, significant barriers to public cloud

13 Insight #3: Importance of I/O Business Technical Total Satisfaction gaps: (Imp - Sat) x 100 Sat Gap Sat Gap Sat Gap Flash/SSD technology Disk drive technology Tape technology InfiniBand Ethernet Parallel file systems Storage capacity I/O performance Backup and recovery Deduplication Density Power consumption Reliability, availability, serviceability (RAS) Number of respondents Intersect360 Research, I/O performance is the #1 satisfaction gap in all segments, even non-hpc enterprise.

14 Q: What are the top five/ten/twenty applications? A: If only it were that easy.

15 Insight #2: Many Faces of Big Data Sources of Big Data applications Business Technical Total In-house % % % Purchased % % % Open-source % % % Unknown 1 0.8% 5 2.0% 6 1.6% Number of applications Number of respondents Intersect360 Research, Big Data is predominantly in-house applications Notable change from prior year: Non-HPC sites adopting more open-source

16 Software in Commercial HPC Source: The Exascale Effect: Benefits of Supercomputing Investment for U.S. Industry, new report pending publication, with U.S. Council on Competitiveness

17 HPC Site Census: Applications Figure 2. Top Primary Application Categories by Super Segments, Total Sites HPTC N = 798 mentions HPBC N = 266 mentions

18 HPC Site Census: Applications Figure 3. Supplier Type for Primary Applications, Total Sites N=1,107 Mentions

19 Q: So how do we get enterprise to associate with the term HPC? A: Who cares? How do we drive adoption?

20 Haves vs. Have-Nots Digital Manufacturing Usage among Commercial Respondents, by Number of Employees Mod/Sim HPC Mod/Sim Desktop 3D Tools 2D / None Total Employees Count Percent Count Percent Count Percent Count Percent Count Percent % % % % % % % % % % % % % 3 7.3% % 501-2, % % 6 8.7% 0 0.0% % 2,001-10, % 6 8.3% % 1 2.4% % 10,000 or more % % 4 5.8% 2 4.9% % Total % % % % % Note: "Total" column may exceed sum of other columns because of a small number of respondents who did not specify a level of technology usage. 55% of the HPC usage is at companies with over 10,000 employees. 56% of those maxed out at 2D drawing have 20 or fewer employees. 62% of companies with over 10,000 employees are using HPC. Only 8% of companies with under 100 employees are using HPC.

21 Key Benefit: Quality Rate the importance of each of the following to your core business (5 = most important; 1 = least important) Mod/Sim HPC Mod/Sim Desktop 3D Tools 2D / None Total Employees Avg. % 4/5 Avg. % 4/5 Avg. % 4/5 Avg. % 4/5 Avg. % 4/5 Production efficiency % % % % % High product quality % % % % % Newness/novelty of product % % % % % Speed to market % % % % % Use of computer-based tools % % % % % Industry R&D leadership % % % % % Respondents Link digital manufacturing to core messages Product quality resonates very well across all groups New features and reduced time-to-market are hit-andmiss messages for those who have not yet adopted Not technology for technology s sake

22 Working with Intersect360 Research If you are an HPC vendor: We d love to have you as a client Advisory/consulting, data and insights, plus whitepapers, webinars, podcasts, etc. Brief us any time If you are an HPC user: Free access to research if you participate See to join user group Custom work for users also available Sign up for updates at

23 Questions Actionable Market Intelligence for High Performance Computing