Datacenter Networking Memory Solutions. Where Mainstream and High Performance Intersect

Transcription

1 Datacenter Networking Memory Solutions. Where Mainstream and High Performance Intersect MEMCON 2016 Salman Jiva: Senior Business Development Mgr Compute & Network Business Unit 2016 Micron Technology, Inc. All rights reserved. Information, products, and/or specifications are subject to change without notice. All information is provided on an AS IS basis without warranties of any kind. Statements regarding products, including regarding their features, availability, functionality, or compatibility, are provided for informational purposes only and do not modify the warranty, if any, applicable to any product. Drawings may not be to scale. Micron, the Micron logo, and all other Micron trademarks are the property of Micron Technology, Inc. All other trademarks are the property of their respective owners.

2 Zettabytes/Year Demand Drivers Annual Data Center IP Traffic Networked Devices Requiring Connectivity 26.3B B % CAGR Mobility & Video driving Bandwidth IoT driving Access Impact of the Cloud Source: Cisco Global Cloud Index 2014 Increased Intelligence at the Edge 2016 Micron Technology, Inc. October 13, 2016

3 Network Congestion Everyone is contending for network bandwidth Newer applications require deterministic performance metrics Congestion in the data center network is problematic Low Latency Reliable bandwidth Data center workloads demand high throughput and consistent performance from Ethernet switches Micron Technology, Inc. October 13, 2016 Micron Confidential

4 Top of Rack Switch / Leaf Switch Various applications can contend for the same resources Leaf Switch will access the compute through brute force Or with some intelligence Micron Technology, Inc. October 13, 2016 Micron Confidential

5 Approach One : Cut-Through-Switching Applications: High performance computing Real time data feeds High frequency trading Requirements Low latency critical Less (<50%) congested network to maintain reliability Memory Implementation On-Chip packet memory Cut Through Switching is ideal for low latency applications in lightly congested networks Micron Technology, Inc. October 13, 2016 Micron Confidential

6 Approach Two: Store and Forward Switching Performance unity in heavily congested networks Applications: Map-reduce Distributed search Requirements High reliability of performance / bandwidth Adequate latency Memory Implementation Off-Chip Packet Memory Store and Forward Switching is needed for applications that cannot afford packet loss Micron Technology, Inc. October 13, 2016 Micron Confidential

7 Software Defined Networks Cloud Scale Data Centers are looking for cost effective HW solutions OCP (Open Compute Project) Networking White box development Networking software Rise of merchant silicon SDN switches are leading the way for the next generation cloud scalable data centers Promise of reducing capital and operational expense Micron Technology, Inc. October 13, 2016 Micron Confidential

8 Deep Buffer Top of Rack Switch in Data Center Networking Example: Broadcom chipset using GDDR5 - BCM88370 Up to 800 Gbps forwarding capacity per device Advanced, flexible and configurable packet processor Integrated hierarchical traffic manager with support for thousands of flows External packet buffer memory supporting DDR4 or GDDR5 DRAM Micron Technology, Inc. October 13, 2016 Micron Confidential

9 Bare Metal Deep Buffer Top of Rack Switch Agema AGC7648A 10GbE Deep Buffer Switch 48xSFP+ and 6xQSFP28 ONIE Pre-loaded Qumran Switching Chip Deep packet buffers: 6GB GDDR Micron Technology, Inc. October 13, 2016 Micron Confidential

10 Interface Masters Edge Aggregation Switch Niagara 2648X4C Flexible switch system based on Broadcom s StrataDNX Qumran switch 48 Ports of SFP+ and 4 Ports of QSFP28 Designed for optical transport, carrier Ethernet, edge switching, data center cloud and enterprise campus market segments. Deep packet buffers: 8GB GDDR5 Block Diagram Micron Technology, Inc. October 13, 2016 Micron Confidential

11 Interface Masters Edge Aggregation Switch Niagara 2648X4C Flexible switch system based on Broadcom s StrataDNX Qumran switch 48 Ports of SFP+ and 4 Ports of QSFP28 Designed for optical transport, carrier Ethernet, edge switching, data center cloud and enterprise campus market segments. Deep packet buffers: 8GB GDDR5 Block Diagram Micron Technology, Inc. October 13, 2016 Micron Confidential

12 Graphics Memory

13 Divergence of Memory Standards Applications and markets drive the memory requirement to specialized product Micron Technology, Inc. October 13, 2016 Micron Confidential

14 What is a Graphics Memory? DRAM device for graphics cards, game consoles and high-performance compute Single Ended I/O (POD 1.35V / 1.5V) DDR3/DDR4 base construct Advanced Features Data Eye Optimization Adaptive Interface Timing Data Integrity Micron Technology, Inc. October 13, 2016 Micron Confidential

15 Density (Gb) DDR vs GDDR Family Density Comparison DDR GDDR5X GDDR DDR 2016 Micron Technology, Inc.

16 DDR vs GDDR Family Bandwidth Comparison Per Package Bandwidth Gb/s GDDR5X DDR3 GDDR DDR5 DDR Micron Technology, Inc.

17 Moving to Mainstream

18 Defining Mainstream Wikipedia: The ideas or activities that are regarded as normal or conventional. Dominant trend in opinion fashion or the arts. Micron s: 1. Multiple applications / segments 2. Availability 3. Cost efficient 4. Greatest Flexibility/Scalability 5. Lowest Risk Micron Technology, Inc. October 13, 2016 Micron Confidential

19 Intersection of Mainstream and High Performance Understanding the requirements while minimizing the risk and total cost of ownership Niche - HMC, HBM Performance (i.e. BW, Latency) GDDR5 Mainstream - DDR3, DDR4, LPDDR Micron Technology, Inc. October 13, 2016 Micron Confidential

20 Graphics DRAM Market General Market for Graphics DRAM Longevity of Supply Consoles PC, Notebook, Workstation, HPC PC/Notebook 2-3 years Workstation/HPC 4-6 years Workstation/HPC Consoles 6-8 years 2016 Micron Technology, Inc.

21 High Performance Mainstream Memory Comparison GDDR5X versus DDR and GDDR What does it take to support 1Terabit Switching Capacity? (>2Tb Memory BW) Requirements TCO Valuation DDR4 Channel Complexity 80% simpler than DDR4 53% simpler than GDDR5 GDDR5 GDDR5X pins Board Footprint 82% smaller than DDR4 64% smaller than GDDR5 DDR4 GDDR5 GDDR5X mm Energy Efficiency 44% greener than DDR4 9% greener than GDDR5 DDR4 GDDR5 GDDR5X pj/bit Micron Technology, Inc.

22 GDDR5X Performance and Power Efficiency INDUSTRY-LEADING POWER EFFICIENCY G5X < 6pJ/Bit G5X Supports Lowest System Power GDDR5X-120 GDDR5X-100 GDDR5-80 GDDR5-70 Performance (Gb/s) Power (pj/bit) Gfx Card: Memory: GDDR5X GDDR5 HBM GDDR5 8G GDDR5X G GDDR W/Memory 1.7W/Memory GDDR5X accounts for less than 10% of the power budget on the GTX1080 graphics card Above values based on typical Graphics card memory read write data patterns 2016 Micron Technology, Inc.

23 Lower Power Density Discrete package solutions offer most flexible thermal management options Enable implementations of air cooled systems (vs. liquid) ASUS GeForce GTX GB ROG STRIX OC Edition GDDR5X (8 x 10 Gbps Micron Technology, Inc. October 13, 2016 Micron Confidential

24 GDDR5X Highlights Continuity From GDDR5 Supports GDDR5 speed modes GDDR5X adds an ultra-high speed operating mode Gbps (up to 16 Gbps) Feature GDDR5 GDDR5X VDD, VDDQ 1.5V / 1.35V ±3% 1.35V ±3% VPP N/A 1.8V -3%/+6% Package BGA mm x 12mm 0.8mm ball pitch BGA mm x 10mm 0.65mm ball pitch Data rates 6, 7, 8 Gb/s 10, 12 Gb/s I/O width x16, x32 x16, x32 Mirror function Signal Pins Operating Modes DDR QDR, DDR Low Speed High Speed Ultra High Speed Gb/s 32B Access / BL8 PLL/DLL off ODT off, LP on Gb/s 32B Access / BL8 PLL/DLL off ODT on Gb/s 64B Access / BL16 PLL/DLL on ODT on DDR (GDDR5) Modes QDR (GDDR5X) Mode 2016 Micron Technology, Inc.

25 Scalable Packaging MCM (multi-chip-modules) allow for system scalability Increase bandwidth and density beyond single discrete Lower Risk/Lower Cost Established capability in organic substrates with high density trace/space Healthy ecosystem of OSATs and partners Products have re-work capability 2016 Micron Technology, Inc.

26 GDDR5 and GDDR5X in Networking Deep buffered Top of Rack Switches provide relief to heavily congested networks GDDR5 adopted beyond Graphics Market Best in class power efficiency with < 6pJ/bit for air cooled environment Bandwidth to meet Terabit solutions Most cost effective, low risk solution GDDR5/5X serves as low risk and low TCO solution while meeting high performance needs 2016 Micron Technology, Inc.

27