Fast Innovation requires Fast IT

Size: px
Start display at page:

Download "Fast Innovation requires Fast IT"

Transcription

1 Fast Innovation requires Fast IT

2 Cisco IT - Analytics Implementation Vineet Jain Cisco IT

3 Dramatic Internet Growth Occurring Through New Connections Fixed Computing Mobility / BYOD Internet of Things Internet of Everything 50B things 200M 10B Source: Cisco Internet Business Solutions Group, 2012

4 Taking Advantage of Increasingly Relevant and Valuable Connections Connections Availability, comprehensiveness, accuracy, timeliness, relevance, and richness People, data, things Context awareness, increased processing power, greater sensing abilities Intelligence Convergence Visibility Security Source: Cisco IBSG, 2012

5 Who Will Drive Big Data? IT Becomes More of a Strategic Business Partner Globally, 73% say IT will drive Big Data in partnership with other groups Research & Development Finance Operations Engineering Sales & Marketing Source: Cisco Connected World Technology Report

6 Cisco IT Response Data Innovation Accelerator Collaborative Use of Information in Cisco s Ecosystem to Drive Decision Making, Operational Efficiencies and Creation of Value We will deliver Business Value Technology Culture Revenue/Cost Optimization Time to Value Innovation Maturity

7 Data Innovation Building Blocks Hierarchy Services Data and Analytics Policy and Rules Framework Hierarchy Management Platform Hierarchy as a Service Datawarehouse Big Data In-memory Analytics Ops Intelligence Data Virtualization Rules Engine and Repository Framework End State Collaborative use of information to drive decision making, operations efficiencies, and value creation

8 Data Analytic Platforms Data Warehouse Big Data In Memory Ops Intelligence Data Virtualization Platform HANA UCS What Is it? Data Warehouse Appliance EDW Enterprise Measures SSOTs Distributed Computing with Inexpensive Servers ~ Infinite Capacity ALL your DATA High Performing Inmemory database Self Service Limited High Value Data Machine Log monitoring, analysis and reporting tool Used for immediate action of log events Connect different data models Data federation, combined result sets Use Case Standard Enterprise BI Reporting Pre-canned & adhoc analysis Data mining & exploration Unstructured data (Content, Documents, Logs) Large Structured Data Offload EDW ETL processing Real Time Data Predictive Analytics What-Ifs, Modeling Proactive Monitoring Incident Root Causing Design & Architecture Feedback Real time data across sources Data governance Integrated & Consistent Data

9 Big Data Definition (Gartner) VOLUME VARIETY VELOCITY Big data is high volume, high velocity, and/or high variety information assets that require new forms of processing to enable enhanced decision making, insight discovery and process optimization

10 Use Case 1 - Dynamic Insights for Sales Executives 10

11 Dynamic Insights for Sales Executives (DISE) Goal Drive top-down sales management accountability for sales performance Use real-time data and analytics to drive execution Capability Increased pipeline & funnel visibility Predictability in sales forecast and bookings Sales measures by multiple lenses of the business (customer, channel, product, etc) Insights: Track sales funnel and forecast accuracy Perform P&L analysis Negotiate with customers and channel partners Manage selling resources Timely Insights into Business Accelerate Execution Rapidly Adapt to Business Needs Sales Performance Indicators Mobile Accessibility

12 Dynamic Insights for Sales Executives (DISE) Legacy DISE MBR: My Business Reports $$ of Bookings by Level Overall Plan Attainment SFDC & OMF: Pipeline Forecasting PowerPoint & Excel: All other information, e.g. Architecture & Partner Limited ad-hoc drill-downs One System: Multiple Data Sets Plan, Forecast, Bookings and Pipeline data Summary and Drill-Down Views: Ability to show performance, comparisons and trends Theater, Country, Segment, GTM Customer, Partner, Self serve data analysis & reports Mobile Accessibility: Today: Desktop, ipad & iphone

13 Cisco HANA High Level Architecture Self Service Client Dashboard IT Authored Load Balanced Explorer Pipeline (Every Hour) Forecast (Every 5 Minutes) Misc. Data EDW OMF Bookings (Every 15 minutes)

14 DISE Run The Business (RTB) Dashboard The DISE RTB Dashboard enables automated, self-serve access to Plan, Forecast, Bookings and Pipeline information in a consolidated view set for Cisco Sales Management. 710,830,879 rows of Pipeline data 553,884,879 rows of Bookings data 76,756,764 rows of Forecast data Plus all the contextual data (customers, products, etc.)

15 Value and Learnings Value Customized views and levels of detail combined with real-time data Time-to-capability reduced and custom view sets built by end users in less than a day Summary to transaction level details in seconds Mobile access (ipad & iphone) and compatible with all browsers Learnings HANA Blazing Fast (Sub-second) Experience Platforms Slow (3-4 seconds) Managing data consistency across multiple data analytic platforms

16 Use Case 2 - Cisco Partner Annuity Opportunity Management 16

17 Cisco Partner Annuity Opportunity Management Business Opportunity: Low value / high volume service opportunities Business Value Enhanced Opportunity Management Ease of Doing Business Increased for Cisco Partners Drive Incremental Bookings Future Potential Big Data PaaS Enables the Cisco Services Smart Analytics Strategy Designed for High Availability, Resiliency and Performance Process and Integration of ALL Data Assets Creates Higher Value Services

18 Logical Architecture Source Systems Cisco Tidal Enterprise Scheduler Orchestration Service EDW Reference data Product Data Set Data Storage and Processing Service Opportunity Data EDW Validation Result Set New SSOT Opportunity Cisco Customer Care Install Base and Service Contracts Daily Input Data Daily Output Data Rule to Data Rules Entity Mapping Business Rule Engine End User UI Tools

19 Hadoop Physical Architecture A new architecture called spine and leaf creates a maximum of one routing hop among sets of Big Data servers, with servers connected to an access switch ( leaf ), connecting to a nonblocking, fully interconnected mesh of switch/routers ( spine ). 19

20 Value and Learnings Value $40m/yr incremental service bookings estimated in first year Processing time reduced from 50hrs to 5hrs with 50% additional data. More than billion records processed daily. Business Rules Engine provided business agility Learnings Cost effective and scales linearly with addition of more nodes to the cluster. Cisco s Common Platform Architecture(CPA) for Hadoop allowed for fast installation and efficient operations. Invest in Hadoop Skills. Used Hive to leverage existing SQL skills

21 Use Case 3 IoE in IT Operations 21

22 Business Need Need: Improve the Effectiveness of IT Support Challenge Manual Log Monitoring No Alerts on Errors/ Exceptions No History of Logs Limited Visibility to Logs = Missing Correlation and Improper Root Cause Analysis Solution Proactive Performance and Availability Monitoring Incident Root Causing Design and Architecture Feedback Business Insight Cost Reduction for Operational Excellence

23 Machine Data to Operational Intelligence Application Servers Unix, UCS, VMware Syslog Web Servers Configuration Databases Tickets

24 Splunk: The IT Data Engine No predefined schema, no custom connectors, no RDBMS Customer Facing Data Outside the Datacenter Click-stream data Shopping cart data Online transaction data Logfiles Configs Messages Traps Alerts Metrics Scripts Changes Tickets Manufacturing, logistics CDRs & IPDRs Power consumption RFID data GPS data Virtualization Windows Linux/Unix Applications Databases Networking & Cloud Registry Event logs File system sysinternals Configurations syslog File system ps, iostat, top Hypervisor Guest OS, Apps Cloud Web logs Log4J, JMS, JMX.NET events Code and scripts Configurations Audit/query logs Tables Schemas Configurations syslog SNMP netflow

25 Value and Learnings Value Broken link reduction 95% Availability 99.1->99.9 Performance SLA 98.2->99.4 Saved 76 mins RCA per incident Learnings Uniform logging standard and log data quality is critical Most effective for log analytics when immediate action is needed

26 Big Data Cisco Business Opportunities Fault prediction Threat intelligence Performance predictor Multimedia content analytics Video/audio IT and Operations Performance monitoring Operational benchmarking Compliance Pervasive Security Sales and Marketing Opportunity Mining Recommendation/Guided Selling Campaign effectiveness Customer segmentation Engineering and Manufacturing Customer insights Inventory management Distribution and logistics optimizations Informed supplier negotiations Software Recommendation

27 Big Data -> Smart Data The Edge is Infinitely Scaling, But The Center Cannot Connect the Edge to the Center with business process, rules & analytics Business Process, Rules Management and Analytics Analytics at the Edge enables faster decision making Doing so reduces the volume of data and therefore cost at the center

28 How Is Cisco IT Encouraging Data Innovation? Easy Access to Platforms / Data Self Service with Help The Data Scientist

29