Lifecycle Intelligence: Splunking the Product Development Lifecycle and DevOps

Transcription

1 Copyright 2014 Splunk Inc. Lifecycle Intelligence: Splunking the Product Development Lifecycle and DevOps Jon Rooney Director of Developer Splunk

2 Disclaimer During the course of this we may make forward- looking statements regarding future events or the expected performance of the company. We you that such statements reflect our current and based on factors currently known to us and that actual events or results could differ materially. For important factors that may cause actual results to differ from those contained in our forward- looking statements, please review our filings with the SEC. The forward- looking statements made in the this are being made as of and date of its live If reviewed auer its live this may not contain current or accurate We do not assume any to update any forward- looking statements we may make. In any about our roadmap outlines our general product and is subject to change at without It is for purposes only, and shall not be incorporated into any contract or other commitment. Splunk undertakes no either to develop the features or described or to include any such feature or in a future release. 2

3 Agenda! and background! Splunk for Development! Demos!! Customer Examples! Live Demo! Q&A 3

4 and Background

5 My Background and Role! Director of Developer Splunker of 2+ years! Veteran of MicrosoU, Bay Area start- ups, Accenture! Philadelphia Screenshot here 5

6 Splunk for App Development

7 Development Challenges Unit Build Staging Code Check- in Deploy 7

8 Development Challenges Lack of visibility across the product development lifecycle Code Unit Build Pressure to increase velocity and agility with DevOps Limited insights into behavior and Check- in performance from logs Staging Deploy 8

9 Splunk for Lifecycle Intelligence FIND AND FIX ISSUES FASTER Quickly trace and errors anywhere in the codebase with search and monitoring PUSH BETTER CODE USING ANALYTICS Instrument your app logs to gain intelligence GAIN END- TO- END VISIBILITY ACROSS THE DEV TOOL CHAIN Break down dev tool silos with insights from machine data 9

10 Find and Fix Issues Faster dashboards show error rate in and impact of pushing new builds Developers can search and visualize web logs, Java logs without access Alerts developers as soon as a problem arises 10

11 Push Beger Code Using Gain end- to- end visibility to make informed decisions insights without the need for tools Ask while exploring and data void submitpurchase(purchaseid)! {!! log.info("action=submitpurchasestart, purchaseid=%d", purchaseid)! //these calls throw an exception on error!!submittocreditcard(...)!!generateinvoice(...)!!generatefullfillmentorder(...)!! log.info("action=submitpurchasecompleted, purchaseid=%d", purchaseid)! }!! 11

12 End- To- End Visibility Across The Dev Tool Chain Project and Issue Tracking Code Repository CI / Build Servers QA / Tes@ng Tools Deployment Servers 12

13 Task Tracking Version Control Code Review What Data Can You Splunk? Which tasks are assigned to which developers? What progress is being made to complete assigned tasks? What tasks remain for this release/ sprint? Who is changing files? What kinds of files are being changed? What branches are most What types of are occurring for a branch? Which code has already been reviewed for this release/sprint? Who has completed the most code reviews? What code has NOT been reviewed? CI / Build Server How many builds completed today/this week/this month? Which check- in kicked off this build? Which tests ran against this failed build? 13

14 Key Benefits of Lifecycle Intelligence Reduced Time to Market Increased Agility Insights Shrink it takes to get code through dev/test to market through faster issue and With visibility into processes like code check- ins, builds and tests to support DevOps like Instrument customer logs to capture business events and user behavior Our devs are now able to find and fix issues five to ten 4mes faster. We can monitor all the automa4on and handoffs it takes to deploy mes a day My code isn t ready un4l it s Splunk- ready 14

15 Demos

16 Customer Examples

17 Customer Success 17

18 Splunk Enables DevOps Agility! Challenges: Teams struggle to recognize errors in new builds due to infrastructure complexity Logs are siloed, scagered across dozens of servers, without a single view and with no ability to correlate or search other than manual processes Lack the ability to analyze trends and iden@fy outliers! With Splunk: Increased success rates of deployments - lower errors for new builds Detect issues prior to them having an affect on the produc@on process Aler@ng on thresholds for event log errors - roll- back problema@c deployments or diagnose a build in a subset of the produc@on environment It s like we were working without peripheral vision before and now we have it. 18 Robert Gonsalves Web Opera4ons

19 Splunking QA for Agility and Code Quality! Challenges: Difficulty defects finding and fixing issues took days/weeks Developers struggled to ensure that insights can be gleaned from custom- built around user behavior and performance Not automated alert system to immediately team about errors! With Splunk: Provide full visibility into Sanity and Load in QA environments before deploying to Assists in if tests do not contain the expected results New code is not ready the logs are Splunk- friendly Developers are now able to look for errors and troubleshoot issues five to faster by having all their event data centralized in Splunk. Nate Smalley Principal Engineer 19

20 & Deployment with Splunk! Challenges: No single place to access and visualize machine data Manual diagnosing and searching through data generated by servers and To retrieve sysadmins have to ssh into machines before sending off to developers to grep through the logs! With Splunk: Quickly validate and troubleshoot code pushes to Ensure that new code does not impact performance or user experience Reduced one s error rate by 2 orders of magnitude in a mager of weeks Dump all the logs into Splunk, and it starts looking like one big system, instead of a bazillion teeny ones that hate each other. Alison Perkins Senior Systems Engineer 20

21 Internet- Scale Performance Challenges: Difficulty in retrieving log events covering a range and matching specific criteria Each team has their own set of tools and homegrown monitoring systems each a silo Time- consuming and error- prone tradi@onal search methods led to experts searching through mountains of data to uncover issues! With Splunk: Teams are able to share data and dashboards to gain insights on historical and data Improved visibility and understanding of performance data before code is deployed to produc@on Overall velocity improvement ability to run 2x number of tests per day Splunk lets us quickly correlate and debug performance issues in a environment so we can track our cri@cal SLAs in pre- produc@on. Amit Sehgal Performance & Scalability Engineer 21

22 Wrap- up

23 What Did We Learn Today?! Splunk can be valuable for development and DevOps! Find and fix issues with search and monitoring! Instrument your custom app logs with Logging to make those logs more Splunk- friendly! Splunk can correlate data from disparate tools across your lifecycle to give your insights and help to market! Lots of customers are doing this you can too! 23

24 Where to go for More Info! Tutorials, Code Samples, Geung Started, Downloads hgp://dev.splunk.com/! Support hgps:// GitHub hgps://github.com/splunk/! Twiger hgps://twiger.com/splunkdev! Blog hgp://blogs.splunk.com/dev/ 24

25 Special Offer: Try Splunk MINT Express for Free! Splunk MINT offers a fast path to mobile intelligence. How fast? Find out with a 6- month trial* Register for your free trial: hgp://mint.splunk.com/conf2014offer Download the Splunk MINT SDKs Add the Splunk MINT line of SDK code and publish** Start geung digital intelligence at your finger@ps! *Offer valid for.conf2014 anendees and coworkers of anendees only. **Trial allows monitoring of up to 750,000 monthly ac4ve users (MAUs). 25

26 THANK YOU