SYMPOSIUM March 22-23, 2018

Transcription

1 Bigger and Better Data Lessons from Frontlines of Precision Medicine Getting Your Transformation Right Frank Lee PhD IBM Global Industry Leader for Systems Group SYMPOSIUM March 22-23, th Annual Big Data & Business Analytics Symposium March 22-23, 2018

2 Precision Medicine: A Case Study for Speed, Smart & Scale 5th Annual Big Data & Business Analytics Symposium March 22-23,

3 Paradigm Shift 1 st Symptom 1 st Diagnosis 1 st Treatment 2 nd Symptoms 2 nd Diagnosis 2 nd Treatment 3 rd Symptoms 3 rd Diagnosis 3 rd Treatment Diagnosis biomarkers Treatment Symptoms 5th Annual Big Data & Business Analytics Symposium March 22-23,

4 Precision: Genomics Landscape of Colorectal Cancer Strickler et al: Genomic landscape of cell-free DNA in patients with colorectal cancer 5th Annual Big Data & Business Analytics Symposium March 22-23,

5 Precision Supported by Big Data Automation and instrumentation for decoding DNA (Next-Gen Sequencing) Early and frequent sequencing to monitor cancer (Liquid Biopsy) Single cell sequencing from tissue biopsy Tracking all related biomarkers (methylation, expression, protein etc) Connected to clinical phenotypes (symptoms) and outcome 5th Annual Big Data & Business Analytics Symposium March 22-23,

6 8 Hours from tissue isolation to sequencing test results 2.5 Years from start of clinical trial to FDA approval (Nov 2015) 5th Annual Big Data & Business Analytics Symposium March 22-23,

7 10 year & $3 billion 5th Annual Big Data & Business Analytics Symposium March 22-23,

8 Speed: From Days to Hours 5th Annual Big Data & Business Analytics Symposium March 22-23,

9 Speed+: 3D Genomics for De Nova Assembly 5th Annual Big Data & Business Analytics Symposium March 22-23,

10 Smart: Auto-drive Analytical Pipeline 5th Annual Big Data & Business Analytics Symposium March 22-23,

11 Scale: Institutional, Regional, Global 5th Annual Big Data & Business Analytics Symposium March 22-23,

12 Instrumenting Data: Challenges & Opportunities 5th Annual Big Data & Business Analytics Symposium March 22-23,

13 Processing Data Faster Than Instruments High Performance data landing and analysis Byte: 1 Grain of Rice Terabyte: 2 Container Ships Petabyte: Blankets Manhattan Exabyte: Blankets US West Coast States Zettabyte: Fills Pacific Ocean Yottabyte: AN EARTH SIZE BALL OF RICE 5th Annual Big Data & Business Analytics Symposium March 22-23,

14 Finding & Tracking Data Finding needles in haystacks, lots of them and growing faster ever (human API) 5th Annual Big Data & Business Analytics Symposium March 22-23,

15 Using My Data To Solve Your Problem Using Deep Learning to Train Model based on Bigger & Better Dataset Training a CNN to filter genomic variants based on highquality results, then apply it to low-coverage raw data 5th Annual Big Data & Business Analytics Symposium March 22-23,

16 Aggregating Our Data to Solve One Problem Combining datasets into large cohorts for anlaysis Precision: Epigenetic Landscape of CNS Tumors 100 Labs 150 Researchers 3000 Samples 91 Classes 1 AI Classifier 5th Annual Big Data & Business Analytics Symposium March 22-23,

17 How to Instrument Data? 5th Annual Big Data & Business Analytics Symposium March 22-23,

18 Internet of Data Fast Data Landing Smart Data Tiering Flexible Data Accessing Global Data Peering Data Cataloguing 5th Annual Big Data & Business Analytics Symposium March 22-23,

19 High Speed & Throughput 1GB 2M 20K 5th Annual Big Data & Business Analytics Symposium March 22-23,

20 High Performance Data Lander ILM policy engine for landing 5th Annual Big Data & Business Analytics Symposium March 22-23,

21 Genomics GATK 3.5 Best Practice Pipeline 50% Speedup GATK 3.8 Removing 1TB memory requirement GPU 21

22 Tagging & Labelling Data What File name File size Filer owner File path Filesystem name File set name File inode ID File permission File ctime File atime File mtime When Cluster name Global file ID Job submission user Job ID Job name Flow ID Job status Job start time Job finish time Job working directory Input files User variables 22

23 Internet of Data Fast Data Landing Smart Data Tiering Flexible Data Accessing Global Data Peering Data Cataloguing 5th Annual Big Data & Business Analytics Symposium March 22-23,

24 Scale of Bigger Data 5th Annual Big Data & Business Analytics Symposium March 22-23,

25 Bending the Curve 5th Annual Big Data & Business Analytics Symposium March 22-23,

26 Peta-scale Data Management to Lower Cost ILM policy engine data life cycle management 26

27 Internet of Data Fast Data Landing Smart Data Tiering Flexible Data Accessing Global Data Peering Data Cataloguing 5th Annual Big Data & Business Analytics Symposium March 22-23,

28 Multi-protocol access SMB NFS POSIX HDFS S3 CES 5th Annual Big Data & Business Analytics Symposium March 22-23,

29 NFS POSIX HDFS SMB 5th Annual Big Data & Business Analytics Symposium March 22-23,

30 Internet of Data Fast Data Landing Smart Data Tiering Flexible Data Accessing Global Data Peering Data Cataloguing 5th Annual Big Data & Business Analytics Symposium March 22-23,

31 5th Annual Big Data & Business Analytics Symposium March 22-23,

32 Global Data Peering with Cache 5th Annual Big Data & Business Analytics Symposium March 22-23,

33 Global Data Peering with Cloud 5th Annual Big Data & Business Analytics Symposium March 22-23,

34 Internet of Data Fast Data Landing Smart Data Tiering Flexible Data Accessing Global Data Peering Data Cataloguing 5th Annual Big Data & Business Analytics Symposium March 22-23,

35 Metadata Catalogue 5th Annual Big Data & Business Analytics Symposium March 22-23,

36 Data Dashboard 5th Annual Big Data & Business Analytics Symposium March 22-23,

37 Metadata for Dataset 5th Annual Big Data & Business Analytics Symposium March 22-23,

38 Genomic Database 5th Annual Big Data & Business Analytics Symposium March 22-23,

39 Architecture of Instrumented Data 5th Annual Big Data & Business Analytics Symposium March 22-23,

40 Instrumented Data: Early Applications 5th Annual Big Data & Business Analytics Symposium March 22-23,

41 Metadata-driven Information Sharing 5th Annual Big Data & Business Analytics Symposium March 22-23,

42 Metadata-driven Workflow & Cloud 5th Annual Big Data & Business Analytics Symposium March 22-23,

43 Bouncing Back 5th Annual Big Data & Business Analytics Symposium March 22-23,

44 5th Annual Big Data & Business Analytics Symposium March 22-23,

45 45

46 46