How to build an autonomous anything

Transcription

1 How to build an autonomous anything Richard Rovner VP Marketing MathWorks 2015 The MathWorks, Inc. 1

2 2

3 3

4 4

5 5

6 6

7 7

8 Autonomous Technology 8

9 Autonomous Acting independently 9

10 Autonomous Technology 10

11 Autonomous Technology Provides the ability of a system to act independently of direct human control 11

12 Autonomous Technology Provides the ability of a system to act independently of direct human control under unrehearsed conditions 12

13 13

14 Capabilities of an Autonomous System Sense 14

15 Capabilities of an Autonomous System Sense Perceive 15

16 Capabilities of an Autonomous System Sense Perceive Decide & Plan Learning Algorithms Optimization 16

17 Capabilities of an Autonomous System Sense Perceive Decide & Plan Act Control Algorithms 17

18 Responsibility Autonomous Technology Balancing Responsibility Computer Human Degree of Autonomy 18

19 Bazille s Studio Bazille 1870 Shuffleton s Barbershop Rockwell

20 Autonomous Artistic Style Classification Rutgers University Sense Machine Learning Classification Style Classifier (SVM) Style: Regionalism Perceive Decide & Plan Image Feature Extraction Visual Features Genre Classifier (SVM) Genre: Interior Act Artist Classifier (SVM) Artist: Rockwell 20

21 Where to add autonomy with perception? Analyze more data Reduce bias Improve measurement quality Save time Improve performance Determine Loudspeaker Quality Virtual Semiconductor Manufacturing Calibration 21

22 Cost of rig: $1,000,000+ Repair cost: $100,000 Cost of valve: $200 22

23 23

24 24

25 25

26 Autonomous Service for Predictive Maintenance Sense Which sensor values should they use? Vibration Timing Perceive Pressure Temperature Decide & Plan Act Other variables 26

27 Autonomous Service for Predictive Maintenance Sense Perceive Decide & Plan Act Normal Operation Monitor Closely Maintenance Needed 27

28 Autonomous Service for Predictive Maintenance Sense Perceive Decide & Plan Find out more: What s Big Data New and in Machine Image Processing Learning for and Predictive Computer Maintenance Vision with MATLAB Roy Paul Fahn, Peeling Michael Donnenfeld Image Technical Processing Computing and Deep Learning Act Normal Operation Monitor Closely Maintenance Needed 28

29 Machine Learning or Deep Learning? Machine Learning Approach Sensor 1 Sensor 2 Sensor 25 Sensor a Sensor b Sensor c 1. Normal 2. Monitor 3. Maintain Correlation Analysis Feature Extraction Classification Output Deep Learning Approach Sensor 1 Sensor 2 Sensor Normal 2. Monitor 3. Maintain Feature Extraction & Classification Output 29

30 Mega Release of Deep Learning Capabilities Design Deep Learning & Vision Algorithm Accelerate and Scale Training High Performance Embedded Implementation Deep learning design is easy in MATLAB Apps for Ground Truth Labeling, Pixel Labeling Pre-trained model importer Training Visualization Parallel Computing Toolbox 7x faster than pycaffe 2x faster than TensorFlow GPU Coder 14x faster than pycaffe 4x faster than TensorFlow 1.6x faster than C++ Caffe 31

31 Mega Release of Deep Learning Capabilities Find out more: Deep Introduction Learning: to Machine How to do this Learning MATLAB and Deep Learning Design Deep Learning & Vision Algorithm Roy Conor Fahn Daly Accelerate and Scale Training Image Getting Processing Started with and MATLAB Deep Learning and Simulink High Performance Embedded Implementation Deep learning design is easy in MATLAB Apps for Ground Truth Labeling, Pixel Labeling Pre-trained model importer Parallel Computing Toolbox 7x faster than pycaffe 2x faster than TensorFlow GPU Coder 14x faster than pycaffe 4x faster than TensorFlow 1.6x faster than C++ Caffe 32

32 What are the best predictors? Data-driven Model-driven Name of Presenter Time and Location Jet Engine Monitoring 33

33 Autonomous Glucose Level Management 34

34 Autonomous Glucose Level Management Bigfoot Biomedical Sense + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person Act Continuous Glucose Monitor 35

35 Autonomous Glucose Level Management Bigfoot Biomedical Sense + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person + + Act Mobile App Continuous Glucose Monitor 36

36 Autonomous Glucose Level Management Bigfoot Biomedical Sense Virtual Lab Simulink, Stateflow Polyspace + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person + + Act Mobile App Continuous Glucose Monitor 37

37 Autonomous Glucose Level Management Bigfoot Biomedical Sense + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person + + Act Mobile App Continuous Glucose Monitor 38

38 Autonomous Glucose Level Management Bigfoot Biomedical Sense Virtual Clinic MATLAB, Toolboxes + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person + + Act Mobile App Continuous Glucose Monitor 39

39 Virtual Clinic Generating data through simulation 40

40 Virtual Clinic Scaling computations to simulate 50 million patients a day 41

41 Where will you get your data? Simulation Public repositories In the field In the lab Internet of Things (IoT) 42

42 Working with Big Data Just Got Easier Tall arrays in MATLAB Machine Memory e.g. 4~8GB e.g. 100GB~ 1TB Stream large input signals from MAT-files Tall Data 43

43 CNH Develops Intelligent Filling System for Forage Harvesters 44

44 45

45 Autonomous Trailer Filling Sense Perceive Decide & Plan Act Control Algorithms 46

46 Autonomous Trailer Filling Sense Perceive Decide & Plan Act Control Algorithms 47

47 48

48 Autonomous Trailer Filling Sense 3D Camera Embedded Platform MPC5121e User Input Visualization Perceive Decide & Plan CAN Actuators Act Computer vision and controls algorithms ECU Control Algorithms 49

49 Autonomous Trailer Filling Sense Perceive Decide & Plan 3D Cameras Embedded Coder Vehicle Display Controller CAN Driver Input Visualization Computer Vision Controls Actuators Act Computer vision and controls algorithms ECU 50

50 How will you put it into production? Embedded Systems IT Systems Cloud Desktop Apps 51

51 Investments in Model-Based Design Efficient code generation Floating-point HDL code generation 52

52 Investments in Model-Based Design Code verification in support of CERT C standard Detect and fix standards compliance issues at design time 53

53 Investments in Model-Based Design Code verification in support Detect and fix standards compliance of CERT C standard issues at design time Find out more: Faster Model-Based and Safer Design System for Development Fuel System Development with Model-Based Design Manuel Christopher Fedou Slack, Airbus Development Simulink and Model-Based of Smart and Autonomous Design Systems 54

54 55

55 56

56 57

57 Capabilities of an Autonomous System Sense Perceive Decide & Plan Act Control Algorithms 58

58 How to build an autonomous anything Focus on Perception Use the Best Predictors Get the Right Data Flow to Production Look for autonomy in creative places Do more than manually possible Data-driven Model-driven Reduce to actionable data Take advantage of Big Data Use simulation to supplement available data Address the architecture Leverage Model-Based Design for embedded Automate integration with enterprise IT systems 59

59 What is your autonomous anything? 60