How to build an autonomous anything

Size: px
Start display at page:

Download "How to build an autonomous anything"

Transcription

1 How to build an autonomous anything Mischa Kim 2015 The MathWorks, Inc. 1

2 2

3 3

4 4

5 5

6 6

7 7

8 Autonomous Technology 8

9 Autonomous Technology Having the power for self-governance 9

10 Autonomous Technology Provides the ability of a system to act independently of direct human control under unrehearsed conditions 10

11 11

12 Capabilities of an Autonomous System Sense 12

13 Capabilities of an Autonomous System Sense Perceive 13

14 Capabilities of an Autonomous System Sense Perceive Decide & Plan Learning Algorithms Optimization 14

15 Capabilities of an Autonomous System Sense Perceive Decide & Plan Act Control Algorithms 15

16 Responsibility Autonomous Technology Transfers Responsibility to Computers Computer Human Degree of Autonomy 16

17 Bazille s Studio Bazille 1870 Shuffleton s Barbershop Rockwell

18 Autonomous Artistic Style Classification Rutgers University Sense Machine Learning Classification Style Classifier (SVM) Style: Regionalism Perceive Decide & Plan Image Feature Extraction Visual Features Genre Classifier (SVM) Genre: Interior Act Artist Classifier (SVM) Artist: Rockwell 18

19 Where to add autonomy with perception? Analyze more data Reduce bias Reduce variability Save time Improve performance Determine Loudspeaker Quality Virtual Semiconductor Manufacturing Calibration 19

20 21

21 22

22 23

23 24

24 Autonomous Service for Predictive Maintenance Sense Which sensor values should they use? Vibration Timing Perceive Pressure Temperature Decide & Plan Act Other variables 25

25 Autonomous Service for Predictive Maintenance Sense Perceive Decide & Plan Act Normal Operation Monitor Closely Maintenance Needed 26

26 What are the best predictors? Data Models Name of Presenter Time and Location Jet Engine Monitoring 27

27 Autonomous Glucose Level Management 29

28 Autonomous Glucose Level Management Bigfoot Biomedical Sense + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person Act Continuous Glucose Monitor 30

29 Autonomous Glucose Level Management Bigfoot Biomedical Sense + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person + + Act Mobile App Continuous Glucose Monitor 31

30 Autonomous Glucose Level Management Bigfoot Biomedical Sense Virtual Lab Simulink, Stateflow Polyspace + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person + + Act Mobile App Continuous Glucose Monitor 32

31 Autonomous Glucose Level Management Bigfoot Biomedical Sense + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person + + Act Mobile App Continuous Glucose Monitor 33

32 Autonomous Glucose Level Management Bigfoot Biomedical Sense Virtual Clinic MATLAB, Toolboxes + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person + + Act Mobile App Continuous Glucose Monitor 34

33 Virtual Clinic Generating data through simulation 35

34 Virtual Clinic Scaling computations to simulate 50 million patients a day 36

35 Where will you get your data? Simulation Public repositories In the lab In the field Internet of Things (IoT) 37

36 CNH Develops Intelligent Filling System for Forage Harvesters 39

37 40

38 Autonomous Trailer Filling Sense Perceive Decide & Plan Act Control Algorithms 41

39 Autonomous Trailer Filling Sense Perceive Decide & Plan Act Control Algorithms 42

40 43

41 Autonomous Trailer Filling Sense 3D Camera Embedded Platform MPC5121e User Input Visualization Perceive Decide & Plan CAN Actuators Act Computer vision and controls algorithms ECU Control Algorithms 44

42 Autonomous Trailer Filling Sense Perceive Decide & Plan 3D Camera Embedded Coder Embedded Platform MPC5121e CAN User Input Visualization Computer Vision Controls Actuators Act Monitoring ECU Control Algorithms 45

43 How will you put it into production? Embedded Systems IT Systems Desktop Apps 46

44 48

45 49

46 50

47 How to build an autonomous anything Focus on Perception Use the Best Predictors Get the Right Data Flow to Production Look for autonomy in creative places Do more than manually possible Data-driven Model-driven Reduce to actionable data Take advantage of Big Data Use simulation to supplement available data Address the architecture Leverage Model-Based Design for embedded Automate integration with enterprise IT systems 51

48 What is your autonomous anything? 53