How to build an autonomous anything Mischa Kim 2015 The MathWorks, Inc. 1
2
3
4
5
6
7
Autonomous Technology 8
Autonomous Technology Having the power for self-governance 9
Autonomous Technology Provides the ability of a system to act independently of direct human control under unrehearsed conditions 10
11
Capabilities of an Autonomous System Sense 12
Capabilities of an Autonomous System Sense Perceive 13
Capabilities of an Autonomous System Sense Perceive Decide & Plan Learning Algorithms Optimization 14
Capabilities of an Autonomous System Sense Perceive Decide & Plan Act Control Algorithms 15
Responsibility Autonomous Technology Transfers Responsibility to Computers Computer Human Degree of Autonomy 16
Bazille s Studio Bazille 1870 Shuffleton s Barbershop Rockwell 1950 17
Autonomous Artistic Style Classification Rutgers University Sense Machine Learning Classification Style Classifier (SVM) Style: Regionalism Perceive Decide & Plan Image Feature Extraction Visual Features Genre Classifier (SVM) Genre: Interior Act Artist Classifier (SVM) Artist: Rockwell 18
Where to add autonomy with perception? Analyze more data Reduce bias Reduce variability Save time Improve performance Determine Loudspeaker Quality Virtual Semiconductor Manufacturing Calibration 19
21
22
23
24
Autonomous Service for Predictive Maintenance Sense Which sensor values should they use? Vibration Timing Perceive Pressure Temperature Decide & Plan Act Other variables 25
Autonomous Service for Predictive Maintenance Sense Perceive Decide & Plan Act Normal Operation Monitor Closely Maintenance Needed 26
What are the best predictors? Data Models Name of Presenter Time and Location Jet Engine Monitoring 27
Autonomous Glucose Level Management 29
Autonomous Glucose Level Management Bigfoot Biomedical Sense + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person Act Continuous Glucose Monitor 30
Autonomous Glucose Level Management Bigfoot Biomedical Sense + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person + + Act Mobile App Continuous Glucose Monitor 31
Autonomous Glucose Level Management Bigfoot Biomedical Sense Virtual Lab Simulink, Stateflow Polyspace + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person + + Act Mobile App Continuous Glucose Monitor 32
Autonomous Glucose Level Management Bigfoot Biomedical Sense + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person + + Act Mobile App Continuous Glucose Monitor 33
Autonomous Glucose Level Management Bigfoot Biomedical Sense Virtual Clinic MATLAB, Toolboxes + - Perceive Decide & Plan Target Glucose Level Insulin Pump Person + + Act Mobile App Continuous Glucose Monitor 34
Virtual Clinic Generating data through simulation 35
Virtual Clinic Scaling computations to simulate 50 million patients a day 36
Where will you get your data? Simulation Public repositories In the lab In the field Internet of Things (IoT) 37
CNH Develops Intelligent Filling System for Forage Harvesters 39
40
Autonomous Trailer Filling Sense Perceive Decide & Plan Act Control Algorithms 41
Autonomous Trailer Filling Sense Perceive Decide & Plan Act Control Algorithms 42
43
Autonomous Trailer Filling Sense 3D Camera Embedded Platform MPC5121e User Input Visualization Perceive Decide & Plan CAN Actuators Act Computer vision and controls algorithms ECU Control Algorithms 44
Autonomous Trailer Filling Sense Perceive Decide & Plan 3D Camera Embedded Coder Embedded Platform MPC5121e CAN User Input Visualization Computer Vision Controls Actuators Act Monitoring ECU Control Algorithms 45
How will you put it into production? Embedded Systems IT Systems Desktop Apps 46
48
49
50
How to build an autonomous anything Focus on Perception Use the Best Predictors Get the Right Data Flow to Production Look for autonomy in creative places Do more than manually possible Data-driven Model-driven Reduce to actionable data Take advantage of Big Data Use simulation to supplement available data Address the architecture Leverage Model-Based Design for embedded Automate integration with enterprise IT systems 51
What is your autonomous anything? 53