Artificial Intelligence & Machine Learning. Elena Ehrlich, PhD

Transcription

1 Artificial Intelligence & Machine Learning Elena Ehrlich, PhD

2 What is AI?

3 Agenda Image & Video Recognition Rekognition Deep-Learning Enabled Video Cameras DeepLens Natural Language Understanding Comprehend Voice & Convseration Bots Polly, Lex, & Alexa Fully-Managed Machine Learning Sagemaker

4 Image Analysis AWS Rekognition

5 Rekognition: Object & Scene Detection Bay Beach Coast Outdoors Sea Water Palm_tree Plant Tree Summer Landscape Nature Hotel Category 99.18% 99.18% 99.18% 99.18% 99.18% 99.18% 99.21% 99.21% 99.21% 58.3% 51.84% 51.84% 51.24% Confidence

6 Rekognition: Facial Analysis { "contentstring": } { } "Attributes": [ ], "ALL" "Image": { } "Bytes": "..." DetectFaces "FaceDetails": [{ "BoundingBox": { "Height": , "Left": , "Top": , "Width": }, "Confidence": , "Emotions": [{ "Confidence": , "Type": "HAPPY" }, { "Confidence": , "Type": "CALM" }, { "Confidence": , "Type": "CONFUSED" }], "AgeRange": { "High": 47, "Low": 30 }, "Beard": { "Confidence": , "Value": false }, "Eyeglasses": { "Confidence": , "Value": true }, "EyesOpen": { "Confidence": , "Value": true }, "Gender": { "Confidence": , "Value": Female" }, "MouthOpen": { "Confidence": , "Value": true }, "Mustache": { smart cropping & ad overlays sentiment capture demographic analysis face editing & pixelation

7 Rekognition: Compare Faces Face Comparision

8 Rekognition: Image Moderation Confidence score Hierarchical taxonomy Suggestive 82.7% Female Swimwear or Underwear 82.7% Nudity and Sexuality 50.1% Covered Nudity 50.1% "ModerationLabels": [ { "Confidence": , "Name": "Suggestive", "ParentName": "" }, { "Confidence": , "Name": "Female Swimwear or Underwear", "ParentName": "Suggestive" }, { "Confidence": , "Name": "Covered Nudity", "ParentName": "Nudity and Sexuality" }, { "Confidence": , "Name": "Nudity and Sexuality", "ParentName": "" }, ]

9 Interesting Demos Time permitting

10 Deep-Learning Enabled Video Cameras AWS DeepLens

11 DeepLens: Deep-Learning Enabled Video Camera A DL video camera uses deep convolutional neural networks (CNNs) to analyze visual imagery. The device itself is a development environment to build computer vision applications. April 2018 AWS DeepLens communicates with the following ML endpoints: Amazon SageMaker, for model training and validation AWS Lambda, event-driven triggers run inference against CNN models AWS Greengrass, for deploying updates and functions to your device and other IoT devices

12 Natural Language Understanding AWS Comprehend

13 Comprehend: Keyword, Sentiment, & Topic Modeling

14 Comprehend: Keyword, Sentiment, & Topic Modeling

15 Comprehend: Keyword, Sentiment, & Topic Modeling

16 Comprehend: Keyword, Sentiment, & Topic Modeling

17 Life-like Speech AWS Polly

18 Polly: Life-like Speech Service Plain Text SSML Lexicons Speech Synthesis Markup Language <speak> - Start Tag <break> - Pause in Speech <lang> - Specifies the language <mark> - Tag Name for specific word <p> - Indicates Paragraph <phoneme>- phonetic pronunciation <prosody> - Controls the volume <s> - Indicates a sentence <say-as>- Interpretation <sub> - Alias words <w> - Customize pronunciation <amazon:effect name="whispered"> Plain Text SSML <lexeme> <grapheme>espresso</grapheme > <alias>ess-press-oh</alias> </lexeme> Lexicons

19 Conversational Engines AWS Lex

20 Lex: The Advent Of Conversational Interactions 1st Gen: Machine-oriented interactions Availability 2nd Gen: Control-oriented & translated 3rd Gen: Intent-oriented Testing Speech Recognition Business Logic Language Understanding Security Mobile Disparate Systems Messaging platforms Scale Authentication

21 Lex Converstaional Engines Operational Bots Chatbots for IT automation Informational Bots Chatbots for everyday consumer requests Application Bots Build powerful interfaces to mobile applications Enterprise Productivity Bots Streamline enterprise work activities and improve efficiencies Reset my Password TCO analysis Productivity. News updates Weather information Game scores. Book tickets Order food Manage bank accounts. Check sales numbers Marketing performance Inventory status. Internet of Things (IoT) Bots Enable conversational interfaces for device interactions Wearables Appliances Auto.

22

23 Sagemaker: Fully-Managed Machine Learning Most Common Algorithms Provided Linear Learner Factorization Machines XGBoost Algorithm Image Classification Algorithm Amazon SageMaker Sequence2Sequence K-Means Algorithm Principal Component Analysis (PCA) Latent Dirichlet Allocation (LDA) Neural Topic Model (NTM) DeepAR Forecasting BlazingText import sagemaker 10x Performance Single-Click Training OpenSource tools TensorFlow Apache MXNet A/B Testing Built-in Train Models at Petabyte Scale Deploy in Production Auto-Scaling Cluster of AWS EC2 Instances

24 AI/ML Adoption Benefits 1 MAKING THE BEST USE OF A DATA SCIENTISTS TIME While the power of ML is unrivaled, data scientists spend around 80% of their time on preparing and managing data for analysis hence only 20% of their time is used to derive insights 2 CONVERTING THE POWER OF MACHINE LEARNING INTO BUSINESS VALUE While 60% of companies agree that big data will help improve their decision making and competitiveness only 28% indicate that they are currently generating strategic value from their data 3 EMBEDDING MACHINE LEARNING INTO THE FABRIC OF YOUR BUSINESS The value of data science relies upon operationalizing models within business applications and processes, yet 50% of the predictive models [built] don t get implemented

25 Thank you Elena Ehrlich, PhD

26 Appendix

27 AWS AI/ML: The Stack Services Speech: Polly & Transcribe Vision: Rekognition Image & Rekognition Video Language: Lex, Translate & Comprehend Platforms SageMaker AWS DeepLens Amazon ML Spark & EMR Mechanical Turk Frameworks Apache MXNet Tensor- Flow Caffe2 & Caffe AWS Deep Learning AMI Cognitive Toolkit PyTorch Gluon Keras

28 AWS AI/ML: Notable Successes Services Platforms Frameworks

29 AWS AI/ML: Solutions for Every Skill Level Services Designed for Developers & Data Scientists Solution-oriented Prebuilt Models Available via APIs Image Analysis, NLU, NLP, Translation, Text-to-Speech & Speech-to-Text Platforms Designed for Data Scientists to Address Common Needs Fully Managed Platform for Model Building Reduces the Heavy Lifting in Model Building & Deployment Frameworks Designed for Data Scientists to Address Advanced / Emerging Needs Provides Maximum Flexibility to develop on the leading AI Frameworks Enables Expert AI Systems to be Developed & Deployed

30 Rekognition: Search & Understand Visual Content Real-time & batch image analysis Object & Scene Detection Facial Detection Facial Analysis Face Search Image Moderation Celebrity Recognition

31 Rekognition: Image Moderation Upload picture Object Creation Lambda Users S3 Bucket Rekognition No inappropriate content detected Inappropriate content detected Rejected Picture posted to end users Approved Manual Review User Notification

32 Rekognition: Video - Case Study Architecture

33 Polly: Life-like Speech Service Converts text to life-like speech Fully managed 47 voices 27 languages Low latency, real time

34 Lex: Build Natural, Conversational Interactions In Voice & Text Voice & Text Chatbots Powers Alexa Voice interactions on mobile, web & devices Text interaction with Slack & Messenger (with more coming) Enterprise Connectors Salesforce Microsoft Dynamics Marketo Zendesk Quickbooks Hubspot

35 Lex: Build Natural, Conversational Interactions In Voice & Text BOT Intent Slot & Slot type An Amazon Lex bot is powered by Automatic Speech Recognition (ASR) and Natural Language Understanding (NLU) capabilities An intent represents an action that the user wants to perform Intent name A descriptive name for the intent. Sample utterances How a user might convey the intent. How to fulfill the intent How you want to fulfill the intent after the user provides the necessary information Slot - An intent can require zero or more slots or parameters Slot type Each slot has a type. You can create your custom slot types or use built-in slot types BOT Intent Slot & Slot type

36 Response Cards Simplify interactions for your users Increase bot's accuracy Can be used with Facebook Messenger, Slack, and Twilio as well as your own client applications.

37 DeepLens Architecture

38 IoT Anomaly Detection AWS Kinesis Analytics

39 Kinesis Analytics: real-time insights from streaming data

40 Kinesis Analytics: real-time insights from streaming data

41 AI/ML Assessment AI Inquisitors AI Adopters AI Experts Interested in AI but have limited expertise and/or resources Limited expertise and/or use of AI for one-off projects Advanced expertise and/or use of embedded AI in apps

42 Assessing POC Targets: Criteria Business Value Ability to Execute Data Availability

43 AI/ML Assessment Prep Question Sample Answer What Business or Operational benefits are you trying to drive? Improve content personalization How will you consume the outputs and put them into action? What types of data is available today? Where does the data reside? What types of analytics and/or machine learning are being employed today? What staff and/or consultants currently support these activities? Content will be distributed at a targeted level Content and subscription data Business Intelligence Predictive Analytics Data Engineers Data Scientists What software currently supports these activities? R / Python What is your ideal scenario in tackling these business objectives? One-to-one content for individuals What challenges have you experienced when deploying AI? Prioritization of Targets Operationalization