Machine Learning Logistic Regression Hamid R. Rabiee Spring 2015
|
|
- Shon Jefferson
- 6 years ago
- Views:
Transcription
1 Machine Learning Logistic Regression Hamid R. Rabiee Spring /
2 Agenda Probabilistic Classification Introduction to Logistic regression Binary logistic regression Logistic regression: Decision surface Logistic regression: ML estimation Logistic regression: Gradient descent Logistic regression: multi-class Logistic Regression: Regularization Logistic Regression VS. Naïve Bayes 2
3 Probabilistic Classification Generative probabilistic classification (Previous lecture) motivation: assume a distribution for each class and try to find the parameters for the distributions cons: need to assume distributions; need to fit many parameters Discriminative approach: Logistic regression (Focus of today) motivation: like least square, but assume logistic distribution y(x) = (wtx); classify based on y(x) > 0:5 or not. technique: gradient descent 3
4 Introduction to Logistic regression Logistic regression represents the probability of category i using a linear function of the input variables: The name comes from the logit transformation: 4
5 Binary logistic regression Logistic Regression assumes a parametric form for the distribution then directly estimates its parameters from the training data. The parametric model assumed by Logistic Regression in the case where boolean is: P( Y X ) Y is Notice that equation (2) follows directly from equation (1), because the sum of these two probabilities must equal 1. 5
6 Binary logistic regression We only need one set of parameters: Sigmoid (logistic) function 6
7 Logistic regression vs. Linear regression Adapted from slides of John Whitehead 7
8 Logistic regression: Decision surface Given a logistic regression W and an X: Decision surface f(x;w)=constant Decision surfaces are linear functions of x Decision making on Y: 8
9 Computing the likelihood in details We can re-express the log of the conditional likelihood as: l l l l l l l( w) y ln P( y 1 x, w) (1 y )ln P( y 0 x, w) l l l l Py ( 1 x, w) l l y ln ln P( y 0 x, w) l l Py ( 0 x, w) l n n l l l y w0 wi xi w0 wi xi l i 1 i 1 ( ) ln(1 exp( )) 9
10 Logistic regression: ML estimation is a concave in w What is a concave and a convex function? No closed form solution 10
11 Optimizing concave/convex function Maximum of a concave function = minimum of a convex function Gradient ascent (concave) / Gradient descent (convex) 11
12 Gradient ascent / Gradient descent For function f(w) If f is concave : Gradient ascent rule If f is convex: Gradient descent rule 12
13 Logistic regression: Gradient descent Iteratively updating the weights in this fashion increases likelihood each round. We eventually reach the maximum We are near the maximum when changes in the weights are small. Thus, we can stop when the sum of the absolute values of the weight differences is less than some small number. 13
14 Logistic regression: multi-class In the two-class case For multiclass, we work with soft-max function instead of logistic sigmoid Aka Softmax 14
15 Logistic Regression: Regularization Overfitting the training data is a problem that can arise in Logistic Regression, especially when data has very high dimensions and is sparse. One approach to reducing overfitting is regularization, in which we create a modified penalized log likelihood function, which penalizes large values of w. l l 2 w = arg max ln Py ( x, w) w w l 2 The derivative of this penalized log likelihood function is similar to our earlier derivative, with one additional penalty term l( w) x l ( l ˆ( l 1 l i y P y x, w)) wi wi l which gives us the modified gradient descent rule w w x l ( y l Pˆ ( y l 1 x l, w)) w i i i i l 15
16 Logistic Regression VS. Naïve Bayes In general, NB and LR make different assumptions NB: Features independent given class -> assumption on P(X Y) LR: Functional form of P(Y X), no assumption on P(X Y) LR is a linear classifier decision rule is a hyperplane LR optimized by conditional likelihood no closed-form solution concave -> global optimum with gradient ascent 16
17 Logistic Regression VS. Naïve Bayes Consider Y and Xi boolean, X=<X1... Xn> Number of parameters: NB: 2n +1 LR: n+1 Estimation method: NB parameter estimates are uncoupled LR parameter estimates are coupled 17
18 Logistic Regression VS. Gaussian Naive Bayes When the GNB modeling assumptions do not hold, Logistic Regression and GNB typically learn different classifier functions Logistic Regression is consistent with the Naïve Bayes assumption that the input features Xi are conditionally independent given Y,it is not rigidly tied to this assumption as is Naive Bayes. GNB parameter estimates converge toward their asymptotic values in order log(n) examples, where n is the dimension of X. Logistic Regression parameter estimates converge more slowly, requiring order (n ) examples. 18
19 Summary Logistic Regression learns the Conditional Probability Distribution P(y x) Local Search. Begins with initial weight vector. Modifies it iteratively to maximize an objective function. The objective function is the conditional log likelihood of the data: so the algorithm seeks the probability distribution P(y x) that is most likely given the data. 19
20 Any Question End of Lecture 9 Thank you! Spring
Intro Logistic Regression Gradient Descent + SGD
Case Study 1: Estimating Click Probabilities Intro Logistic Regression Gradient Descent + SGD Machine Learning for Big Data CSE547/STAT548, University of Washington Sham Kakade March 29, 2016 1 Ad Placement
More informationPAST research has shown that real-time Twitter data can
Algorithmic Trading of Cryptocurrency Based on Twitter Sentiment Analysis Stuart Colianni, Stephanie Rosales, and Michael Signorotti ABSTRACT PAST research has shown that real-time Twitter data can be
More informationImproving the Accuracy of Base Calls and Error Predictions for GS 20 DNA Sequence Data
Improving the Accuracy of Base Calls and Error Predictions for GS 20 DNA Sequence Data Justin S. Hogg Department of Computational Biology University of Pittsburgh Pittsburgh, PA 15213 jsh32@pitt.edu Abstract
More informationCustomer Relationship Management in marketing programs: A machine learning approach for decision. Fernanda Alcantara
Customer Relationship Management in marketing programs: A machine learning approach for decision Fernanda Alcantara F.Alcantara@cs.ucl.ac.uk CRM Goal Support the decision taking Personalize the best individual
More informationNeural Networks and Applications in Bioinformatics. Yuzhen Ye School of Informatics and Computing, Indiana University
Neural Networks and Applications in Bioinformatics Yuzhen Ye School of Informatics and Computing, Indiana University Contents Biological problem: promoter modeling Basics of neural networks Perceptrons
More informationDetermining NDMA Formation During Disinfection Using Treatment Parameters Introduction Water disinfection was one of the biggest turning points for
Determining NDMA Formation During Disinfection Using Treatment Parameters Introduction Water disinfection was one of the biggest turning points for human health in the past two centuries. Adding chlorine
More informationPredictive Modeling using SAS. Principles and Best Practices CAROLYN OLSEN & DANIEL FUHRMANN
Predictive Modeling using SAS Enterprise Miner and SAS/STAT : Principles and Best Practices CAROLYN OLSEN & DANIEL FUHRMANN 1 Overview This presentation will: Provide a brief introduction of how to set
More informationStartup Machine Learning: Bootstrapping a fraud detection system. Michael Manapat
Startup Machine Learning: Bootstrapping a fraud detection system Michael Manapat Stripe @mlmanapat About me: Engineering Manager of the Machine Learning Products Team at Stripe About Stripe: Payments infrastructure
More informationModeling User Click Behavior in Sponsored Search
Modeling User Click Behavior in Sponsored Search Vibhanshu Abhishek, Peter S. Fader, Kartik Hosanagar The Wharton School, University of Pennsylvania, Philadelpha, PA 1914, USA {vabhi, faderp, kartikh}@wharton.upenn.edu
More informationDerivative-based Optimization (chapter 6)
Soft Computing: Derivative-base Optimization Derivative-based Optimization (chapter 6) Bill Cheetham cheetham@cs.rpi.edu Kai Goebel goebel@cs.rpi.edu used for neural network learning used for multidimensional
More informationUsing Decision Tree to predict repeat customers
Using Decision Tree to predict repeat customers Jia En Nicholette Li Jing Rong Lim Abstract We focus on using feature engineering and decision trees to perform classification and feature selection on the
More informationApplication of Machine Learning to Financial Trading
Application of Machine Learning to Financial Trading January 2, 2015 Some slides borrowed from: Andrew Moore s lectures, Yaser Abu Mustafa s lectures About Us Our Goal : To use advanced mathematical and
More informationNew restaurants fail at a surprisingly
Predicting New Restaurant Success and Rating with Yelp Aileen Wang, William Zeng, Jessica Zhang Stanford University aileen15@stanford.edu, wizeng@stanford.edu, jzhang4@stanford.edu December 16, 2016 Abstract
More informationAnalysing the Immune System with Fisher Features
Analysing the Immune System with John Department of Computer Science University College London WITMSE, Helsinki, September 2016 Experiment β chain CDR3 TCR repertoire sequenced from CD4 spleen cells. unimmunised
More informationMulti-objective optimization
Multi-objective optimization Kevin Duh Bayes Reading Group Aug 5, 2011 The Problem Optimization of K objectives simultaneously: min x [F 1 (x), F 2 (x),..., F K (x)], s.t. x X (1) X = {x R n g j (x) 0,
More informationEFA in a CFA Framework
EFA in a CFA Framework 2012 San Diego Stata Conference Phil Ender UCLA Statistical Consulting Group Institute for Digital Research & Education July 26, 2012 Phil Ender EFA in a CFA Framework Disclaimer
More informationCopyr i g ht 2012, SAS Ins titut e Inc. All rights res er ve d. ENTERPRISE MINER: ANALYTICAL MODEL DEVELOPMENT
ENTERPRISE MINER: ANALYTICAL MODEL DEVELOPMENT ANALYTICAL MODEL DEVELOPMENT AGENDA Enterprise Miner: Analytical Model Development The session looks at: - Supervised and Unsupervised Modelling - Classification
More informationPredicting International Restaurant Success with Yelp
Predicting International Restaurant Success with Yelp Angela Kong 1, Vivian Nguyen 2, and Catherina Xu 3 Abstract In this project, we aim to identify the key features people in different countries look
More informationIBM SPSS & Apache Spark
IBM SPSS & Apache Spark Making Big Data analytics easier and more accessible ramiro.rego@es.ibm.com @foreswearer 1 2016 IBM Corporation Modeler y Spark. Integration Infrastructure overview Spark, Hadoop
More informationA comparative study of Linear learning methods in Click-Through Rate Prediction
2015 International Conference on Soft Computing Techniques and Implementations- (ICSCTI) Department of ECE, FET, MRIU, Faridabad, India, Oct 8-10, 2015 A comparative study of Linear learning methods in
More informationPredicting gas usage as a function of driving behavior
Predicting gas usage as a function of driving behavior Saurabh Suryavanshi, Manikanta Kotaru Abstract The driving behavior, road, and traffic conditions greatly affect the gasoline consumption of an automobile.
More informationCredit Risk Models Cross-Validation Is There Any Added Value?
Credit Risk Models Cross-Validation Is There Any Added Value? Croatian Quants Day Zagreb, June 6, 2014 Vili Krainz vili.krainz@rba.hr The views expressed during this presentation are solely those of the
More informationResponse Modeling Marketing Engineering Technical Note 1
Response Modeling Marketing Engineering Technical Note 1 Table of Contents Introduction Some Simple Market Response Models Linear model Power series model Fractional root model Semilog model Exponential
More informationThis is a quick-and-dirty example for some syntax and output from pscore and psmatch2.
This is a quick-and-dirty example for some syntax and output from pscore and psmatch2. It is critical that when you run your own analyses, you generate your own syntax. Both of these procedures have very
More informationData Analytics with MATLAB Adam Filion Application Engineer MathWorks
Data Analytics with Adam Filion Application Engineer MathWorks 2015 The MathWorks, Inc. 1 Case Study: Day-Ahead Load Forecasting Goal: Implement a tool for easy and accurate computation of dayahead system
More informationAnalytical Capability Security Compute Ease Data Scale Price Users Traditional Statistics vs. Machine Learning In-Memory vs. Shared Infrastructure CRAN vs. Parallelization Desktop vs. Remote Explicit vs.
More informationE-Commerce Sales Prediction Using Listing Keywords
E-Commerce Sales Prediction Using Listing Keywords Stephanie Chen (asksteph@stanford.edu) 1 Introduction Small online retailers usually set themselves apart from brick and mortar stores, traditional brand
More informationApplying Regression Techniques For Predictive Analytics Paviya George Chemparathy
Applying Regression Techniques For Predictive Analytics Paviya George Chemparathy AGENDA 1. Introduction 2. Use Cases 3. Popular Algorithms 4. Typical Approach 5. Case Study 2016 SAPIENT GLOBAL MARKETS
More informationToday. Last time. Lecture 5: Discrimination (cont) Jane Fridlyand. Oct 13, 2005
Biological question Experimental design Microarray experiment Failed Lecture : Discrimination (cont) Quality Measurement Image analysis Preprocessing Jane Fridlyand Pass Normalization Sample/Condition
More informationPredictive Modelling for Customer Targeting A Banking Example
Predictive Modelling for Customer Targeting A Banking Example Pedro Ecija Serrano 11 September 2017 Customer Targeting What is it? Why should I care? How do I do it? 11 September 2017 2 What Is Customer
More informationEvolutionary Algorithms
Evolutionary Algorithms Evolutionary Algorithms What is Evolutionary Algorithms (EAs)? Evolutionary algorithms are iterative and stochastic search methods that mimic the natural biological evolution and/or
More informationData Mining Applications with R
Data Mining Applications with R Yanchang Zhao Senior Data Miner, RDataMining.com, Australia Associate Professor, Yonghua Cen Nanjing University of Science and Technology, China AMSTERDAM BOSTON HEIDELBERG
More informationDISTRIBUTED ARTIFICIAL INTELLIGENCE
DISTRIBUTED ARTIFICIAL INTELLIGENCE LECTURE 3: PROBLEM MODELING INTRODUCTION There are different approaches for modeling of agent-based systems. The model that has gained most attention ti is modeling
More informationWE consider the general ranking problem, where a computer
5140 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 54, NO. 11, NOVEMBER 2008 Statistical Analysis of Bayes Optimal Subset Ranking David Cossock and Tong Zhang Abstract The ranking problem has become increasingly
More informationAdvances in Machine Learning for Credit Card Fraud Detection
Advances in Machine Learning for Credit Card Fraud Detection May 14, 2014 Alejandro Correa Bahnsen Introduction Europe fraud evolution Internet transactions (millions of euros) 800 700 600 500 2007 2008
More informationData Mining and Applications in Genomics
Data Mining and Applications in Genomics Lecture Notes in Electrical Engineering Volume 25 For other titles published in this series, go to www.springer.com/series/7818 Sio-Iong Ao Data Mining and Applications
More informationPrediction of permeability from reservoir main properties using neural network
Scientific Research and Essays Vol. 6(32), pp. 6626-6635, 23 December, 2011 Available online at http://www.academicjournals.org/sre DOI: 10.5897/SRE11.686 ISSN 1992-2248 2011 Academic Journals Full Length
More informationTop-down Forecasting Using a CRM Database Gino Rooney Tom Bauer
Top-down Forecasting Using a CRM Database Gino Rooney Tom Bauer Abstract More often than not sales forecasting in modern companies is poorly implemented despite the wealth of data that is readily available
More informationOn Burst Detection and Prediction in Retweeting Sequence
On Burst Detection and Prediction in Retweeting Sequence Zhilin Luo 1, Yue Wang 2, Xintao Wu 3, Wandong Cai 4, and Ting Chen 5 1 Shanghai Future Exchange, China 2 University of North Carolina at Charlotte,
More informationA logistic regression model for Semantic Web service matchmaking
. BRIEF REPORT. SCIENCE CHINA Information Sciences July 2012 Vol. 55 No. 7: 1715 1720 doi: 10.1007/s11432-012-4591-x A logistic regression model for Semantic Web service matchmaking WEI DengPing 1*, WANG
More informationEstimation, Forecasting and Overbooking
Estimation, Forecasting and Overbooking Block 2 Zaenal Akbar (zaenal.akbar@sti2.at) Copyright 2008 STI INNSBRUCK Agenda Topics: 1. Estimation and Forecasting 2. Overbooking Tuesday, 21.03.2017 1 146418
More informationGetting Started With PROC LOGISTIC
Getting Started With PROC LOGISTIC Andrew H. Karp Sierra Information Services, Inc. 19229 Sonoma Hwy. PMB 264 Sonoma, California 95476 707 996 7380 SierraInfo@aol.com www.sierrainformation.com Getting
More information2 Maria Carolina Monard and Gustavo E. A. P. A. Batista
Graphical Methods for Classifier Performance Evaluation Maria Carolina Monard and Gustavo E. A. P. A. Batista University of São Paulo USP Institute of Mathematics and Computer Science ICMC Department of
More informationTRANSPORTATION PROBLEM AND VARIANTS
TRANSPORTATION PROBLEM AND VARIANTS Introduction to Lecture T: Welcome to the next exercise. I hope you enjoyed the previous exercise. S: Sure I did. It is good to learn new concepts. I am beginning to
More informationMachine Learning Models for Pattern Classification. Comp 473/6731
Machine Learning Models for Pattern Classification Comp 473/6731 November 17 th 2016 Prof. Neamat El Gayar Topics Introduction on Machine Learning Neural Networks Single Layer Perceptron and Discriminant
More informationExploring the Genetic Basis of Congenital Heart Defects
Exploring the Genetic Basis of Congenital Heart Defects Sanjay Siddhanti Jordan Hannel Vineeth Gangaram szsiddh@stanford.edu jfhannel@stanford.edu vineethg@stanford.edu 1 Introduction The Human Genome
More informationCorrecting Sample Bias in Oversampled Logistic Modeling. Building Stable Models from Data with Very Low event Count
Correcting Sample Bias in Oversampled Logistic Modeling Building Stable Models from Data with Very Low event Count ABSTRACT In binary outcome regression models with very few bads or minority events, it
More informationActive Chemical Sensing with Partially Observable Markov Decision Processes
Active Chemical Sensing with Partially Observable Markov Decision Processes Rakesh Gosangi and Ricardo Gutierrez-Osuna* Department of Computer Science, Texas A & M University {rakesh, rgutier}@cs.tamu.edu
More informationWhat is Evolutionary Computation? Genetic Algorithms. Components of Evolutionary Computing. The Argument. When changes occur...
What is Evolutionary Computation? Genetic Algorithms Russell & Norvig, Cha. 4.3 An abstraction from the theory of biological evolution that is used to create optimization procedures or methodologies, usually
More informationEnergy-Aware Active Chemical Sensing
Energy-Aware Active Chemical Sensing Rakesh Gosangi and Ricardo Gutierrez-Osuna Department of Computer Science and Engineering Texas A&M University, College Station, Texas 77840 {rakesh,rgutier}@cse.tamu.edu
More informationEvolutionary Algorithms - Population management and popular algorithms Kai Olav Ellefsen
INF3490 - Biologically inspired computing Lecture 3: Eiben and Smith, chapter 5-6 Evolutionary Algorithms - Population management and popular algorithms Kai Olav Ellefsen Repetition: General scheme of
More informationCapacity Dilemma: Economic Scale Size versus. Demand Fulfillment
Capacity Dilemma: Economic Scale Size versus Demand Fulfillment Chia-Yen Lee (cylee@mail.ncku.edu.tw) Institute of Manufacturing Information and Systems, National Cheng Kung University Abstract A firm
More informationA New Interpretation of the Logistic Model in Estimating Seasonal and Yearly Natural Gas Consumption
013, Vol. 5, No. 4 A New Interpretation of the Logistic Model in Estimating Seasonal and Yearly Natural Gas Consumption Ahmet Goncu 1,* 1 Dept. of Mathematical Sciences, Xian Jiaotong Liverpool University,
More informationUSING NEURAL NETWORKS IN ESTIMATING DEFAULT PROBABILITY A CASE STUDY ON RETAIL LENDING
Laura Maria BADEA, PhD Candidate Department of Economic Cybernetics E-mail: laura.maria.badea@gmail.com USING NEURAL NETWORKS IN ESTIMATING DEFAULT PROBABILITY A CASE STUDY ON RETAIL LENDING Abstract.
More informationA NOVEL FOREST FIRE PREDICTION TOOL UTILIZING FIRE WEATHER AND MACHINE LEARNING METHODS
A NOVEL FOREST FIRE PREDICTION TOOL UTILIZING FIRE WEATHER AND MACHINE LEARNING METHODS Leo Deng* Portland State University, Portland, Oregon, USA, leodeng5@gmail.com Marek Perkowski Portland State University,
More informationThe Transportation and Assignment Problems. Chapter 9: Hillier and Lieberman Chapter 7: Decision Tools for Agribusiness Dr. Hurley s AGB 328 Course
The Transportation and Assignment Problems Chapter 9: Hillier and Lieberman Chapter 7: Decision Tools for Agribusiness Dr. Hurley s AGB 328 Course Terms to Know Sources Destinations Supply Demand The Requirements
More informationExamination of Cross Validation techniques and the biases they reduce.
Examination of Cross Validation techniques and the biases they reduce. Dr. Jon Starkweather, Research and Statistical Support consultant. The current article continues from last month s brief examples
More informationLithium-Ion Battery Analysis for Reliability and Accelerated Testing Using Logistic Regression
for Reliability and Accelerated Testing Using Logistic Regression Travis A. Moebes, PhD Dyn-Corp International, LLC Houston, Texas tmoebes@nasa.gov Biography Dr. Travis Moebes has a B.S. in Mathematics
More informationPPDSparse: A Parallel Primal and Dual Sparse Method to Extreme Classification
PPDSparse: A Parallel Primal and Dual Sparse Method to Extreme Classification Ian E.H. Yen 1, Xiangru Huang 2, Wei Dai 1, Pradeep Ravikumar 1, Inderjit S. Dhillon 2 and Eric Xing 1 1 Carnegie Mellon University.
More information^ Springer. The Logic of Logistics. Theory, Algorithms, and Applications. for Logistics Management. David Simchi-Levi Xin Chen Julien Bramel
David Simchi-Levi Xin Chen Julien Bramel The Logic of Logistics Theory, Algorithms, and Applications for Logistics Management Third Edition ^ Springer Contents 1 Introduction 1 1.1 What Is Logistics Management?
More informationClick Through Rate Prediction for Contextual Advertisment Using Linear Regression
Click Through Rate Prediction for Contextual Advertisment Using Linear Regression Muhammad Junaid Effendi Dept. of Computer & Information Systems Engineering, N.E.D University of Engineering & Technology,
More informationUsing Social Media Metrics to Predict Artist and Album Success
Using Social Media Metrics to Predict Artist and Album Success Pedro Garzon Stanford University pgarzon@stanford.edu Vinson Luo Stanford University vluo@stanford.edu Reynis Vazquez Stanford University
More informationPrice of anarchy in auctions & the smoothness framework. Faidra Monachou Algorithmic Game Theory 2016 CoReLab, NTUA
Price of anarchy in auctions & the smoothness framework Faidra Monachou Algorithmic Game Theory 2016 CoReLab, NTUA Introduction: The price of anarchy in auctions COMPLETE INFORMATION GAMES Example: Chicken
More informationLogistic Regression, Part III: Hypothesis Testing, Comparisons to OLS
Logistic Regression, Part III: Hypothesis Testing, Comparisons to OLS Richard Williams, University of Notre Dame, https://www3.nd.edu/~rwilliam/ Last revised February 22, 2015 This handout steals heavily
More informationHow much is my car worth? A methodology for predicting used cars prices using Random Forest
How much is my car worth? A methodology for predicting used cars prices using Random Forest Nabarun Pal Department of Metallurgical and Materials Engineering Indian Institute of Technology Roorkee Roorkee,
More informationSpatial analysis of epidemics: Disease gradients and patterns
Spatial analysis of epidemics: Disease gradients and patterns Space.The Frontier.Finally. Epidemics are dynamic population processes in time and space We have spent a few weeks dealing exclusively with
More informationChapter kn m/kg Ans kn m/kg Ans kn m/kg Ans
Shigley's Mechanical Engineering Design 10th Edition Budynas Solutions Manual Completed download: https://testbankreal.com/download/shigleys-mechanical-engineering-design- 10th-edition-solutions-manual-budynas-nisbett/
More informationIncentives in Crowdsourcing: A Game-theoretic Approach
Incentives in Crowdsourcing: A Game-theoretic Approach ARPITA GHOSH Cornell University NIPS 2013 Workshop on Crowdsourcing: Theory, Algorithms, and Applications Incentives in Crowdsourcing: A Game-theoretic
More informationThe Willingness to Pay for a Certification Label and a Tribal Art Design of Native American Wooden Gift Products. Daisuke Sasatani
The Willingness to Pay for a Certification Label and a Tribal Art Design of Native American Wooden Gift Products Daisuke Sasatani University of Washington Modeling for Marketing Multivariable Techniques
More informationAgile Industrial Analytics
Agile Industrial Analytics Successfully introduce analytics services in the machinery industry Dr. Christian Schlögel Chief Digital Officer KUKA AG Dr.-Ing. Babak Farrokhzad Senior Manager Data Analytics
More informationA MACHINE-LEARNING APPROACH TO OPTIMAL BID PRICING
A MACHINE-LEARNING APPROACH TO OPTIMAL BID PRICING Richard D. Lawrence IBM T.J. Watson Research Center P.O. Box 218 Yorktown Heights, New York 10598 ricklawr@us.ibm.com Abstract We consider the problem
More informationGlobal Optimization for Advertisement Selection in Sponsored Search
Cui Q, Bai FS, Gao B et al. Global optimization for advertisement selection in sponsored search. JOURNAL OF COM- PUTER SCIENCE AND TECHNOLOGY 302): 295 310 Mar. 2015. DOI 10.1007/s11390-015-1523-4 Global
More informationA HYBRID MODERN AND CLASSICAL ALGORITHM FOR INDONESIAN ELECTRICITY DEMAND FORECASTING
A HYBRID MODERN AND CLASSICAL ALGORITHM FOR INDONESIAN ELECTRICITY DEMAND FORECASTING Wahab Musa Department of Electrical Engineering, Universitas Negeri Gorontalo, Kota Gorontalo, Indonesia E-Mail: wmusa@ung.ac.id
More informationMachine Learning in Computational Biology CSC 2431
Machine Learning in Computational Biology CSC 2431 Lecture 9: Combining biological datasets Instructor: Anna Goldenberg What kind of data integration is there? What kind of data integration is there? SNPs
More informationChapter 3. Labour Demand. Introduction. purchase a variety of goods and services.
Chapter 3 Labour Demand McGraw-Hill/Irwin Labor Economics, 4 th edition Copyright 2008 The McGraw-Hill Companies, Inc. All rights reserved. 4-2 Introduction Firms hire workers because consumers want to
More informationAdaptive Mechanism Design: A Metalearning Approach
In Proceedings of the International Conference on Electronic Commerce (ICEC 06), Fredericton, Canada, August 2006. Adaptive Mechanism Design: A Metalearning Approach ABSTRACT David Pardoe Peter Stone Department
More informationGenetic Algorithms in Matrix Representation and Its Application in Synthetic Data
Genetic Algorithms in Matrix Representation and Its Application in Synthetic Data Yingrui Chen *, Mark Elliot ** and Joe Sakshaug *** * ** University of Manchester, yingrui.chen@manchester.ac.uk University
More informationYou are Who You Know and How You Behave: Attribute Inference Attacks via Users Social Friends and Behaviors
You are Who You Know and How You Behave: Attribute Inference via Users Social Friends and Behaviors Neil Zhenqiang Gong ECE Department, Iowa State University neilgong@iastate.edu Bin Liu MSIS Department,
More informationarxiv: v2 [cs.cv] 15 Feb 2018
Advanced Steel Microstructural Classification by Deep Learning Methods Seyed Majid Azimi 1,2,4,*, Dominik Britz 2,3, Michael Engstler 2,3, Mario Fritz 1, and Frank Mücklich 2,3 arxiv:1706.06480v2 [cs.cv]
More informationMODELING THE EXPERT. An Introduction to Logistic Regression The Analytics Edge
MODELING THE EXPERT An Introduction to Logistic Regression 15.071 The Analytics Edge Ask the Experts! Critical decisions are often made by people with expert knowledge Healthcare Quality Assessment Good
More informationA SAS Macro to Analyze Data From a Matched or Finely Stratified Case-Control Design
A SAS Macro to Analyze Data From a Matched or Finely Stratified Case-Control Design Robert A. Vierkant, Terry M. Therneau, Jon L. Kosanke, James M. Naessens Mayo Clinic, Rochester, MN ABSTRACT A matched
More informationKuhn-Tucker Estimation of Recreation Demand A Study of Temporal Stability
Kuhn-Tucker Estimation of Recreation Demand A Study of Temporal Stability Subhra Bhattacharjee, Catherine L. Kling and Joseph A. Herriges Iowa State University Contact: subhra@iastate.edu Selected Paper
More informationProducer Preferences and Characteristics in Biomass Supply Chains. Ira J. Altman Southern Illinois University-Carbondale
Producer Preferences and Characteristics in Biomass Supply Chains Ira J. Altman Southern Illinois University-Carbondale Tom G. Johnson University of Missouri-Columbia Wanki Moon Southern Illinois University-Carbondale
More informationOVERVIEW OF ELECTRIC COST OF SERVICE STUDIES
The Prime Group Priority Cost of Service, Rate & Regulatory Support OVERVIEW OF ELECTRIC COST OF SERVICE STUDIES By: Larry Feltner There are a number of considerations in determining the level and structure
More informationChapter 15: Monopoly. Notes. Watanabe Econ Monopoly 1 / 83. Notes. Watanabe Econ Monopoly 2 / 83. Notes
Econ 3 Introduction to Economics: Micro Chapter : Monopoly Instructor: Hiroki Watanabe Spring 3 Watanabe Econ 93 Monopoly / 83 Monopolistic Market Monopolistic Pricing 3 Inefficiency of Monopoly Price
More informationA stochastic production planning optimization for multi parallel machine under leasing Contract
A stochastic production planning optimization for multi parallel machine under leasing Contract Medhioub Fatma, Hajej Zied, and Rezg idhal LGIPM-University of Lorraine, Metz, France Abstract: In this paper,
More informationVery Short-Term Electricity Load Demand Forecasting Using Support Vector Regression
Very Short-Term Electricity Load Demand Forecasting Using Support Vector Regression Anthony Setiawan, Irena Koprinska, and Vassilios G. Agelidis Abstract In this paper, we present a new approach for very
More informationCEng 713 Evolutionary Computation, Lecture Notes
CEng 713 Evolutionary Computation, Lecture Notes Introduction to Evolutionary Computation Evolutionary Computation Elements of Evolution: Reproduction Random variation Competition Selection of contending
More informationEvaluation of random forest regression for prediction of breeding value from genomewide SNPs
c Indian Academy of Sciences RESEARCH ARTICLE Evaluation of random forest regression for prediction of breeding value from genomewide SNPs RUPAM KUMAR SARKAR 1,A.R.RAO 1, PRABINA KUMAR MEHER 1, T. NEPOLEAN
More informationMachine learning in neuroscience
Machine learning in neuroscience Bojan Mihaljevic, Luis Rodriguez-Lujan Computational Intelligence Group School of Computer Science, Technical University of Madrid 2015 IEEE Iberian Student Branch Congress
More informationBrian Macdonald Big Data & Analytics Specialist - Oracle
Brian Macdonald Big Data & Analytics Specialist - Oracle Improving Predictive Model Development Time with R and Oracle Big Data Discovery brian.macdonald@oracle.com Copyright 2015, Oracle and/or its affiliates.
More informationPLANNING FOR PRODUCTION
PLANNING FOR PRODUCTION Forecasting Forecasting is the first major activity in the planning, involving careful study of past data and present scenario to estimate the occurence, timing or magnitude of
More informationA Parametric Bootstrapping Approach to Forecast Intermittent Demand
Proceedings of the 2008 Industrial Engineering Research Conference J. Fowler and S. Mason, eds. A Parametric Bootstrapping Approach to Forecast Intermittent Demand Vijith Varghese, Manuel Rossetti Department
More informationCREDIT RISK MODELLING Using SAS
Basic Modelling Concepts Advance Credit Risk Model Development Scorecard Model Development Credit Risk Regulatory Guidelines 70 HOURS Practical Learning Live Online Classroom Weekends DexLab Certified
More informationAdvanced Analytics through the credit cycle
Advanced Analytics through the credit cycle Alejandro Correa B. Andrés Gonzalez M. Introduction PRE ORIGINATION Credit Cycle POST ORIGINATION ORIGINATION Pre-Origination Propensity Models What is it?
More informationEconomic management and thresholds in ecosystems. Aart de Zeeuw Tilburg University, the Netherlands Beijer Institute Stockholm, Sweden
Economic management and thresholds in ecosystems Aart de Zeeuw Tilburg University, the Netherlands Beijer Institute Stockholm, Sweden The material in this keynote presentation has been published in the
More informationForecasting, Overbooking and Dynamic Pricing
Forecasting, Overbooking and Dynamic Pricing Block 2 Zaenal Akbar (zaenal.akbar@sti2.at) Copyright 2008 STI INNSBRUCK Agenda 1. Estimation and Forecasting 2. Overbooking 3. Dynamic Pricing 2 Where we left
More informationMetamodelling and optimization of copper flash smelting process
Metamodelling and optimization of copper flash smelting process Marcin Gulik mgulik21@gmail.com Jan Kusiak kusiak@agh.edu.pl Paweł Morkisz morkiszp@agh.edu.pl Wojciech Pietrucha wojtekpietrucha@gmail.com
More information1) Operating costs, such as fuel and labour. 2) Maintenance costs, such as overhaul of engines and spraying.
NUMBER ONE QUESTIONS Boni Wahome, a financial analyst at Green City Bus Company Ltd. is examining the behavior of the company s monthly transportation costs for budgeting purposes. The transportation costs
More informationPredicting Yelp Restaurant Reviews
Predicting Yelp Restaurant Reviews Wael Farhan UCSD: A53070918 9500 Gilman Drive La Jolla, CA, 92093 wfarhan@eng.ucsd.edu ABSTRACT Starting a restaurant is a tricky business. Restaurant owners have to
More information