HR001117S0017 World Modelers Frequently Asked Questions
|
|
- Bertha Banks
- 6 years ago
- Views:
Transcription
1 HR001117S0017 World Modelers Frequently Asked Questions As of April 21, 2017 Q48. We were wondering if we can focus on a few specific Technical Areas mentioned in the BAA. In our case, if we primarily concentrate on two TAs, can we expect to receive developed models from another funded performer working on one of the other TAs or from DARPA? If not, we shall enhance our team accordingly? A48. Proposers do not have to necessarily propose against multiple TAs or particular combinations of TAs. Again, proposers should strive to propose the most highly capable team necessary to develop an approach to at least some, but not necessarily all, the technical challenges of the program. Proposers may provide proposals addressing multiple or a single task area. However, proposers should not overreach and propose to a greater number of task areas than their approach and expertise level of their teams can bear. Much like Big Mechanism and Communicating with Computers, this program will involve collaborative technology development among performers. Teams may be proposed, or alternatively, performers funded to work on specific Task Areas may be assembled into teams after award at kickoff. Proposers may identify quantitative models that they work with (e.g., a proposer who models groundwater might bring groundwater models to the program) but no one is required to supply quantitative models. DARPA will collect and provide quantitative models to funded performers. Q47. During proposer s day and in the BAA there is reference to leveraging capability from Big Mechanism. Big Mechanism is not yet available on the DARPA Open catalog. Can you provide information (to include documentation, code, etc.) on capability we should leverage from Big Mechanism? A47. Access to capabilities from Big Mechanism is not a necessary condition for developing a responsive proposal to the World Modelers BAA. Big Mechanism is still an active program with development efforts still underway. Finalized models, deliverables, and/or publications will be made available via the DARPA Open Catalog World Modelers will kickoff as its own freestanding program. When Big Mechanism ends, if there are technologies or capabilities that can be leveraged, then performers may do so.
2 Q46. As to temporal scale, World Modelers is committed to evaluating the accuracy of its forecast, so use cases that forecast one to five years into the future are preferred. [emphasis added] Can you say more about the evaluation? For example: Should we also expect sub annual forecasts that are used in annual program / performer evaluations? Will the program adopt uniform metrics (e.g. Brier score, log loss, hit rate, etc.) or is this up to the performer? Will any forecasts have to be delivered regularly to the evaluator? Is there a provision for evaluating long term forecasts? A46. Ultimately, World Modelers does not insist that all forecasts be accurate or that all forecasts be quantitative, but that analysts should know when they can trust quantitative forecasts. However, the models forecasts should be accurate enough to be useful, i.e. to support recommendations. Directly from the BAA, note that the accuracy of forecasts is grouped with utility, because models can be useful even when they are not very accurate. Nevertheless, the World Modelers program will work in domains that afford opportunities to continuously track the accuracy of forecasts. For example, migration is an ongoing process, so at any moment one can ask for a forecast of the number of people who move from one location to another during an interval of time, and at the end of the interval one can test the accuracy of the forecast. Migration is a good domain because it affords thousands of such tests, in contrast with analysis questions about one off events (e.g., tsunami). The methodology for evaluation will be very clear and shared among all funded performers. The specific details or approach to evaluation will be driven to some degree by the specifics of the use cases and stakeholders interested in the program. A government evaluation team will develop World Modelers use cases for development and testing in each phase. The development plan for the World Modelers program is to build and refine complete World Modelers systems continuously, as opposed to waiting to integrate component technologies until they mature. Proposers are welcome to suggest use cases. However, to help ensure that World Modelers technology is general, these problems must be made available to all participants and all participants must solve the test problems set by the evaluation team. These requirements will help to avoid situations in which participants work in isolation and develop problem specific technologies. Q45. I am interested in talking with other potential proposers to explore teaming opportunities. Where can I find the list of attendees at the Proposers Day? A45. The link to the World Modelers attendee list, which includes those who agreed to share their contact information, is publicly available here: _roster.pdf Q44. The government entities clause in the CFP indicates that for the government to compete, it must provide written justification to demonstrate that the work is not otherwise available from the private sector. However, if another company/organization is the prime, and they establish an agreement with the government to be a subcontractor part of their team, is the 'demonstration that the work is not available' still applicable?
3 A44. The rules for Government entities apply both if they act as a prime or subcontractor. The BAA identifies both legal citations as potential justification starting points or citations that are not acceptable. The proposer should discuss the issue with their GC to determine if they have any legal exceptions that would allow them to receive funding from another Government agency. Q43. I would like to provide a briefing or white paper and meet with the PM to discuss my approach. How can I make these arrangements? A43. During the BAA proposal timeframe, DARPA cannot legally comment on aspects of World Modelers outside of what is within the BAA and in the open Q&A document available to all proposers. Q42. I read through the BAA and plan to organize a team to submit a proposal. Due to the nature of focusing multiple domains, this effort could be relatively large. May I ask if the program has some expected level of funding for each award? Of course, I understand that budget realism is a must, but would like to have an idea on how to shape the team. A42. DARPA cannot provide budgeting guidance or comment on specific budgetary questions from potential performers. Since each proposal has its own unique statement of work and may or may not fully propose tasks from a TA, DARPA has no up front method to uniformly determine what is the appropriate level of funding. Thank you for your understanding. Q41. Unfortunately, I missed the World Modelers Proposers Day that occurred on February 3. Were there minutes recorded from that event? If so and if appropriate, can you guide me to WM information that has emerged from that day or since? A41. The Question and Answer portion of the Proposers Day was captured and has been made available as a document to all potential proposers here: with us/opportunities Q40. I have a question about the interface between the Technical Areas of World Modelers. How can proposers for individual TAs go about assuming the type of model (in terms of representation) that will be made available to them, or that they will need to make available? A40. Proposed approaches do not necessarily need to focus on the exact format or content of the outputs of the models. As referenced in the BAA, domain experts and computer scientists have already integrated nine quantitative models to evaluate 20 qualitative scenarios. It is up to the proposers to address how to do this type of analysis in a less time consuming manner. Integrating and parameterizing these and other models potentially developed under World Modelers in the future should be done in a single computational framework. The aim of World Modelers is to automate much of the work done by humans so as to conduct such analyses in roughly one month, not necessarily constrained by the types of quantitative and qualitative models being integrated Selected performers will be required to collaborate with each other after award and kickoff. More specifically, performers working among different TAs will ultimately develop products that will be integrated in a single computational framework, though not necessarily immediately upon kickoff.
4 Proposers should carefully scope what they can contribute to the World Modelers program and should not feel obligated to propose complete World Moldelers systems. Proposers should be clear about potential or anticipated dependencies and synergies between what they propose and other technologies or TA approaches. As of April 11, 2017 Q39. Will political considerations (e.g. elections, social uprisings, terrorist acts, etc.) be of interest to the program? A39. Yes. However, DARPA is aware that socio political models are less mature and accurate than, say, geophysical or biophysical models. They tend to be qualitative, and even the quantitative ones tend to be retrospective rather than prospective. Where social phenomena are modeled, the models should stay close to the measurable causal antecedents of social phenomena (e.g. economic and physical security as antecedents of decision to migrate), so we can back off to forecasting antecedents if the social models are inadequate. Mechanistic, ideally quantitative, models are the goal, and if social phenomena cannot be modeled mechanistically and quantitatively, then the program will make do with models of causal antecedents of these phenomena. Q38. How big should my team be? How big can it be? A38. Proposers should strive to propose the most highly capable team necessary to develop an approach to at least some, but not necessarily all, the technical challenges of the program. Q37. What is the program budget or anticipated award? A37. DARPA is not sharing this program s budget information with proposers. The focus of the proposer should be on addressing the World Modelers Task Areas and objectives. Concerning awards, multiple awards are anticipated. The level of funding for individual awards made under this solicitation has not been predetermined and will depend on the quality of the proposals received and the availability of funds. Q36. What should be complete by the end of year one? A36. This program seeks to have a fast start in that a usable model (not necessarily perfected) should be developed to address the food insecurity problem. Expertise will not be explicitly excluded, but expertise is not the only way to get model development going quickly. Q35. What will be the user role in running the model? Will users be in the loop or out of the loop? A35. This is up to the proposers. However, machines will not solve modeling problems autonomously.
5 Q34. Will one of the deliverables be code? A34. Yes, DARPA anticipates deliverables will include code. The deliverables need to run on authentic analytical problems. Q33. Can the causal model be built from information or data that is mined? A33. That is an approach, but certainly not the only approach. Q32. What are the best models or databases available? A32. DARPA is not aware of the best and this may be dependent upon approach and model design. DARPA is open to proposer ideas. Q31. Can we talk to the agencies that are interested in World Modelers? A31. DARPA does not wish to impede communications that might help the World Modelers program, but no such interactions are necessary for proposers. Q30. To get qualitative and quantitative models in sync seems to be a big technology problem. How will World Modelers address this issue? A30. Correct. Getting multiple models in synch is an open research problem. It isn't just qualitative and quantitative models that need to be synched, but also other varieties of models, such as regression models and ODE models and systems dynamics models. The general problem is one of maintaining multiple representations of roughly "the same thing," representations that might make slightly different modeling assumptions, or work at slightly different temporal or spatial scales. Humans manage to translate the outputs of one model into inputs of another, or reconcile outputs of ensembles, but these are often semantic judgments. It remains to be seen whether machines can have sufficiently rich semantics of models to perform these sorts of judgments. Q29. How will World Modelers use sensitivity analysis approaches? A29. Machine assisted refinement of models as a result of sensitivity analyses would be of interest to the World Modelers program. Identification of good proxies for parameters would similarly be of interest. Q28. Will abstracts be requested before proposals? A28. No, there will be no request for abstracts.
6 Q27. When one thinks of a model of the world, there may be lots of variables and broad strokes. How can these all be captured or characterized? A27. All modeling involves tradeoffs. One model might be more realistic than another in the sense of representing more true causal factors, but it might be only slightly more accurate in its predictions and considerably harder to explain. Additionally, the more realistic model might have less data available to estimate its parameters, or it might over fit its data. Yes, World Modelers is trying to model complicated systems, but the modeling challenge for World Modelers technology is utterly familiar: How to build useful models that, for various reasons, don't represent all causal factors. Q26. How important is the run time of a World Modelers model? A26. The run time is less important than the usefulness of analysis graphs, demonstration of causal relationships, and comprehensive understanding of factors related to uncertainty. All things being equal, run times of weeks or months would be a concern. World Modelers seeks to facilitate analyses that currently take humans weeks or months. Run time in and of itself is not a strong criterion for evaluating World Modelers technology. Q25. One can imagine a large library of models will be needed to run a successful World Modelers program, how will these be assembled? A25. DARPA will assemble a library of models, at least for the first year's use case. Another interpretation of this question focuses on the verb "assemble." Assembling models will require that they "talk" to each other, which might involve, among other things, ontologies to map outputs to inputs and so on. Assembling quantitative models in support of analyses is one of the central problems in the program. Q24. Will proposals that include Subject Matter Experts in areas such as agriculture, social science, or finance be viewed favorably? A24. This is principally a technical program to facilitate different types of analysis using causal models. However, Subject Matter Experts (SMEs) might guide the development of analyses of national and global security questions, and, of course, they will have domain knowledge that machines might lack. That said, if the sole purpose of SMEs is to ensure that analyses are credible, then their value to the program is somewhat limited because the program is intended to develop modeling technology, not necessarily high quality analyses. One can imagine SMEs serving as stand ins for users of the technology, or as authentic users who intend to bring the technology into their own workplaces. But it is also conceivable that World Modelers technology can be built without the assistance of SMEs. Q23. What is the role of machine learning in World Modelers? A23. Machine learning can have many roles in the program, from learning proxies for quantitative model parameters to learning lightweight approximations to expensive quantitative models. Solutions might involve machine learning concepts such as ensemble modeling and feature
7 selection. It's really for proposers to say how machine learning will figure in their technical proposals. However, World Modelers is not simply an exercise in data mining. Its goal is humanmachine analysis based on causal models. Q22. How separate or separable are the Task Areas? A22. Proposers may provide proposals addressing multiple or a single task area. However, proposers should not overreach and propose to a greater number of task areas than their approach and expertise level of their teams can bear. Much like Big Mechanism and Communicating with Computers, this program will involve collaborative technology development among performers. Teams may be proposed, or alternatively, performers funded to work on specific Task Areas may be assembled into teams after award at kickoff. Q21. Is the intent to build generic models for any domain? A21. Yes and no. Yes, we are interested in modeling technologies for many domains or use cases. But we are interested in analyzing specific questions (e.g., about food security in South Sudan) so generic models are useful only to get the specific analysis started. Q20. What will be the use cases? A20. There will be common program use cases, as well as potentially performer suggested use cases. However, all performer suggested use cases must be made available to all funded World Modeler performers, and all performers will also have to deliver a model and output for a common use case provided by DARPA and the government evaluation team. We want to avoid a situation where a particular performer works in isolation on a private use case. More importantly, we want to avoid a situation where modeling technology is useful only for a private use case. Q19. There are powerful models available, but they are proprietary. How can the program overcome potential limitations? A19. Since this is a fundamental research program, it is preferable for the models to build upon open source models available to the public. In Phase I, the emphasis will be on humans and machines working together to assemble qualitative and quantitative analyses; the quality of the quantitative models will be secondary. If proprietary models are part of a solution, the proposal should address how to accomplish these goals and overcome any licensing restrictions. Q18: Is there a specific Task Area for the user interface component? A18. Task Areas four and five encompass work (configuring the model to run and uncertainty analysis) that will involve the interface. There is no one Task Area that just addresses the user interface on its own.
8 Q17. Where does interface design and building fit in this program? A17. This is an important part of World Modelers, much like the DARPA Communicating with Computers program. Humans and machines will communicate ultimately to run the models. The interface will be an important consideration for the uncertainty reports under Task Area 5. Proposers may employ an existing interface technology or build their own. However, some aspects of World Modelers can be addressed without worrying about interfaces with humans, so proposers should not feel obliged to explain how machines and humans will interact unless this is genuinely a necessary part of the work they propose. Q16: What is the expectation for the quantitative models to change as conditions related to national and global security change? A16. It is likely that structural changes to quantitative models developed over years or decades will be rare, as many of these models are tested and trusted. However, the parameters impacting the model inputs are likely to change (e.g. soil erosion, the anticipated impact of El Niño in a given year, or disruptive change like a nation state dividing). Q15. How will component models, such as crop models, be run when there is little soil data available for a region of interest? A15. The expectation is that proposers will address data needs or develop approaches that accommodate lack of complete data. Q14. What role will crowd sourcing play in terms of model parameterization? A14. Crowd sourcing may be considered as one of many potential sources of information or as proxy for data needs of quantitative models. Q13. Will DARPA Big Mechanism or related program technologies, models, or results be provided? A13. Yes, to the extent possible, as Big Mechanism is still an active program with development efforts still underway. Finalized models, deliverables, and/or publications will be made available via the DARPA Open Catalog Q12. What are the transition goals for World Modelers? A12. This is considered a fundamental research or basic research program, but the goal remains delivery of useful models and modeling technologies for interested stakeholders.
9 Q11. Will the analyses be expected to consider global warming effects? A11. That is a possible part of the solution, but this does not mean that World Modelers will model the climate. Rather, it is envisioned the World Modelers program will treat climate effects as drivers of downstream processes; it will focus on how climate change may drive other processes, and it will model climate in terms of driver variables without addressing climate change in and of itself. Q10. What are the types of questions that are expected to be answered by the models developed in this program? A10. The focus will be on questions related to national and global security (e.g. migration patterns, predictions of food riots, etc.). Food security will be the first focus, since models addressing this challenge are fairly well characterized. At the end of the final Phase III of the program, the objective is for a user to ask any type of question related to national and global security in any particular region of the world. However, for example, the model will not be asked questions that have no obvious security implications, such as who will win the Grammys?. Q9. Will the models be expected to filter fake news? A9. This is not a program about fake news. That said, the expectation is that a thorough analysis would have a strong enough internal logic and gather enough data to identify anomalies. Q8. Will quantitative or qualitative models be provided? A8. Qualitative models should be developed by a machine. An educated reader of news or expert analyses could generate a qualitative model, but this can and should be done by machines, to advance the state of the art. Proposers may identify quantitative models that they work with (e.g., a proposer who models groundwater might bring groundwater models to the program) but no one is required to supply quantitative models. DARPA will collect and provide quantitative models to funded performers. Q7. Will data, such as United States Agency for International Development pricing data, be provided for the models? A7. It is anticipated that data will be provided for the first year of Phase I in order to catalyze model development. Q6. What is the anticipated role of social media in this program? A6. Parameterization of qualitative models involving human behavior is an anticipated challenge. Proxies may involve social media, satellite imagery, or other approaches that may be detailed in proposals. DARPA is open to imaginative but feasible approaches.
10 Q5. What is the latency target for the program? A5. Complicated analyses currently take six months to two years, and the output target for the program is within the range of weeks to one month with the analyses being at least comparable to, if not more useful than, those currently generated entirely by humans. Q4. How much should computers engage with humans in terms of data curation? A4. The expectation is that World Modelers will involve human and computer collaboration, given the differing strengths of each. For example, development of qualitative models has generally been done by humans, but setting the parameters of quantitative models could likely be done through machine reading. Q3. What will be the anticipated output of World Modelers to a specific question? A3. It will not just be a number or a statement. Each qualitative and quantitative model component will conduct its own analysis. Via the uncertainty report, there will be an indication of what is unknown and uncertain, and, ideally, why. This is a new area of research, and it is anticipated that the outputs will be similarly nuanced. In order for the output to be useful, its limitations should be called out. Q2. What is an uncertainty report? A2. This is new territory. Iterative model development and incorporation of numerous quantitative models may introduce and propagate uncertainty. It is important for the output to be useful that this uncertainty be characterized. This is the goal of Task Area 5. Sources of uncertainty should be identified. Ultimately, World Modelers does not insist that all forecasts be accurate or that all forecasts be quantitative, but that analysts should know when they can trust quantitative forecasts. However, he models forecasts should be accurate enough to be useful, i.e. to support recommendations. Q1. How is World Modelers different from other DARPA programs, such as Explainable Artificial Intelligence (XAI), Data Driven Discovery of Models (D3M), and Probabilistic Programming for Advancing Machine Learning (PPAML)? A1. There is certainly a common theme in all these programs. They all emphasize causal models sufficient for explanation. Prediction is good, but causal explanation is better. The interest of World Modelers is in solving problems, such as the food insecurity example, which involve heterogeneous, interacting systems on variable spatial and temporal scales. In the case of World Modelers, the causal processes are slow moving (in terms of months to years in the cases of weather patterns, migration, human behavior, etc.). Additionally, the focus of World Modelers is upon causality and mechanisms, not big data in and of itself. World Modelers will probably rely on some statistical models, occasionally, but, ideally, these will have causal interpretations. The output should incorporate both quantitative and qualitative analyses.
Artificial Intelligence Exploration (AIE) Opportunity DARPA-PA Automating Scientific Knowledge Extraction (ASKE)
Artificial Intelligence Exploration (AIE) Opportunity DARPA-PA-18-02-01 Automating Scientific Knowledge Extraction (ASKE) I. Opportunity Description The Defense Advanced Research Projects Agency (DARPA)
More informationWorld Modelers. Paul R. Cohen Information Innovation Office, DARPA
World Modelers Paul R. Cohen Information Innovation Office, DARPA The Goal of World Modelers World Modelers technology will enable analysts to build models rapidly to analyze questions relevant to national
More informationDARPA-BAA MUSE Frequently Asked Questions. As of March 20, 2014
DARPA-BAA-14-22 MUSE Frequently Asked Questions As of March 20, 2014 Q63. (a) Will you consider using Other Transaction Authority (845 agreement) for nontraditional performers? (b) If so, can it still
More informationTHE IMPORTANCE OF PLANNING DURING PROJECT EXECUTION
THE IMPORTANCE OF PLANNING DURING PROJECT EXECUTION A BASIS White Paper by Dr. Dan Patterson, PMP Introduction Twenty-five years ago, I was taught that project management was built upon the premise of
More informationHR001118S0022 COMPASS Proposers Day Questions and Answers
HR001118S0022 COMPASS Proposers Day Questions and Answers Q1: What is the dividing line between TA1 and TA2? Is it based on time scale of goals and scope of actions? What are some examples of the sorts
More informationSimulation Analytics
Simulation Analytics Powerful Techniques for Generating Additional Insights Mark Peco, CBIP mark.peco@gmail.com Objectives Basic capabilities of computer simulation Categories of simulation techniques
More informationHR001118S0047 SYSTEMATIZING CONFIDENCE IN OPEN RESEARCH AND EVIDENCE (SCORE) Program Frequently Asked Questions (FAQs) as of 7/18/18
HR001118S0047 SYSTEMATIZING CONFIDENCE IN OPEN RESEARCH AND EVIDENCE (SCORE) Program Frequently Asked Questions (FAQs) as of 7/18/18 30Q: Will the data from TA1 include actual PDFs of the published articles,
More information5 Important Questions to Ask Potential BPM Vendors
5 Important Questions to Ask Potential BPM Vendors By Tripp Solomon, Product Marketing Manager GETTING STARTED WITH YOUR BPM INITIATIVE There are many elements to consider when embarking on a Business
More informationDefinitive Guide for Better Pricing. Build a solid pricing foundation that will help you create consistent sales and profit growth.
Definitive Guide for Better Pricing Build a solid pricing foundation that will help you create consistent sales and profit growth. INDEX Introduction 2 Identifying New Customers 4 Here Are Some Questions
More informationWatson-Glaser III Critical Thinking Appraisal (US)
Watson-Glaser III Critical Thinking Appraisal (US) Development Report Candidate Name: Organization: Pearson Sample Corporation Date of Testing: 21-11-2017 (dd-mm-yyy) 21-11-2017 Page 1 of 15 How to Use
More informationWHITEPAPER ANSWERS ARE FINE, RESOLUTIONS ARE BETTER. by Dave Morfas, Product Marketing Manager.
WHITEPAPER ANSWERS ARE FINE, RESOLUTIONS ARE BETTER by Dave Morfas, Product Marketing Manager WHITEPAPER ANSWERS ARE FINE, RESOLUTIONS ARE BETTER 2 ANSWERS DON T ALWAYS RESOLVE ISSUES There is a big difference
More informationAgriculture Investment Data Needs: NGOs
Agriculture Investment Data Needs: NGOs Background The Initiative for Open Ag Funding 1 works to support efforts to end hunger and food insecurity by ensuring organizations have the information they need
More informationWHITE PAPER THE 6 DIMENSIONS (& OBSTACLES) OF RISK MANAGEMENT
WHITE PAPER THE 6 DIMENSIONS (& OBSTACLES) OF RISK MANAGEMENT Risk management efforts often begin as focused attempts to improve certain elements of risk or compliance management within one functional
More informationFAQ: Implementation Complete Phase
FAQ: Implementation Complete Phase Question 1: How can I determine if the Implementation Complete milestone has been met? Response: There are several industry accepted measures for the Implementation Complete
More informationIBM Planning Analytics Express
Performance management and business intelligence for midsize organisations IBM Planning is a performance management (PM) and business intelligence (BI) solution for midsize organisations. It delivers the
More informationTen Steps to Evaluate and Select A Mid-Market Budgeting, Forecasting, and Reporting Solution
Ten Steps to Evaluate and Select A Mid-Market Budgeting, Forecasting, and Reporting Solution August 2007 BPM Partners, Inc. Six Landmark Square Stamford, CT 06901 203-359-5677 www.bpmpartners.com Introduction
More informationIndustrial Engineering Prof. Inderdeep Singh Department of Mechanical and Industrial Engineering Indian Institute of Technology, Roorkee
Industrial Engineering Prof. Inderdeep Singh Department of Mechanical and Industrial Engineering Indian Institute of Technology, Roorkee Module - 04 Lecture - 04 Sales Forecasting I A very warm welcome
More informationMulti-Disciplinary Basic Research in the Science of Autonomy with Naval Relevance BAA QUESTIONS & ANSWERS As of 18 November 2008
Multi-Disciplinary Basic Research in the Science of Autonomy with Naval Relevance BAA 09-008 QUESTIONS & ANSWERS 19 53 As of 18 November 2008 Q 19: From the Q&A it seems to be that industry CANNOT be the
More informationService management solutions White paper. Six steps toward assuring service availability and performance.
Service management solutions White paper Six steps toward assuring service availability and performance. March 2008 2 Contents 2 Overview 2 Challenges in assuring high service availability and performance
More informationTHE IMPORTANCE OF PLANNING DURING PROJECT EXECUTION
THE IMPORTANCE OF PLANNING DURING PROJECT EXECUTION Dr. Dan Patterson, PMP Chief Design Officer, PLANNING & SCHEDULING Introduction Twenty-five years ago, I was taught that project management was built
More informationAnalytics for All Your Data: Cloud Essentials. Pervasive Insight in the World of Cloud
Analytics for All Your Data: Cloud Essentials Pervasive Insight in the World of Cloud The Opportunity We re living in a world where just about everything we see, do, hear, feel, and experience is captured
More informationPredictive Marketing: Buyer s Guide
Predictive Marketing: Buyer s Guide Index Introduction 2 About This ebook 2 The Benefits of Using a Predictive Marketing Solution 2 Recommended Steps to Making an Informed Purchase 2 Step #1: How do you
More informationFrom Theory to Data Product
From Theory to Data Product Applying Data Science Methods to Effect Business Change KDD 2017 - August 13 Advanced Analytics Entry Points Strategy Organization Policies, Procedures & Standards Components
More informationTeraCrunch Solution Blade White Paper
TeraCrunch Solution Blade White Paper Transforming Organizations With Predictive Analytics & Artificial Intelligence M a y 2 0 1 6 TABLE OF CONTENTS 1. INTRODUCTION 3 2. APPROACH 3 3. PLATFORM 4 4. PROCESS
More informationCitation Statistics (discussion for Statistical Science) David Spiegelhalter, University of Cambridge and Harvey Goldstein, University of Bristol We
Citation Statistics (discussion for Statistical Science) David Spiegelhalter, University of and Harvey Goldstein, University of We welcome this critique of simplistic one-dimensional measures of academic
More informationTDWI Analytics Principles and Practices
TDWI. All rights reserved. Reproductions in whole or in part are prohibited except by written permission. DO NOT COPY Previews of TDWI course books offer an opportunity to see the quality of our material
More informationNimble Storage InfoSight for VMs, a step forward in infrastructure analytics
Nimble Storage InfoSight for VMs, a step forward in infrastructure analytics Prepared for: Nimble Storage April 2015 TABLE OF CONTENTS TABLE OF CONTENTS 1 EXECUTIVE SUMMARY 2 BUSINESS NEEDS PROACTIVE IT
More informationRoadmap to Success. Leveraging RPA to Drive Growth and Explore New Opportunities for Efficiency
A I Roadmap to Success Leveraging RPA to Drive Growth and Explore New Opportunities for Efficiency Sponsored by 1 Introduction Robotic process automation (RPA) is driving massive increases in productivity
More informationNOVEC Project Proposal
NOVEC Project Proposal Authors: Abdulrahaman Alsabti Kevin Mitchell Dan Package 10/02/2014 Contents I. Introduction... 1 a. Background... 1 b. Problem Statement... 1 c. Stakeholders... 2 d. Scope... 2
More informationA Systematic Approach to Performance Evaluation
A Systematic Approach to Performance evaluation is the process of determining how well an existing or future computer system meets a set of alternative performance objectives. Arbitrarily selecting performance
More informationThe Critical Role of Talent Analytics in Successful Mergers and Acquisitions
The Critical Role of Talent Analytics in Successful Mergers and Acquisitions The art and science of managing human capital to create people-driven synergies Why 70% of M&A transactions don t achieve expected
More informationEssentials of Business Architecture Roger Burlton
April 2, 2019 Essentials of Business Architecture Roger Burlton The Business Architecture Concept Model: Design the Business Phase In the last Column in the series, I broached the idea of a concept model
More informationSome insights about Insights
Can I get some insights, please? Over the years, I have come to somewhat dislike the term insights almost to the same level as, say, a Data Lake. And that s saying something. Not because these concepts
More informationMBF1413 Quantitative Methods
MBF1413 Quantitative Methods Prepared by Dr Khairul Anuar 1: Introduction to Quantitative Methods www.notes638.wordpress.com Assessment Two assignments Assignment 1 -individual 30% Assignment 2 -individual
More informationDecision Analysis Making the Big Decisions
Decision Analysis Making the Big Decisions Endeavor Management 2700 Post Oak Blvd. P + 713.877.8130 Suite 1400 F + 713.877.1823 Houston, Texas 77056 www.endeavormgmt.com Overview You probably face a lot
More informationTickITplus Implementation Note
Title Understanding Base Practices Requirement Sizing Date April 2015 Reference TIN015-1504 Originator Dave Wynn Version v1r0 Key Terms Base Practices, Implementation, Requirements, Sizing, Estimating,
More informationGENDER PAY GAP REPORT
GENDER PAY GAP REPORT www.britishcouncil.org FOREWORD The British Council is the UK s international organisation for cultural relations and educational opportunities. We create friendly knowledge and understanding
More informationCONSULTATION ON USE OF RESOURCES AND WELL- LED ASSESSMENTS - NHS Providers response
February 2017 CONSULTATION ON USE OF RESOURCES AND WELL- LED ASSESSMENTS - NHS Providers response ABOUT NHS PROVIDERS NHS Providers is the membership organisation and trade association for the NHS acute,
More informationSocialSim Proposers Day agenda
SocialSim Proposers Day agenda Start End Duration Item 7:45 AM 8:45 AM 1:00 Registration 8:45 AM 8:55 AM 0:10 8:55 AM 9:25 AM 0:30 9:25 AM 10:05 AM 0:40 Security Briefing DARPA Security Contracts Management
More informationIdentify Risks. 3. Emergent Identification: There should be provision to identify risks at any time during the project.
Purpose and Objectives of the Identify Risks Process The purpose of the Identify Risks process is to identify all the knowable risks to project objectives to the maximum extent possible. This is an iterative
More informationIntelligent Workflow Management: Architecture and Technologies
Proceedings of The Third International Conference on Electronic Commerce(ICeCE2003), Hangzhou Oct. 2003, pp.995-999 Intelligent Workflow Management: Architecture and Technologies Chen Huang a, Yushun Fan
More informationRequest for Proposal BC for Brand Research Questions and answers
Request for Proposal 17-681725-BC for Brand Research Questions and answers 1. Qualitative research can be fielded using different methodologies, and as part of determination in our suggested approach,
More informationThe. Revolution. Automation is helping companies across industries do more with
The AI Revolution Artificial intelligence is set to disrupt and transform businesses across industries, and there will be clear winners and losers. Rashed Haq Automation is helping companies across industries
More informationCertified Identity Governance Expert (CIGE) Overview & Curriculum
Overview Identity and Access Governance (IAG) provides the link between Identity and Access Management (IAM) rules and the policies within a company to protect systems and data from unauthorized access,
More informationFinancial Planning & Analysis Solution. A Financial Planning System is one of the core financial analytics applications that an enterprise needs.
Financial Planning & Analysis Solution A Financial Planning System is one of the core financial analytics applications that an enterprise needs. Trusted Experts in Analytics What is Financial Planning
More informationBook Outline. Software Testing and Analysis: Process, Principles, and Techniques
Book Outline Software Testing and Analysis: Process, Principles, and Techniques Mauro PezzèandMichalYoung Working Outline as of March 2000 Software test and analysis are essential techniques for producing
More informationUnderstanding RPA ROI
A I Understanding RPA ROI How to Measure It and Why It s Important Sponsored by 1 Introduction Robotic process automation (RPA) can deliver significant benefits to companies of practically any size and
More informationUnder The Hood. The idatalabs Platform Architecture
Under The Hood The idatalabs Platform Architecture idatalabs solutions are powered by an underlying platform architecture that relies on state-of-the-art technologies, including machine learning, natural
More informationMeasuring Corporate Impact on Ecosystems: A Comprehensive Review of New Tools
Measuring Corporate Impact on Ecosystems: A Comprehensive Review of New Tools Executive Summary By Sissel Waage, Emma Stewart and Kit Armstrong With support from BSR s Environmental Services, Tools and
More informationLABOUR MARKET INFORMATION
SKILLS ANTICIPATION BACKGROUND NOTE FEBRUARY 2017 INFORMATION SYSTEMS COLLECTING INFORMATION AND DATA ON LABOUR MARKET TRENDS Today, important economic and social trends affect the situations in which
More informationIBM Watson Analytics Data Refinement. For Personal and Professional editions of Watson Analytics
IBM Watson Analytics Data Refinement For Personal and Professional editions of Watson Analytics Even a simple analytics project has multiple steps and people Business Analysts Reporting Data Access Data
More informationWatson Glaser III (US)
Watson Glaser III (US) Development Report Candidate Name: Organization: Pearson Sample Corporation Date of Testing: (dd mm yyyy) Page 1 of 15 How to Use Your Report Success in the 21st century workplace
More informationThe Wow! Factor: A Perfect Example of Using Business Analytics and Cloud Computing to Create Business Value
Case Study The Wow! Factor: A Perfect Example of Using Business Analytics Introduction This Case Study is about how one enterprise (IBM) found a way to extract additional business value from its existing
More informationRFP Q&A. Financial Modeling Tool. Questions regarding the project scope
RFP Q&A Financial Modeling Tool Could you provide examples of digital development programs for which you envision this modelling tool to be useful? As there are a great range of programs, it would be useful
More informationDealmakers Planning for a Successful Integration: The M&A Roadmap for Success
Dealmakers Planning for a Successful Integration: The M&A Roadmap for Success Last month In MidMarket Talk, Dealmakers Planning for a Successful Integration: Performing Cultural Due Diligence (CDD) focused
More informationIs It Time to Evolve from Spreadsheets to Business Intelligence?
Position Paper Is It Time to Evolve from Spreadsheets to Business Intelligence? Gregg Gordon Sr. Director, Big Data Practice No matter how your organization delivers value to your market, customers are
More informationTALKDESK EBOOK Talkdesk Contact Center KPI Benchmarking Report
TALKDESK EBOOK 2018 Talkdesk Contact Center KPI Benchmarking Report Table of Contents Introduction 03 I. Contact Center KPI Best Practices 04 II. Top Four Contact Center Metrics 06 III. Average Abandonment
More informationTALKDESK EBOOK Talkdesk Contact Center KPI Benchmarking Report
TALKDESK EBOOK 2018 Talkdesk Contact Center KPI Benchmarking Report Table of Contents Introduction 03 I. Contact Center KPI Best Practices 04 II. Top Four Contact Center Metrics 06 III. Average Abandonment
More informationEER Assurance Background and Contextual Information IAASB Main Agenda (December 2018) EER Assurance - Background and Contextual Information
Agenda Item 8-C EER Assurance - Background and Contextual Information The September 2018 draft of the guidance was divided into two sections, with section II containing background and contextual information.
More informationPerformance Skills Leader. Individual Feedback Report
Performance Skills Leader Individual Feedback Report Jon Sample Date Printed: /6/ Introduction REPORT OVERVIEW Recently, you completed the PS Leader assessment. You may recall that you were asked to provide
More informationFinancial Close Software Comparison G2 Crowd Analysis of FloQast and BlackLine Reviews
Financial Close Software Comparison Introduction The close process is uniquely stressful for the accounting professionals that do the work. It takes the pressure of an inflexible deadline and adds the
More informationBUSINESS DEVELOPMENT INTELLIGENCE MONITORING FOR LAW FIRMS
WHITEPAPER BUSINESS DEVELOPMENT INTELLIGENCE MONITORING FOR LAW FIRMS Most major law firms engage in intelligence monitoring to spot new business opportunities and inform attorneys about important developments
More informationIBM Decision Optimization and Data Science
IBM Decision Optimization and Data Science Overview IBM Decision Optimization products use advanced mathematical and artificial intelligence techniques to support decision analysis and identify the best
More informationThought Leadership Marketing: 2014 Guide To Lead Generation
WHITE PAPER Thought Leadership Marketing: 2014 Guide To Lead Generation This white paper is developed for marketers charged with generating leads and prospect engagement through webcasts. It assumes the
More information<Project Name> Business Case
Business Case Author(s) Contributors Department Campus DOCUMENT HISTORY Version Date Person Notes 1.0 ITS Portfolio Management Office Business Case Page 1 TABLE OF CONTENTS
More informationAdapting software project estimation to the reality of changing development technologies
Adapting software project estimation to the reality of changing development technologies Introduction Estimating software projects where significant amounts of new technology are being used is a difficult
More informationQ&A from the PSMJ Resources, Inc. / XL Group Webinar on September 18, 2012: Developing Satisfied Clients: 6 Steps That Can Save Your Assets
Q&A from the PSMJ Resources, Inc. / XL Group Webinar on September 18, 2012: Developing Satisfied Clients: 6 Steps That Can Save Your Assets Q: Can you give us examples of how to set up a procedure to ID
More informationHR001119S0003 Accelerated Molecular Discovery Frequently Asked Questions (FAQs) As of 12/14/2018
HR001119S0003 Accelerated Molecular Discovery Frequently Asked Questions (FAQs) As of 12/14/2018 35Q: Is it the proposer s responsibility to find a government team to perform IV&V? Is including a letter
More informationConducting a SharePoint Assessment
Conducting a SharePoint Assessment Poll Questions What percentage of roundtable attendees utilize Microsoft SharePoint? How is SharePoint utilized within your organization? Do you believe your organization
More informationAgile Essentials Track: Business Services
Agile Essentials Track: Business Services Presenter: Mark Thomas Synopsis Are you a victim of building the wrong solutions slowly? If so, you re not alone, and considering an Agile approach may be the
More informationApproved for public release,
Statement for the Record before the House Armed Services Committee Subcommittee on Strategic Forces on the Fiscal Year 2018 Priorities and Posture of the National Security Space Enterprise Robert Cardillo
More information7 STEPS. - to - Designing an Incentive Compensation Plan that Drives Sales Per formance
7 STEPS - to - Designing an Incentive Compensation Plan that Drives Sales Per formance S ales organizations focus intensely on improving sales plan compensation, and for good reason: 74% of companies surveyed
More informationBuilding credibility: Establishing online identity without sacrificing convenience
Building credibility: Establishing online identity without sacrificing convenience May 2006 Executive summary Shifting from familiar, paper-based approaches to identity verification can save money, but
More informationDoomed from the Start?
Doomed from the Start? Why a Majority of Business and IT Teams Anticipate Their Software Development Projects Will Fail Winter 2010/2011 Industry Survey 2011. Geneca LLC. All Rights Reserved. Why a Majority
More informationThe importance of the right reporting, analytics and information delivery
The importance of the right reporting, and Introduction This is the second of a three-part series focused on designing a business intelligence (BI) solution. In order to design a complete solution, there
More informationProportionality guidance for departments
Proportionality guidance for departments Contents Introduction... 3 Level of analysis... 3 RPC expectations Consultation stage IA... 7 Low impact... 7 Medium impact... 9 High impact... 11 RPC expectations
More informationA Multi- Dimensional Framework for Implementing Technology Business Management
A Multi- Dimensional Framework for Implementing Technology Business Management Alex-Paul Manders, ISG TBM Practice Lead, Americas ISG WHITE PAPER 2016 Information Services Group, Inc. All Rights Reserved
More informationTRANSITIONING FROM SCHEDULING TO TRUE PLANNING
TRANSITIONING FROM SCHEDULING TO TRUE PLANNING Dr. Dan Patterson, PMP Chief Design Officer, Introduction Is there a difference between planning and scheduling? These two terms are used interchangeably
More informationUtilizing Optimization Techniques to Enhance Cost and Schedule Risk Analysis
1 Utilizing Optimization Techniques to Enhance Cost and Schedule Risk Analysis Colin Smith, Brandon Herzog SCEA 2012 2 Table of Contents Introduction to Optimization Optimization and Uncertainty Analysis
More informationSystems Analysis and Design Methods Chapter 2: Information System Building Blocks
Systems Analysis and Design Methods Chapter 2: Information System Building Blocks Multiple Choice Questions 1. Data that has been refined and organized by processing and purposeful intelligence is called:
More information2012 North American Clinical Laboratory Competitive Strategy Leadership Award
2012 2012 North American Clinical Laboratory Competitive Strategy Leadership Award 2012 Frost & Sullivan 1 We Accelerate Growth Competitive Strategy Leadership Award Clinical Laboratory, North America,
More informationISACA Systems Implementation Assurance February 2009
ISACA Pressures Today Pressure to increase realization of value from IT spending Pressure to deliver on IT projects at a time when resources/budgets are constrained Pressure from risk of technology-based
More informationCan AI improve portfolio managers'
lakyara Can AI improve portfolio managers' Investment decision-making? Yusuke Umezu 13.October.2017 Executive Summary Nomura Research Institute and Nomura Asset Management recently conducted a proof of
More informationIMAGE ACQUISTION AND PROCESSING FOR FACILITY LOAD FORECASTING
Technical Disclosure Commons Defensive Publications Series August 24, 2016 IMAGE ACQUISTION AND PROCESSING FOR FACILITY LOAD FORECASTING Matthew Wood Patrick Dunagan John Clark Kristina Bohl Follow this
More informationDEPARTMENT OF DEFENSE STANDARD PRACTICE
NOT MEASUREMENT SENSITIVE 5 April 2012 SUPERSEDING 28 January 2008 DEPARTMENT OF DEFENSE STANDARD PRACTICE DOCUMENTATION OF VERIFICATION, VALIDATION, AND ACCREDITATION (VV&A) FOR MODELS AND SIMULATIONS
More informationThe Hybrid Automation Revolution
A I The Hybrid Automation Revolution Why 90% of Automation-Ready Processes Require a Hybrid Human-Robot Approach Sponsored by 1 Introduction RPA (robotic process automation) allows enterprises to reduce
More informationJOB DESCRIPTION TEMPLATE
JOB DESCRIPTION TEMPLATE JOB DETAILS JOB TITLE REPORTS TO DEPARTMENT REF NUMBER LOCATION EMAIL ADDRESS Junior Business Analyst IT Manager Technology Junior Business Analyst:0006 Pretoria recruitment@moiponefleet.co.za
More informationDefining and Managing an Optimal Sourcing Mix
WHAT TO LET GO, WHAT TO HOLD ON TO Defining and Managing an Optimal Sourcing Mix Lawrence Kane, Senior IT Leader, Boeing & John Lytle, Director, ISG ISG WHITE PAPER 2013 Information Services Group, Inc.
More informationSECURING VALUE FOR MONEY IN OUTSOURCED CONTRACTS How Local Authorities Can Deliver Their Cost Reduction Remit
SECURING VALUE FOR MONEY IN OUTSOURCED CONTRACTS How Local Authorities Can Deliver Their Cost Reduction Remit Roger Warner, ISG ISG WHITE PAPER 2014 Information Services Group, Inc. All Rights Reserved
More informationPrinciples and Characteristics of the COSA System. A Concise Introduction
Principles and Characteristics of the COSA System A Concise Introduction Principles and Characteristics of the COSA System This is a brief overview of the basic principles and characteristics of the COSA
More informationLeadership Agility Profile: 360 Assessment. Prepared for J. SAMPLE DATE
Prepared for J. SAMPLE About this Report Introduction LEADERSHIP that special quality that enables leaders to achieve extraordinary success. In today's uncertain world the need for leadership is at an
More informationAdvancing analytics and automation within internal audit
Advancing analytics and automation within internal audit A look into the current maturity stages of internal audit analytics and how internal audit departments are further developing their analytics programs
More informationTOOL #47. EVALUATION CRITERIA AND QUESTIONS
TOOL #47. EVALUATION CRITERIA AND QUESTIONS 1. INTRODUCTION All evaluations and fitness checks should assess the evaluation criteria of effectiveness, efficiency, coherence, relevance and EU added value
More informationAudit Trends 2018 Survey Results
Audit Trends 2018 Survey Results A global perspective on the current state of audit, challenges to overcome and opportunities to add further value to the audit function. About the Audit Trends 2018 Survey
More informationProject Management Process Groups. PMP Study Group Based on the PMBOK Guide 4 th Edition
Project Management Process Groups PMP Study Group Based on the PMBOK Guide 4 th Edition Introduction PM Process Groups In order for a project to be successful, the project team must: Select appropriate
More informationImplementing an Employee Engagement Programme
Implementing an Employee Engagement Programme A People & Culture White Paper Introduction Over the last decade, employers focus has moved away from employees who are satisfied with their working conditions,
More informationSRM s New Allure. By Jerome M Wendt, Independent Storage Analyst
By Jerome M Wendt, Independent Storage Analyst Contents The SRM Market...3 SRM s New Allure...4 The Right Stuff...5 Implementation Intangibles...8 The Deliverables...9 About Us...10 2006 TeraCloud Inc.
More informationwipro.com Cognitive and Predictive Mining: Improving Efficiency and Driving Capabilities
wipro.com Cognitive and Predictive Mining: Improving Efficiency and Driving Capabilities M ining has become an increasingly precise practice. Modern mines have applications that ship and synthesize data
More informationWhite Paper. Strategic Alignment
White Paper Strategic Alignment Within any organisation there will be visions and goals which are set by the governing body 1 and define the purpose of the organisation. These overarching statements are
More informationANALYTICS COMPETENCIES - MANAGING BIG DATA & BI
LUNCHTALK Series ANALYTICS COMPETENCIES - MANAGING BIG DATA & BI Presented by Michael Hartung www.erasig,com Agenda FREE WEBINAR Trends in Analytics and Business Intelligence Analytics Structure and Definition
More information