Dalia Research ESOMAR 28

Transcription

1 Dalia Research ESOMAR 28 About Dalia Research GmbH Founded in 2013 and headquartered in Berlin, Germany, Dalia Research GmbH develops programmatic sampling technologies to facilitate the collection of market-, social- and opinion insights through web-enabled mobile devices. With a publisher network that encompasses well over individual apps and mobile websites, Dalia Research accesses respondents in real-time in over 80 countries worldwide and currently processes up to 3.5 million answers per day. Dalia Research was recently selected the "most innovative startup in Europe" in the market research and consumer insights industry (IIeX 2015). It counts three of the the world s top- ve market research agencies, the world s ve leading online panels and the two leading survey exchanges among its clients. With Wellington Partners, the Investments Bank of Berlin and WestTech Ventures, Dalia also counts some of the most reputed venture capital rms among its investors and shareholders. Dalia Research is a pioneer in applying mobile targeting and attribution algorithms to survey data collection. To guarantee a high degree of data-integrity and data-quality, Dalia Research does not store any Personally Identi able Information (PII) on respondents. As part of its engagement for promoting research integrity and quality in digital research, Dalia was invited to join a group of industry thought leaders that, under the umbrella of ESOMAR, devises strategies to better communicate the wider societal value of market and opinion research. As a certi ed corporate member of the World Association for Market, Social and Opinion Research (ESOMAR), Dalia Research complies with the ICC/ESOMAR International Code on Market and Social Research and strictly adheres to ISO Standards on market and opinion research, ESOMAR guidelines and the requirements of the Children s Online Privacy Act (COPPA). 1. What experience does your company have in providing online samples for market research? Dalia Research provides targeted access to pro led mobile respondents to three of the the world s top- ve market research agencies, the world s ve leading online panels and the two global survey exchanges. Dalia s respondent platform can be accessed by small and mid-sized market research agencies through its partnership with the two leading survey exchanges or through a direct setup with Dalia s project management team. About Us ESOMAR 28 Page 1 of 5

2 2. Please describe and explain the type(s) of online sample sources from which you get respondents. Are these databases? Actively managed research panels? Direct marketing lists? Social networks? Web intercept (also known as river) samples? Dalia Research sources from thousands of different websites and apps in over 80 countries worldwide. Users visit their favorite mobile, tablet or desktop apps or website and are invited to join a live-panel via a direct communication on the (mobile) website or app. Respondents that meet prede ned criteria, pass a quality assurance and response prediction algorithm and explicitly opt-in twice to participate in research are invited through, whenever feasible, a strati ed random sampling approach to complete a survey. 3. If you provide samples from more than one source: How are the different sample sources blended together to ensure validity? How can this be replicated over time to provide reliability? How do you deal with the possibility of duplication of respondents across sources? Dalia Research has built a technology that allows a standardized way of sourcing panelists from thousands of mobile and web-interfaces in over 80 countries. Our standardized sourcing method avoids duplications and ensures that panelists can take part in a speci c survey only once, unless required otherwise. Panelists are identi ed by digital ngerprinting technologies and device tracking software to ensure that they register only once. We thereby maintain a high-level of response quality and ensure methodological consistency across all countries. 4. Are your sample source(s) used solely for market research? If not, what other purposes are they used for? Yes, our sample is recruited and used solely for market, social and opinion research purposes. 5. How do you source groups that may be hard to reach on the internet? Dalia Research continuously expands its partnerships with websites and apps across the mobile web to source groups that are hard to reach. In order to assure a large diversity in the panel base, we are making sure to include niche websites/apps that focus on particular interests and demographics. 6. If, on a particular project, you need to supplement your sample(s) with sample(s) from other providers, how do you select those partners? Is it your policy to notify a client in advance when using a third party provider? Dalia Research does not supplement sample from third parties. 7. What steps do you take to achieve a representative sample of the target population? Dalia Research puts the control to select desired target populations in the hands of the client. Respondents are selected through a strati ed random sampling approach within pre-de ned demographic, psychographic or other target groups. Additionally, Dalia Research has the ability to About Us ESOMAR 28 Page 2 of 5

3 stagger launch times, and manage quotas according to survey starts or completes. 8. Do you employ a survey router? Yes, Dalia Research employs a survey router. 9. If you use a router: Please describe the allocation process within your router. How do you decide which surveys might be considered for a respondent? On what priority basis are respondents allocated to surveys? If a precise match based on targeting criteria cannot be established in real-time through an API-integration, a prioritization algorithm attributes a respondent to surveys based on reported IR, LOI, CPI, conversion rates on past completions of that survey and other parameters. The allocation process is fully automated. The algorithms are dynamic and automatically adjust according to supply and demand across countries. Members of the Dalia Research team need permission from management to temporarily and manually override the prioritization algorithm for individual projects or integrations. 10. If you use a router: What measures do you take to guard against, or mitigate, any bias arising from employing a router? How do you measure and report any bias? Dalia Research samples from a very large pool of possible respondents. Only participants who meet all targeting requirements set by our clients can participate in research projects. Our data science team continuously monitors a wide range of potential sources for bias based on active and passive data the user work ow and system performance. Router-related metrics are constantly monitored to avoid or reduce potential bias. 11. If you use a router: Who in your company sets the parameters of the router? Is it a dedicated team or individual project managers? The parameters that affect algorithmic prioritization are partially set by clients (ie IR, CPI etc.) and partially the result of the performance of the survey in our system. The Dalia Research team regularly reviews set ups and makes sure that everything is con gured correctly. 12. What pro ling data is held on respondents? How is it done? How does this differ across sample sources? How is it kept up- to-date? If no relevant pro ling data is held, how are low incidence projects dealt with? Respondents complete detailed dynamic demographic and targeting surveys, where various demographic, geographic and psychographic criteria are assessed, along with trust and quality assurance measures. Furthermore, respondents are actively and passively pro led for hundreds of different categories whenever they interact with our system. Dalia Research is able to run even low incidence projects. About Us ESOMAR 28 Page 3 of 5

4 13. Please describe your survey invitation process. Dalia Research s participants are not invited to take part in surveys via . Users are logged into websites/apps that Dalia Research has partnered with and are offered to participate in research in exchange for non-monetary rewards. Generic survey invitations are presented on the partner s website without speci c information on the nature of a particular research project in order to avoid self- selection bias. Once a respondent opts-in to participate in market research, Dalia Research informs the user about the nature of market research and explains that the feedback a respondent provides to Dalia Research as part of the targeting and quality assurance process will be recorded anonymously. 14. Please describe the incentives that respondents are offered for taking part in your surveys. How does this differ by sample source, by interview length, by respondent characteristics? In order to increase the quality of responses, Dalia Research offers only non- monetary rewards to respondents, including access to premium content, virtual rewards, airtime or charitable donations. The value of the rewards are adjusted according to the complexity of a survey a process that is controlled by the websites and apps that Dalia Research partners with and that the respondents come from. Participants are rewarded for every completed survey. 15. What information about a project do you need in order to give an accurate estimate of feasibility using your own resources? For manual projects, we evaluate the feasibility of projects based on the following criteria: time in eld, incidence rates, device type (mobile or desktop), length of interview, speci c targeting criteria, quotas and number of completed interviews required. 16. Do you measure respondent satisfaction? Is this information made available to clients? We ask users to rate surveys after each completed interview and can share this information with our clients. In fact, satisfaction metrics are one of the key parameters that we track in order to continuously improve the experience of our users and thus the response quality of the research projects that we conduct. 17. What information do you provide to debrief your client after the project has nished? Our clients have access to a real-time reporting dashboard that tracks the most important survey completion metrics, including participation and drop-out rates, completion times and process descriptions. 18. Who is responsible for data quality checks? If it is you, do you have in place procedures to reduce or eliminate undesired within survey behaviours, such as (a) random responding, (b) Illogical or inconsistent responding, (c) overuse of item non- About Us ESOMAR 28 Page 4 of 5

5 response (e.g. Don t Know ) or (d) speeding (too rapid survey completion)? Please describe these procedures. Dalia Research creates a dynamic trust scores for each user based on, among other things, speeding, random responses and other undesirable response patterns. This mechanism is complemented by digital ngerprinting technologies, blacklisting of sources and dynamic screening questions based on user behavior. Dalia Research can only monitor data-quality in real-time for surveys hosted (and scripted) in the Dalia Platform. For externally hosted surveys, we encourage our partners to use services such as True Sample to automatically monitor response quality. 19. How often can the same individual be contacted to take part in a survey within a speci ed period whether they respond to the contact or not? How does this vary across your sample sources? Panel users can only take part in surveys when logged into our partners website. Our respondents opt-in to complete surveys that are currently targeted to them. Dalia Research doesn t have the possibility to send s or reminders to different panel users. The extensive reach of Dalia Research enables us to randomly attribute high incidence surveys to quali ed respondents. 20. How often can the same individual take part in a survey within a speci ed period? How does this vary across your sample sources? How do you manage this within categories and/or time periods? Our respondents can only take part in surveys that are currently targeted to them and meet their targeting criteria. With access to a very large pool of possible respondents, we limit the maximum number of completed surveys at one per week and user, unless otherwise required. 21. Do you maintain individual level data such as recent participation history, date of entry, source, etc., on your survey respondents? Are you able to supply your client with a project analysis of such individual level data? Yes, Dalia Research maintains these data and can make it available to clients. 22. Do you have a con rmation of respondent identity procedure? Do you have procedures to detect fraudulent respondents? Please describe these procedures as they are implemented at sample source registration and/or at the point of entry to a survey or router. If you offer B2B samples what are the procedures there, if any? In addition to the tools and measures outlined in question 18, Dalia Research conducts regular consistency checks and automated trap questions, blacklisting of partners, real-time monitoring of response patterns and behavior, location veri cation (mobile) and other measures. Dalia Research currently does not offer low-incidence B2B sampling. About Us ESOMAR 28 Page 5 of 5

6 23. Please describe the opt-in for market research processes for all your online sample sources. Dalia Research has implemented a double opt-in process, which a respondent has to complete before participating in a survey. The rst stage of this opt-in procedure involves securing the agreement of a respondent to participate in research on our partner s site. The respondent is then briefed on the nature of market research and is actively required to opt-in again by accepting the conditions for the research project. 24. Please provide a link to your Privacy Policy. How is your Privacy Policy provided to your respondents? As a company registered in and operating out of Germany, Dalia Research is regulated under strict privacy protection laws. Our privacy policy can be found at: A link to this privacy policy is made available to respondents during the opt-in procedure. 25. Please describe the measures you take to ensure data protection and data security. In order to ensure data protection and data security, we have rewalls in place in our data center and access to all servers is done through SSL secured keys. The data is stored in Europe. Our database is protected from external access. 26. What practices do you follow to decide whether online research should be used to present commercially sensitive client data or materials to survey respondents? Most research surveys are hosted by our clients, who are then responsible for the security of their surveys and the relevant content. 27. Are you certi ed to any speci c quality system? If so, which one(s)? Dalia Research employs bot detection, source monitoring, automated data quality processes, and regular screening of recruitment sources. 28. Do you conduct online surveys with children and young people? If so, do you adhere to the standards that ESOMAR provides? What other rules or standards, for example COPPA in the United States, do you comply with? As a corporate member of Esomar, Dalia Research fully complies with the ICC/ ESOMAR International Code, ESOMAR guidelines (including on mobile research, online research, passive data collection, interviewing children and young people and others) and the requirements of the Children s Online Privacy Act (COPPA). We do not knowingly conduct surveys with children under the age of 13 or the relevant age limits for market and opinion research in countries where the minimum age is higher. Dalia Research complies with all standards on interviewing children and young people. About Us ESOMAR 28 Page 6 of 6