Data, and only Data is important, or is it?

Transcription

1 Data, and only Data is important, or is it? Hannu Jaakkola Tampere University of Technology Finland Hannu Jaakkola 1

2 Main Message Topic: Chorus singing, and only chorus singing is important Research Question: The role of data in the current society Your value is the value of your data Approach: From ICT Trends to the data related issues Conclusion: The growing importance of data is clearly indicated; however data itself is not enough Hannu Jaakkola 2

3 Structure of the presentation The Characteristics of the Data ICT Trends The role of Context Autonomity and IoT sensor data Big Data from data to understanding Open Data official and unofficial data sources The role Licensing Business model (of the official open data) Discussion Hannu Jaakkola 3

4 CHARACTERISTICS OF THE DATA Hannu Jaakkola 4

5 Conceptualization of Data Small Data Big Data Openly Available Data Open Data Hannu Jaakkola 5

6 Data Ecosystem Machine Produced Data Hannu Jaakkola 6

7 Characteristics summarized Several data classification dimensions Data itself is not important mostly used for simple processing using single data sources Value comes from ability to integrate data from several sources and simplify the results in easy-tounderstand format (visualization) Data > Information > Knowledge -> Understanding Hannu Jaakkola 7

8 APPROACHING THE TOPIC Hannu Jaakkola 8

9 Emerging Technologies (Gartner 2013) Hannu Jaakkola 9

10 Hannu Jaakkola 10

11 From 2014 to 2015 Gartner 2015 Hype Cycle says: Big Data is Out, Machine Learning is in Hannu Jaakkola 11

12 Emerging Technologies (Gartner 2015) Hannu Jaakkola 12

13 ICT Changes - Openess as an Enabler (Several sources) Hannu Jaakkola 13

14 Incremental changes Continuous changes on the current trend Hannu Jaakkola 14

15 Radical Changes Important changes, new trend Hannu Jaakkola 15

16 Paradigms Pervasive changes troughout the target system Hannu Jaakkola 16

17 FOCUS IN THE SELECTED TOPICS Hannu Jaakkola 17

18 Context is the key Computing context network connectivity communication cost, communication bandwidth nearby resource User context user profile, location, social situation Physical context lighting, noise, traffic condition, temperature Time context time of a day, week, month and season of the year Context is the set of environmental states and settings that either determines an application s behavior or in which an application event occurs and is interesting to the user (Chen & Kotz 2005). Data is used to build the context. The growing role of the sensor (raw) data. Hannu Jaakkola 18

19 Autonomity - IoT Growing amount of all data transferred by networks is produced by machines (sensor data) IDC: 11% (2005) -> 40% (2020) Variety of data formats ususally raw data The degree of autonomity of the machines is growing Missing or minimal human control both to the operations and the data Growing intelligence of machines and applications IoT, IoS Cultivation of sensor data brings added-value; raw data has small value Actionable value cultivated by machines (instead of data processing) Raw data cultivated by (big data) applications Connected Machines and People Sensors additional complexity layer From IoT to Internet Embedded Society (IoNT) Hannu Jaakkola 19

20 Hannu Jaakkola 20

21 & Hannu Jaakkola 21

22 Human Sensing and Monitoring Hannu Jaakkola 22

23 Going to mobile Hannu Jaakkola 23

24 Big Data A Key Technology Opportunity to handle a collection of large, complex, distributed data sets capture, curation, storage, search, sharing, analyze, integrate and visualize Sources of data databases, open internet data, real time sensor data (surveillance fotage, embedded devices, ), information-sensing mobile devices, aerial sensory, software logs, cameras, microphones, RFI readers, wireless sensor networks (Internet of Things) Applications IDC: Business Inteligence combined with external data Social Analytics Social gestures (organized data, e.g. lifeline) Growth130 (2005) -> 40,000 (2020) EB (E=10**18 Bytes) Increasingly machine produced :11% (2005) -> 40% (2020) Low utilization level ( 0,5% in 2013 used in analysis) 24 Hannu Jaakkola

25 Big Data technologies (Gartner 2012 & 2013) Hannu Jaakkola 25

26 Open Data Open Data: data that is freely available to everyone to use and republish without restrictions from copyright, patents or other mechanisms of control Data produced by public organization should be freely available for use and re-use EU: annual business value Direct 40 Billion EUR With indirect 140 Billion EUR Additional: openess, transparency, trust, confidence, commitment Beneficials: An ecosystem having different types of collaborating organizations Agile SME sector most promising

27 Open Data Barometer ( ) Readiness: how far a country has in place for realising the potential benefits of open data Implementation: the extent to which government has published a range of key datasets Impacts: the extent to which open data has been seen to lead to change. Hannu Jaakkola 27

28 Open Data Barometer ( ) Hannu Jaakkola 28

29 Open Data Barometer Grand Total (2015)

30 OD Opportunities General European Union: the economic gains direct 40 Billion and with indirect 140 billion annually (EC27 Societal opportunities: having more data openly available will help to discover new and innovative solutions; Efficiency: sharing data inside and between public administrations increases productivity; Citizens participation: activation of citizens in political and social life, increasing transparency of government Company Better utilization of data Costs decrease because of free data Supports development of innovative applications and use of data; Overlapping work decreases New data is available for business purposes Availability of benchmarking data learning from experiences; Opportunities for better history analysis and predictive analytics Hannu Jaakkola 30

31 OD Challenges Problems in the capability of users and application developers to recognize the opportunities related to open data; Unfamiliar business idea; Lack of technical readiness; complex data formats or interfaces; Inability to find suitable data sources; Insufficient availability of regional data sources for local services; Unclear licensing (instead of good efforts still complex); Legal issues (grey area data) are unclear; Globalization related problems: which law is applied (fits to intellectual property rights, but also to cloud based implementation); National differences in privacy policy; Technical limitations related to data publishing platforms; Guarantee of maintenance and updatedness of data is missing; Variation in data quality and reliability. Hannu Jaakkola 31

32 Supply does not fit Demand (Deloitte; UK: data sources) Open Data Supply Demand Usefulness Government Spending Economy Demographics Health and Social Care Labour market Environment Government operations Population Health Education Crime and Justice Business Geospatial Transport Housing Personal finances Agriculture Planning Social Conditions Arts, sports & recreation Energy resources and Utilities Public data is mainly collected for administrative purposes Reuse and demand related to it are not taken into account Summary of the findings Geospatial information is most important in use Economy related informatioin has most downloads, in balance with supply and demand, too Government spending is biggest group in supply, last in use Some supply minorities are reasonable high in demand and in use Hannu Jaakkola 32

33 Some Rights Reserved Data CC Creative Commons - CC Attribution (BY - give the author or licensor the credits), Share-alike (SA - distribute only under an identical license), Non-commercial (NC - use only for non-commercial purposes), No-derivative (ND only verbatim copies, no derivatives) Used in combiner manner. Additional: CC0: Public Domain - the right holder waives all rights CC PDM Public Domain Mark 1.0 (No Copyright): data is already in the public domain; can be used by anyone Open Data Commons - ODC Specifically for data, datasets and databases; Open Data Commons Attribution Licence ODC-By (compatible with CC BY). Open Data Commons Open Database Licence ODC-ODbL (compatible with CC BY SA). Public Domain Dedication Licence PDDL (compatible with CC Zero). Open Government Licence (OGL) Reuse of Government and other public sector information The user has a worldwide, royaltyfree right to use data Hannu Jaakkola 33

34 Openly Available Data Licensing May be licensed according to commonly accepted rules or not Globalization which law applied May wild and uncontrolled from both directions No clear legal rules In some cases secondary licensing Service agreement defines the rights MyData IDC Who owns it and Who defines the rules half of the data that needs protection is protected the proportion of this data grows from 30% to 45% of all data in ten years Hannu Jaakkola 34

35 What about this data? The value of health and fittness sensing devices business is at the momen 3 Billion USD Expected growth to the level of 10 times the current value Tens of producers Most of the sensing devices connected to mobile phone New opening: Apple Iwatch & Apple Healthbook; collecting wide variety of health related data Where is business? Hannu Jaakkola 35

36 OPEN DATA BASED BUSINESS Hannu Jaakkola 36

37 Open Data Ecosystem (Deloitte; modified) Hannu Jaakkola 37

38 Open Data Business Model (Deloitte; modified) Hannu Jaakkola 38

39 The roles Supplier: Organizations that publish their data via an open interface. These are in most cases public sector organizations collecting the data for their primary operative purposes (see Figure 4 data ecosystem). Aggregators: Organizations that collect and aggregate open data (sometimes with other existing (internal) data), visualize it, look for correlation and group it by sector. Developers: Organizations that design and implement applications for consuming by other organizations of the value chain. Enrichers: Organizations that use open data to enhance their existing products and services (in the form of added-value properties). Enablers: Organizations that facilitate the supply or use of open data. This group of organizations cover hosting services, instrumentation of data / products (e.g. to provide behavioral data of the users in the form of user profilization), and advisory services Customer: the end-user of the data. Hannu Jaakkola 39

40 CONCLUDING REMARKS Hannu Jaakkola 40

41 Open data summarized Open Data and Openly Available Data are important sources for new business and services Improvement in technology and infrastructure enable the beneficial use of the data Rapid changes in last few years, high expectations but also challenges Positive attitude in public sector accelerates the changes Privacy and Security rules / laws and IPR related interpretations are not clear - will slow down the progress Supply and Demand do not meet each other in data availabilitiy Hannu Jaakkola 41

42 Discussion: Who owns the data? A huge amount of data produced by individuals by themselves E.g. Facebook 500 TB of new data ingested into the databases every day, Twitter 500 tweets per day, only 70 GB All transactions, registrations, activities, including mobile device usage produce new data partially open, partially closed; source of your context High business value of the (cultivated) data Ownership of My Data the current approach Owned by information systems and authorities I have my data only in the loan, when I use it My right to have access to my data is limited or restricted My right to control the use of my data is limited or restricted Flipped IS architecture possible? All my data is owned by me and I store it Information systems have access to my data as I like My control to authorize the data usage Hannu Jaakkola 42

43 Hannu Jaakkola 43