Big Data Europe and Data Platforms for Tests. Thessaloniki

Transcription

1 Big Data Europe and Data Platforms for Tests. Thessaloniki Dr. Josep Maria Salanova Grau Center for Research and Technology Hellas - Hellenic Institute of Transport Head of Data collection and processing, algorithm design, and use of specialized transport software packages laboratory jose@certh.gr Web:

2 Big Data Europe project

3 Big Data Europe Empowering Communities with Data Technologies Enable European companies to build innovative multilingual products and services based on semantically interoperable, largescale, multi-lingual data assets and knowledge, available under a variety of licenses and business models. Big Data Europe aims to: Collect requirements for the ICT infrastructure needed by dataintensive science practitioners tackling a wide range of societal challenges; covering all aspects of publishing and consuming semantically interoperable, large-scale, multi-lingual data assets and knowledge. Design and implement an architecture for an infrastructure that meets requirements, minimizes the disruption to current workflows, and maximizes the opportunities to take advantage of the latest European RTD developments, including multilingual data harvesting, data analytics, and data visualization.

4 Big Data Europe Empowering Communities with Data Technologies Health Heterogeneous data linking and integration, biomedical semantic indexing Food & Agriculture Large-scale distributed data integration Security Real-time monitoring, stream processing and data analytics, image data analysis Energy Real-time monitoring, stream processing, data analytics, decision support Transport Streaming sensor network and geospatial data integration Climate Real-time monitoring, stream processing and data analytics Social Sciences Statistical and research data linking and integration

5 Big Data Europe Empowering Communities with Data Technologies Probe data that is used Floating Car Data ( locations per minute) Bluetooth detections (millions of daily detections in 43 locations) Services that are being implemented Improved topology-based map matching Mobility patterns recognition and forecasting Bluetooth Data GPS Data Map Matching Traffic Classification and Prediction Results Classification and Prediction Data

6 Big Data Europe Empowering Communities with Data Technologies Map Matching Algorithm

7 Big Data Europe Empowering Communities with Data Technologies Map Matching Algorithm rownum recorded_times tamp transfer osmids :43: :43: :43: :43: :44: :44: :44: :45: :45: :45: :45: :45: :46:

8 Big Data Europe Empowering Communities with Data Technologies Start Historical Link Traffic State BT Historical Link Traffic State (FCD) Historical Link Traffic State (Loop Detectors) Historical Link Traffic State Classification Store in Historical States Define Current Link Traffic State Compare Traffic States (ML, NN) Predict (ARIMAX NN) Traffic Classification and Prediction Validate Prediction

9 Thessaloniki, Data Platform for Tests

10 Thessaloniki on the map ~ inhabitants ~ private cars & motorcycles daily trips 1 (+1) public transport operator for urban trips ~35 public transport operators for extra-urban trips taxis kms of streets 8,8 kms of dedicated bus lanes 12 kms of dedicated bicycle lanes 89,4 kms of ring road parking places

11 Existing ITS layout Peripheral Urban Central

12 Thessaloniki Mobility lab

13 Mobile sensors in Thessaloniki Stationary sensors network: Point to point tracking of MAC ids along the network through 43 Bluetooth device detectors. Travel time estimation Route choice model calibration Origin Destination matrix estimation / Mobility patterns estimation Traffic flow extrapolation Dynamic sensors fleet: Floating Car Data provided in real time by a professional fleets composed of taxis and 600 buses Traffic status estimation (average speed) Origin Destination matrix estimation / Mobility patterns estimation Taxi/bus performance indicators Social media (geolocated tweets & Facebook check-in events) Activity patterns estimation Events / incidents detection Attraction models estimation

14 Mobile sensors in Thessaloniki

15 Dynamic Sensors Data

16 Floating Car Data (taxis) Device ID GPS position (X, Y, Z) Orientation (degrees) Speed (km/h) Timestamp Zone Status

17 Floating Car Data (taxis) vehicles (dispatching application) Circulating hours per day Pulse generated each 100 meters (10-12 seconds) pulses per minute

18 Mobile sensors in Thessaloniki

19 Stationary Sensors Data

20 Bluetooth devices detectors 43 detectors (EEA, SEE-ITS & EASYTRIP) 4 million detections per week (peak period) unique devices detected per day (one intersection) 1 million tracked trips per week tracked trips per day (one path) More detectors installed in other cities and in Bulgaria (SEE-ITS & EASYTRIP)

21 Point to point BT network Real time travel time provision to drivers (VMS, internet, smart device)

22 Mobile sensors in Thessaloniki

23 Mobile sensors in Thessaloniki Datatank (Back office + APIs) CKAN (front end)

24 Social media

25 Social media check-in events per week (750 locations) Up to 50 check-in events per minute (in the 136 locations tagged as bar) 17 check-in events per minute (in the 150 locations tagged as restaurant) 12 check-in events per minute (in the 32 locations tagged as outdoor) 10 check-in events per minute (in the 125 locations tagged as cafe) 10 check-in events per minute (in the 55 locations tagged as nightlife) Up to 1265 check-in events during the peak hour 920 check-in events in bars (Sunday 01.00) 300 check-in events in restaurants (Saturday 22.00)

26 Social media BAR /02/ :00 23/02/ :00 24/02/ :00 25/02/ :00 26/02/ :00 27/02/ :00 28/02/ :00 29/02/ :00 01/03/ :00 02/03/ :00 15 CAFE /02/ :00 23/02/ :00 24/02/ :00 25/02/ :00 26/02/ :00 27/02/ :00 28/02/ :00 29/02/ :00 01/03/ :00 02/03/ :00 12 NIGHTLIFE /02/ :00 23/02/ :00 24/02/ :00 25/02/ :00 26/02/ :00 27/02/ :00 28/02/ :00 29/02/ :00 01/03/ :00 02/03/ :00

27 Social media

28 Social media

29 Thank you! Dr. Josep Maria Salanova Grau