EXPERIENCE WITH FESTA IN EUROFOT AND DRIVE C2X

Transcription

1 EXPERIENCE WITH FESTA IN EUROFOT AND DRIVE C2X FOT-Net Final Event Amsterdam, 18 th March 2014 Adrian Zlocki, ika, Sami Koskinen, VTT, FOT-Net is a support action co-funded by the European Commission to network FOT activities at European, national and international level.

2 THE EUROFOT PROJECT OBJECTIVES Assessment of impacts of ADAS in real traffic, by focusing on the analysis of: safety traffic efficiency environment driver behaviour driver workload user acceptance usability Cost-benefit analysis, based on results from impact assessment

3 METHODOLOGY DATA ACQUISITION AND MANAGEMENT Collection of around 100 vehicle signals from CAN-Bus Data of vehicle dynamics (a lateral, a long, v ego etc.) Status of driver assistance systems (active/passive etc.) Driver activities (operation of instruments) Position (GPS) Process of data upload and processing is designed to work fully autonomously No driver interaction required

4 DATA ANALYSIS IN THE FESTA V Context 4

5 EUROFOT DATA ANALYSIS STEPS ACCORDING TO FESTA Data analysis Database Data quality analysis Data processing Performance indicators calculation Hypothesis testing Global assessment Hypothesis to test Answer to hypothesis 5

6 TESTING OF HYPOTHESES FOR ACC AVAILABLE DATA Mileage N passenger cars Number of drivers N trucks Overall km Motorway km Rural km 64 - Urban km 64 -

7 TESTING OF HYPOTHESES FOR ACC USAGE ACC Type of measure Performance indicator First month treatment Results Last month treatment Relative Increase / Decrease Objective Objective Objective Subjective (Questionnaire) Percentage of travel time travelled with active ACC Number of ACC activations per hour travelled Number of overriding per hour travelled with active ACC Change of user practices in using the ACC 19 % 25 % +31 % % % - 63 % (no change) - Results Drivers use ACC more often and longer over time Slight decrease of overriding the ACC (not significant) Drivers report no change of ACC usage

8 Number of incidents [1/100km] TESTING OF HYPOTHESES INCIDENTS 1,0 0,9 0,8 Baseline Treatment 0,7 0,6 0,5 0,4 0,3 0,2 0,1 0,0 Conditions Baseline Baseline Mean [s] Experimental phases Treatment Mean [s] Treatment % Increase/ Reduction N Mileage [km] Motorway ,996

9 Fuel consumption [l/100km] TESTING OF HYPOTHESES FOR ACC FUEL CONSUMPTION 8,5 Baseline Treatment 8,0 7,5 7,0 6,5 6,0 Baseline Experimental phases Treatment Baseline Treatment % Increase/ Mileage Conditions Mean Mean N Reduction [km] [l/100 km] [l/100 km] Motorway ,695

10 FESTA & DRIVE C2X Sami Koskinen, VTT FOT-Net is a support action co-funded by the European Commission to network FOT activities at European, national and international level.

11 THE FIRST PHASES OF DRIVE C2X Emphasize to all that FOTs are largescale user tests How many are familiar with FOT methodology? We organised experienced task forces to watch over subtopics Having FOT experts enabled the first phases of FESTA V, e.g. the research question process, to complete quickly 11

12 PILOTING A lot of FESTA-like discussion on benefits of controlled testing vs. naturalistic and importance of video The need to control execution of scenarios In the end, co-op scenarios not necessarily so different from conventional test setups Pilot analysis: how much data is actually needed, who has time? We concentrated on validation, created SW. FESTA could cover validation in more detail? 12

13 COLLECTING USABLE DATA A large effort to get from we ll log huge amounts of data to logging validated high quality data, in formats and size easier to analyse, adding annotations & observations and documenting tests Concentrated in test & data documentation, what we called plainly metadata: test plan, groups, who s driving at what time, national traffic data etc. 13

14 CONCLUSIONS ON PREPARING DATA FESTA doesn t warn strongly enough about required time to prepare data validate, import into database, fix speed limit data, convert data into common formats, write metadata, detect events, calculate indicators, check plausibility and outliers It takes 1-4 months just for the test site to provide all required files and tables. General expectation for this: a week or even while the FOT is running. Re-use cases may lack documentation. Skipping data preparation steps would mean achieving only partial analyses 14