Type evaluation approval with a focus on the implementation of metrological field tests methods

Transcription

1 Type evaluation approval with a focus on the implementation of metrological field tests methods Stéphane Géneau de Lamarlière (France) July 16th 2013 NIST Laboratoire national de métrologie et d essais

2 Contents - LNE presentation - Type evaluation approval in France - Technologies approved and MPE (maximum permissible error) - Steps of type examination : - Technical documentation and instrument examination - Laboratory tests - Field tests (road and track) - Theorical and real duration of type evaluation - Problems encountered in type examination 2

3 LNE, an essential actor An independant body A state-owned company appointed by the French Ministry of Industry to perform a twofold mission: protection of public safety and consumers, and provision of services to the industry A recognized body Notified for over 8 European Directives including the MID and the NAWI Directives in legal metrology Approved by competent ministries to perform tests and verifications on over 90 products covered by regulations Accredited by French accreditation body COFRAC for calibration, tests, certification of products and certification of management systems Over a century of experience providing services to all economic agents concerned with quality and safety issues 3

4 Extensive scientific and technological expertise Research Transfer Tests Calibration Certification standards torque mathematics mechanics physics chemistry dimensions vibration electronics management biology regulations acoustics fields temperature statistics pressure composition mass energy flow Technical assistance Training Information 4

5 Key figures 11 sites France (Paris, Trappes, Toulouse, Nîmes, Saint-Etienne, Poitiers, Chambéry) USA (Washington DC) China (Shanghai, Hong-Kong) Qatar Outstanding resources 800 staff including ¾ of technicians, engineers and researchers m² of laboratory space Extensive network of partners 76 M turnover including 50 M sales 25 M investment over last five years 21% of budget allocated to R&D 5

6 LNE : the French metrology network coordinator Distributed system One pilot and international representative = LNE 4 NMIs + 6 Designated Institutes (associate laboratories) Actors the Pilot / Coordinator : LNE-DRST (LNE s R&D Department) the Laboratories the Metrology Council 6

7 LNE / legal metrology In accordance with French law, LNE is the body appointed by the French Ministry of Industry for several types of control LNE is a French notified body for the 2009/23/CE Directive (non-automatic weighing Instruments) and the 2004/22/CE Directive. LNE is authorized to issue OIML certificates of conformity for 20 categories of instruments. LNE is an issuing authority in the frame of the OIML R60 and R76 MAA DOMC 7

8 LNE / legal metrology the control process Design Manufacturing In use Or Or Type Examination Approval of Quality systems Or First verification or EC verification Subsequent verification Unit verification 37 measuring instrument catégories are regulated in France 8

9 LNE / legal metrology Public services activities Involvement in standardization activities and legal metrology international organizations : OIML : involvement in 14 Technical Committees WELMEC groups : involvement in 6 WG Standardization : CEN, BNPé, Afnor : 12 working groups National working groups (French Bureau of Metrology) Interface with trade associations (syndicat de la mesure, cofip, cecod, cecip ) 9

10 LNE / legal metrology Key figures Each year, the legal metrology activity represents : More than 100 Type Approval 450 audits 1200 audit days 10

11 Contents - LNE presentation - Type evaluation approval in France - Technologies approved and MPE (maximum permissible error) - Steps of type examination : - Technical documentation and instrument examination - Laboratory tests - Field tests (road and track) - Theorical and real duration of type evaluation - Problems encountered in type examination 11

12 Speedmeter Type approval Technologies approved used in France : - automatic speedmeter associated with camera - Doppler (stationary and in motion) - Electromagnetic loops - Average speed (Time/distance) - manual speedmeter : - Laser Maximum permissible error in type approval : - stationary speedmeter : +/- 3 km/h for speed below 100 km/h and +/-3% for speed equal or above 100 km/h - In motion speedmeter : +/- 7 km/h for speed below 100 km/h and +/-7% for speed equal or above 100 km/h 12

13 Steps of type approval Analyse of technical documentation Technical and Administrative Examination of instrument submitted to tests Laboratory tests Tests report Field tests Tests report certification evaluation report and certificate TAE report 13

14 Step 1 - Technical documentation Conformity of the technical documentation including : metrological characteristics, detailed description of operating modes and principles manufacturing drawing and plans of components, general software information and source code, sealings and markings definition and localization Handbook expression of uncertainty in measurement (OIML G1-100) 14

15 Step 2 - Technical examination Conformity of the instrument submitted to laboratory and field tests (Technical and Administrative Examen) with : the technical documentation, the technical requirements of the june 4th 2009 decree : measurement unit (km/h), resolution of 0.1 km/h for in service verification, indication of approaching or receding mode, access to software identification, log event for software metrological parameters, speed selector device, protection against tampering, start autotest, standing aiming device 15

16 Step 3 - Laboratory tests Laboratory tests are the same as defined in OIML D11 : 2004 or OIML R91:1991. Criteria during tests of effects of influence factors : instruments must operate correctly ie correct and legible display and results must be within the MPE. Criteria during tests of disturbances : instruments must also operate properly. However, during the disturbance the instrument could perform no measurement or issue an error message, provided that after stopping the disturbance it operates correctly. Tests are made by LNE accredited laboratory (ISO17025) 16

17 Step 4 - Field tests 1/3 2 types including 2000 measurements for automatic speedmeters and 500 for manual speedmeters : on road with actual traffic on track with specific cars (type and speed) Purpose is to check : compliance with MPE (all over the measuring interval, in night and day conditions, with rain, different types of vehicules, high traffic, in receding and approaching modes.) Effectiveness and conformity of the installation conditions defined in the handbook (left or right side, above the road ) compliance with requirements on photographs Criterion => 0 nonconformity is allowed The interest of field tests rather than laboratory tests is that it allows to test the instrument in real conditions of use (including all complexity factors affecting the result of measurement). 17

18 Step 4 - Field tests 2/3 Road tests : the main road site is a motorway with 4 lanes and important traffic (between 2000 and 3500 vehicules per hour), - Video Track tests (particular configuration, up to maximal length for laser instrument, up to maximal speed ) 3 km length track Annular speed test track 18

19 Step 4 - Field tests 3/3 Reference instruments used (traceable to the SI and with uncertainty less than 1/3 of MPE tested instrument) : - HADER (Doppler) and LNE video tool - Video soft analyse - ICARUS (encoder) : distance and time between 2 points and instantaneous speed measurement - ARMI (two laser barriers to determine average speed measurement) 19

20 Theorical and real (based on experience) time of type examination Analyse of technical documentation Technical and Administrative Examen of instrument submit to tests Laboratory tests Field tests certification Theorical duration Real duration 1 month 1 month 1 month 15 days At least twice longer due to problems encountered described here after 20

21 Problems encountered 1/4 During technical and administrative examination : - incomplete documentation (no source code, no sufficient description, wrong incertainty determination ) - The 4 parts of the OIML guide G1-100 : - Modelling the measurement - Evaluating standard uncertainty (type A or B) - Determining combined standard uncertainty (correlated or uncorrelated input quantities) - Determining expanded uncertainty (coverage factor) - Technical requirements not fulfilled (no speed selector device, no standing aiming device...) During laboratory tests : failed tests (EMC, temperature ) 21

22 Problems encountered 2/4 During field tests : MPE not respected with specific vehicule due to wrong algorithm : - in approaching or receding mode - when distance measurement is close to max Speedmeter under test : 94 km/h Reference instrument : 89.1 km/h MPE : +/- 3km/h 22

23 Problems encountered 3/4 Wrong association of measurement data : Speedmeter under test : km/h Reference instrument : km/h Speed measurement stored in the file : 89 km/h 23

24 Problems encountered 4/4 Other cases not illustrated: - wrong picture framing resulting in wrong vehicule identification (zoom lens too high for exemple), - measured vehicule hidden by another vehicule (truck for exemple), - wrong mechanical fastening camera resulting in wrong vehicule identification, - measurement instrument providing results of speed lower than the value of the speed selector device (in case of speed meter associated with camera), - Eccho phenomenon resulting in wrong vehicule identification, - 24

25 R91 End Thank you for your attention 25