Marie Curie Action Initial Training Networks (ITNs) Call: FP7-People ITN Deadline: 7th May The Evaluation process

Transcription

1 Marie Curie Action Initial Training Networks (ITNs) Call: FP7-People ITN Deadline: 7th May 2007 The Evaluation process

2 Marie Curie Action Initial Training Network (ITNs) A total of 905 Outline Proposals were received on the deadline of 7th May Proposals are evaluated within 8 Panels CHE: 115 proposals (29 experts) LIFE: 230 proposals (73 experts) ENV: 95 proposals (25 experts) ECO-SOC: 21 (ECO) (29 experts) 78 (SOC) ENG: 183 (61 experts together with MAT) MAT: 29 PHY: 152 (39 experts) There are about 256 expert evaluators involved. Some 25 Chairs and Vice-Chairs

3 The role of Chairs and Vice-Chairs. Role of Chairs and Vice-Chairs The Commission has appointed Chairs and Vice-Chairs to assist in the preparation and follow-up of the evaluation process. They will not evaluate any proposal. (1 Chair + 3 to 5 Vice Chairs have been appointed by panel) The Chairs and Vice-Chairs have an important role and a special responsibility for assisting in the management process of the evaluation in order to achieve the highest possible level of quality. Closely working with the Commission officials who are responsible for managing the evaluation process (e.g.: monitoring of the individual evaluation process,...)

4 Evaluation process: Timetable Initial Training Networks (ITNs) Timetable 4 June Experts briefing in Brussels (ECO-SOC, MAT and ENG) 5 June: launch of Remote evaluation 11 June Experts briefing in Brussels (CHE, ENV, LIF, PHY) 12 June: launch of Remote evaluation. Deadline for remote evaluation: 21 June (ECO-SOC, MAT, ENG) 28 June (CHE, ENV, LIF and PHY) Consensus meetings in Brussels: 2-4 July (ECO-SOC) 4-6 July (MAT, ENG) July (CHE, ENV, LIF, PHY)

5 Evaluation process: Timetable Initial Training Networks (ITNs) Timetable 11 June Experts briefing in Brussels (CHE, ENV, LIF, PHY) 12 June: launch of Remote evaluation. Deadline for remote evaluation: 28 June (CHE, ENV, LIF, PHY) Consensus meetings in Brussels: July (CHE, ENV, LIF, PHY)

6 Remote evaluation Before Starting your remote evaluation: Again we strongly recommend to read: Work Programme The Guide for applicants The Rules for submission of proposals, and the related evaluation, selection and award procedure (

7 Remote Evaluation Evaluation process: Remote Evaluation (all experts) Remote Evaluation is carried out by experts evaluators at their home or normal place of work. Deadline for remote evaluation has to be respected, any delay in submitting your evaluation will negatively affect the next step. The web-based evaluation support system (RIvET- Remote Individual Evaluation Tool) allows access to the proposals that you have been assigned (average 11 by experts, 3 experts by proposal). Note that the list of proposals that you have been assigned does not necessarily corresponds to the choices that you have expressed in the selection tool. Individual Evaluation Reports (IARs) should be produced in RIvET

8 Guidance for Remote Evaluation Guidance for Remote Evaluation (all experts) A personal login and password to enter the application should be provided to you by ( Very quickly you should accept in the system the proposals that have been allocated to you. Also very quickly, and when first reading a proposal, please assess again whether you have a confict of interest which would affect your ability to impartially evaluate that proposal. Recommended that you read all proposals allocated to you before starting the detailed evaluation. It gives a good overview and it places each proposals within the marking range. Reminder: proposal evaluation is strictly confidential and in accordance with your Confidentiality Declaration, you must not reveal any detail of the evaluation process.

9 Guidance for Remote Evaluation Guidance for Remote Evaluation (all experts) Evaluation form : individual assessment reports (IAR) is the form to assess the proposals against the 2 blocks of criteria (stage 1) and to attribute marks. For each proposal save regularly your assessment using the button «Save as draft» When you consider that you have completed your assessment of a proposal, please Finalise your Individual Assessment Report (IAR) in RIVET. Print a copy which you should bring with you to the evaluation meetings in Brussels (It will be usefull during the consensus meetings when discussing with the other experts).

10 Guidance for Remote Evaluation Guidance for Remote Evaluation (all experts) «Saving as draft» and «Finalise» functions for IAR

11 Guidance for Remote Evaluation Guidance for Remote Evaluation (Rapporteurs) All experts evaluators are also nominated Rapporteur for some of the proposals they have evaluated. The role of the Rapporteur is to lead the consensus discussions during the evaluation week in Brussels and therefore to produce the Consensus and Evaluation Summary Report. At remote evaluation stage once all «IARs» have been finalised the nominated rapporteur is requested to confer with the Panel Moderator (Commission Project Officer) and generate the «Draft Consensus Report» in RIvET. Generated the draft consensus report simply collates, in one document, all individual experts comments and marks for each block of criteria and calculates corresponding average marks.

12 Guidance for Remote Evaluation Guidance for Remote Evaluation (Rapporteurs) Draft consensus reports are automatically produce using the options: create CR create from average including experts comments apply and then Save as draft Print a copy of CR and bring it with you to the evaluation meetings in Brussels. You maysave this document in Word on a memory stick to facilitate editing of the consensus report in Brussels since RIvET is not providing a spell-check.

13 Guidance for Remote Evaluation Guidance for Remote Evaluation (Rapporteurs) IMPORTANT: do not produce the draft consensus report untill the «Panel Moderator» (Commission Project Officer) asks you to do it. Indeed, during remote evaluation, Panel Moderators assisted by the Chairs and the Vice Chairs will monitor progress of evaluation and in particular a quality of Individual Assessment Reports in order to: identify any incoherence between marks and comments or any other types of anomalies caused by misunderstanding of the ITN scheme (use of statistics: low/high markers, matching pairs, proposals not following marking range) allow possible adjustment before consensus meetings. At consensus meetings the statistics of each experts will be provided and distributed to all other experts.

14 Consensus Meetings in Brussels Initial Training Networks (ITNs) Consensus meetings Meetings will be organised according to «Panels» Introductory meeting with the aim to further clarify as needed any aspects of the procedure. Scheduling of all meetings will be distributed. Parallel Consensus Discussion meetings, rapporteurs will be responsible to lead consensus discussions. Where necessary meetings will be attended by a Commission staff or a Chair or a Vice Chair. The «Consensus Report»(CRs): the Rapporteur s role will be crucial in ensuring that CRs are of high quality. A plenary panel meeting aimed at approving the ranked list. A short briefing on evaluation stage 2 will be given by the Commission services.