Events
2013
24-25 January 2013
Expert meeting “Constructing and validating language tests linked to the Common European Framework of Reference for Languages (CEFR)” (RelEx)
Venue: ECML, Graz, Austria
Coordinator: José Noijons, The Netherlands
Participants: project team
26-28 February 2013
“Constructing and validating language tests linked to the Common European Framework of Reference for Languages (CEFR)” (RelEx)
Venue: Tallinn, Estonia
Experts: José Noijons, The Netherlands; Gábor Szabó, Hungary
Local organiser: Kersti Sõstar, The National Examinations and Qualifications Centre, Estonia
Participants: Item writers, tests and curriculum specialists
information from the local organiser
José Noijons and Gábor Szabó, ECML consultants ran a 3-day workshop Constructing and Validating Language Tests linked to the CEFR (mainly focusing on FL year-9 examinations at the end of lower secondary education) at the Language Centre of the Innove Foundation in Tallinn on February 26–28, 2013.
The number of participants was 14, among who were experienced language testers with different foreign language backgrounds, and staff members who were relatively new to the area of language testing. The Centre’s psychometrician also participated in the workshop. Although the consultants were impressed by participants’ knowledge of and experience in many facets of language testing, and by their motivation to improve the existing examinations, and by the fact that many of the studies on these topics published by the Council of Europe had been translated into the Estonian language (such as the CEFR, the Manual on relating language examinations to the CEFR, and some of its appendices), it was still very useful to get some feedback from the external experts. The consultants together with the participants identified a number of issues that would need extra attention in the process of producing valid examinations, possibly linked to the CEFR. After the workshop the participants were eager the support by the ECML to be continued: in the form of feedback on new versions of the examinations, specifically the L2 examinations; support on linking the examinations, specifically the benchmarking and standard-setting procedures and on external validation of these linking procedures.
25-27 March 2013
“Constructing and validating language tests linked to the Common European Framework of Reference for Languages (CEFR)”: workshop
Venue: Zagreb, Croatia
Experts: Jana Berešová, Slovak Republic; Gábor Szabó, Hungary
Local organiser: Dubravka Kovačević, ETTA, Croatia
Participants: primary and secondary language teachers; Education and Teacher Training Agency advisors
Project site
Information from the moderating experts
In March 2013, an ECML Training and Consultancy event took place in Zagreb, Croatia, aimed at providing an opportunity for Croatian primary school teachers to become more familiar with language testing principles and practices. Based on the local needs and requirements, the workshop focused on familiarization with the CEFR, constructing and assessing tests measuring the productive skills, as well as on how such tests can be linked to the CEFR. Participants had the chance to listen to presentations as well as to be actively engaged in hands-on activities as part of the three-day workshop.
Discussions included issues that were related to the development of assessment instruments in primary schools, making it possible for participants to implement the results of the workshop immediately. Also, participants are likely to disseminate information in their respective professional environments in the future, making the impact of the workshop even more significant.
With the Training and Consultancy program it is possible for member states to utilize the cooperation with the ECML in a variety of language assessment projects to the fullest, by shaping the format and content to meet local needs and expectations to the greatest extent.
3-4 April 2013
Expert meeting “Constructing and validating language tests linked to the Common European Framework of Reference for Languages (CEFR)” (RelEx)
Venue: ECML, Graz, Austria
Participant: José Noijons, The Netherlands
23-24 april 2013
Expert meeting “Relating language examinations to the common European reference levels of language proficiency: promoting quality assurance in education and facilitating mobility (RelEx - RELANG)”
Venue: ECML, Graz, Austria
Coordinator: José Noijons, The Netherlands
Participants: project team
19-21 June 2013
“Constructing and validating language tests linked to the Common European Framework of Reference for Languages (CEFR)”: expert meeting
Venue: Vilnius, Lithuania
Experts: José Noijons, The Netherlands; Gábor Szabó, Hungary
Local organiser: Stase Skapiené, Ministry of Education and Science, Lithuania
Participants: language teachers
Project site
26-28 June 2013
“Constructing and validating language tests linked to the Common European Framework of Reference for Languages (CEFR)”
Venue: Nicosia, Cyprus
Experts: Gilles Breton, France; José Noijons, The Netherlands
Local organiser: Sotiria Hadjichristofi-Neocleous, Ministry of Education and Culture, Cyprus
Participants: language teachers
Project site
13-15 August 2013
“Constructing and validating language tests linked to the Common European Framework of Reference for Languages (CEFR)”: workshop
Venue: Reykjavík, Iceland
Experts: Jana Berešová, Slovak Republic; Gilles Breton, France
Local organiser: Eyjólfur Már Sigurdsson, University of Iceland Language Centre, Governing Board member and National nominating authority of the ECML in Iceland
Participants: language teachers on lower and upper secondary as well as tertiary level
Project site
2012
6-8 June 2012
Expert meeting “Constructing and validating language tests linked to the Common European Framework of Reference for Languages (CEFR)” (RelEx)
Venue: ECML, Graz, Austria
Coordinator: José Noijons, The Netherlands
Participants: project team
5-6 September 2012
“Constructing and validating language tests linked to the Common European Framework of Reference for Languages (CEFR)”
Venue: ECML, Graz, Austria
Coordinator: José Noijons, The Netherlands
Co-animators: Jana Bérešová, Slovak Republic; Gilles Breton, France; Gábor Szabó, Hungary
Participants: 1 representative of each of the following ECML member States: Croatia, Cyprus, Czech Republic, Estonia, Iceland, Lithuania
Website: RelEx
27-28 September 2012
“Constructing and validating language tests linked to the Common European Framework of Reference for Languages (CEFR)”
Venue: Nicosia, Cyprus
Experts: Gilles Breton, France; José Noijons, The Netherlands
Local organiser: Sotiria Hadjichristofi-Neocleous, Ministry of Education and Culture, Cyprus
Participants: teachers
Project site: Relex
Information from the moderating experts
As part of its 2012-2015 programme “Learning through languages” the ECML now offers training and consultancy that is targeted at specific language issues in its member states. In this context the Cyprus Ministry for Education and Culture requested support for a revision of its state examinations of English at CEFR-level B2. Two members of the RelEx project - Constructing and validating language tests linked to the CEFR – have given a two-day workshop during which general language-testing issues such as validity, reliability, fairness, equity and other ethical considerations have been related to the present state examinations of English.
At a more technical language-testing level, the quality of the present tasks and items have been discussed, and proposals for new or adapted formats have been made. As a result a new format for a mock examination has been decided upon. A small group of local testing experts will produce such a mock examination in the coming few weeks. This will then be presented to fellow experts for comments and it will then be presented to the two ECML consultants for their feedback.
It is the intention of the Cyprus Ministry for Education and Culture to introduce the new format for the state examinations of English in the course of the year 2013.
Information from the local organisers
A two-day workshop was organized by the ECML and the Cyprus Ministry of Education and Culture on 27 and 28 September 2012, at the Cyprus Pedagogical Institute, in Nicosia. The training was provided by Jose Noijons and Giles Breton. The participants were administrators, State School English teachers and English teachers who work at the State Institutes of Further Education.
One of the primary aims of the workshop was to evaluate the current English examinations taken at the State Institutes and link them to CEFR. The participants’ examination skills were enhanced by being given supporting tools and carrying out practical tasks in groups that highlighted important issues that arise and are to be taken into account when planning, designing and assessing examination papers. The overall seminar was excellent and to the point. The consultants paid extra attention not to overload the attendees and provided breaks whenever necessary.
Both trainers were excellent in their presentations and analysis in dealing with B2 level testing. They were detailed and when necessary provided explanations and justifications needed in dealing with present examining issues and implementing new strategies. Group work proved especially useful mainly because teachers were given the opportunity to express their opinion.
In general, the knowledge acquired was of great importance and significant inside information with regards to CEFR B2 level testing and examining system was gained.