 | |
| PEDA1234-1 | Designing Standardised tests and questionnaires
 |
|
| Duration : | 15h Th, 15h Pr |
|
| Credits/ECTS : |
|
|
| Holder(s) : | Jean‑Luc Gilles |
|
| Language : | Langue française |
|
| Course contents : | Attention: the course is not organized in 2007-2008 but will start again in 2008-2009.
The aim of this course is to train the students to elaborate standardized tests (among which level of achievement tests) and context questionnaires.
The method proposed for the elaboration of the tests is the Quality Management Cycle for Standardized Tests Construction (CGQTS) (Gilles & Leclercq, 1996; Gilles, 2002; Gilles & al., 2004).
This method is instrumented with an open source platform entitled exAMS (http://www.dgie.ulg.ac.be/index.php?page=exams&lang=gb resulting from the research ")electronic Construction & Quality Control in standardized testing" (e-C&QCST) (Gilles & al., 2005).
Each student will also be trained inside this course to the use of the exAMS platform accessible via the Internet. |
|
| Course objective : | The students are trained:
- To analyze and build the theoretical framework of a standardized test: to select competencies, processes or aspects to assess, to articulate a test with a competencies system of reference;
- To realize the "design" of a standardized test according to the previous analysis;
- To respect the technical rules and the recommendations in items and in questionnaires construction ;
- To create trainings, when the context of the test requires it;
- To prepare and manage the delivering of an electronic or paper-pencil standardized test;
- To set up the adequate analyses to evaluate edumetric qualities of the tests;
- To interpret the results of these analyses and to draw the conclusions for the revision of the tools ;
- To elaborate a report interpreting the results of the managed tests;
- To create personalized and diagnostic feedbacks bringing to light the strengths and the weaknesses of the trainees;
- To analyze the standardized testing process in order to control and regulate it for the next cycle of construction. |
|
| Prerequisites : | None. |
|
| Workshops : | Theory and practical aspects of the course are not separated.
Read "Organization". |
|
| Organization : | The course is made on the basis of the problem based learning approach. After some hours of theory, the students have to build themselves, in group, a pedagogical standardized test and pass by the successive steps of construction of a standardized test (CGQTS cycle). According to the difficulties and problems, deepenings are considered with the students.
Within the framework of this course, the students are coached by docimologists of the firm Assess-Group S.A. (http://www.assess-group.be/ (spin off of the University of Liege) and of the USLR )SMART (http://www.smart.ulg.ac.be.) |
|
| Written notes : | Book advised:
- Nitko, A. (2006). Educational Assessment of Students, Columbus, Ohio : Merrill Prentice Hall (first edition: 1996). |
|
| Assessment : | The assessment of the students will be proposed on the basis of:
(1) An open book written test (50% of the final score) with comprehension and analyse questions. This test will be composed of:
- 25 multiple choice questions with general implicit solutions, confidence degrees and possibility of short justifications of the answers (trainings will be available before the examination);
- 2 long open end questions about standardized assessments case studies.
(2) A report of the seminar group (50% of the final score). This report will comprise a collective part and a specific part written by each member of the group. |
|
| Contacts : | Contact email: dgie@ulg.ac.be |
|
| Remarks : | A platform to support the trainings organized by the unit of General Didactics and Educational Intervention (GDEI/DGIE (http://www.dgie.ulg.ac.be/index.php?page=presentation&lang=gb) is accessible via the Internet. This platform is entitled )DID@CAMPUS (http://www.dgie.ulg.ac.be/didacampus/ and proposes more detailed informations about the courses and seminars:)
www.dgie.ulg.ac.be/didacampus/ (http://www.dgie.ulg.ac.be/didacampus/)
The DID@CAMPUS platform contains a specific part for this course. The students are invited to register in order to obtain:
- last advertisements in relation with the course; - documents and links concerning the concepts explained during the course;
- formative online tests;
- forums of discussion;
-... |
|
