10-08 Analysis of Measurement instruments

introduction to Classical test theory, item response models and structural equation modeling

Tutors

Prof. Dr. Cees Glas, Dr. Hans Vos, Drs. Wim Tielen.

Maximum number of participants

25

Requirements

Knowledge of statistics and methodology in the field of the behavioral and social sciences

Literature

Various texts will be supplied.

Work method

Every session consists of a lecture of approximately 2.5 hours and a computer workshop of approximately 3 hours.

Contents

In general, the course provides an overview of classical and modern test theory discusses the coherence of the various theories and deals with the application of test theory for developing and evaluating measurement instruments for the social sciences.

Lecture 1 Introduction

  • Subjects Overview of classical test theory, generalizability theory and item response theory, the relation between the various approaches and some important applications such as evaluation of reliability and validity, item analysis, test equating, and optimal test construction
  • Workshop 1 Reliability Analysis, the MIRT package.
  • Literature Basic elements of educational measurement, Measurement models in assessment and evaluation, Applications of measurement models, Chapters 6, 7 and 8 from J. Scheerens, S. Thomas, & C.A.W. Glas. Educational evaluation and monitoring: A systemic approach. Swets and Zeitlinger Publishers.

Lecture 2 Item Response Theory

  • Subjects Applications of IRT: test equating, adaptive testing, and analysis of item bias (differential item functioning, DIF).
  • Workshop 2 Test equating and DIF analysis using the MIRT package.
  • Literature As for Lecture 1.

Lecture 3 Introduction to structural equation modeling (SEM)

  • Subjects Overview and pros and cons of different approaches such as split ballot experiments, test-retest designs, simplex models, MTMM models and split ballot MTMM design
  • Workshop 3 Measurement models for survey questions, LISREL
  • Literature Various articles

Lecture 4 Multilevel IRT and SEM models

  • Subjects Introduction to general multilevel models
  • Practice 4 Multilevel Factor analysis and SEM with the Lisrel package, Multilevel IRT with the MIRT package.
  • Literature articles

Dates

May 18, 19, 25, and 26 2010

Registration

The deadline for registration for this course is April 6, 2010.
Before you register, please read our regulations for registration.
To register, please go to our registration form.

Comments