Change search
ReferencesLink to record
Permanent link

Direct link
To use or not to use a teacher support program
KTH, School of Education and Communication in Engineering Science (ECE), Learning.ORCID iD: 0000-0002-6982-7116
(English)Manuscript (preprint) (Other academic)
National Category
Educational Sciences
URN: urn:nbn:se:kth:diva-134212OAI: diva2:665454

QS 2013

Available from: 2013-11-20 Created: 2013-11-20 Last updated: 2013-11-20Bibliographically approved
In thesis
1. Measuring long-term effects of a school improvement initiative
Open this publication in new window or tab >>Measuring long-term effects of a school improvement initiative
2013 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

There is a growing demand for studies applying quantitative methods to large-scale data sets for the purpose of evaluating the effects of educational reforms (UVK, 2010). In this thesis the statistical method, Propensity Score Analysis (PSA), is presented and explored in the evaluating context of an extensive educational initiative within science and technology education; the Science and Technology for All-program (NTA). The research question put forward reads; under what conditions are PSA-analyses a useful method when measuring the effects from a school improvement initiative in S & T?

The study considers the use of PSA when looking for long-term effects that could be measured, what to take into consideration to be able to measure this, and how this could be done. The baseline references (outcome variables) used in order to measure/evaluate the long-term effects from the studied program is students’ achievements in the national test (score and grades) and their grades in year 9. Some findings revealed regarding the object of study (long-term effects from using NTA) are also presented.

The PSA method is found to be a useful tool that makes it possible to create artificial control groups when experimental studies are impossible or inappropriate; which is often the case in school education research. The method opens up for making use of the rich source of registry data gathered by authorities. PSA proves reliable and relatively insensitive to the effects of covariates and heterogeneous effecter if the number of samples is large enough. The use of PSA (or other statistical methods) also makes it possible to measure outcomes several years after treatment. There are issues of concern when using PSA. One is the obvious demand for organized collection of measurement data. Another issue of concern is the choice of outcome variables. In this study the chosen outcome variables (pupils’ score and grading in national tests and grades in year 9) open up for discussions regarding aspects that might not be reflected/measured in national tests and/or teachers’ grading. Findings regarding the long-term effects from using NTA) show significantly positive effects in physics on test scores (average increase 16.5%) and test grades, but not in biology and chemistry. In this study no significant effects are found for course grades. PSA approach has proved to be a reliable method. There is however a limitation in terms of the method's ability to capture more subtle aspects of learning. A combination of quantitative and qualitative approach when studying long-term effects from educational intervention is therefore suggested.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2013. 56 p.
, Trita-ECE, 2013:02
Propensity Score Analysis (PSA), effect study, quantitative evaluation, educational intervention, compulsory school, Science and Technology for All Initiative, representative sample, non-random selection, multi-level modelling, post-matching multivariate regression
National Category
Educational Sciences
urn:nbn:se:kth:diva-133998 (URN)978-91-7501-928-4 (ISBN)
2013-12-03, Sydöstra Galleriet, Biblioteket, Osquars backe, KTH, Stockholm, 13:00 (Swedish)

QC 20131120

Available from: 2013-11-20 Created: 2013-11-14 Last updated: 2013-11-20Bibliographically approved

Open Access in DiVA

No full text

Search in DiVA

By author/editor
Svärdh, Joakim
By organisation
Educational Sciences

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 23 hits
ReferencesLink to record
Permanent link

Direct link