Format:
1 Online-Ressource (28 Seiten)
ISSN:
0013-1644
,
0013-1644
Content:
Mechanisms causing item nonresponses in large-scale assessments are often said to be nonignorable. Parameter estimates can be biased if nonignorable missing data mechanisms are not adequately modeled. In trend analyses, it is plausible for the missing data mechanism and the percentage of missing values to change over time. In this article, we investigated (a) the extent to which the missing data mechanism and the percentage of missing values changed over time in real large-scale assessment data, (b) how different approaches for dealing with missing data performed under such conditions, and (c) the practical implications for trend estimates. These issues are highly relevant because the conclusions hold for all kinds of group mean differences in large-scale assessments. In a reanalysis of PISA (Programme for International Student Assessment) data from 35 OECD countries, we found that missing data mechanisms and numbers of missing values varied considerably across time points, countries, and domains. In a simulation study, we generated data in which we allowed the missing data mechanism and the amount of missing data to change over time. We showed that the trend estimates were biased if differences in the missing-data mechanisms were not taken into account, in our case, when omissions were scored as wrong, when omissions were ignored, or when model-based approaches assuming a constant missing data mechanism over time were used. The results suggest that the most accurate estimates can be obtained from the application of multiple group models for nonignorable missing values when the amounts of missing data and the missing data mechanisms changed over time. In an empirical example, we furthermore showed that the large decline in PISA reading literacy in Ireland in 2009 was reduced when we estimated trends using missing data treatments that accounted for changes in missing data mechanisms.
Content:
Peer Reviewed
Note:
This publication is with permission of the rights owner freely accessible due to an alliance licence and a national licence (funded by the DFG, German Research Foundation) respectively.
In:
Thousand Oaks, Calif. [u.a.] : SAGE Publications, 79,4, Seiten 699-726, 0013-1644
Language:
English
DOI:
10.1177/0013164419829196
URN:
urn:nbn:de:kobv:11-110-18452/25311-6
URL:
Volltext
(kostenfrei)
