Our latest publications

• Gin, Brian; Sim, Nicholas; Skrondal, Anders & Rabe-Hesketh, Sophia (2019). A Dyadic IRT Model. arXiv.org.  ISSN 2331-8422.
• Engelhardt, Lena; Naumann, Johannes; Goldhammer, Frank; Frey, Andreas; Wenzel, Franziska; Hartig, Katja & Horz, Holger (2019). Convergent Evidence for the Validity of a Performance-Based ICT Skills Test. European Journal of Psychological Assessment.  ISSN 1015-5759. . doi: 10.1027/1015-5759/a000507
• Reis Costa, Denise & Eklöf, Hanna (2019). IRT Scales for Self-reported Test-Taking Motivation of Swedish Students in International Surveys. Springer Proceedings in Mathematics & statistics.  ISSN 2194-1009.  265, s 53- 63 . doi: 10.1007/978-3-030-01310-3_5
• Trapp, Stefanie; Blömeke, Sigrid & Ziegler, Matthias (2019). The openness-fluid-crystallized-intelligence (OFCI) model and the environmental enrichment hypothesis. Intelligence.  ISSN 0160-2896.  73, s 30- 40 . doi: 10.1016/j.intell.2019.01.009
• Paap, Muirne C. S.; Born, Sebastian & Braeken, Johan (2019). Measurement Efficiency for Fixed-Precision Multidimensional Computerized Adaptive Tests: Comparing Health Measurement and Educational Testing Using Example Banks. Applied psychological measurement.  ISSN 0146-6216.  43(1), s 68- 83 . doi: 10.1177/0146621618765719
• Hautz, Wolf E.; Kämmer, Juliane E.; Hautz, Stefanie C.; Sauter, Thomas C.; Zwaan, Laura; Exadaktylos, Aristomenis; Birrenbach, Tanja; Maier, Volker; Müller, Martin & Schauber, Stefan Kilian (2019). Diagnostic error increases mortality and length of hospital stay in patients presenting through the emergency room. Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine.  ISSN 1757-7241. . doi: doi.org/10.1186/s13049-019-0629-z
• Blömeke, Sigrid & Olsen, Rolf Vegar (2019). Consistency of results regarding teacher effects across subjects, school levels, outcomes and countries. Teaching and Teacher Education : An International Journal of Research and Studies.  ISSN 0742-051X.  77, s 170- 182 . doi: 10.1016/j.tate.2018.09.018
• Freytag, Julia; Stroben, Fabian; Hautz, Wolf E.; Schauber, Stefan Kilian & Kämmer, Juliane E. (2019). Rating the quality of teamwork—a comparison of novice and expert ratings using the Team Emergency Assessment Measure (TEAM) in simulated emergencies. Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine.  ISSN 1757-7241.  27(1) . doi: 10.1186/s13049-019-0591-9
• Zachrisson, Henrik Daae; Janson, Harald & Lamer, Kari (2019). The Lamer Social Competence in Preschool (LSCIP) Scale: Structural Validity in a Large Norwegian Community Sample. Scandinavian Journal of Educational Research.  ISSN 0031-3831.  63(4), s 551- 565 . doi: 10.1080/00313831.2017.1415963
• Rutkowski, Leslie; Svetina, Dubravka & Liaw, Yuan-Ling (2019). Collapsing Categorical Variables and Measurement Invariance. Structural Equation Modeling.  ISSN 1070-5511. . doi: 10.1080/10705511.2018.1547640 Vis sammendrag

  Cross-cultural comparisons of latent variable means demands equivalent loadings and intercepts or thresholds. Although equivalence generally emphasizes items as originally designed, researchers sometimes modify response options in categorical items. For example, substantive research interests drive decisions to reduce the number of item categories. Further, categorical multiple-group confirmatory factor analysis (MG-CFA) methods generally require that the number of indicator categories is equal across groups; however, categories with few observations in at least one group can cause challenges. In the current paper, we examine the impact of collapsing ordinal response categories in MG-CFA. An empirical analysis and a complementary simulation study suggested meaningful impacts on model fit due to collapsing categories. We also found reduced scale reliability, measured as a function of Fisher’s information. Our findings further illustrated artifactual fit improvement, pointing to the possibility of data dredging for improved model-data consistency in challenging invariance contexts with large numbers of groups.

• Frey, Andreas & Hartig, Johannes (2019). Kompetenzdiagnostik, I:  Handbuch Schulpädagogik.  Waxmann Verlag.  ISBN 978-3-8252-8698-9.  Chapter 75.  s 849 - 858
• Luo, Hao; Andersson, Björn Håkan; Tang, Jennifer & Wong, Gloria (2019). Applying Item Response Theory Analysis to the Montreal Cognitive Assessment in a Low-Education Older Population. Assessment (Odessa, Fla.).  ISSN 1073-1911.  s 1- 13 . doi: 10.1177/1073191118821733
• Liu, Yanlou; Xin, Tao; Andersson, Bjørn & Tian, Wei (2019). Information matrix estimation procedures for cognitive diagnostic models. British Journal of Mathematical & Statistical Psychology.  ISSN 0007-1102.  72(1), s 18- 37 . doi: 10.1111/bmsp.12134
• Blömeke, Sigrid; Thiel, Oliver & Jenssen, Lars (2019). Before, During, and After Examination: Development of Prospective Preschool Teachers' Mathematics-Related Enjoyment and Self-Efficacy. Scandinavian Journal of Educational Research.  ISSN 0031-3831.  63(4), s 506- 519 . doi: 10.1080/00313831.2017.1402368 Fulltekst i vitenarkiv.
• Dearing, Eric; Zachrisson, Henrik Daae; Mykletun, Arnstein & Toppelberg, Claudio O (2018). Estimating the Consequences of Norway’s National Scale-Up of Early Childhood Education and Care (Beginning in Infancy) for Early Language Skills. AERA Open.  ISSN 2332-8584.  4(1), s 1- 16 . doi: 10.1177/2332858418756598 Fulltekst i vitenarkiv.
• Matta, Tyler; Rutkowski, Leslie; Rutkowski, David & Liaw, Yuan-Ling (2018). lsasim: an R package for simulating large‑scale assessment data. Large-scale assessments in education.  ISSN 2196-0739.  6(15) Vis sammendrag

  This article provides an overview of the R package lsasim, designed to facilitate the generation of data that mimics a large scale assessment context. The package features functions for simulating achievement data according to a number of common IRT models with known parameters. A clear advantage of lsasim over other simulation software is that the achievement data, in the form of item responses, can arise from multiple-matrix sampled test designs. Furthermore, lsasim offers the possibility of simulating data that adhere to general properties found in the background questionnaire (mostly ordinal, correlated variables that are also related to varying degrees with some latent trait). Although the background questionnaire data can be linked to the test responses, all aspects of lsasim can function independently, affording researchers a high degree of flexibility in terms of possible research questions and the part of an assessment that is of most interest.

• Rutkowski, David; Rutkowski, Leslie & Liaw, Yuan-Ling (2018). Measuring Widening Proficiency Differences in International Assessments: Are Current Approaches Enough?. Educational Measurement: Issues and Practice.  ISSN 0731-1745.  37(4), s 40- 48 . doi: 10.1111/emip.12225 Vis sammendrag

  Participation in international large‐scale assessments has grown over time with the largest, the Programme for International Student Assessment (PISA), including more than 70 education systems that are economically and educationally diverse. To help accommodate for large achievement differences among participants, in 2009 PISA offered low‐performing systems the option of including an easier set of items in the assessment with an aim of providing improved achievement estimates. However, there remains a lack of evidence on the performance of this design innovation. As such, we simulate a design that closely mirrors the PISA 2015 math assessment in order to empirically examine the benefits of including easy items for low‐performing countries. We extend the PISA design to include increased numbers of easy items and items that are easier than currently implemented. Findings show that the current PISA approach provides little advantage compared to a common test for all participants. Our study also demonstrates persistent bias, low coverage rates, and low correlations between generating and estimated proficiency under current designs. Through our simulation we also show that to improve achievement estimation for low performers about half of the items would need to be made significantly easier.

• Spoden, Christian; Frey, Andreas & Bernhardt, Raphael (2018). Implementing three CATs within eighteen months. Journal of Computerized Adaptive Testing.  ISSN 2165-6592.  6(3), s 38- 55 . doi: 10.7333/1809-060338
• Nagy, Gabriel; Nagengast, Benjamin; Frey, Andreas; Becker, Michael & Rose, Norman (2018). A multilevel study of position effects in PISA achievement tests: Student- and school-level predictors in the German tracked school system. Assessment in education : Principles, Policy & Practice.  ISSN 0969-594X. . doi: 10.1080/0969594X.2018.1449100
• Nagy, Gabriel; Nagengast, Benjamin; Becker, Michael; Rose, Norman & Frey, Andreas (2018). Item position effects in a reading comprehension test: An IRT study of individual differences and individual correlates. Psychological Test and Assessment Modeling.  ISSN 2190-0493.  60(2), s 165- 187
• Frey, Andreas; König, Christoph & Spoden, Christian (2018). Special Topic: Advances in Educational Measurement. Psychological Test and Assessment Modeling.  ISSN 2190-0493.  60(2), s 141- 144
• Frey, Andreas; König, Christoph & Spoden, Christian (2018). Special Topic: Advances in Educational Measurement Part II. Psychological Test and Assessment Modeling.  ISSN 2190-0493.  60(3), s 325- 326
• Fink, Aron; Born, Sebastian; Frey, Andreas & Spoden, Christian (2018). A continuous calibration strategy for computerized adaptive testing. Psychological Test and Assessment Modeling.  ISSN 2190-0493.  60(3), s 327- 346
• Frey, Andreas; Spoden, Christian; Goldhammer, Frank & Wenzel, Franziska (2018). Response time-based treatment of omitted responses in computer-based testing. Behaviormetrika.  ISSN 0385-7417.  45, s 505- 526 . doi: 10.1007/s41237-018-0073-9
• Janssen, Jeroen H. M.; Van Laar, Saskia; De Rooij, Mark J.; Kuha, Jouni & Bakk, Zsuzsa (2018). The Detection and Modeling of Direct Effects in Latent Class Analysis. Structural Equation Modeling.  ISSN 1070-5511.  26(2), s 280- 290 . doi: 10.1080/10705511.2018.1541745
• Avian, Alexander; Messerer, Brigitte; Frey, Andreas; Meissner, Winfried; Weinberg, Annelie; Ravekes, William & Berghold, Andrea (2018). Scaling properties of pain intensity ratings in paediatric populations using the Faces Pain Scale-revised: Secondary analyses of published data based on the item response theory. International Journal of Nursing Studies.  ISSN 0020-7489.  87, s 49- 59 . doi: 10.1016/j.ijnurstu.2018.07.009
• Tveit, Sverre & Olsen, Rolf Vegar (2018). Eksamens mange roller i sertifisering, styring og støtte av læring og undervisning i norsk grunnopplæring. Acta Didactica Norge - tidsskrift for fagdidaktisk forsknings- og utviklingsarbeid i Norge.  ISSN 1504-9922.  12(4) . doi: 10.5617/adno.6381 Fulltekst i vitenarkiv. Vis sammendrag

  Hvilke roller har eksamen i norsk grunnopplæring? I Forskrift til opplæringslova framgår det blant annet at eksamenskarakteren skal fastsette kompetansen til eleven ved slutten av opplæringen i faget. Denne artikkelen viser imidlertid at policydokumenter og policyutviklere har en rekke forventninger til hva man skal oppnå ved å ha eksamen og hva man skal kunne benytte eksamensresultater til. I et samspill mellom teori og empiri identifiser artikkelen tre roller for vurdering: å sertifisere, styre og støtte læring og undervisning. Dette begrepsapparatet brukes til å analysere både eksamens formelt definerte formål, og tilsiktede og utilsiktede funksjoner ved eksamenssystemet. Artikkelen baserer seg på tre typer historiske data: (i) Stortingsmeldinger, (ii) Utdanningsdirektoratets årlige rapporter, Utdanningsspeilet, samt (iii) ekspertintervjuer gjennomført i 2013 med en statssekretær og en seniorrådgiver i Kunnskapsdepartementet, og direktøren og en avdelingsdirektør i Utdanningsdirektoratet. I tillegg er det gjort en analyse av gjeldende bestemmelser, slik de kommer til uttrykk i Forskrift til opplæringslova og Rammeverket for eksamen av 2017. Artikkelen avdekker manglende avklaringer av eksamens formål og peker på at dette kan føre til at politikere og andre policyutviklere forvalter og videreutvikler eksamenssystemet på sviktende grunnlag. Videre kan det føre til at Utdanningsdirektoratet, Fylkesmannen og andre tilsynsmyndigheter, skoleeiere, skoleledere, lærere, foreldre og elever bruker eksamensdata på uheldige måter. Artikkelen konkluderer med at lovverk, forskrift og rammeverk for eksamen bør gjennomgås og endres til eksplisitt å uttrykke de rollene eksamen skal fylle og ikke. Slik kan man få et bedre utgangspunkt for å utvikle eksamensprøver og sikre hensiktsmessig bruk av eksamensresultater både nasjonalt og lokalt.

• Blömeke, Sigrid & Olsen, Rolf Vegar (2018). På vei mot et sammenhengende nasjonalt kvalitetsvurderingssystem. Acta Didactica Norge - tidsskrift for fagdidaktisk forsknings- og utviklingsarbeid i Norge.  ISSN 1504-9922.  12(4) . doi: http://dx.doi.org/10.5617/adno.6278 Vis sammendrag

  Artikkelen presenterer de mest sentrale verktøyene for kvalitetsmonitorering som har blitt innført som en del av det «Nasjonale kvalitetsvurderingssystemet for grunnopplæringen» (de nasjonale prøvene, kartleggingsprøvene og elev-undersøkelsen), i all hovedsak ut fra et perspektiv om at dette er målinger som skal bidra med informasjon til skoler, skoleeiere og nasjonale beslutningstakere. Gjennom beskrivelsen legger vi et grunnlag for en drøfting av seks forhold som vi foreslår som spesielt viktige for å videreutvikle det nasjonale kvalitetsvurderingssystemet. Hovedkonklusjonen fra denne drøftingen er at norsk skole har utviklet mange målinger som hver for seg i stor grad har god kvalitet. Det legges imidlertid ikke til rette for en helhetlig analyseramme som gjør det mulig å se de ulike målingene i sammenheng med hverandre, og som i sterkere grad vektlegger et utviklingsperspektiv.

• Liaw, Yuan-Ling; Wu, Yuanyue; Rutkowski, David & Rutkowski, Leslie (2018). Evaluating PISA scales across Chinese economies. Asia Pacific Journal of Education.  ISSN 0218-8791.  38(3), s 432- 451 . doi: 10.1080/02188791.2018.1491388
• Nilsen, Trude & Blömeke, Sigrid (2018). Lærerkvalitet, undervisningskvalitet, -kvantitet og prestasjon: Analyser av TIMSS 2015 data i naturfag på barnetrinnet, I: Julius Kristjan Björnsson & Rolf Vegar Olsen (red.),  Tjue år med TIMSS og PISA i Norge: Trender og nye analyser.  Universitetsforlaget.  ISBN 978-82-15-03006-7.  3.  s 57 - 74
• Hoth, Jessica; Kaiser, Gabriele; Döhrmann, Martina; König, Johannes & Blömeke, Sigrid (2018). A situated approach to assess teachers‘ professional competencies using classroom videos, In Orly Buchbinder & Sebastian Kuntze (ed.),  Mathematics Teachers Engaging with Representations of Practice: A dynamically evolving field.  Springer Publishing Company.  ISBN 978-3-319-70593-4.  2.  s 23 - 45
• Döhrmann, Martina; Kaiser, Gabriele & Blömeke, Sigrid (2018). The Conception of Mathematics Knowledge for Teaching from an International Perspective: The Case of the TEDS-M Study, In Yeping Li & Rongjin Huang (ed.),  How Chinese Acquire and Improve Mathematics Knowledge for Teaching.  Brill Academic Publishers.  ISBN 978-94-6351-236-7.  4.  s 57 - 82
• Yang, Xinrong; Kaiser, Gabriele; König, Johannes & Blömeke, Sigrid (2018). Measuring Chinese teacher professional competence: adapting and validating a German framework in China. Journal of Curriculum Studies.  ISSN 0022-0272.  50(5), s 638- 653 . doi: 10.1080/00220272.2018.1502810
• Gustafsson, Jan-Eric & Blömeke, Sigrid (2018). Development of School Achievement in the Nordic Countries During Half a Century. Scandinavian Journal of Educational Research.  ISSN 0031-3831.  62(3), s 386- 406 . doi: 10.1080/00313831.2018.1434829
• Nilsen, Trude; Björnsson, Julius Kristjan & Olsen, Rolf Vegar (2018). Hvordan har likeverd i norsk skole endret seg de siste 20 årene?, I: Julius Kristjan Björnsson & Rolf Vegar Olsen (red.),  Tjue år med TIMSS og PISA i Norge: Trender og nye analyser.  Universitetsforlaget.  ISBN 978-82-15-03006-7.  7.  s 150 - 172 Vis sammendrag

  Likeverd er et viktig aspekt ved norsk skole, og forskjeller i prestasjoner knyttet til hjemmebakgrunn er små i Norge sett i et internasjonalt perspektiv. Likevel er det mye som tyder på at dette kanskje er i ferd med å endres. Denne studien ser på hvordan likeverd har endret seg i løpet av 20 år, og bruker data fra TIMSS (4. og 8. trinn) og PISA (10. trinn) fra 1995 til 2015. Prestasjonsforskjeller mellom skoler (variansen) er stigende gjennom perioden for to av de tre trinnene, men har en nedgang i siste runde i 2015. Samtidig viser det overordnede bildet at spredningen i prestasjoner synker, for så å øke i siste del av perioden. Dersom man sammenligner PISA og TIMSS når det gjelder sammenhengen mellom elevers hjemmebakgrunn og prestasjoner, er ikke mønsteret så tydelig. På 8. trinn i TIMSS har sammenhengen mellom hjemmebakgrunn og prestasjoner på skolenivå doblet seg. Den totale sammenhengen øker kun svakt i TIMSS i perioden, men er uendret i PISA.

• Olsen, Rolf Vegar & Blömeke, Sigrid (2018). Hva forklarer endringer i elevenes matematikkprestasjoner over tid?, I: Julius Kristjan Björnsson & Rolf Vegar Olsen (red.),  Tjue år med TIMSS og PISA i Norge: Trender og nye analyser.  Universitetsforlaget.  ISBN 978-82-15-03006-7.  6.  s 128 - 149 Vis sammendrag

  TIMSS-undersøkelsene har vist at norske elever på 4. og 8. trinn har hatt en framgang i matematikk- og naturfagprestasjoner siden 2003. Dette kom etter en tilsvarende stor tilbakegang fra 1995 til 2003. I dette kapitlet presenteres en analyse hvor endringen i gjennomsnittlig matematikkskår for 8. trinn fra 2003 til 2015 blir knyttet til endringer for 22 bakgrunnsvariabler. Generelt kan endringer i elevprestasjoner knyttes til flere fundamentalt ulike kilder: Sammensetningen av elevkohortene kan endre seg, undervisningens innhold og kvalitet kan endre seg, og sammenhengene mellom bakgrunnsfaktorer og prestasjoner i matematikk kan endre seg over tid. Gjennom å anvende Oaxaca-Blinder-dekomponering (OBD) kan slike mulige bidrag til framgangen separeres og tallfestes. Analysen gir ikke et entydig bidrag til å forstå den store framgangen. Et funn som kan framheves, er at faktorer knyttet til elevenes selvfølelse og trivsel framstår som viktige.

• Olsen, Rolf Vegar & Björnsson, Julius Kristjan (2018). Fødselsmåned og skoleprestasjoner, I: Julius Kristjan Björnsson & Rolf Vegar Olsen (red.),  Tjue år med TIMSS og PISA i Norge: Trender og nye analyser.  Universitetsforlaget.  ISBN 978-82-15-03006-7.  4.  s 76 - 93 Vis sammendrag

  I Norge går alle barn født det samme året på samme klassetrinn, med veldig få unntak. Dette betyr at forskjell i alder kan være bortimot tolv måneder på det samme trinnet. I idrett og utdanning viser eksisterende litteratur at generelt presterer de eldste på trinnet vesentlig bedre enn de yngste. Hensikten med denne studien er å bruke norske data fra TIMSS og PISA gjennom 20 år for å se om denne effekten (relativ alderseffekt – RAE) har endret seg over tid, og hvordan den varierer etter klassetrinn og alder. Studien bruker en såkalt regresjons-diskontinuitetsanalyse for å se på effekten over to klassetrinn, og resultatene indikerer at effekten er omtrent 60 % av effekten av et helt skoleår. RAE er to ganger større blant de yngste elevene (4. og 5. trinn) enn de eldste (8. og 9. trinn), men analysene viser at forholdet mellom effekten av et år på skolen og RAE er den samme i begge aldersgruppene. Resultatene er diskutert, og diverse implikasjoner av dem er omtalt.

• Olsen, Rolf Vegar & Björnsson, Julius Kristjan (2018). Tjue år med internasjonale skoleundersøkelser i Norge: Bakgrunn, læringspunkter og veien videre, I: Julius Kristjan Björnsson & Rolf Vegar Olsen (red.),  Tjue år med TIMSS og PISA i Norge: Trender og nye analyser.  Universitetsforlaget.  ISBN 978-82-15-03006-7.  1.  s 12 - 34 Vis sammendrag

  TIMSS 1995 kan regnes som den første internasjonale undersøkelsen av sitt slag, og i de mer enn 20 årene som har gått, har vi sett en framvekst av flere og mer varierte internasjonale undersøkelser. I dette kapitlet gir vi en bakgrunn for resten av boka ved å beskrive noen typiske kjennetegn ved de internasjonale undersøkelsene, og vi beskriver hvordan disse undersøkelsene spesielt legger til rette for to typer sammenlikninger – mellom land og over tid; to referanserammer som på hver sine måter gir nyttige linser for å tolke resultater. Vi presenterer også det vi mener er de mest sentrale funnene for norsk skole gjennom disse 20 årene, og på tvers av de ulike undersøkelsene. Sammenlikninger over tid viser at norsk skole har vært preget av en nedgang etterfulgt av en oppgang, og vi ser at læringsmiljø og skoleklima rapporteres å være betydelig bedre enn tidligere. Sammenlikninger med andre viser at norsk skole er preget av relativt små forskjeller: mellom skoler, mellom kjønn (med lesing som unntak) og mellom elever med ulik hjemmebakgrunn. Vi avrunder kapitlet med å foreslå hvordan undersøkelsene kan endre design for å styrke gyldigheten til sammenlikninger innenfor begge disse to referanserammene.

• Scherer, Ronny; Siddiq, Fazilat & Sánchez Viveros, Bárbara (2018). The Cognitive Benefits of Learning Computer Programming: A Meta-Analysis of Transfer Effects. Journal of Educational Psychology.  ISSN 0022-0663. . doi: 10.1037/edu0000314 Vis sammendrag

  Does computer programming teach students how to think? Learning to program computers has gained considerable popularity, and educational systems around the world are encouraging students in schools and even children in kindergartens to engage in programming activities. This popularity is based on the claim that learning computer programming improves cognitive skills, including creativity, reasoning, and mathematical skills. In this meta-analysis, we tested this claim performing a 3-level, random-effects meta-analysis on a sample of 105 studies and 539 effect sizes. We found evidence for a moderate, overall transfer effect (g = 0.49, 95% CI [0.37, 0.61]) and identified a strong effect for near transfer (g = 0.75, 95% CI [0.39, 1.11]) and a moderate effect for far transfer (g = 0.47, 95% CI [0.35, 0.59]). Positive transfer to situations that required creative thinking, mathematical skills, and metacognition, followed by spatial skills and reasoning existed. School achievement and literacy, however, benefited the least from learning to program. Moderator analyses revealed significantly larger transfer effects for studies with untreated control groups than those with treated (active) control groups. Moreover, published studies exhibited larger effects than gray literature. These findings shed light on the cognitive benefits associated with learning computer programming and contribute to the current debate surrounding the conceptualization of computer programming as a form of problem solving. (PsycINFO Database Record (c) 2018 APA, all rights reserved)

• Pankow, Lena; Kaiser, Gabriele; König, Johannes & Blömeke, Sigrid (2018). Perception of student errors under time limitation: are teachers faster than mathematicians or students?. ZDM: Mathematics Education.  ISSN 1863-9690.  50(4), s 631- 642 . doi: 10.1007/s11858-018-0945-1
• Liu, Yanlou; Andersson, Björn Håkan; Tao, Xin; Zhang, Haiyan & Wang, Lingling (2018). Improved Wald Statistics for Item-Level Model Comparison in Diagnostic Classification Models. Applied psychological measurement.  ISSN 0146-6216. . doi: 10.1177/0146621618798664
• Nilsen, Trude; Scherer, Ronny & Blömeke, Sigrid (2018). The relation of science teachers' quality and instruction to student motivation and achievement in the 4th and 8th grade: A Nordic perspective, In Nordic Council of Ministers (ed.),  Northern Lights on TIMSS and PISA 2018.  Nordic Council of Ministers:.  ISBN 978-92-893-5565-0.  Chapter 3.  s 61 - 94
• Brinchmann, Ellen Iren; Braeken, Johan & Lyster, Solveig-Alma Halaas (2018). Is there a direct relation between the development of vocabulary and grammar?. Developmental Science.  ISSN 1363-755X.  s 1- 13 . doi: 10.1111/desc.12709
• Yang, Xinrong; Kaiser, Gabriele; König, Johannes & Blömeke, Sigrid (2018). Professional Noticing of Mathematics Teachers: a Comparative Study Between Germany and China. International Journal of Science and Mathematics Education.  ISSN 1571-0068.  s 1- 21 . doi: 10.1007/s10763-018-9907-x
• Paap, Muirne C. S.; Kroeze, Karel A.; Glas, Cees A.W.; Terwee, Caroline B.; van der Palen, Job & Veldkamp, Bernard P (2018). Measuring Patient-Reported Outcomes Adaptively: Multidimensionality Matters!. Applied psychological measurement.  ISSN 0146-6216.  42(5), s 327- 342 . doi: 10.1177/0146621617733954
• Schlesinger, Lena; Jentsch, Armin; Kaiser, Gabriele; König, Johannes & Blömeke, Sigrid (2018). Subject-specific characteristics of instructional quality in mathematics education. ZDM: Mathematics Education.  ISSN 1863-9690.  50(3), s 475- 490 . doi: 10.1007/s11858-018-0917-5
• Karay, Yassin & Schauber, Stefan Kilian (2018). A validity argument for progress testing: Examining the relation between growth trajectories obtained by progress tests and national licensing examinations using a latent growth curve approach. Medical teacher.  ISSN 0142-159X.  40(11), s 1123- 1129 . doi: 10.1080/0142159X.2018.1472370 Fulltekst i vitenarkiv. Vis sammendrag

  Background: Progress testing is a longitudinal assessment that aims at tracking students' development of knowledge. This approach is used in many medical schools internationally. Although progress tests are longitudinal in nature, and their focus and use of developmental aspects is a key advantage, individual students’ learning trajectories themselves play, to date, only a minor role in the use of the information obtained through progress testing. Methods: We investigate in how far between-person differences in initial levels of performance and within-person rate of growth can be regarded as distinct components of students’ development and analyze the extent to which these two components are related to performances on national licensing examinations using a latent growth curve model. Results: Both, higher initial levels of performances and steepness of growth are positively related to long-term outcomes as measured by performance on national licensing examinations. We interpret these findings as evidence for progress tests’ suitability to monitor students’ growth of knowledge across the course of medical training. Conclusions: This study indicates that individual development as obtained by formative progress tests is related to performance in high-stakes assessments. Future studies may put more focus on the use of between-persons differences in growth of knowledge.

• Eliassen, Erik; Zachrisson, Henrik Daae & Melhuish, Edward (2018). Is cognitive development at three years of age associated with ECEC quality in Norway?. European Early Childhood Education Research Journal.  ISSN 1350-293X.  26(1), s 97- 110 . doi: 10.1080/1350293X.2018.1412050
• Scherer, Ronny & Guttersrud, Øystein (2018). Observing the World Through Your Own Lenses – The Role of Perceived Adaptability for Epistemological Beliefs About the Development of Scientific Knowledge. Frontiers in Psychology.  ISSN 1664-1078.  9 . doi: 10.3389/fpsyg.2018.01006 Fulltekst i vitenarkiv.
• Gao, Yizhu; Zhai, Xiaoming; Andersson, Björn Håkan; Zeng, Pingfei & Xin, Tao (2018). Developing a Learning Progression of Buoyancy to Model Conceptual Change: A Latent Class and Rule Space Model Analysis. Research in Science Education.  ISSN 0157-244X.  s 1- 20 . doi: 10.1007/s11165-018-9736-5
• Daus, Stephan; Nilsen, Trude & Braeken, Johan (2018). Exploring content knowledge: Country profile of science strengths and weaknesses in TIMSS. Possible implications for educational professionals and science research.. Scandinavian Journal of Educational Research.  ISSN 0031-3831.  s 1- 19 . doi: 10.1080/00313831.2018.1478882 Fulltekst i vitenarkiv. Vis sammendrag

  This study offers curriculum developers, teachers and science education researchers a fine-grained profile on strengths and weaknesses in specific science domains and topics. The study involved a representative sample of 3844 Norwegian pupils in grade 8. Their responses on 216 TIMSS items in 18 topics from 4 science domains were modelled in a hierarchical item response model. An internal comparison identified topics that were relatively harder or easier compared to other topics for the Norwegian pupils, and an external comparison identified topics that were relatively harder or easier for the Norwegian pupils compared with the average of TIMSS participating countries. Interpretation of the profile necessitates contextualisation; hence, these strengths and weaknesses as well as their plausible explanations and possible implications are discussed from the perspectives of curriculum development, teacher training and science education research.

• Teig, Nani; Scherer, Ronny & Nilsen, Trude (2018). More isn't always better: The curvilinear relationship between inquiry-based teaching and student achievement in science. Learning and Instruction.  ISSN 0959-4752.  56, s 20- 29 . doi: 10.1016/j.learninstruc.2018.02.006 Vis sammendrag

  Previous studies have assumed a linear relationship between inquiry-based teaching and student achievement in science. However this assumption may be questionable. Recent evidence on the effectiveness of inquiry-based teaching has yielded conflicting findings. To test the linearity assumption, the present study investigated the relation between inquiry-based teaching and achievement by taking into account the possible existence of nonlinear relations using Norwegian TIMSS 2015 data. A multilevel structural equation modeling analysis showed that the relationship was curvilinear. Inquiry-based teaching was positively correlated with achievement, but high frequency of inquiry activities was negatively related to achievement. Furthermore, we found that classroom SES did not affect the strength of the relationship between inquiry and achievement. These findings challenge the linearity assumption and contribute to explaining the conflicting evidence in earlier research as well as promote the effectiveness of inquiry-based teaching regardless of students’ socioeconomic backgrounds.

• Daus, Stephan & Braeken, Johan (2018). The sensitivity of TIMSS country rankings in science achievement to differences in opportunity to learn at classroom level. Large-scale assessments in education.  ISSN 2196-0739.  6(1) . doi: 10.1186/s40536-018-0054-1 Fulltekst i vitenarkiv. Vis sammendrag

  Background Fair comparisons of educational systems in large-scale assessments can be made only if the differences in curricula have little impact on the outcomes. This study investigated the sensitivity of science achievement rankings to varying degrees of curriculum implementation in the Trends in International Mathematics and Science Study (TIMSS). Methods Country-specific teacher-reported curriculum implementation profiles across the TIMSS science domains were charted including their within-country variability across the classrooms for 33 participating countries of TIMSS 2015. A sensitivity test compared the original ranking to TIMSS curriculum implementation scenarios (a least-possible, a most-possible, and more realistic country-specific median implementation). Results In contrast to expectations, no support was found for a positive relationship between opportunity to learn and science achievement at the between-country level or the within-country level, with only minor exceptions. The sensitivity analysis under different curriculum implementation scenarios also suggests little impact on the rank order of the countries. Conclusions Plausible explanations for this null finding are addressed; attention and research efforts should focus on improving the quality of curriculum implementation indicators in large-scale assessments.

• Arnesen, Anne; Braeken, Johan; Ogden, Terje & Melby-Lervåg, Monica (2018). Assessing Children’s Social Functioning and Reading Proficiency: A Systematic Review of the Quality of Educational Assessment Instruments Used in Norwegian Elementary Schools. Scandinavian Journal of Educational Research.  ISSN 0031-3831.  s 1- 26 . doi: 10.1080/00313831.2017.1420685 Fulltekst i vitenarkiv.
• Greiff, Samuel & Scherer, Ronny (2018). Complex Problem Solving and Its Position in the Wider Realm of the Human Intellect. Journal of Intelligence.  ISSN 2079-3200.  6(5) . doi: 10.3390/jintelligence6010005 Fulltekst i vitenarkiv.
• Tesema, Melaku Tesfa & Braeken, Johan (2018). Regional inequalities and gender differences in academic achievement as a function of educational opportunities: Evidence from Ethiopia. International Journal of Educational Development.  ISSN 0738-0593.  60, s 51- 59 . doi: 10.1016/j.ijedudev.2017.10.023 Fulltekst i vitenarkiv.
• Scherer, Ronny; Tondeur, Jo; Siddiq, Fazilat & Baran, Evrim (2018). The importance of attitudes toward technology for pre-service teachers' technological, pedagogical, and content knowledge: Comparing structural equation modeling approaches. Computers in Human Behavior.  ISSN 0747-5632.  80, s 67- 80 . doi: 10.1016/j.chb.2017.11.003 Fulltekst i vitenarkiv.
• Nerstad, Christina G. L.; Rosalind, Searle; Černe, Matej; Dysvik, Anders; Škerlavaj, Miha & Scherer, Ronny (2018). Perceived Mastery Climate, Felt Trust, and Knowledge Sharing. Journal of Organizational Behavior.  ISSN 0894-3796.  39(4), s 429- 447 . doi: 10.1002/job.2241 Vis sammendrag

  Interpersonal trust is associated with a range of adaptive outcomes, including knowledge sharing. However, to date, our knowledge of antecedents and consequences of employees feeling trusted by supervisors in organizations remains limited. On the basis of a multisource, multiwave field study among 956 employees from 5 Norwegian organizations, we examined the predictive roles of perceived mastery climate and employee felt trust for employees' knowledge sharing. Drawing on the achievement goal theory, we develop and test a model to demonstrate that when employees perceive a mastery climate, they are more likely to feel trusted by their supervisors at both the individual and group levels. Moreover, the relationship between employees' perceptions of a mastery climate and supervisor‐rated knowledge sharing is mediated by perceptions of being trusted by the supervisor. Theoretical contributions and practical implications of our findings are discussed.

• Strietholt, Rolf & Scherer, Ronny (2018). The Contribution of International Large-Scale Assessments to Educational Research: Combining Individual and Institutional Data Sources. Scandinavian Journal of Educational Research.  ISSN 0031-3831.  62(3), s 368- 385 . doi: 10.1080/00313831.2016.1258729 Fulltekst i vitenarkiv.
• Rutkowski, Leslie & Rutkowski, David (2018). Improving the Comparability and Local Usefulness of International Assessments: A Look Back and A Way Forward. Scandinavian Journal of Educational Research.  ISSN 0031-3831.  62(3), s 354- 367 . doi: 10.1080/00313831.2016.1261044
• Kjøbli, John; Zachrisson, Henrik Daae & Bjørnebekk, Gunnar (2018). Three Randomized Effectiveness Trials — One Question: Can Callous-Unemotional Traits in Children Be Altered?. Journal of Clinical Child & Adolescent Psychology.  ISSN 1537-4416.  47(3), s 436- 443 . doi: 10.1080/15374416.2016.1178123
• Gess, Christoph; Wessels, Ina & Blömeke, Sigrid (2017). Domain-specificity of research competencies in the social sciences: Evidence from differential item functioning. Journal for Educational Research Online.  ISSN 1866-6671.  9(2), s 11- 36 Fulltekst i vitenarkiv.
• Soe-Agnie, S.E.; Paap, Muirne C. S.; VanDerNagel, J.E.L.; Nijman, H.J.M. & de Jong, C.A.J. (2017). The generalizability of the structure of substance abuse and antisocial behavioral syndromes: A systematic review. Psychiatry Research.  ISSN 0165-1781.  259, s 412- 421 . doi: 10.1016/j.psychres.2017.11.007
• Matta, Tyler; Flournoy, John & Byrne, Michelle (2017). Making an unknown unknown a known unknown: Missing data in longitudinal neuroimaging studies. Developmental Cognitive Neuroscience.  ISSN 1878-9293.  33, s 83- 98 . doi: 10.1016/j.dcn.2017.10.001 Fulltekst i vitenarkiv. Vis sammendrag

  The analysis of longitudinal neuroimaging data within the massively univariate framework provides the opportunity to study empirical questions about neurodevelopment. Missing outcome data are an all-to-common feature of any longitudinal study, a feature that, if handled improperly, can reduce statistical power and lead to biased parameter estimates. The goal of this paper is to provide conceptual clarity of the issues and non-issues that arise from analyzing incomplete data in longitudinal studies with particular focus on neuroimaging data. This paper begins with a review of the hierarchy of missing data mechanisms and their relationship to likelihood-based methods, a review that is necessary not just for likelihood-based methods, but also for multiple-imputation methods. Next, the paper provides a series of simulation studies with designs common in longitudinal neuroimaging studies to help illustrate missing data concepts regardless of interpretation. Finally, two applied examples are used to demonstrate the sensitivity of inferences under different missing data assumptions and how this may change the substantive interpretation. The paper concludes with a set of guidelines for analyzing incomplete longitudinal data that can improve the validity of research findings in developmental neuroimaging research.

• Paap, Muirne C. S.; Braeken, Johan; Pedersen, Geir Feigum; Urnes, Øyvind; Karterud, Sigmund; Wilberg, Theresa & Hummelen, Benjamin (2017). A Psychometric Evaluation of the DSM-IV Criteria for Antisocial Personality Disorder: Dimensionality, Local Reliability, and Differential Item Functioning Across Gender. Assessment (Odessa, Fla.).  ISSN 1073-1911. . doi: 10.1177/1073191117745126 Fulltekst i vitenarkiv.
• Petitclerc, Amelie; Côtè, Sylvana; Doyle, Orla; Burchinal, Margaret; Herba, Catherine; Zachrisson, Henrik Daae; Boivin, Michel; Tremblay, Richard E.; Tiemeier, Henning; Jaddoe, Vincent W. & Raat, Hein (2017). Who uses early childhood education and care services? Comparing socioeconomic selection across five western policy contexts. International Journal of Child Care and Education Policy.  ISSN 1976-5681.  11(3) . doi: 10.1186/s40723-017-0028-8
• Cook, Kyle DeMeo; Dearing, Eric & Zachrisson, Henrik Daae (2017). Information Sharing between Teachers and Early Education Programs during School Entry in Norway: Associations with Children's School Adjustment and Success in the First Year. International Journal of Child Care and Education Policy.  ISSN 1976-5681.  11(14) . doi: 10.1186/s40723-017-0039-5 Fulltekst i vitenarkiv.
• Pettersen, Andreas & Braeken, Johan (2017). Mathematical Competency Demands of Assessment Items: a Search for Empirical Evidence. International Journal of Science and Mathematics Education.  ISSN 1571-0068.  s 1- 21 . doi: 10.1007/s10763-017-9870-y Fulltekst i vitenarkiv.
• Hall, Ruby A.S.; Hoffenkamp, Hannah N.; Braeken, Johan; Tooten, Anneke; Vingerhoets, Ad J.J.M. & van Bakel, Hedwig J.A. (2017). Maternal psychological distress after preterm birth: Disruptive or adaptive?. Infant Behavior and Development.  ISSN 0163-6383.  49, s 272- 280 . doi: 10.1016/j.infbeh.2017.09.012 Fulltekst i vitenarkiv.
• Blömeke, Sigrid; Hoth, Jessica & Kaiser, Gabriele (2017). Langtidseffekter av skolegang og lærerutdanning på småskolelæreres kompetanseutvikling :. Acta Didactica Norge - tidsskrift for fagdidaktisk forsknings- og utviklingsarbeid i Norge.  ISSN 1504-9922.  11(3), s 19 . doi: 10.5617/adno.4537 Fulltekst i vitenarkiv.
• Paap, Muirne C. S.; Kroeze, Karel A.; Terwee, Caroline B; van der Palen, Job & Veldkamp, Bernard P (2017). Item usage in a multidimensional computerized adaptive test (MCAT) measuring health-related quality of life. Quality of Life Research.  ISSN 0962-9343.  26(11), s 2909- 2918 . doi: 10.1007/s11136-017-1624-3 Fulltekst i vitenarkiv.
• Engelhardt, Lena; Goldhammer, Frank; Naumann, Justus D & Frey, Andreas (2017). Experimental validation strategies for heterogeneous computer-based assessment items. Computers in Human Behavior.  ISSN 0747-5632.  76, s 683- 692 . doi: 10.1016/j.chb.2017.02.020 Fulltekst i vitenarkiv.
• McNeish, Daniel & Matta, Tyler (2017). Differentiating between mixed-effects and latent-curve approaches to growth modeling. Behavior Research Methods.  ISSN 1554-351X.  s 1- 17 . doi: 10.3758/s13428-017-0976-5 Fulltekst i vitenarkiv.
• Helland-Riise, Fredrik & Martinussen, Monica (2017). Måleegenskaper ved de norske versjonene av Ravens matriser [Standard Progressive Matrices (SPM)/Coloured Progressive Matrices (CPM)]. PsykTestBARN.  ISSN 1893-9910.  7(2), s 1- 21 Fulltekst i vitenarkiv. Vis sammendrag

  Ravens matriser består av flere varianter der Coloured Progressive Matrices (CPM) (5–11 år) og Standard Progressive Matrices (SPM) (8–65 år) kan anvendes for barn og unge. Testen ble utviklet av John C. Raven, og SPM ble først publisert i 1938, mens CPM-versjonen ble publisert i 1998. Testen er ment å måle non-verbal intelligens eller evne til abstrakt resonnering ved at barnet skal finne systemet bak hvordan ulike geometriske figurer er satt opp. Begge versjonene av Raven har oppgaver med økende vanskelighetsgrad organisert i ulike sett. Testen skåres ved at antallet riktige svar summeres opp til en totalskår. Dette kan konverteres til prosentiler basert på normtabellene i manualene. Testen administreres vanligvis uten tidsbegrensning for barn og unge, og det stilles krav om at de som skal anvende testen er sertifisert for å anvende evnetester eller er psykologer. Pearson Assessment har rettighetene til salg og distribusjon av testen i Skandinavia og internasjonalt (pearsonassessment.no). Til sammen ble 15 norske og 24 svenske/danske artikler inkludert i oppsummeringen. Ingen av disse var rene psykometriske studier, men stort sett studier der Raven ble brukt for å måle intelligens enten som utkommevariabel, kontrollvariabel eller for å beskrive gruppen. Litt under halvparten av studiene var basert på kliniske grupper (for eksempel autisme, epilepsi eller døve), men de øvrige studiene var basert på skolebarn fra 5–16 (SPM) og 5–7 (CPM) år. Ingen av studiene hadde gjennomført adekvate studier av testens reliabilitet og det er heller ikke gjennomført normstudier basert på norske eller svensk/danske utvalg. Resultatene fra studiene støtter begrepsvaliditeten til testen som et godt mål på abstrakt resonneringsevne ved generelt høye korrelasjoner med andre kognitive tester. Konklusjon. Det er god dokumentasjon på testens begrepsvaliditet, men det mangler studier av testens reliabilitet basert på norske eller svenske/danske utvalg. Det er heller ikke normstudier fra Skandinavia, noe som er problematisk ved klinisk bruk av testen.

• Hjetland, Hanne Næss; Brinchmann, Ellen Iren; Scherer, Ronny & Melby-Lervåg, Monica (2017). Preschool predictors of later reading comprehension ability: a systematic review. Campbell systematic reviews.  ISSN 1891-1803.  14 . doi: 10.4073/csr.2017.14 Fulltekst i vitenarkiv.

Sjå alle arbeida i Cristin

• Björnsson, Julius Kristjan & Olsen, Rolf Vegar (red.) (2018). Tjue år med TIMSS og PISA i Norge: Trender og nye analyser. Universitetsforlaget.  ISBN 978-82-15-03006-7.  224 s.

Sjå alle arbeida i Cristin

• Reis Costa, Denise (2018). LOGANShiny: an app for illustrating the analysis of log-file data in International Large-scale Assessments. [www ].
• Reis Costa, Denise (2018). Exploring Log Files in International Large-scale Assessments: Methods, Practices and Tools.
• Reis Costa, Denise & Eklöf, Hanna (2018). Test-taking Motivation in International Surveys: an IRT Approach.
• Tesema, Melaku Tesfa (2018). Gender Differences for STEM Achievement and Enrolment in Ethiopian Higher Education.
• Olsen, Rolf Vegar; Tveit, Sverre & Björnsson, Julius Kristjan (2018). Nasjonale prøver og eksamener i norsk og svensk grunnopplæring. Acta Didactica Norge - tidsskrift for fagdidaktisk forsknings- og utviklingsarbeid i Norge.  ISSN 1504-9922.  12(4) . doi: http://dx.doi.org/10.5617/adno.6647
• Andresen, Øystein Næss & Smestad, Trine (2018). Fødselsmåned påvirker skoleprestasjoner. Forskning.no : nettavis med nyheter fra norsk og internasjonal forskning.
• Daus, Stephan; Stancel-Piatak, Agnes & Braeken, Johan (2018). Instructional sensitivity of the TIMSS items and test to Norwegian science education instruction.
• Van Laar, Saskia & Braeken, Johan (2018). Measurement Invariance in Within-Group Designs.
• Van Laar, Saskia & Braeken, Johan (2018). Measurement Invariance in Within-Subjects Designs.
• Daus, Stephan (2018). Out of tune: Can we hear a bas(i)s for Norway’s decision to move its tested populations one grade up in TIMSS?.
• Scherer, Ronny; Siddiq, Fazilat & Sánchez Viveros, Bárbara (2018). Technology and the Mind: Does Learning to Code Improve Cognitive Skills?. Proceedings / ACM Multimedia Conference. . doi: 10.1145/3183654.3183658 Vis sammendrag

  Modern technology permeates almost every area in society and thus necessitates the development of new skillsets--including computer coding. Many leaders around the world consequently encourage students to learn to code, as this may help them to develop other skills, including problem solving, reasoning, and numeracy. The current study, based on a meta-analysis, puts to test this largely accepted claim that learning how to code improves other cognitive skills. We identified 105 relevant studies that examined the transfer of coding skills to other cognitive skills, such as reasoning, problem solving, creativity, literacy, and numeracy. These studies provided more than 150 effect sizes and followed experimental and quasi-experimental designs across all educational levels. A three-level random-effects model was specified to the resultant dataset to summarize the transfer effects. Hedges' g formed the basis for this modelling approach. The aggregated size of the transfer effects--independent of the context of transfer--was positive and mediocre (g = 0.49, 95% CI = [0.37, 0.61]), and showed considerable variation within and between studies. At the same time, this effect differed across transfer contexts--for skills closer to computer coding, effects were larger (near transfer) than for skills that overlap only marginally with coding (far transfer). Moreover, the purpose of coding moderated the overall effects. Our response to the question whether learning to code improves other cognitive skills is positive: Indeed, positive transfer effects can be detected. Nevertheless, learning to code has differential rather than uniform effects on other cognitive skills.

• Vartun, Marika; Høegh-Omdal, Kathrine; Smestad, Trine & Andresen, Øystein Næss (2017). Når tall blir et mareritt. utdanningsforskning.no.
• Andresen, Øystein Næss; Rødal, Aina & Vartun, Marika (2017). Forskere utvikler målemetode for ungdommers tilpasningsevne. utdanningsforskning.no.
• Tesema, Melaku Tesfa (2017). Affirmative action as an equity instrument in Higher Education..
• Eliassen, Erik & Zachrisson, Henrik Daae (2017). The causal effect of entry age on children's social competence at age 3 years.
• Kaiser, Gabriele; Blömeke, Sigrid; König, Johannes; Busse, Andreas; Döhrmann, Martina & Hoth, Jessica (2017). Erratum to: Professional competencies of (prospective) mathematics teachers - cognitive versus situated approaches (Educational Studies in Mathematics, (2017), 94, 2, (161-182), 10.1007/s10649-016-9713-8). Educational Studies in Mathematics.  ISSN 0013-1954.  94(2), s 183- 184 . doi: 10.1007/s10649-016-9724-5
• Daus, Stephan & Braeken, Johan (2017). Are TIMSS country scores and rankings sensitive to varying opportunities to learn?.
• Scherer, Ronny & Nilsen, Trude (2017). Relations between School Climate, Instructional Quality, and Educational Outcomes: Findings from TIMSS 2015 in Norway.
• Scherer, Ronny & Nilsen, Trude (2017). Relations between School Climate, Instructional Quality, and Educational Outcomes.
• Zachrisson, Henrik Daae & Melhuish, Edward C. (2017). Early childhood education and care, In Brian Hopkins; Elena Geangu & Sally Linkenauger (ed.),  The Cambridge Encyclopedia of Child Development.  Cambridge University Press.  ISBN 9781316216491.  VI.  s 459 - 463
• Siddiq, Fazilat & Scherer, Ronny (2017). Is there a gap? A meta-analytic review of the gender and SES effects on students’ ICT literacy.
• Frey, Andreas; Kroehne, Ulf; Seitz, Nicki-Nils & Born, Sebastian (2017). Multidimensional adaptive measurement of competences, In Detlef Leutner; Jens Fleischer; Juliane Grünkorn & Eckhard Klieme (ed.),  Competence Assessment in Education. Research, Models, and Instruments.  Springer.  ISBN 978-3-319-50030-0.  Chapter 22.  s 369 - 387
• Kluge, Anders; Boothby, Russel Clark; Dolonen, Jan Arild; Scherer, Ronny & Ludvigsen, Sten Runar (2017). Critical Thinking in a Changing World: ASSESSMENT FRAMEWORK.
• Kluge, Anders; Boothby, Russel Clark; Dolonen, Jan Arild; Scherer, Ronny & Ludvigsen, Sten Runar (2017). Critical Thinking in a Changing World: A Formative Report of the Conceptualization, Assessment, and Implementation of Critical Thinking Skills in 21st Century Education.

Sjå alle arbeida i Cristin