The Norwegian Agency for Lifelong Learning, Vox, is responsible for developing and administering tests for adult immigrants in Norway. Test results are reported in terms of levels of the Common European Framework of Reference, A1 – B1 (from December 2015 also level B2), for listening, reading, speaking and writing. The current paper reports on standard setting procedures carried out for the listening and reading test(s) and discusses questions which were addressed after the first test administration. Two types of data are the basis for the standard setting: a) piloting data (listening and reading) from approximately 3700 students taking one of 18 pilot tests (linked design), and b) data from 17 judges taking part in the standard setting of the listening and reading tests. A modification of the Cito Method (Relating Language Exams to the CEFR - A Manual, Council of Europe 2009, chapter 6) was used for the standard setting. After the first test administration some stakeholders have asked whether more students than expected achieved a B1 on the listening and reading tests. Within Vox, administrators and test developers have discussed how to avoid a labour intensive and therefore costly new standard setting event when new versions of the tests are developed.