Language Assessment

The Challenge:

Design an online English language assessment. Hire and train assessors to accurately grade writing and speaking components within 24 hours. Deliver quarterly assessor calibration sessions.

Test design requirements:

• Quick to complete: 30-45 minutes.
• Easy to navigate and understand how to complete – All instructions are as short, simple and friendly as possible
• Accessible on all devices.
• Comprised of a question pool to ensure academic integrity.

The Solution:

See the “Promotional Video for Online Language Test”. The work breakdown structure to develop test:

• Conducted a critical review and analysis of language benchmarks and grading criteria, test instructions, common test tasks, and navigation.
• Determined the test sections and parameters.
• Map the test parameters and performance criteria to the Common European Framework of Reference.
• Developed a test template. 
• Created 2 prototypes.
• Tested prototypes on groups of test-takers with known language levels. Analysed the scores and quality of responses. Adjusted the test items and format. This step went through several rounds of testing and adjustment.
• Followed up with a student focus groups to collect feedback on the test questions, format and interface. 
• Worked with the IT team to deliver the language level test on the enterprise platform.

The Tools:

• Moodle quiz
• Basic HTML

Promotional Video for Online Language Test

Webinar on PROLA & Level Progression