Digital Assessment Designer

About the team

The Digital Assessment Design team is a small multi-disciplinary team that has a primary focus on the development of fit-for-purpose digital assessments, predominantly in a high-stakes context. The team comprises experts in digital assessment, user-experience research and accessibility. A core driving principle of the work of the team is to support the design and development of fair and equitable assessments, exploring issues pertaining to user-experience, construct validity and modal comparability. We undertake targeted research and evidence gathering activities across a range of subjects, taking into account a range of learner abilities and needs, including those with diagnosed SEND (Special Educational Needs and Disabilities). The team sits in the Quality, Regulation and Governance division and forms part of a wider department that comprises experts in assessment design, assessment research, psychometrics and data analysis and teams responsible for the maintenance and setting of performance standards for Pearson’s qualifications.

About the role

We are seeking a knowledgeable, proactive self-starter with a background in digital assessment design and development to join our small expert team and help drive forward digital assessment transformation in support of company goals.

Working closely with colleagues in the wider department and stakeholders across the business, you will be expected to provide technical expertise, advice and guidance on digital assessment content creation and evaluation, predominantly in a high-stakes assessment context, using international best-practice principles. You will have the interpersonal skills to influence and encourage others to be innovative in the design, development, and operation of new assessment approaches, in both digital-first and dual mode assessment contexts. You will have experience of working in the education sector, a proven ability of successfully leading projects, have great communication skills, and be able to work within multi-disciplinary teams to deliver high priority projects on time and within budget. The learner experience will be at the forefront of the guidance you provide and decisions you make, and therefore the outputs you deliver will have a focus on quality, ensuring valid learner outcomes and reliable assessments. You will ensure that our digital assessment design approaches and principles are functional, inclusive, efficient and enable operational teams to create first-class content for end-users.

Key responsibilities

Digital Assessment Design

Lead digital assessment design activities to develop fit for purpose digital assessments, in line with regulatory requirements or other prescribed standards. Work with subject-matter experts to co-design digital-first assessments, combining expertise in digital assessment systems and capabilities with expertise in fit-for-purpose assessment design principles. Create assessment concept builds using appropriate digital tools. Review, refine and provide feedback on digital assessment items, either as part of new developments or as part of ongoing assessment lifecycle improvements. Employ user-centred design approaches, ensuring that the learner experience is central to assessment design decisions and recommendations. Develop digital assessment guidelines to be used by operational teams to ensure consistency in live assessment delivery over time. Inform and develop detailed requirements for technical developers, working closely with technical teams and other internal stakeholders to ensure solutions are fit for purpose and meet learner needs. Keep up to date with the evolving landscape of digital assessment and apply cutting-edge approaches to the design and development of digital assessments.

Accessibility and Inclusive design

Work with expert colleagues to incorporate accessibility-first principles and remove any barriers to access, thereby helping to ensure digital assessments are accessible to as many learners as possible. Implement and promote best practice accessibility and usability standards across all projects Help ensure assessments comply with organisational and external policies, frameworks and drivers, including adherence to regulatory requirements Support with piloting activity for improved accessibility and greater integration of assistive technologies.

Research and Thought Leadership

Undertake user-research activities that aim to gather evidence that underpin digital assessment design and build confidence in the approaches being taken. Undertake targeted research and evidence gathering activities that inform the development of valid and reliable digital assessments, for example, analysing and interpreting student responses, item and test-level data and assessment process data. Keep up to date with the latest research and emerging assessment technologies, including advancements in AI and how these can support with the design and development of fit for purpose digital assessments. Represent the team/business as required externally including in meetings with customers, conferences, educational institutions, government departments and regulators Share relevant work internally and externally, helping to strengthen Pearson’s reputation as a leader in the digital assessment space.

Project and stakeholder management

Manage stakeholder relationships across the business to ensure both internal and external customer requirements are met to support valid and fit for purpose digital assessment practices, managing expectations as appropriate. Work with relevant teams to ensure timely delivery of assessment products and services to determined budget and quality criteria.

Training and capability building

Provide expert technical guidance and support in the design of digital assessment products across the business. Develop and deliver training to teams across the business as well as assessment writers and other stakeholders, helping to build internal capability and capacity.

Essential Skills, Knowledge and Abilities

We are looking for someone with the following skills, knowledge and abilities:

Experience in the design and development of fit-for-purpose digital assessment Experience working with item banks, both in terms of system enhancement and content development Excellent analytical skills and the ability to understand and interpret data e.g. relating to test performance Ability to work collaboratively as part of a team and to lead cross-functional team activities Demonstrated project management expertise with a successful record of delivery Ability to solve problems creatively Excellent verbal and written communication skills Ability to articulate technical and functional issues to a range of audiences and stakeholders, both internal and external Excellent interpersonal and communication skills Strong persuasive and influencing abilities Proven experience in gathering and synthesizing feedback from research participants Relationship and stakeholder management skills and an ability to foster collaborative working practices

Desirable Knowledge and Experience

In addition, the following knowledge and experience would be highly desirable:

Knowledge of internationally recognised measurement principles, for example, Classical Test Theory (CTT) and Item Response Theory (IRT) Experience in high-stakes educational assessment in the digital context Understanding of the UK assessment landscape and regulatory environment Experience in principles underpinning inclusivity by design Experience in planning and executing digital assessment related research Experience in leveraging AI to create or review digital assessment content Ability to use a range of software to enable wireframing or prototyping of new concepts

The role offers a hybrid working model, with some travel required to the Pearson London office at 80 Strand.

Your rewards & benefits   

We know you’ll do great work, so we give a lot back with some of the best benefits in the business. We know one size doesn’t fit all, so our workplace programs meet the different needs of our diverse teams, and their families, too. 

Please see our attractive UK benefits here: Pearson Jobs - Benefits