Executive Director, Assessment

About this role

Executive Director, Assessment    

College Board – AP&I  

Location:   This is a remote role. Candidates who live near CB offices have the   option   of being fully remote or hybrid (Tuesday and Wednesday in office). All CB employees   are required to   occasionally travel to meet in person for business purposes.  

Role Type:   This is a full-time position.  

About the Team    

The New Course Design   (NCD) department leads the research, design,   development, and launch   of new courses   and their associated exams,   instructional   resources, and teacher professional learning programs , ensuring   consistency across these inter-related AP Program components   and that   they are engaging, feasible, and grounded in evidence . After launching a new course, the NCD department   focuses on continuous improvement of new courses, exams,   instructional interventions,   and   teacher   professional learning programs . NCD partners closely with   the Learning and Assessment division to design and validate new item types for use in new, career-focused AP exams, and then integrates with AP Program   Enablement to produce the annual exam   versions   within the Bluebook digital testing platform (copyright, editorial, layout, design), and to   develop annual rubrics and training materials necessary to conduct the annual AP Reading of student responses.   

About the Opportunity   

As Executive Director,   New AP Course   Assessment s , you will own   the exploration and identification of   assessment   design options   for   6-8 new career-focused AP courses currently in focus, and then   every new course the department builds . You   will   then   be responsible for   ongoing assessment development for new courses,   from   initial   test blueprint s   through pilot exam version s   and into ongoing, year-over-year assessment item   and   version   development. You will   partner closely with assessment innovation leaders within the Learning and Assessment   department   to identify, select, refine, and implement innovative item types for the AP Exams for the new career-focused AP courses,   , selecting the right   blend   of   format s   and modalities   for each course   (e. g.,   traditional, skills-based, project-based, or performance-based )   based on what most validly measures the target skills, and prioritizing formats that support employer recognition or industry credential status where relevant. You'll partner closely with the   College Board’s Psychometric department   and c urriculum   experts   to keep course design and assessment design moving together, and you'll build the internal case, and the stakeholder buy-in, for new assessment approaches alongside the traditional formats that remain part of our portfolio.  

You are someone who can hold both rigor and reinvention at once:   in addition to your core expertise in design of authentic, relevant assessments, you are   fluent enough in psychometric fundamentals to have credible technical conversations, and skilled enough in stakeholder management to bring skeptical partners along on new approaches   to   assessment .  

In this role, you will:  

Assess ment Design & Development (40%)  

• Partner with Learning and Assessment innovation leaders to identify, select, refine, and incorporate promising and innovative item types within the New Course AP Exams   and that clearly and distinctly measure the skills identified as the targets of measurement for the new course, thereby inspiring productive and relevant classroom focus and student practice .   

• Lead design and development of test blueprints and pilot exam versions for new courses,   partnering with AP Program Enablement to   select the assessment format, traditional, performance-based, or project-based,   and scoring models that will enable on-time, accurate, and efficient scoring of free-response questions.  

• Define and o wn assessment model s   that   generate , store, and enable student   utilization   of   workforce credentials, not just an exam score.  

• Partner with AP Program Enablement to   identify   annual   version   development and usage braiding plans and then take responsibility for managing and delivering   ongoing, year-over-year assessment   item   and version   development   beyond   initial   pilot versions.  

• Partner with Learning and Assessment to   recommend and set the vision for new   AP   assessment models, working with measurement partners to   establish   validity and defensibility for each format introduced; ensure this vision   cascad es across their direct reports and the NCD team .  

Cross-Functional Partnership & Change Leadership (20%)  

• Partner with the measurement/psychometrics team on exam version assembly, equating,   and standard settings ,   including for   novel formats that   don't   fit legacy models.  

• Win buy-in from stakeholders attached to traditional assessment models; build trust and   shared   ownership of   new approaches .  

• Represent assessment considerations in cross-functional project reviews with curriculum, design, and program management partners.  

Leadership & Team Management ( 4 0%)  

• Build and hire a team of assessment design staff   who have subject matter   expertise   in the new course domains and will enact the annual cycle of item and   version   development   and administration   responsibilities for the new course exams .  

• Oversee calibration and training of subject matter expert panels on writing and reviewing all assessment types, new and existing.  

• Sign off on assessment deliverables at each project decision point, i.e., the milestones where a   course's   assessment work must be approved before design can   proceed   to the next stage.  

About   You  

You have:  

• 1 0 -15+   years in assessment design, test development,   or curriculum leadership roles with direct, hands-on exposure to how assessment and measurement work, even if the role sat on the curric

Similar jobs

• Executive Director — Welbehealth · Riverside, CA, USA
• Executive Director — OneOncology · Overland Park, KS | Independence, MO
• Executive Director — Welbehealth · North Hollywood, CA, USA
• Executive Director — Lifespacecommunities · Pittsburgh, PA
• Executive Director of Development — University of Southern California · Los Angeles, CA - Downtown
• Associate Director Product Development Program Manager, Digital Assessments — Collegeboard · Remote
• Assessment Lead — Barbaricum · Washington, DC
• Executive Director, Advancement Data Analytics — Embryriddle · Daytona Beach, FL