Senior Efficacy Research and Psychometrics Analyst, Khan Kids (24 months fixed-term)

Khan Academy Kids is looking for a Senior Efficacy Research and Psychometrics Analyst (24 months fixed-term) to strengthen the evidence base behind our assessments and learning content for children in PreK through 2nd grade.

This role spans two complementary areas. First, you will lead the technical side of our psychometrics and efficacy research: serving as the primary point of contact for our external research partners, managing recurring data extracts, analyzing and interpreting psychometric findings, and helping translate research into product improvements. Second, you will own analytics and reporting for Khan Academy Kids: building and maintaining our KPI dashboard and preparing the recurring reporting that our leadership, philanthropy, and school partnerships teams rely on to make decisions and tell our impact story.

You will work on a small, interdisciplinary team alongside product managers, engineers, designers, and academic experts and collaborate closely with leading external research organizations. We are looking for someone with strong quantitative training — ideally in psychometrics, educational measurement, or a related field — who is energized by using rigorous evidence to improve learning experiences for young children.

Responsibilities:

(1) Psychometrics & Efficacy Research

• Lead our psychometric research partnership: Serve as the primary technical point of contact for our external psychometric research partnership, supporting study design, data sharing, psychometric analyses, and interpretation of findings
• Extract, clean, and securely share assessment data with research partners on a recurring schedule
• Analyze and interpret psychometric findings, including item difficulty, score distributions, growth analyses, concurrent validity, and IRT-based scoring
• Partner with our product and engineering teams to translate findings into product improvements, such as updates to scoring models and assessment discontinuation rules
• Collaborate with research partners to develop and publish technical documentation, beginning with the technical manual for our PreK assessment
• Recruit and manage research partner sites: Recruit and onboard school and district sites for psychometric and efficacy studies; execute MOUs; align on consent procedures and participant incentives; and coordinate site visits for direct child assessment data collection
• Partner with our legal team to draft and negotiate data-sharing agreements with districts and research organizations, including requirements for pseudonymized and identified data
• Support efficacy research. Coordinate Khan Academy Kids' participation in ongoing efficacy studies and contribute to the design of future studies, aligning internal and external stakeholders on the research approach

(2) Analytics Reporting and Data Infrastructure

We understand that achieving our audacious mission is a marathon, so we set realistic timelines and we focus on delivery that also links to the bigger picture. As a non-profit, we are supported by the generosity of donors as well as strategic partners, and understand our responsibility to our finite resources. We spend every dollar as though it were our own. We are responsible for the impact we have on the world and to each other. We ensure our team and company stay healthy and financially sustainable.

Bring out the joy

We are committed to making learning a joyful process. This informs what we build for our users and the culture we co-create with our teammates, partners and donors.

Cultivate learning mindset

We believe in the power of growth for learners and for ourselves. We constantly learn and teach to improve our offerings, ourselves, and our organization. We learn from our mistakes and aren’t afraid to fail. We don't let past failures or successes stop us from taking future bold action and achieving our goals.

Deliver wow

We insist on high standards and deliver delightful, effective end-to-end experiences that our users can rely on. We choose to focus on fewer things — each of which aligns to our ambitious vision — so we can deliver high-quality experiences that accelerate positive measurable learning with our strategic partners.

We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, gender, gender identity or expression, national origin, sexual orientation, age, citizenship, marital status, disability, or Veteran status. We value diversity, equity, and inclusion, and we encourage candidates from historically underrepresented groups to apply.

As part of this commitment, Khan Academy will ensure that persons with disabilities are provided reasonable accommodations for the hiring process. If reasonable accommodation is needed, please contact careers@khanacademy.org