Skip to content
PHD opening

AI Scientist Benchmark Fellow

Openrefinery.ai · United States

Back to openings

About this position

What’s the next AI frontier?

Scientific discovery, automated. The question is, “how do you judge if an AI model is doing ‘good research’”. The answer comes from researchers who use AI models on real research. So, we're seeking one Fellow per STEM field who wants to build their field's first benchmark and put their name on it.

Core Responsibilities

  • Validate results of the work produced by AI models’ paper reproduction and simulations.
  • Map out your field, including the most important research areas and the taxonomy within.
  • Set the standards for refining AI traces into benchmark samples; create benchmarks to evaluate frontier AI models against.

Authorship

  • Your benchmark will be published as a citable public release, including a paper and an open eval set. You’ll be named a lead author.
  • Bonus: Get more citations for your papers.

Requirements

  • PhD students or postdocs in biology, medicine, neuroscience, materials science, chemistry, physics, mechanical engineering, or chemical engineering.
  • Have published a paper in your field; can judge a paper in your field and catch author’s errors.
  • Currently doing AI for Science research in their fields. (For example, you are using AI agents like Claude Code or Codex for 20+ hours per week in your research).

How it works

  • Can be remote or in-person.
  • You can set your hours. You can take a break if there’s an academic deadline.
  • $50-100/hr (up to $250K annualized). If you’re in the US, F1/visa-friendly structures are available.
  • You get to work directly with our founders and with researchers at frontier AI labs.

About OpenRefinery

Our mission is to advance scientific research via AI advancement. We scaled Turing from $0 to 2.2B (Series E). The cofounders Kai, Alex, and Char led ML programs Facebook AI Research (FAIR) and Zoox, exited two companies before, and built a $300M ARR data business together.

Backed by Zetta Ventures (invested in Kaggle and Domino Data Lab), Chair of the MIT Board of Trustees, Audacious Ventures (investors in Reflection AI and Decagon), and AI researchers from OpenAI, Anthropic, Google DeepMind, Thinking Machines, Nvidia, and the United Arab Emirates’ AI institute.

We partner with researchers at Stanford, MIT, Caltech, ETH Zürich, UPenn, Berkeley, NUS, and more.

How to Apply

Email matko@openrefinery.ai with your field, how you use AI in your research, and one thing models consistently fails in your field. Résumé/CV is optional; you can just share your academic profile.

Members only · Free to join

Sign in to see the full opening

Get the entry requirements, funding, the supervisor's contact and a link to the original advert.

  • Funding
  • How to apply
  • Contact details

Free forever No credit card 30-second sign-up

Similar openings

Funding not stated 11 Nov 2026

PhD Faculty Support and Program Coordinator

Smith College

  • Northampton, United States

If you have any questions about the position or our application process, reach out to us at recruiting-u@smith.edu . DepartmentSchool for Social Work Job Description Job Summary As a member of the Faculty Support, Operations & Systems Office, this position serves as the primary operational and administrative coordinator supporting the PhD Program while also providing faculty support services to the MSW Program. The coordinator plays a critical role in ensuring the effective operation of the SSW PhD program by working with the Manager of Faculty Support and Director of the PhD Program, to navig

Fully funded 11 Nov 2026

Pre-Doctoral Research Specialist, Behavior Change for Good

University of Pennsylvania

  • Philadelphia, United States

University Overview The University of Pennsylvania, the largest private employer in Philadelphia, is a world-renowned leader in education, research, and innovation. This historic, Ivy League school consistently ranks among the top 10 universities in the annual U.S. News & World Report survey. Penn has 12 highly-regarded schools that provide opportunities for undergraduate, graduate and continuing education, all influenced by Penn’s distinctive interdisciplinary approach to scholarship and learning. As an employer Penn has been ranked nationally on many occasions with the most recent award from

Fully funded 11 Nov 2026

Teaching Assistant - Psychology

Liberty University

  • Lynchburg, United States
  • Y RESPONSIBILITIES

Working independently and exercising good judgment and discretion, the Teaching Assistant works on campus in an academic support role for the University. These roles can range from teaching your own classes, overseeing students, grading academic assignments, scheduling, sending emails, lecturing, etc. The Teaching Assistant works a maximum of 20 hours per week (12m - 1040) throughout their contracted time length. ESSENTIAL FUNCTIONS AND RESPONSIBILITIES • Work under the direction and supervision of the Dean, Department Chair, or Professor to whom assigned. • Be present for all necessary events

Funding not stated 11 Nov 2026

PhD Position in Political Science

University of Amsterdam (UvA)

  • Amsterdam, Netherlands

The Department of Political Science is looking for a PhD candidate to work in the “ Doctoral Network Democratic Institutions and Violence Network in Europe ( DIViNE )” project, funded by the HORIZON MSCA action. The candidate will be supervised by Dr. Ursula Daxecker (University of Amsterdam and Max Planck Institute for Political and Social Science) and Dr. Hanne Fjelde (University of Uppsala) and join a network of 1