ForgeApply · Job listing
Member of Technical Staff, Model Evaluation
Mirendil
See all 12 open roles at Mirendil →
Tailor your resume for this Mirendil job in about a minute.
ForgeApply rewrites your resume for this exact posting, then autofills the application on Mirendil's site with it. You review everything before it's sent. Free trial, no card required.
About this role
Mirendil
Mirendil is a tech-first company focused on solving core bottlenecks that unlock step-change acceleration across science and technology. Our first goal is to democratize frontier AI R&D across scientific disciplines. We believe accelerating scientific discovery is one of the most powerful ways to improve the future of humanity, and that AI will play a central role in making that possible.
We are building a frontier AI research company and training our own models end-to-end. Our work spans areas such as model training, reinforcement learning, reasoning systems, and infrastructure for large-scale experiments. Our team includes researchers and engineers from Anthropic, Google DeepMind, xAI, OpenAI, Microsoft, Apple, and MIT.
The Role
We are looking for a research engineer to build the evaluation infrastructure that tells us whether our models are getting better in ways we care about. You'll own the frameworks, pipelines, and tooling that measure model behavior across capabilities. Some example areas you might work on (not limited to):
- Design and build evaluation frameworks that measure model capabilities along realistic axes, beyond standard benchmarks.
- Build automated eval pipelines and regression-detection systems that run continuously and surface signal quickly.
- Develop agent-assisted workflows for humans to efficiently inspect model behavior.
- Instrument training runs with observability tooling so researchers can understand what's changing in model behavior, and why.
- Partner with post-training and RL teams to close the loop between eval signal and training decisions.
If you're excited about the hard problem of knowing whether a frontier AI system is actually improving, we'd love to hear from you.
We offer a base salary of $300,000–$400,000 USD and a meaningful equity grant, depending on experience and background, along with competitive benefits.
Salary insight
The midpoint of this range ($350k) is about 75% above the median disclosed salary for San Francisco roles listed on ForgeApply ($200k across 8,773 jobs).
Based on live postings with disclosed pay on ForgeApply; refreshed daily. Not an estimate of this employer's offer.
Tailor your resume for this Mirendil role before you apply.
Tailor my resume for this jobSimilar jobs
- Member of Technical Staff, Model Efficiency — Cohere · New York
- Member of Technical Staff, Model Training — Parallel · San Francisco or Palo Alto
- Research Engineer, Model Evaluations — Anthropic · Remote-Friendly (Travel-Required) | San Francisco, CA | New York City, NY
- Member of Technical Staff - Model Training — Xai · Austin, Texas; New York, New York; Palo Alto, California; Seattle, Washington
- Member of Technical Staff - Imagine Model — Xai · Palo Alto, California
- Member of Technical Staff (Model Behavior) — Perplexity · San Francisco
- Member of Technical Staff — Research Engineering, Evaluation — Causal · San Francisco
- Member of Technical Staff (Data Scientist, Evals) — Perplexity · San Francisco
Free ATS checker · How to Tailor Your Resume to a Job Description (Step by Step)