data
Posted Apr 14Research Scientist - Frontier Data
at AfterQuery
San Francisco, United StatesOn-site
Responsibilities
- What You'll Do - Design data slides and explore data shapes that expose meaningful model failure modes across domains like finance, code, and enterprise workflows - Build and refine evaluation rubrics and reward signals for RLHF and RLVR training pipelines - Model annotator behavior and run experiments to improve different model capabilities - Develop quantitative frameworks for measuring dataset quality, diversity, and downstream impact on model alignment and capability - Partner with lab research teams
Requirements
- We serve every frontier AI lab with the mission of delivering the best data to power the best models.
- This is a rare opportunity to join a company at a defining moment in AI.
- We're based in San Francisco and backed by leading investors including Altos Ventures, BoxGroup, and Y Combinator and angels from Google DeepMind, OpenAI, Anthropic, Meta Superintelligence Labs, and Microsoft AI and are based in San Francisco.
- About AfterQuery AfterQuery builds the training data and evaluation infrastructure that frontier AI labs use to make their models better.
- Working directly with research teams at top AI labs, you'll experiment with data collection strategies, diagnose model failure modes, and develop the metrics that determine whether a model is actually getting better.
Benefits
- Since raising our $30M Series A at a $300M valuation, AfterQuery has grown well over a $100M revenue run rate.
- - Genuine obsession with how data structure, selection, and quality drive model behavior - Ability to design lightweight experiments, move fast, and extract actionable insights from messy results - Comfort working across domains (you'll touch finance, software engineering, policy, and more) - Strong quantitative instincts and familiarity with LLM training pipelines, RLHF/RLVR, or evaluation methodology - A bias toward building over theorizing Compensation Structure: - Annual target cash compensation of
- benefits (UberEats and ride share stipend, comped Equinox, 401K with match, health, dental, and vision insurance)