research
Posted Jan 20Researcher, Frontier Biological and Chemical Risks
at openai
San Francisco, United StatesOn-site
Requirements
- ABOUT THE TEAM Preparedness is a critical Safety Research team at OpenAI, which is focused on mitigating AI threats to global security https://openai.com/index/updating-our-preparedness-framework/ that could scale to an extreme level of severity.
- Monitoring and predicting the evolving capabilities of frontier AI systems. 2. Mitigation.
- Specifically, we are looking for those that will help us shape our empirical grasp of the whole spectrum of AI safety concerns and will own individual threads within this endeavor end-to-end.
- IN THIS ROLE, YOU'LL: - Work on identifying emerging AI safety risks and new methodologies for exploring the impact of these risks - Build (and then continuously refine) evaluations of frontier AI models that assess the extent of identified risks - Design and build scalable systems and processes that can support these kinds of evaluations - Contribute to the refinement of risk management and the overall development of "best practice" guidelines for AI safety evaluations YOU MIGHT THRIVE IN THIS ROLE IF
- experience in ML research engineering, ML observability and monitoring, creating large language model-enabled applications, and/or another technical domain applicable to AI risk - Are able to operate effectively in a dynamic and extremely fast-paced research environment as well as scope and deliver projects end-to-end IT WOULD BE GREAT IF YOU ALSO HAVE: - First-hand
- experience in red-teaming systems—be it computer systems or otherwise - A good understanding of the (nuances of) societal aspects of AI deployment - Excellent communication skills and the ability to work cross-functionally This role may require access to technology or technical data controlled under the U.S.
- About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence
Contact
- Setting mitigation targets by maintaining OpenAI’s preparedness framework https://openai.com/index/updating-our-preparedness-framework/, and partnering with other staff to achieve these targets.
Additional details
- Keeping misuse safeguards, alignment tools, and security measures on track to adequately address extreme threats that might arise in the future. 3. Coordination.
- This is urgent, fast-paced work that has far-reaching implications for the company and for society.
- ABOUT THE ROLE We are looking to hire exceptional research engineers that can push the boundaries of our frontier models.
- You will own the scientific validity of our frontier preparedness capability evaluations—designing new evals grounded in real threat models (including high-consequence domains like CBRN as well as cyber and other frontier-risk areas), and maintaining existing evals so they don’t stale or silently regress.
- You’ll define datasets, graders, rubrics, and threshold guidance, and produce auditable artifacts (evaluation cards, capability reports, system-card inputs) that leadership can trust during high-stakes launches.
- Export Administration Regulations or International Traffic in Arms Regulations.
- Therefore, this role is restricted to individuals described in paragraph (a)(1) of the definition of “U.S. person” in the U.S.
- Export Administration Regulations, 15 C.F.R. § 772.1, and in the International Traffic in Arms Regulations, 22 C.F.R. § 120.62.
- U.S. persons are U.S. citizens, U.S. legal permanent residents, individuals granted asylum status in the United States, and individuals admitted to the United States as refugees.