engineering
Posted Dec 10, 2024Software Engineer, Compute - Storage
at openai
San Francisco, United StatesRemote
Responsibilities
- you will: - Build and operate storage services that underpin OpenAI’s research infrastructure - Develop object storage systems across cloud and in-house environments - Build systems for cross-region data movement, replication, and recovery - Design lifecycle management capabilities that keep data durable, available, and cost-effective - Evolve the federation layer that unifies multiple backend systems behind a simple interface - Improve performance, reliability, and operational excellence across the
Requirements
- Our stack spans cloud and in-house object stores across very different workload profiles, from GPU-attached systems to dedicated storage hardware.
- You’ll work across object storage, cross-region data movement, lifecycle management, and the federation layer that provides a unified interface across multiple backends.
- Much of our stack runs on Kubernetes, and we primarily build services in Rust. In this role,
- experience building or operating distributed systems in production - Have worked on storage infrastructure, object stores, distributed filesystems, or other data-intensive backend systems - Enjoy owning infrastructure end to end, including debugging and long-term reliability improvements - Write strong production code, ideally in Rust or another systems-oriented language - Are comfortable working with Kubernetes-based systems - Have
- experience with tools such as Terraform, Grafana, or similar infrastructure and observability tooling About OpenAI OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence
Additional details
- ABOUT THE TEAM The Storage Infrastructure team builds and operates the storage foundation behind OpenAI’s most demanding workloads.
- We work directly with research to design storage systems for rapidly evolving experiments, while also powering production at scale.
- We own the platform end to end: backend systems, user-facing services and APIs, and the control planes that manage how data is placed, moved, and retained over time.
- We also build the federation layer that unifies these backends behind a simple interface and routes each workload to the right storage solution.
- ABOUT THE ROLE You will help build the storage platform that powers OpenAI’s research and production systems.
- This is a hands-on infrastructure role for engineers who want to work on deeply technical systems at scale and own them in production.