Senior Software Engineer, Agent Platform

Boston, United StatesHybrid

Responsibilities

Design and build backend systems to scale AI solutions for 167K+ customers.
Build tools to tune LLM-based features, deploy agents, MCP and RAG in production, and evaluate performance using tools like Arize, OpenAI, Bedrock, LangChain, vLLM and Ray.
Develop reliable, scalable data pipelines and APIs for AI systems.
Foster a culture of ownership, experimentation, and customer-first thinking. Who You Are:

We have a big opportunity to build state-of-the-art AI and machine learning technologies at Klaviyo to power our products and develop AI agents that can automatically create and execute marketing or customer experiences, strategies, and campaigns for any business.
As a Senior Software Engineer, Agent Platform , you’ll play a key role in designing and scaling the backend systems that power our AI products and agent solutions.
You’ll collaborate closely with product managers, ML engineers, and data scientists to deliver real-world impact at scale.
Contribute to our agentic architecture to support performant AI agents.
qualifications listed. AI Ops is a rapidly evolving space and we are all constantly learning! 5+ years of
experience as a backend software engineer, building scalable, distributed systems. Strong
experience working in production environments and launching ML/AI projects. Hands-on
experience with generative AI and agentic AI applications in production.
Proficient in Python (or similar).
Experience with big data tools (e.g., Apache Spark, Ray).
Familiarity with cloud infrastructure (AWS, Terraform, Kubernetes).
Knowledge of ML frameworks (Huggingface, PyTorch, TensorFlow, Keras).

Our salary range reflects the cost of labor across various U.S. geographic markets.
The range displayed below reflects the minimum and maximum target salaries for the position across all our US locations.
The base salary offered for this position is determined by several factors, including the applicant’s job-related skills, relevant experience, education or training, and work location.
In addition to base salary, our total compensation package may include participation in the company’s annual cash bonus plan, variable compensation (OTE) for sales and customer success roles, equity, sign-on payments, and a comprehensive range of health, welfare, and wellbeing
Your recruiter can provide more details about the specific salary/OTE range for your preferred location during the hiring process.
Base Pay Range For US Locations: $148,000 — $222,000 USD

Want to learn more about life at Klaviyo? Visit klaviyo.com/careers to see how we empower creators to own their own destiny.

At Klaviyo, we value the unique backgrounds, experiences and perspectives each Klaviyo (we call ourselves Klaviyos) brings to our workplace each and every day.
We believe everyone deserves a fair shot at success and appreciate the experiences each person brings beyond the traditional job requirements.
If you’re a close but not exact match with the description, we hope you’ll still consider applying.
At Klaviyo, we believe the future of software lies not in productivity tools for human users but in software that can run and optimize itself based on outcome or reward metrics.
We’ve built the infrastructure and application that serve as the interface between businesses and consumers.
We now have over 167,000 customers, billions of consumer profiles, and hundreds of billions of customer messages and follow-on conversion data.
This backend-heavy role gives you opportunities to influence architecture, async processing, and distributed systems.
We encourage candidates to apply even if they do not meet all the
Comfortable collaborating with cross-functional technical partners.
Curious, proactive, and eager to learn. Nice to Have: •