jobloom

JobLoom finds jobs directly from company career sites before many job boards, then routes you into detailed role pages like this one.

product

Posted 4 hours ago

Staff Product Manager (Evals)

at Workato

Palo Alto, United StatesOn-site

Responsibilities

  • Define and own the evaluation framework for Workato's internal AI agent features, driving adoption across teams starting with Agent Studio •
  • Build the customer-facing evaluation
  • Establish metrics for what "good" looks like — both for internal agent quality and for customer evaluation adoption •
  • Track record of shipping technical products to both internal and external users •

Requirements

  • Workato delivers enterprise infrastructure for the agentic era, redefining iPaaS and helping enterprises unify data, applications, processes, and AI into a single, governed platform.
  • With enterprise-grade security and continuous innovation at its core, Workato provides the trusted foundation for organizations to automate with confidence and operationalize AI across the business.
  • We're looking for a Staff Product Manager to own evaluations for AI agents at Workato — both the internal framework that helps our teams ship better AI features, and the customer-facing tools that let builders assess and improve the agents they create. This is a role with a dual mandate.
  • Internally, you'll establish how Workato evaluates agent quality, starting with Agent Studio and expanding to other teams shipping AI capabilities.
  • Work with ML engineers and platform teams to ground the framework in technical reality while keeping it accessible •
  • experience writing evaluations for AI/ML systems (agents, LLMs, or similar) •
  • Experience driving adoption of frameworks or practices across engineering teams •
  • Bachelor's degree or equivalent experience •
  • Internal influence skills. You've driven adoption of frameworks, practices, or tools across teams. You can be a credible partner to ML engineers while advocating for what internal teams actually need. • Greenfield comfort.
  • Experience with agent architectures, RAG systems, or LLM application development •
  • Background in ML engineering, solutions architecture, or technical program management before PM •
  • Familiarity with evaluation frameworks (e.g., human eval pipelines, automated benchmarks, red-teaming) (REQ ID: 2538)

Experience

  • 7+ years in Product Management • Hands-on

Contact

  • To learn more, visit www.workato.com Why join us?

Additional details

  • A leader in Enterprise MCP and trusted by 50% of the Fortune 500, Workato’s cloud-native architecture connects every application, data source, and process to power real-time orchestration at scale.
  • Ultimately, Workato believes in fostering a flexible, trust-oriented culture that empowers everyone to take full ownership of their roles .
  • We are driven by innovation and looking for team players who want to actively build our company.
  • But, we also believe in balancing productivity with self-care . That’s why we offer all of our employees a vibrant and dynamic work environment along with a multitude of
  • benefits they can enjoy inside and outside of their work lives.
  • If this sounds right up your alley, please submit an application. We look forward to getting to know you!
  • Business Insider named us an “enterprise startup to bet your career on” •
  • Forbes’ Cloud 100 recognized us as one of the top 100 private cloud companies in the world •
  • Deloitte Tech Fast 500 ranked us as the 17th fastest growing tech company in the Bay Area, and 96th in North America •
  • Quartz ranked us the #1 best company for remote workers Responsibilities

Find more real-time jobs on JobLoom.