Senior Product Manager

We are hiring a Senior Product Manager to own Tracer and drive the systems, processes, and execution behind how we build, evaluate, and improve SuperDial’s AI workflows. This role is responsible for the operational backbone of iteration: prompt changes, quality reviews, evaluation loops, customer-specific logic, and reliability improvements.

This is a builder PM role. You will work deeply with engineering and customer-facing teams and should be comfortable writing code when needed to unblock execution (scripts, prototypes, tooling, integrations, and workflow automation).

About the Role:

Own Tracer end-to-end (internal tooling + systems)

• Own the roadmap and execution for Tracer as an internal platform

• Define Tracer’s success metrics: trace coverage, evaluation throughput, quality signals, reliability improvements, and time-to-debug

• Ensure Tracer supports fast iteration cycles while protecting customer experience and production stability

Enable prompt iteration and customer-specific logic

• Build systems that make prompt changes measurable, testable, and easy to roll out safely

• Support workflows for customer-specific prompt logic and controlled deployments

• Partner with engineering and customer teams to ensure prompt/tooling updates can be made quickly without distracting senior leadership

Drive quality, evaluation, and reliability loops

• Create consistent QA processes and evaluation workflows (human review, automated evals, regressions, guardrails)

• Standardize debugging workflows for failures and production incidents

• Establish quality benchmarks that align with customer expectations and core product performance

Build and ship (including writing code when helpful)

• Partner with engineering to ship tooling improvements quickly

• Write scripts, prototypes, or small internal tools to accelerate iteration

• Work closely with engineers on tracing infrastructure, analytics, dashboards, and experimentation systems

Be the connective tissue across teams

• Partner with Product, Engineering, Ops, CS, and Sales to ensure Tracer drives real business outcomes

• Translate feedback from customer-facing teams into tooling enhancements

• Own internal stakeholder alignment and adoption for Tracer workflows

About You:

Required

• 5+ years of Product Management experience (or equivalent) in B2B SaaS, AI products, developer tools, workflow automation, or platform teams

• Strong technical fluency and ability to partner deeply with engineering

• Ability to write code (Python/Typescript/SQL or similar) to prototype, debug, or build internal tools

• Experience operating with high ownership in fast-moving, ambiguous environments

• Strong analytical skills and comfort defining metrics and evaluation systems

• Excellent communication and ability to drive cross-functional alignment

Preferred

• Experience with LLM workflows, agent systems, prompt versioning, evaluation, or reliability tooling

• Experience building observability or debugging tooling (e.g., tracing, logging, dashboards, experiment tracking)

• Experience in healthcare or enterprise systems where reliability and trust are critical

• Strong customer empathy and ability to translate real-world workflows into platform improvements

What Success Looks Like

First 30 days

• Understand current tracing and evaluation workflows, pain points, and failure modes

• Ship first improvements to debugging workflow, trace visibility, or evaluation speed

First 90 days

• Tracer becomes a reliable foundation for prompt iteration and quality improvement

• Output issues are easier to identify, measure, and resolve

• Teams are operating with faster, safer deployment cycles

6 months

• Tracer is fully embedded into the product development lifecycle

• Quality benchmarks and evaluation loops drive measurable reliability gains

• Prompt changes and customer-specific logic can be shipped quickly with clear confidence signals

Who we are:
SuperDial is transforming AI in healthcare by building scalable, AI-powered solutions that optimize revenue cycle management. Join us and help shape the future of AI in healthcare!

The base salary for this role ranges from $180,000-$230,000, depending on experience, skill set, and fit. We also offer equity and benefits as part of our total compensation package. Final offers may vary based on experience and qualifications - we’re always open to exceptional talent.