Software Engineer - Developer Experience
We’re building a gamified developer platform where tens of thousands of engineers create high‑fidelity datasets that push LLM frontiers. This role owns the technical lifecycle of data pipelines—from defining new data formats with partner labs to shipping the tooling, environments, docs, and QA that make those formats real at scale.
What You’ll Do
Own projects end-to-end , from initial prototyping to ongoing maintenance, bug fixing, and iteration based on feedback.
Own developer experience pipelines end‑to‑end: Prototype tooling for collecting new data formats → productionize workflow → iterate from developer experience
Champion DX: Create clear, concise guidelines and documentation to empower our data contributors and ensure high-quality inputs for your projects.
Quality & governance: Develop and manage the quality standards for your projects, which includes training and aligning content reviewers to ensure data consistency and accuracy. Implement automated checks, eval harnesses, reviewer workflows, and data quality bars; be hands on and in the weeds to align with reviewers on standards.
Maintain & iterate: Monitor, debug, and continuously improve reliability, latency, and contributor success rates.
What You’ll Do Sometimes
Define Frontier data formats: Co‑author specs/RFCs with frontier lab researchers; design schemas, metadata, and versioning for new task/trajectory formats.
Build developer tooling & environments: Ship tooling, sandboxes, CLIs/SDKs, and capture/instrumentation to make contribution flows fast and safe.
You’ll Succeed Here If You Have
Excellent written communication skills, with a proven ability to explain complex concepts to a less technical audience.
An organized and process-oriented mindset – you enjoy bringing structure to ambiguous problems and are meticulous about quality.
Foundational full-stack skills, with experience in React and at least one modern backend language (e.g., Python, Node.js, Go).
Strong technical judgment and a pragmatic mindset – you know how to balance speed with quality, recognizing the need for a scrappy solution versus when to invest in a robust architecture.
A deep resourcefulness with AI – you are highly adept at prompt engineering and using AI tools to find the fastest path to a solution.
Characteristics we’re looking for
Curiosity, pride in your work, desire to push the frontiers
Nice to Have
Experience designing or running evaluations for LLM outputs to measure and track quality, accuracy, or other performance metrics.
Familiarity with building tools for other developers, such as CLIs, SDKs, or internal dashboards.
Experience with cloud infrastructure (AWS), Docker, and CI/CD pipelines
Recommended Jobs
Commerical Account Manager
Are you looking to grow your career in a family owned and oriented environment? Advanced IPM is searching for hard working, self-motivated, driven, outgoing, confident, clean cut outside Commercial A…
Office Administrator - UniFirst
Where will a UniFirst Career take you? As an industry leader in the rental, lease and sale of uniforms and facility services products, UniFirst Corporation has grown to become one of the largest co…
Lead Product Manager - Content Trust
About The Company: At Scribd (pronounced “scribbed”), our mission is to spark human curiosity. Join our team as we create a world of stories and knowledge, democratize the exchange of ideas and info…
Principal Training Product Manager
Overview Provide product management support for our training products, enabling us to empower our customers to solve the world’s problems with GIS. Your role will be to collaborate with our teams …
Licensed Insurance Sales Representative
Vicky Chen - State Farm Agency, located in Chino Hills, CA has an immediate opening for a full-time Licensed Insurance Sales Professional. We are an award winning State Farm agency focused on fulfill…
Network Software Test Principal Engineer
Network Software Test – Principal Engineer San Jose, CA About Arrcus Arrcus was founded to enhance business efficiency through superior network connectivity. The Arrcus Connected Edge (ACE…
Machine Learning Engineer II, Trust & Safety
Why PlayStation? PlayStation isn’t just the Best Place to Play — it’s also the Best Place to Work. Today, we’re recognized as a global leader in entertainment producing The PlayStation family of pr…
Senior Software Engineer (Data Platform Cortex Xpanse)
Company Description Our Mission At Palo Alto Networks® everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vi…
Machine Learning Engineer
About Abaka AI Abaka AI is built on one mission: to be the world’s most trusted data partner for AI companies. More than 1,000 industry leaders across Generative AI, Embodied AI, and Automoti…