Software Engineer - Developer Experience
We’re building a gamified developer platform where tens of thousands of engineers create high‑fidelity datasets that push LLM frontiers. This role owns the technical lifecycle of data pipelines—from defining new data formats with partner labs to shipping the tooling, environments, docs, and QA that make those formats real at scale.
What You’ll Do
Own projects end-to-end , from initial prototyping to ongoing maintenance, bug fixing, and iteration based on feedback.
Own developer experience pipelines end‑to‑end: Prototype tooling for collecting new data formats → productionize workflow → iterate from developer experience
Champion DX: Create clear, concise guidelines and documentation to empower our data contributors and ensure high-quality inputs for your projects.
Quality & governance: Develop and manage the quality standards for your projects, which includes training and aligning content reviewers to ensure data consistency and accuracy. Implement automated checks, eval harnesses, reviewer workflows, and data quality bars; be hands on and in the weeds to align with reviewers on standards.
Maintain & iterate: Monitor, debug, and continuously improve reliability, latency, and contributor success rates.
What You’ll Do Sometimes
Define Frontier data formats: Co‑author specs/RFCs with frontier lab researchers; design schemas, metadata, and versioning for new task/trajectory formats.
Build developer tooling & environments: Ship tooling, sandboxes, CLIs/SDKs, and capture/instrumentation to make contribution flows fast and safe.
You’ll Succeed Here If You Have
Excellent written communication skills, with a proven ability to explain complex concepts to a less technical audience.
An organized and process-oriented mindset – you enjoy bringing structure to ambiguous problems and are meticulous about quality.
Foundational full-stack skills, with experience in React and at least one modern backend language (e.g., Python, Node.js, Go).
Strong technical judgment and a pragmatic mindset – you know how to balance speed with quality, recognizing the need for a scrappy solution versus when to invest in a robust architecture.
A deep resourcefulness with AI – you are highly adept at prompt engineering and using AI tools to find the fastest path to a solution.
Characteristics we’re looking for
Curiosity, pride in your work, desire to push the frontiers
Nice to Have
Experience designing or running evaluations for LLM outputs to measure and track quality, accuracy, or other performance metrics.
Familiarity with building tools for other developers, such as CLIs, SDKs, or internal dashboards.
Experience with cloud infrastructure (AWS), Docker, and CI/CD pipelines
Recommended Jobs
Sr. Product Manager, Cloud
We’re in an unbelievably exciting area of tech and are fundamentally reshaping the data storage industry. Here, you lead with innovative thinking, grow along with us, and join the smartest team in th…
Frontend Engineer - Search & Computer Vision
Who We Are Verkada is the largest cloud-based B2B physical security platform company in the world. Only Verkada offers six product lines — video security cameras, access control, environmental…
Housekeeper
House Cleaning: Keeping our home clean and organized. Cooking and Meal Prep: Preparing delicious meals and doing some meal prep. Laundry: Managing the laundry to keep everything fresh. Miscellaneous T…
Store Lead, San Francisco
Friendly? Assertive? Passionate about food made from the highest quality, local ingredients? Join the Proper Food team! Proper Food is a food concept that offers freshly handcrafted, wholesome, a…
Product Manager, Waymo Driver Validation
Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildi…
Senior scientist
We help the world run better At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and w…
Recreational Therapist (CTRS)-Neuro-PRN
Join the excitement of a dynamic company committed to providing exceptional neurological rehabilitation . Collage Home and Community Rehabilitation Partners is a growing organization dedicated to exc…
Software Engineer (Product)
About Column For companies building financial technology and transforming the financial services space, the biggest bottleneck to their growth and innovation is often the underlying banks and infras…
Bookkeeper
Our company is currently seeking a Bookkeeper to join our team! You will be responsible for preparing and examining financial records for our company. Responsibilities: Obtain primary fi…