Machine Learning Data Engineer - Systems & Retrieval
Zyphra is an artificial intelligence company based in Palo Alto, California.
The Role:
As a Machine Learning Data Engineer - Systems & Retrieval , you will build and optimize the data infrastructure that fuels our machine learning systems. This includes designing high-performance pipelines for collecting, transforming, indexing, and serving massive, heterogeneous datasets from raw web-scale data to enterprise document corpora. You’ll play a central role in architecting retrieval systems for LLMs and enabling scalable training and inference with clean, accessible, and secure data. You’ll have an impact across both research and product teams by shaping the foundation upon which intelligent systems are trained, retrieved, and reasoned over.
You’ll work across:
Design and implementation of distributed data ingestion and transformation pipelines
Building retrieval and indexing systems that support RAG and other LLM-based methods
Mining and organizing large unstructured datasets, both in research and production environments
Collaborating with ML engineers, systems engineers, and DevOps to scale pipelines and observability
Ensuring compliance and access control in data handling, with security and auditability in mind
Requirements:
Strong software engineering background with fluency in Python
Experience designing, building, and maintaining data pipelines in production environments
Deep understanding of data structures, storage formats, and distributed data systems
Familiarity with indexing and retrieval techniques for large-scale document corpora
Understanding of database systems (SQL and NoSQL), their internals, and performance characteristics
Strong attention to security, access controls, and compliance best practices (e.g., GDPR, SOC2)
Excellent debugging, observability, and logging practices to support reliability at scale
Strong communication skills and experience collaborating across ML, infra, and product teams
Bonus Skill Set:
Experience building or maintaining LLM-integrated retrieval systems (e.g, RAG pipelines)
Academic or industry background in data mining, search, recommendation systems, or IR literature
Experience with large-scale ETL systems and tools like Apache Beam, Spark, or similar
Familiarity with vector databases (e.g., FAISS, Weaviate, Pinecone) and embedding-based retrieval
Understanding of data validation and quality assurance in machine learning workflows
Experience working on cross-functional infra and MLOps teams
Knowledge of how data infrastructure supports training pipelines, inference serving, and feedback loops
Comfort working across raw, unstructured data, structured databases, and model-ready formats
Why Work at Zyphra:
Our research methodology is to make grounded, methodical steps toward ambitious goals. Both deep research and engineering excellence are equally valued
We strongly value new and crazy ideas and are very willing to bet big on new ideas
We move as quickly as we can; we aim to minimize the bar to impact as low as possible
We all enjoy what we do and love discussing AI
Benefits and Perks:
Comprehensive medical, dental, vision, and FSA plans
Competitive compensation and 401(k)
Relocation and immigration support on a case-by-case basis
On-site meals prepared by a dedicated culinary team; Thursday Happy Hours
In-person team in Palo Alto, CA, with a collaborative, high-energy environment
If you're excited by the challenge of high-scale, high-performance data engineering in the context of cutting-edge AI, you’ll thrive in this role. Apply Today!
Recommended Jobs
Senior Accountant
Where Purpose Meets Precision, Support LA’s BEST’s Finance Team as our Senior Accountant! About LA’s BEST LA’s BEST is a public/private partnership between the City of Los Angeles, the Los A…
Termite Repair Technician
Looking for a fun, family oriented place of employment? The Creepy Team is growing and we need your wood repair & treatment skills! Home Guard Pest Control is looking for a full-time Wood Repair/Term…
Therapist (LMFT, LCSW, LPCC) Earn $90,000 full time plus benefits
Make a Difference While Growing Your Career! At Palo Alto Therapy we are driven by a simple yet profound mission: to empower children, teens, and families through high-quality, evidence-based menta…
Senior Backend Engineer
About Mesh Founded in 2020, Mesh is the first global payment network for crypto, connecting hundreds of exchanges, wallets, and financial services platforms to enable seamless digital asset paymen…
Territory Manager
Sales Executive (SE), As part of our aggressive North American growth and expansion, LifeSignals is looking for a Sales Executive (SE). The SE role will focus on generating new sales in the Hospital …
Au Pair
Your Responsibilities: Childcare Support: Help care for our three children, including morning and bedtime routines, engaging activities, and after-school care. School Drop-off/Pick-up: Assist with tra…
Founding Machine Learning Engineer
About Trove Trove is developing an AI associate for financial firms - think enterprise search & agents for private equity, hedge funds, and banks Our mission is to deliver associate‑level AGI …
Quality Assurance Manager
What you´ll do Develop and implement quality plans and processes to support the overall quality strategy of Henkel customers. Ensure that customer requirements are met and customer satisfaction…
Senior Piping Estimator
Senior Piping Estimator job in Orange County, CA This is a permanent, full time position with a great salary and benefits package. Responsibilities: Utilize Excel and On-Screen Takeoff (OST)…