Data Engineer

Senior Data Architect – Data Engineering

Location: San Francisco, CA
Reports To: VP of Engineering
FLSA Status: Exempt
Employment Type: Full-Time
Compensation: $140,000 – $160,000 annually (based on experience)

About Cargomatic

Cargomatic is transforming the local trucking industry with cutting-edge technology that connects shippers and carriers in real time. Every product that humans build, grow, or sell has spent time on a truck. Local trucking is the lifeblood of every regional economy, yet this $82 billion industry still relies heavily on outdated systems. Cargomatic is bringing transparency, efficiency, and intelligence to local freight through modern technology and data-driven solutions.

We are solving complex, real-world logistics problems every day. If you thrive in a fast-paced environment, enjoy building scalable systems, and want to help shape the future of AI-powered logistics, we’d love to meet you.

Position Summary

Cargomatic is seeking a Senior Data Architect – Data Engineering to design and build scalable, cloud-native data infrastructure that powers analytics, machine learning, and AI-driven applications. This role combines deep data architecture expertise with hands-on experience in modern data platforms and LLM-enabled application development.

You will lead the design of enterprise-grade data models, architect RAG systems, implement agentic workflows, and integrate secure, production-ready LLM capabilities into our ecosystem. This is a high-impact role with significant ownership, visibility, and opportunity to shape the future of intelligent logistics technology.

Key Responsibilities

Data Architecture & Engineering

• 
  

  Design and build scalable, cloud-native data pipelines (batch and streaming) supporting analytics, ML, and AI-powered applications



• 
  

  Architect enterprise-grade data models across data lakes, warehouses, and real-time systems (Snowflake, Databricks, Kafka, DBT)



• 
  

  Define standards for data governance, reliability, performance, and cost optimization



• 
  

  Optimize storage formats and distributed data systems (Parquet, Delta Lake, Iceberg)

AI & LLM-Enabled Systems

• 
  

  Develop Retrieval-Augmented Generation (RAG) systems integrating structured and unstructured enterprise data



• 
  

  Design and implement agentic workflows using frameworks such as LangChain, LangGraph, LlamaIndex, n8n, or similar



• 
  

  Integrate LLM APIs (OpenAI, Anthropic, or similar) into secure, production-ready applications



• 
  

  Implement guardrails, validation layers, monitoring, and evaluation frameworks to mitigate hallucination, prompt injection, and data security risks

Backend & API Development

• 
  

  Build secure backend APIs (Python/FastAPI) to expose AI-powered capabilities



• 
  

  Ensure observability, monitoring, and cost controls across AI and data services



• 
  

  Contribute to microservices architecture and distributed system design

Collaboration & Leadership

• 
  

  Partner cross-functionally with Product, Engineering, and Operations to translate business requirements into scalable technical solutions



• 
  

  Mentor junior engineers and contribute to architectural standards and best practices



• 
  

  Drive innovation in data engineering and AI-powered logistics systems

Qualifications

• 
  

  Bachelor’s degree in Computer Science or equivalent practical experience



• 
  

  8+ years of software or data engineering experience in production environments



• 
  

  Strong expertise in data modeling, distributed systems, and scalable cloud architectures



• 
  

  Hands-on experience with ETL/ELT frameworks and streaming technologies (Kafka, Spark, HEVO, Snowflake, DBT, etc.)



• 
  

  Advanced SQL skills and deep understanding of modern storage formats



• 
  

  Proficiency in Python and RESTful API development



• 
  

  Experience integrating LLM APIs into production applications



• 
  

  Strong understanding of system reliability, observability, and cost management in cloud environments

Desired Experience

• 
  

  Experience building RAG pipelines including embeddings, vector search, chunking strategies, and hybrid retrieval



• 
  

  Experience designing multi-agent or agentic AI workflows with orchestration frameworks



• 
  

  Knowledge of LLM evaluation, monitoring, and tracing tools (LangSmith or similar)



• 
  

  Experience with microservices architecture and distributed system design



• 
  

  Exposure to transportation, logistics, or supply chain domains



• 
  

  Active GitHub contributions or demonstrated passion for emerging AI and data technologies

Why Join Cargomatic?

We offer competitive compensation and a comprehensive benefits package, including:

• 
  

  Medical, Dental, and Vision insurance



• 
  

  401(k) with company match



• 
  

  Flexible Spending Accounts (FSA)



• 
  

  Company-paid Life and Disability insurance



• 
  

  Flexible Paid Time Off (PTO) and company holidays



• 
  

  Paid Parental Leave



• 
  

  Employee Assistance Program (EAP)



• 
  

  Opportunity to build cutting-edge AI solutions in a high-growth logistics technology company



• 
  

  Collaborative, high-impact team environment

Cargomatic is proud to be an Equal Opportunity Employer. We are committed to creating a diverse and inclusive workplace where all employees feel valued and empowered to succeed.