Senior Data Engineer
I am partnered with a Real Time Intelligence Company, who have built a platform that uses AI to transform publicly available data into real time operational insights.
With a huge part of their business growing, they are now looking to hire a Senior Data Engineer, who will be an integral part of the team, working on new and exciting projects, building new pipelines, migrating from one service to another service and building a data and analytics infrastructure.
Responsibilities
- Build and maintain data pipelines for large scale data ingestion, real time analytics and Machine Learning Services
- Develop and optimize NLP, LLMs and other AI powered applications
- Write CI/CD pipelines and have the ability to do code reviews
- Design and build a data analytics infrastructure
Qualifications
- Professional Experience in using Apache Storm, Kafka or Flink for real time data or streaming
- 5+ years experience in Data Engineering and building pipelines using Databricks and Spark
- Can demonstrate experience in building CI/CD pipelines and DevOps best practises
- Experience with real time data streaming
Recommended Jobs
Sr. Technical Sourcer
Who We Are Nuro is a self-driving technology company on a mission to make autonomy accessible to all. Founded in 2016, Nuro is building the world’s most scalable driver, combining cutting-edge AI …
Customer Service Alterations
From Aisle to Algorithm and for All Life’s Moments, at David’s Bridal, we empower our customers and our employees to stay true to their dreams and find the one, whether that means the event or the wed…
Program Manager, Critical Harm Operations
About the TeamCritical Harm Operations sits within User Safety & Risk Operations and builds enforcement systems for Frontier Risk and Material Harm that are accurate, fast, defensible, and built to sc…
Postgres DBA
Postgres DBA Role Descriptions: 1. Strong knowledge of Postgres Architecture. 2. Experience with different types of backup and restores in Postgres. 3. Experience with database upgrade on mino…
Vice President of Finance
CONFIDENTIAL SEARCH Vice President of Finance Los Angeles, CA (Brentwood) | Hybrid | Full-Time About Our Client Our client is a fast-growing, well-funded Series A beauty and consumer goods …
Staff RFIC Design Engineer
Company Description WD is building the infrastructure behind the AI-driven data economy. As AI scales, so does data. Every interaction, every model, every system generates data that must be store…
COTA - Travel Contract
We are hiring a Certified Occupational Therapy Assistant for a contract role in Stockton, CA at a skilled nursing facility. Under the guidance of a licensed Occupational Therapist, you will help pati…
Therapist (AMFT, LCSW,LPC)
Job Description Job Description Salary: $60k-75k DOE Therapist About Prosperous Health Prosperous Health is dedicated to providing compassionate, evidence-based behavioral health and sub…
Substance Use Disorder (SUD) Counselor (SUDCC-II, II) or (CADC-II, III) or (CATC-II, III)
You Matter • Make a difference every day in the lives of the underserved • Join a mission driven organization with a people first culture • Excellent career growth opportunities Join us an…