Senior Data Engineer
I am partnered with a Real Time Intelligence Company, who have built a platform that uses AI to transform publicly available data into real time operational insights.
With a huge part of their business growing, they are now looking to hire a Senior Data Engineer, who will be an integral part of the team, working on new and exciting projects, building new pipelines, migrating from one service to another service and building a data and analytics infrastructure.
Responsibilities
- Build and maintain data pipelines for large scale data ingestion, real time analytics and Machine Learning Services
- Develop and optimize NLP, LLMs and other AI powered applications
- Write CI/CD pipelines and have the ability to do code reviews
- Design and build a data analytics infrastructure
Qualifications
- Professional Experience in using Apache Storm, Kafka or Flink for real time data or streaming
- 5+ years experience in Data Engineering and building pipelines using Databricks and Spark
- Can demonstrate experience in building CI/CD pipelines and DevOps best practises
- Experience with real time data streaming
Recommended Jobs
Operations Program Manager
About Redwood Materials Redwood is localizing a global battery supply chain that seamlessly integrates recovery, reuse, and recycling — keeping critical minerals in circulation and driving the en…
Travel Nurse RN - Emergency Room (ER) / Trauma - $2,229 per week in Tulare, CA
Registered Nurse (RN) | Emergency Room (ER) / Trauma Location: Tulare, CA Agency: Infojini Healthcare Pay: $2,229 per week Shift Information: Nights - 3 days x 12 hours Contrac…
B2B Sales Executive - CBS Division
Join our CBS Division at City Wide Facility Solutions as a B2B Sales Executive! In this role, you will drive the growth of our CBS division by identifying, developing, maintaining relationships and p…
Senior Outreach Representative
ABOUT EIP Energy Infrastructure Partners LLC (EIP) is a minority-owned business specializing in energy efficiency, electrification, decarbonization, and demand-side management programs. With offic…
Occupational Therapist Assistant (COTA)
Are you passionate about helping children? Are you looking for a collaborative practice offering one-on-one treatment? Are you ready to have fun at work? Leaps & Bounds Pediatric Therapy is excited t…
Nurse 3-1314
Job Title: Nurse 3 Location: Redondo Beach, CA Zip Code: 90278 Pay Rate: Up to $65.09/hr. Schedule: 9x80 A Start Date: Immediate Job Type: Contract- 12 months Keyword's: #RedondoBeachjobs; #Nu…
Clinical Therapist
Job Title : Clinical Therapist (ASW, AMFT, APC, LMFT, LCSW, LPCC) Location : Hybrid Mandatory (Remote and In-Person) Employment Type : Fee for Service (Minimum 20 hours per week) About U…
Executive Assistant
Help Protect Napa County from Wildfires! Looking for a meaningful career that helps protect California communities and landscapes? Nestled among world-renowned vineyards, Michelin-starred dining, lux…
Forklift & Trailer Mechanic
POSITION SUMMARY: Responsible for the safe and timely performance of regular service, maintenance, and repair work on trailers and lift trucks; Responsible for ensuring trailers and forklifts remain…
Research Scientist - Reinforcement Learning, Robotics
About Applied Intuition Applied Intuition, Inc. is powering the future of physical AI. Founded in 2017 and now valued at $15 billion, the Silicon Valley company is creating the digital infrastruct…