Senior Data Engineer
I am partnered with a Real Time Intelligence Company, who have built a platform that uses AI to transform publicly available data into real time operational insights.
With a huge part of their business growing, they are now looking to hire a Senior Data Engineer, who will be an integral part of the team, working on new and exciting projects, building new pipelines, migrating from one service to another service and building a data and analytics infrastructure.
Responsibilities
- Build and maintain data pipelines for large scale data ingestion, real time analytics and Machine Learning Services
- Develop and optimize NLP, LLMs and other AI powered applications
- Write CI/CD pipelines and have the ability to do code reviews
- Design and build a data analytics infrastructure
Qualifications
- Professional Experience in using Apache Storm, Kafka or Flink for real time data or streaming
- 5+ years experience in Data Engineering and building pipelines using Databricks and Spark
- Can demonstrate experience in building CI/CD pipelines and DevOps best practises
- Experience with real time data streaming
Recommended Jobs
Forms Analyst
Job Description and Duties Under the supervision of the Supervisor I of the Forms Management Unit, the Analyst I/II is responsible for a wide variety of analytical and consultative assignments, wh…
Part-Time Front Desk Associate
Part-Time Front Desk Associate – Resort-Style Homeowners Association Location: Manteca, CA Schedule: Part-Time (Weekends and/or Evenings may be required) Compensation: Competitive hourly w…
Coordinating Esthetician
Job Description Job Description Salary: $18-$20 Esthetics Career with Facial Lounge: Join Us as a Coordinating Esthetician (Esthetician License Required) About Facial Lounge At Facial…
Sandwich Maker & Cashier
Job Description Job Description Benefits: Employee discounts Free uniforms Benefits/Perks Flexible Scheduling Competitive Compensation Career Advancement Opportunities Job Su…
Plaintiff Litigation Paralegal (3+ Years) - Mesothelioma / Asbestos -- Emeryville, CA
Plaintiff Litigation Paralegal (3+ Years) – Mesothelioma / Asbestos L&W Recruiting – Plaintiff Litigation Firm A plaintiff‑side litigation firm is seeking a Paralegal with 3+ years of experien…
Travel Radiology Interventional Radiology Tech Job
Job Overview TLC Nursing Associates, Inc. is seeking an experienced Interventional Radiology Technologist to assist physicians in minimally invasive, image?guided procedures while upholding pat…
Part Time Unarmed Security Guard
Part-Time Security Guard - Vernon, CA ⏱ 60-Second Read — Everything You Need to Know $19–$20/hr | Part-Time Flex | Graveyard Shift | Vernon, CA Job Description Dinasty Security Inc. is hirin…
SeniorSpecialist, Global Controls - Santa Monica, 90404
SeniorSpecialist, Global Controls - Santa Monica, 90404, United States of America How we LEAD: Universal Music Groups Global Controls & Assurance (GCA) Department is a global team of professional…
Customer Service & E-Commerce Team Leader (Customer Service, In-Store Shopper Department Manager)
At Whole Foods Market, we are working to nourish people and the planet. In this role, you will provide overall leadership to the Customer Service & E-Commerce programs; this means you are accountable…