Senior Data Engineer
I am partnered with a Real Time Intelligence Company, who have built a platform that uses AI to transform publicly available data into real time operational insights.
With a huge part of their business growing, they are now looking to hire a Senior Data Engineer, who will be an integral part of the team, working on new and exciting projects, building new pipelines, migrating from one service to another service and building a data and analytics infrastructure.
Responsibilities
- Build and maintain data pipelines for large scale data ingestion, real time analytics and Machine Learning Services
- Develop and optimize NLP, LLMs and other AI powered applications
- Write CI/CD pipelines and have the ability to do code reviews
- Design and build a data analytics infrastructure
Qualifications
- Professional Experience in using Apache Storm, Kafka or Flink for real time data or streaming
- 5+ years experience in Data Engineering and building pipelines using Databricks and Spark
- Can demonstrate experience in building CI/CD pipelines and DevOps best practises
- Experience with real time data streaming
Recommended Jobs
Data Engineer
Title: Data Engineer Belong. Connect. Grow. with KBR! KBR's National Security Solutions team provides high-end engineering and advanced technology solutions to our customers in the intell…
Security Program / Project Manager
Exciting Security Program / Project Manager contract opportunity. Requirements ~7 plus years of program or project management experience, with several years in cybersecurity or technology progra…
Bureau Chief
Job Description and Duties Do you enjoy working in a fast-paced Remote-Centered environment with variety in your work? The California Department of Insurance (CDI) is seeking a dynamic Bureau Chie…
Registered Client Service Associate
Registered Client Service Associates provide exceptional service to our clients and support Financial Advisor(s) (FAs)/ Private Wealth Advisor(s) (PWAs)/ teams on a daily basis. Through regular inter…
Healthcare Recruiter
Jumpstart Your Career in Healthcare Recruitment! Entry-Level Recruiter Role | Paid Training, Mentorship & Growth Opportunities Salary: $57,000 per year ($50,000 base + $7,000 COLA) + weekly comm…
Travel Nurse RN - Operating Room - $3,200 to $3,300 per week in Joshua Tree, CA
Registered Nurse (RN) | Operating Room Location: Joshua Tree, CA Agency: Compunnel Healthcare Pay: $3,200 to $3,300 per week Shift Information: Days - 5 days x 8 hours Contract…
VP of Product
The Role Clearstory is looking for a seasoned Vice President of Product to lead product execution and help shape the next phase of our product strategy as we scale a proven financial workflow plat…
Athletics Coach - JV Boys Volleyball
Description We are looking for a JV Boys Volleyball at Aspire Stockton Secondary Academy. Aspire Public Schools operates a network of high-performing, college preparatory charter schools serving T…
Advertising Project Manager
: As a Digital Project Manager at eJam, you'll orchestrate the creation and optimization of cutting-edge digital marketing assets, overseeing projects from inception to execution. Based in the vibra…