Senior Data Engineer-1521
City: LA, CA
Onsite/ Hybrid/ Remote: Remote
Duration : 6 months
Rate Range : Up to$92.5/hr on W2 depending on experience (no C2C or 1099 or sub-contract)
Work Authorization : GC, USC, All valid EADs except OPT, CPT, H1B
Core Skills:
Expertise in big data engineering pipelines, Spark. Python, MPP Databases/SQL (Snowflake), Cloud Environments (AWS)
Must Have:
- Expertise in Big Data engineering pipelines
- Strong SQL and MPP Databases (Snowflake, Redshift, or BigQuery)
- Apache Spark (PySpark, Scala, Hadoop ecosystem)
- Python/Scala/Java programming
- Cloud Environments (AWS – S3, EMR, EC2)
- Data Warehousing and Data Modeling
- Data orchestration/ETL tools (Airflow or similar)
Responsibilities:
- Design, build, and optimize large-scale data pipelines and warehousing solutions.
- Develop ETL workflows in Big Data environments across cloud, on-prem, or hybrid setups.
- Collaborate with Data Product Managers, Architects, and Engineers to deliver scalable and reliable data solutions.
- Define data models and frameworks for data warehouses and marts supporting analytics and audience engagement.
- Maintain strong documentation practices for data governance and quality standards.
- Ensure solutions meet SLAs, operational efficiency, and support analytics/data science teams.
- Contribute to Agile/Scrum processes and continuously drive team improvements.
Qualifications:
- 6+ years of experience in data engineering with large, distributed data systems.
- Strong SQL expertise with ability to create performant datasets.
- Hands-on experience with Spark, Hadoop (HDFS, Hive, Presto, PySpark).
- Proficiency in Python, Scala, or Java.
- Experience with at least one major MPP or cloud database (Snowflake preferred, Redshift or BigQuery acceptable).
- Experience with orchestration tools such as Airflow.
- Strong knowledge of data modeling techniques and data warehousing best practices.
- Familiarity with Agile methodologies.
- Excellent problem-solving, analytical, and communication skills.
- Bachelor’s degree in STEM required.
Recommended Jobs
Client Advisor
Gucci seeks a Client Advisor in Glendale, responsible for delivering exceptional customer service and achieving sales targets. The role requires a minimum of 3 years in luxury fashion sales, with stro…
Senior Quality Assurance Engineer
Intellisense Systems innovates what seemed impossible. We are a fast-growing Southern California technology innovator that solves tough, mission-critical challenges for our customers in advance…
ML Infrastructure Engineer (Staff / Principal)
About the Team We’re a tight-knit team of proven drug hunters, deep learning researchers, and software engineers united by a common mission — drive AI innovation in biochemistry, discovering and d…
User Research Coordinator
Our client, a leading organization in the technology and gaming industry, is seeking a User Research Coordinator to join their team. As a User Research Coordinator, you will be part of the Research Op…
Software Engineer, Account Protection
About the Team The Integrity team at OpenAI is dedicated to ensuring that our cutting-edge technology is not only revolutionary but also secure from a myriad of adversarial threats. We strive to mai…
Senior Machine Learning Engineer, Computer Vision - Robotics
Scale’s Robotics business unit is dedicated to solving the data bottleneck in Physical AI. This position will be a key contributor in conducting applied research in Robotics and developing ML pipelin…
Software Engineer, Inference - TL
About the Team Our team brings OpenAI’s most capable research and technology to the world through our products. We empower consumers, enterprises, and developers alike to access state-of-the-art AI …
LEAD Python Engineer (GenAI, Full Stack Engineer) (San Bruno, CA)
~8+ Software Engineering experience ~3-5 years of experience of python if they have experience with another OO language thats great - Full Stack Ex. needed ~ Cloud experience - Azure - 2+ - won’t …