Software Engineer II, Data Engineering & Infrastructure
- Design, build, and maintain robust and scalable data pipelines and ETL/ELT processes to ingest, transform, and load data from various sources into our data warehouse.
- Develop and manage data infrastructure components using AWS cloud services and infrastructure-as-code tools like Terraform.
- Collaborate with data scientists, analysts, autonomy engineering teams and product teams to understand their data needs and build solutions that meet their requirements.
- Optimize data processing systems for performance, reliability, and cost-efficiency.
- Implement monitoring, alerting, and logging for data pipelines and infrastructure to ensure operational stability.
- Champion best practices in data governance, data quality, and security.
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
- 3+ years of professional experience in software engineering, with a focus on data-related projects.
- Proficiency in at least one programming language commonly used for data engineering (e.g., Python, Go or C++).
- Solid experience with big data processing frameworks like Apache Spark, Flink, Kinesis Data Stream, or similar technologies.
- Hands-on experience with cloud platforms (AWS, GCP, or Azure) and their data services (e.g., S3, Redshift, BigQuery, Glue).
- Strong knowledge of SQL and experience working with relational and NoSQL databases.
- Intermediate knowledge of data analytics infrastructure, including data transformation tools such as DBT and visualization frameworks and tools
- Experience with building and managing data pipelines using an orchestrator like Apache Airflow.
- Able to systematically approach open-ended questions to identify pragmatic data solutions that scale
- Able to work effectively in a highly cross-functional, fast-moving and high-stakes environment
- Proven ability to communicate technical, data-driven solutions to both technical and non-technical audiences across stakeholders
- Experience with data warehousing solutions like Snowflake or data lake architectures.
- Familiarity with modern data stack tools and practices.
- A passion for building elegant, scalable, and maintainable systems.
- Experience using Amazon Web Services (AWS) tools
Recommended Jobs
Marketing Field Representative
With 100 years of experience, our commitment to our employees and our customers is strong. See why we are one of the largest, locally-owned auto groups in Southern California. Using a "hands-on" appro…
Backend Engineer - Enterprise Agent
About xAI xAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on e…
Senior Software Engineer
WeightWatchers is a global digital health company. We are the #1 doctor-recommended – and most clinically studied – behavioral weight health program in the world. For sixty years, WeightWatchers…
General Manager | San Francisco Premium Outlets
INTRODUCTION At Burberry, we believe creativity opens spaces. Our purpose is to unlock the power of imagination to push boundaries and open new possibilities for our people, our customers and our …
Frontend Engineer
About Mesh Founded in 2020, Mesh is the first global payment network for crypto, connecting hundreds of exchanges, wallets, and financial services platforms to enable seamless digital asset paymen…
Customer Care Representative (Entry Level Assistant Manager)
About the Job Assistant Manage r (Entry Level) for Athletic Club The Role: Prime Time Athletic Club in Burlingame seeks a service-oriented individual who is honest, energetic, polite, ent…
Logistics Manager
Position: Logistics Manager Company: Vupico © Vupico © is a fast-growing company specializing in the import and distribution of high-quality home and lifestyle products. We are looking for a…
Nanny
A family in La Jolla, CA is eeking a reliable, nurturing, and proactive Au Pair/Nanny and Housekeeper to care for three school-aged children and support household upkeep. The ideal candidate will prov…
Perception Engineer, Machine Learning
Job Overview: We are seeking a Perception Engineer with expertise in sensor fusion and computer vision and to develop target detection, tracking, and classification capabilities for a variety of s…
Senior · Staff · Principal Backend Engineer
Senior / Staff / Principal Backend Engineer Location: Onsite San Francisco We have multiple startups interested in talent. Here is a generic summary. Instead of a perfect job description, we pres…