Sr. Data Engineer
The Data and Artificial Intelligence Platform (DAP) group is a key component of Visas Technology organization providing the enabling technology and processes to handle Visas data assets and deliver valuable information products and services to customers. Within DAP the Data as a Service (DaaS) team consists of skilled data engineers focused on building data pipelines to meet Visas data needs and delivers secure high-quality and easy-to-use data assets.
As a Senior Data Engineer youll join our Data & AI Platform Data as a Service organization in Foster City California. You will help design enhance and build our data infrastructure and pipelines within an agile development environment using Gen AI regularly and collaborating with colleagues who will support and challenge you daily.
Primary responsibilities:
As a Sr. Data Engineer you will play a key role in the innovation design and development of comprehensive data pipeline solutions.
Essential functions includes:
- Design develop and maintain robust and scalable data pipelines and ETL processes
- Design and develop conceptual logical and physical data models to map our data requirements into database structures
- Ensure data services are highly available secure scalable and resilient.
- Improve and support production systems ensuring that production issues are promptly resolved
- Collaborate with the agile team user community architects and support teams to understand requirements and implement effective solutions
- Drive innovation to differentiate our data products and accelerate time-to-market delivery.
- Represent the team in various technical forums and build deep partnerships with product management.
- Adhere to established software development guidelines security standards and responsible use of Gen AI tools and frameworks
- Help maintain atmosphere of mutual accountability
What We Offer:
- Exciting Challenges: We work at a scale rarely seen in the industry solving complex data and AI problems across the entire stack offering limitless opportunities to leverage and lead in this ever-growing field.
- Teamwork and Fun: Each of us brings diverse and rich experiences to the team enabling us to deliver much more than the sum of our parts and have fun at the same time.
- Fantastic People: With strong leadership you will have the opportunity to learn collaborate and deliver together with some of the best and most creative minds in the industry.
This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.
Qualifications :
Basic Qualification:
2 years of relevant work experience and a Bachelors degree OR 5 years of relevant work experience
3 or more years of work experience with a Bachelors Degree or more than 2 years of work experience with an Advanced Degree (e.g. Masters MBA JD MD)
Strong programming skills in at least two of the following languages: Java Python Go Scala
Experience utilizing GenAI technologies in software development
Hands-on experience developing data processing pipeline feature extraction production deployment and monitoring
Expertise with Apache Spark Kafka Hadoop Hive Trino Presto Apache Airflow and NoSQL databases like Hbase working with PB level data volume
Hands on Experience in on-prem (Hadoop) and cloud-based data platforms (AWS Azure DataBricks) and related data storage (HDFS S3) and processing tools (Spark)
Experience with GenAI or Agentic AI technologies (e.g. LLMs NLP) and RAG-based architecture and Vector DBs
Working experience in building solutions using MCP and A2A frameworks.
Advanced proficiency and expertise in J2EE technologies Microservices and REST APIs
Proven track record of building and deploying streaming and batch ETL pipelines using the latest Big Data technologies
Experience in an Agile environment with a strong emphasis on best software development practices such as CI/CD code reviews and test automation using tools like Jira and Jira Align
Strong understanding of algorithms and data structures
Excellent problem-solving and troubleshooting abilities
Excellent communication and interpersonal skills and a strong team player.
Should have key leadership behaviors like Positive attitude Quick learner Collaborative and Obsess with Customer
Additional Information :
Work Hours: Varies upon the needs of the department.
Travel Requirements: This position requires travel 5-10% of the time.
Mental/Physical Requirements: This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk communicate in person and by telephone frequently operate standard office equipment such as telephones and computers.
Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.
Visa will consider for employment qualified applicants with criminal histories in a manner consistent with applicable local law including the requirements of Article 49 of the San Francisco Police Code.
U.S. APPLICANTS ONLY: The estimated salary range for a new hire into this position is 123000.00 to 173950.00 USD per year which may include potential sales incentive payments (if applicable). Salary may vary depending on job-related factors which may include knowledge skills experience and addition this position may be eligible for bonus and equity. Visa has a comprehensive benefits package for which this position may be eligible that includes Medical Dental Vision 401 (k) FSA/HSA Life Insurance Paid Time Off and Wellness Program.
Remote Work :
No
Employment Type :
Full-time
Recommended Jobs
System Wireless Test Engineer
Company: Qualcomm Technologies, Inc. Job Area: Engineering Group, Engineering Group Systems Test Engineering General Summary: This individual possesses the solid engineering fundame…
Associate Manager, PC Commercial
Description Job Title: Associate Manager, PC Commercial Requisition ID: R025937 : Job Title: Associate Manager, PC Commercial 6 Digital Gaming, 3P Platforms Reporting To: Direc…
Director, Production Safety (UCAN) DE
Job Summary: The Director, Production Safety, who reports to the VP of Production Safety, oversees the safety strategy and operations for The Walt Disney Company's physical productions in the U.S.…
Credit Officer
Based in California Competitive Package About Our Client A large global bank Job Description Essential Functions : # Analyze financial statements, tax returns with emphasis on cashf…
Remote Sales Customer Representative
Ready to make a tangible impact from the comfort of your home? Join us as a Remote Sales Customer Representative and help families build lasting financial security! Ready to shape your income and f…
Assistant Store Manager
Be part of an iconic story. At Calvin Klein, we believe in fostering an inclusive and collaborative culture by celebrating different perspectives, backgrounds and beliefs to truly connect with o…
Therapist - Rimrock Program
Job Title : Full-Time Therapist (LMSW or Higher) – Specializing in Trauma, CBT, and EMDR for Children and Adolescents Position Overview: We are seeking a highly skilled and compassionate thera…
Engineer, Plant Operations, Full Time, Variable
Under direct supervision of the Plant Operations & Maintenance Manager when performing planning, organizing and coordination, and supervision of minor projects and general corrective and preventive ma…
District Manager
Are you a positive, upbeat, passionate, competitive person? Someone who is determined to thrive in a rapidly changing environment. If you understand that leading, training, and recruiting for your sto…
Director, Employment Law Litigation
Our values start with our people, join a team that values you! Bring your talents to Ross, our leading off-price retail chain with over 2,200 stores, and a strong track record of success and growth…