Senior Data Engineer

Xscion
San Francisco, CA

As an employee, you Turn Change Into Value® - for our clients, for our company, for your professional growth, for the consumers. We hire the best and brightest, who are driven to create lasting value. At xScion, you aren't just another team member, you're impactful. You're empowered. You're driven. You're an xScioneer.

Location: Los Angeles, San Francisco, Salt Lake City, Portland, Seattle

As a Senior Data Engineer, You Will:


  • Design, develop, and operationalize large-scale enterprise data solutions using AWS services such as S3, Glue, Athena, Lambda, RedShift, EMR, Spark, and DynamoDB

  • Analyze, redesign, and re-platform on-premise data solutions from Cloudera Hadoop platforms to AWS native data stack

  • Design, develop, and deploy data pipelines from ingestion to consumption within a big data architecture using Java, Python, or Scala

  • Participate in discussions related to architecture, design, and product development to understand business requirements and translate them into technical solutions

  • Take responsibility for complete user stories through analysis, design, development, and testing as per project timelines

  • Develop and maintain scripts to automate batch jobs

  • Support and maintain existing applications, troubleshooting and resolving technical issues

  • Follow appropriate technical best practices and internal processes while complying with various information security controls

  • Maintain existing data solutions running on Hadoop stack using HDFS, Oozie, Impala, and Hive, handling some enhancements until the cloud migration.

To Be Successful, You Need:


  • Bachelor's Degree in Computer Science, Information Technology, or other relevant fields

  • Must be a US Citizen or a Green Card holder for over 3 years with the intent to become a US Citizen.

  • 7+ years of software development experience related to data engineering

  • Hands-on experience in Java, Python, or Scala with the ability to understand/write complex SQL queries

  • Proficient in AWS services such as S3, Glue, Athena, Lambda, RedShift, EC2, EMR, Spark, and DynamoDB using Java, Python, Scala, or PySpark

  • Experience deploying software solutions to the cloud platform through CI/CD in a DevOps model

  • General understanding of application and data security concepts with exposure to AWS IAM, CloudTrail, CloudWatch, AWS Config, Secrets Manager, and KMS

  • Hands-on experience with Hadoop technologies such as HDFS, Oozie, Impala, and Hive

  • Experience with Ansible, Terraform, or Cloud Formation scripts to develop or support Infrastructure as Code

  • Experience working with Hadoop-based Big Data architecture and solutions.

  • Experience working in an Agile development environment using Agile tools like Jira or Rally.

  • Proficiency with UNIX commands and shell scripts.

  • Ability to effectively communicate, collaborate, and work in a team environment to deliver high-quality work independently.

  • Nice to have experience with RDBMS and data warehouses

  • Nice to have experience with Machine Learning technologies and data visualization tools

Why xScion?


  • We have an amazing culture – We were named a Best Places to Work in Virginia 8 times, including 2025.

  • We are poised for rapid growth – We are on the cutting edge of digital transformation in Financial Services, Healthcare, Nonprofit and Public Sector and continuously welcome new clients to the xScion family.

  • We believe in your continuous development – We invest in our teams’ development, including our Communities of Practice, technology partnerships, sandbox and paying for certifications and trainings to improve their skills because we are committed to collectively being the best at what we do.

  • We want you to make an impact in whatever you do – Our people are given the opportunity to provide impactful change to our clients and team.

  • We believe in equality - As a woman-owned organization, we believe in an inclusive and diverse culture where everyone’s uniqueness makes us stronger.

  • Great Benefits : Medical, dental, 401(k) match, flexible spending and more, but we also have unique perks such as up to 27 days off a year (including your birthday!), remote work opportunities, parental leave, wellness benefits and many other things that inspire balance and flexibility.

We’re Transforming RegTech Organizations:

At xScion, we Turn Change Into Value. We help clients in highly regulated industries start or accelerate their digital transformation initiatives by shifting their mindset and goals into smaller, actionable steps that create lasting value. With more than 20 years of experience supporting Regulatory Technology (RegTech), xScion provides both domain experts and tailored solutions to help organizations navigate complex compliance and technology requirements. We specialize in Business Agility, Cloud Transformation and Organizational Change Management solutions for clients in Financial Services, Public Sector, Nonprofits and Healthcare. Our experts help prepare and create change to clients’ processes, technology and culture in order to improve operational efficiencies and the customer experience. As a certified Woman-Owned Small Business, we are proud to be the most trusted solutions partner that business and technology leaders count on to deliver lasting, impactful value.

All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or protected veteran status. xScion takes affirmative action in support of its policy to employ and advance in employment individuals who are minorities, women, protected veterans and individuals with disabilities.

You will be added to our talent community when you apply to this job. You may opt out at any time.

Want to Learn More about xScion?

Check us out on or socially at LinkedIn , Twitter and Glassdoor .

Posted 2025-11-25

Recommended Jobs

Advanced PCT - Training Consultant

BioLife
Moreno Valley, CA

This role requires that all individuals on the team hold one of the following current/active certifications: California Certified Phlebotomy Technician 1 License (CPT1), a California Certified Phlebo…

View Details
Posted 2025-12-16

Senior Data Scientist - Growth Measurement

Roblox
San Mateo, CA

WHY DATA SCIENCE & ANALYTICS? The Data Science & Analytics organization's mission is to increase our speed, frequency and acumen of making decisions at scale by instilling a data-influenced approac…

View Details
Posted 2025-12-25

Software Engineer, Platform

Sierra
San Francisco, CA

About us At Sierra, we’re building a platform to enable every company in the world to build their own autonomous AI agents for everything from customer service to commerce. We are primarily an in-…

View Details
Posted 2025-12-04

Product Manager, Payment Risk

Tomo Credit
San Francisco, CA

Who We Are As seen on TechCrunch, Forbes, and Bloomberg, join one of fastest growing areas in FinTech by taking on the credit system.  Work directly with one of Inc.’s top female founders and …

View Details
Posted 2025-11-25

Product Manager, Energy Storage

Redwood Materials
Paradise, CA

About Redwood Materials Redwood is localizing a global battery supply chain that seamlessly integrates recovery, reuse, and recycling —  keeping critical minerals in circulation and drivin…

View Details
Posted 2025-11-28

Machine Learning Engineer

Productnow
Palo Alto, CA

In this role, you will Explore and experiment with state-of-the-art AI models and machine learning techniques, contributing to core product features powered by ML. Own projects end-to-end – fro…

View Details
Posted 2026-01-13

Senior ML Infrastructure Engineer

Gridware
San Francisco, CA

About Gridware Gridware is a San Francisco-based technology company dedicated to protecting and enhancing the electrical grid. We pioneered a groundbreaking new class of grid management called act…

View Details
Posted 2025-12-16

Medical Science Liaison - Ontario and Western Canada

Teva Pharmaceutical Industries Ltd.
Ontario, CA

Who we are Together, we’re on a mission to make good health more affordable and accessible, to help millions around the world enjoy healthier lives. It’s a mission that bonds our people across nea…

View Details
Posted 2026-01-09

Backend Engineer - WEB3

Intellipro Group Inc.
San Francisco, CA

Job Title: Backend Engineer Position Type: FTE – Permanent Location: Remote / Hybrid in Bay Area Salary Range: 100,000-200,000(USD) Job ID#: 152131 Job Description: We are seeking an ex…

View Details
Posted 2025-12-13

Senior Full Stack Software Engineer, Financial Products and Infrastructure

Carta
Ontario, CA

The Company You’ll Join Carta develops purpose-built software that transforms traditional accounting into a powerful growth engine. Carta’s world-class fund administration platform supports n…

View Details
Posted 2025-12-13