Matillion Data Engineer

JOB SUMMARY

The Senior Data Engineer will design, build, and implement data integration solutions, including data pipelines, data API's, and ETL jobs , to meet the data needs of applications, services, micro services, data assets, and business intelligence and analytical tools. Working with data architects, application development teams, data analytics teams, business analytics, product managers, and the data governance COE, the Senior Data Engineer will design and develop interfaces between applications, databases, data assets, external partners, and third-party systems in a combination of cloud and on-premise platforms.

• Develops and maintains scalable data pipelines and builds out new integrations to support continuing increases in data volume and complexity
• Designs and develops scalable ETL packages for point to point integration of data between source systems, extraction and integration of data into various data assets, including data warehouse and fit for purpose data repositories, both on prem and cloud
• Designs and develops scalable data APIs to provide data as a service to microservices, applications, and analytical tools
• Designs and develops data migrations in support of enterprise application and system implementations from legacy systems
• Writes functional specifications for data pipelines and APIs and writes and performs unit/integration tests
• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Assists in planning, coordinating, and executing engineering projects
• Supports and collaborates with other Engineers through evaluation, design analysis, and development phases
• Maintains knowledge, ensures competency and compliance with policies and procedures, in order to be the technical expert while collaborating with cross-functional teams
• This list is not all-inclusive and you are expected to perform other duties as requested or assigned

ESSENTIAL DUTIES

• Develops and maintains scalable data pipelines and builds out new integrations to support continuing increases in data volume and complexity
• Designs and develops scalable ETL packages for point to point integration of data between source systems, extraction and integration of data into various data assets, including data warehouse and fit for purpose data repositories, both on prem and cloud
• Designs and develops scalable data APIs to provide data as a service to microservices, applications, and analytical tools
• Designs and develops data migrations in support of enterprise application and system implementations from legacy systems
• Writes functional specifications for data pipelines and APIs and writes and performs unit/integration tests
• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Assists in planning, coordinating, and executing engineering projects
• Supports and collaborates with other Engineers through evaluation, design analysis, and development phases
• Maintains knowledge, ensures competency and compliance with policies and procedures, in order to be the technical expert while collaborating with cross-functional teams
• This list is not all-inclusive and you are expected to perform other duties as requested or assigned
• Meet with the Product Owner to gather requirements
• Experience building ETL for analytical models
• Design and Develop Matillion orchestration jobs to integrate the data and Compare the results of the Data integration between the Source and Target
• Experience in implementing frame work solutions for data reconciliation
• Evaluate Results and discuss discrepancies with the Product Owner and Business and bring closure to the discrepancy
• Deploy code to Production

Matillion and Snowflake are the key requirements

About AgreeYa:
AgreeYa is a global systems integrator delivering a competitive advantage for its customers through software, solutions, and services. Established in 1999, AgreeYa is headquartered in Folsom, California, with a global footprint and a team of more than 1,800+ professionals across offices. AgreeYa works with 550+ organizations ranging from Fortune 100 firms to small and large businesses across industries such as Telecom, Banking, Financial Services & Insurance, Healthcare, Utility & Energy, Technology, Public Sector, Pharma & Biotech, Retail, Client, and others. Please visit us at for more information.

Equal Opportunity:
AgreeYa is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, gender identity, sexual orientation, national origin, disability, veteran status or other protected characteristics. Visit our website at to learn about our Career & Culture.