Data Engineer (Cloud and DevOps), ETL ,AWS , SQL, Python
Data Engineer (Cloud and DevOps), ETL ,AWS , SQL, Python
Toronto
Roles & Responsibilities
Build, design and implement scalable data lake architecture using AWS S3 and Lakeformation
Build and optimize ETL Pipelines using AWS Glue, EMR and Spark
Implement Event-Driven workflows using EventBridge, SNS and SQS
Design and query datasets using Athena
Manage metadata and data lineage using Amazon Neptune DB
Expose APIs for data subscription and sharing using API Gateway and AWS Lambda
Automate infrastructure provisioning using Terraform and CloudFormation
Ensure data security and compliance by implementing robust IAM policies and access controls.
Develop and maintain a self-serve data portal using Angular and integrate it with backend services
Must Have Technical/Functional Skills
Strong experience in automating infrastructure provisioning using Terraform or CloudFormation (Preferably with Terraform)
Strong Experience with AWS Services: S3, Lake Formation, Glue, EMR, Athena, Lambda, EventBridge, SNS, SQS
Proficiency in Apache Spark for distributed data processing
Familiarity with Amazon Neptune DB for graph-based metadata management
Strong understanding of Data lake architecture, data governance and security best practices
Proficiency in SQL, Python and Spark for Data Engineering tasks
Recommended Jobs
IT Business Analyst
Apply Description Job Title: IT Business Analyst Location: Los Angeles Department: Information Technology Reports To: CIO Position Overview The IT Business Analyst plays a c…
Cook
Create Your Experience of a Lifetime! Come work and play in the mountains! Whether it’s your first-time seeing snow or you were born on the slopes, joining our team means discovering (or re-di…
Dual Rate Cashier/Main Banker
Job Summary: Responsible for conducting customer transactions in an accurate and efficient manner; including exchange of gaming instruments for cash and customer inquiries, maintain the cage cash su…
Music Facilitator (Contract)
Responsibilities Canyon Ridge Hospital is currently seeking a compassionate and talented Music Facilitator (Contractor). At Canyon Ridge Hospital we understand that not all wounds are visi…
Independent Optometrist - Walmart
What you'll do at Position Summary... What you'll do... Launch your services in Walmart stores! As an Independent Optometrist leasing space inside our Walmart stores you will take a l…
Supplier Quality Engineer, PCB/PCBa
The Supplier Quality Engineer will play a key role in ensuring world-class performance of the Zoox prototype and production supply base, and drive continuous improvement. The ideal candidate will be …
FSO, Compliance Manager
Q Microwave, a leader in the precision RF manufacturing, design and manufacture of cutting-edge military and defense microwave solutions, is seeking a Compliance Manager , FSO to join our entrepreneur…
Regional Administrative Assistant III
Regional Administrative Assistant III Location Oakland, CA (Pill Hill area) : Organization: SEBMF-East Bay Medical Foundation Position Overview: Provides a broad range of high-level secretarial …
Sr. Account Executive - U.S. based
Job Description Job Description ABOUT THE ROLE: We are searching for a high - energy Account Executive who can recognize opportunities and turn leads into long-lasting partnerships to join our…
Houskeeper - Worldmark Anaheim Resort
We Put the World on Vacation Travel + Leisure Co. is the world’s leading vacation ownership and travel membership company, with a dynamic and growing portfolio of resort, travel club, and lifestyl…