Sr. Data Engineer
- Endava
44 Days Ago
NA
NA
Remote
11-15 Years
Required Skills: Snowflake, DBT, Cloud, Cloud architecture, Azure Data Factory, RBAC setup, ETL, SQL, Agile methodology
Job Description
Title: Sr. Data Engineer
Exp: 10+
Must have : snowflake, Cloud, DBT
Responsible:
- Modernize the Data Warehouse and build Analytical Data Store, while also maintaining the existing legacy Data warehouses.
- Design, develop, and implement scalable batch/real time data pipelines (ETLs) to integrate data from a variety of sources into Data Warehouse and Data Lake
- Design and implement data model changes that align with warehouse dimensional modeling standards.
- Proficient in Data Lake, Data Warehouse Concepts and Dimensional Data Model.
- Responsible for maintenance and support of all database environments, design and develop data pipelines, workflow, ETL solutions on both on-prem and cloud-based environments.
- Design and develop SQL stored procedures, functions, views, and triggers
- Design, code, test, document, and troubleshoot deliverables
- Collaborate with others to test and resolve issues with deliverables
- Maintain awareness of and ensure adherence to standards regarding privacy.
- Create and maintain design documents, Source to Target mappings, unit test cases, data seeding.
- Ability to perform Data Analysis and Data Quality tests and create audit for the ETLs.
- Perform Continuous Integration and Deployment using Azure DevOps and Git
Skills Required:
- 10+ years of previous experience
- Experience in Cloud architecture (Azure/AWS)
- Experienced with Azure Data Factory
- Proficient in Snowflake:
- Design of data marts
- Hands-on experience with RBAC setup
- Solid knowledge of architecture
- Hands-on experience with admin setup
- Extensive ETL experience
- Excellent SQL capabilities
- Agile methodology
· DBT experience
