Senior Azure Data Engineering Lead
- E-solutions Inc.
18 Hours Ago
NA
Yearly
Wilmington-DE
10-15 Years
Required Skills: Azure, Data Engineering, Database, DevOps
Job Description
Key Responsibilities
Technical Leadership
- Lead the design, development, and deployment of enterprise-grade Azure data integration solutions.
- Provide technical oversight to onsite and offshore teams.
- Drive solution architecture reviews, code reviews, and deployment governance.
- Act as the primary technical liaison between business stakeholders, architecture teams, and development teams.
Azure Data Factory Development
- Design and develop scalable ADF pipelines for batch and near real-time data integrations.
- Implement reusable ingestion frameworks and metadata-driven ETL processes.
- Optimize pipeline performance, reliability, monitoring, and error handling.
- Troubleshoot production issues and implement long-term remediation strategies.
Azure Platform Engineering
- Design and implement Azure-based data solutions leveraging:
- Azure Data Factory
- Azure SQL Database
- Azure Storage Accounts
- Azure Key Vault
- Azure Functions
- Azure Monitor and Log Analytics
- Azure App Services
- Ensure security, compliance, and operational best practices are followed.
DevOps & CI/CD
- Build and maintain CI/CD pipelines using GitLab.
- Implement version control, branching strategies, automated deployments, and release management.
- Automate deployment of:
- ADF artifacts
- Database changes
- Azure resources
- .NET components
- Establish DevOps best practices and deployment governance.
Database Engineering
- Work with SQL Server and Azure SQL databases.
- Design and optimize stored procedures, views, and database objects.
- Implement database deployment automation through GitLab pipelines.
- Ensure high-performance data processing and data quality standards.
Custom .NET Function Development
- Create, maintain, enhance, and deploy custom .NET functions/services that integrate with ADF pipelines.
- Troubleshoot and optimize existing custom components.
- Support integration between ADF and proprietary business logic components.
- Ensure secure and scalable implementation of .NET solutions in Azure.
Production Support & Governance
- Participate in architecture reviews and design discussions.
- Support deployment planning and production releases.
- Develop operational runbooks, support documentation, and deployment procedures.
- Ensure adherence to banking industry security and compliance standards.
Required Qualifications
Experience
- 10+ years of overall IT experience.
- 7+ years of experience in Microsoft Azure.
- 5+ years of hands-on Azure Data Factory development.
- 3+ years of GitLab DevOps implementation experience.
- Experience leading onsite client engagements and distributed teams.
- Prior experience in banking or financial services environments.
Technical Skills
Azure
- Azure Data Factory (ADF)
- Azure Functions
- Azure SQL Database
- Azure Storage
- Azure Key Vault
- Azure Monitor
- Azure App Services
Data Engineering
- ETL / ELT Design
- Data Integration
- Data Warehousing Concepts
- Performance Optimization
- Data Quality Frameworks
Database
- SQL Server
- Azure SQL
- T-SQL
- Database Release Management
DevOps
- GitLab
- GitLab CI/CD
- Infrastructure as Code
- Automated Deployment Frameworks
- Release Management
Programming
- C#
- .NET Framework / .NET Core
- REST APIs
- PowerShell Scripting
Preferred Qualifications
- Azure Solutions Architect Certification.
- Azure Data Engineer Associate Certification.
- Experience with enterprise ODS/Data Warehouse implementations.
- Familiarity with Agile/Scrum delivery methodology.
- Experience working in highly regulated banking environments.
- Knowledge of infrastructure automation and containerization technologies.
