Senior Azure Data Engineer
- Siri Infotec.LLC.
20 Days Ago
NA
NA
Fort Worth-TX
8-14 Years
Required Skills: Senior Azure Data Engineer with PySpark, Data Bricks
Job Description
Senior Azure Data Engineer with (PySpark, Data Bricks)
Fort Worth, TX
Final round will be Onsite
Contract
Job Description:
We are seeking a highly skilled Senior Azure Data Engineer to join our data and analytics team. In this role, you will design, implement, and support scalable data engineering solutions using Microsoft Azure technologies. You will work closely with product owners and source system teams to build robust data pipelines and analytics platforms that drive business insights and decision-making.
Key Responsibilities:
- Collaborate with cross-functional teams to design and implement data engineering and analytics solutions.
- Develop and maintain batch and streaming data pipelines using Azure Data Factory, Azure Databricks, Azure Functions, and Event Hub.
- Build and optimize data lakes and data warehouses using Azure Data Lake Storage, Blob Storage, and Delta Lake.
- Perform end-to-end development lifecycle tasks including data ingestion, transformation, modeling, testing, CI/CD, performance tuning, and production support.
- Lead and mentor team members, providing technical guidance and best practices.
- Ensure data security, compliance, and governance using Azure-native tools.
- Work in an Agile and DevOps environment, supporting continuous integration and deployment.
- Align work hours with the CST time zone and collaborate with geographically distributed teams
Mandatory Skills & Experience:
- 3+ years of experience in data engineering and cloud development using Microsoft Azure.
- Strong hands-on experience with:
- Azure Data Factory
- Azure Databricks
- Azure Blob Storage
- Azure Data Lake Gen2
- Azure Functions
- Azure Event Hub
- Azure DevOps
- Power BI
- Proficiency in SQL, Python, PySpark, and Unix Shell Scripting.
- Experience with CI/CD tools such as GitHub, Azure DevOps, and Terraform.
- Familiarity with data platforms like Teradata, SQL Server, and Azure Data Explorer.
- Strong understanding of data modeling, data governance, and performance optimization.
- Excellent communication skills and ability to work in Agile teams.
Preferred Qualifications:
- 5+ years of experience in software solution development using Agile and DevOps practices.
- Experience with full-stack development in Azure.
- Certifications such as:
- Microsoft Certified: Azure Developer Associate
- Databricks or Spark Certification
- Experience in the airline industry is a plus.
