Required Skills: Azure Synapse Analytics, Azure Data Factory, ADF, Azure Databricks, Azure Storage, Azure Key Vault, Azure Functions, Logic Apps, Data Engineering, ETL, ELT, Data pipelines, Data integration, SQL Pools, Spark Pools, Delta loads, Incremental data processing, Data merging

Job Description

• Strong hands-on experience with Azure Synapse Analytics, Azure Data Factory (ADF), Azure Databricks, Azure Storage, and Azure Key Vault.
• Experience with SQL Pools, Linked Services, Integration Runtimes, Datasets, Pipelines, and Activities in Azure Data Factory.
• Strong knowledge of ADF activities including ForEach, If Condition, Switch, Until, Lookup, Stored Procedure, Script, Validation, Copy Data, and Data Flow.
• Hands-on experience with Azure Functions, Logic Apps, Notebooks, and SQL Pool Stored Procedures.
• Strong experience designing and implementing CI/CD pipelines and deploying code across Dev → QA → Production environments.
• Experience with Git/GitHub and Azure-based deployment processes.
• Strong SQL skills with hands-on experience creating and working with Stored Procedures, Functions, Dynamic SQL, nested SP calls, and record-by-record processing.
• Strong hands-on experience with Azure Databricks and Spark/Spark Pools.
• Strong Python experience with PySpark, Pandas, NumPy, and related data engineering libraries.
• Experience working with databases such as MySQL and Oracle.
• Must have experience extracting and processing data through APIs.
• Experience retrieving data through Stored Procedures using Python.
• Ability to debug Python code, install libraries, and troubleshoot technical issues.
• Experience with Databricks Notebooks, Delta loads, data merging, and incremental data processing.
• Hands-on experience with Power BI is required.
• Strong understanding of data pipelines, ETL/ELT processes, data integration, and cloud data engineering.