Required Skills: Python, PySpark, SQL, Azure Data
Job Description
Healthcare Azure Data Factory
Mandatory Skills:
·Azure Data Factory (ADF) – Used for orchestrating and managing data pipelines.
·Azure Databricks – Used for data processing, transformation, and analytics.
·Azure Synapse Analytics – Previously used, but it will no longer be part of the future architecture.
·Fivetran – Planned for future implementation to replace SSIS for data ingestion.
·Azure Data Lake Storage (ADLS) – Used as the central storage layer for data.
·Python – Used for automation, scripting, and data engineering tasks.
·PySpark – Not currently used in the bronze layer, but heavily utilized in the silver layer for data transformations.
·SQL – Used for querying and managing data.
·T-SQL – Used for writing stored procedures, functions, and complex SQL logic in SQL Server.
·Databricks