Required Skills: Microsoft Azure Services, Cloud Architecture, Cloud Computing, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure SQL Database, Azure Data Lake Storage, Python, PySpark, Apache Spark, SQL, Scala, Java, Apache Hive, Virtual Machines, Databricks
Job Description
Mandatory Skills & Requirements
- Strong knowledge of Microsoft Azure services, cloud architecture, and cloud computing.
- Experience with Azure data services, including:Azure Data Factory (ADF)
- Azure Databricks
- Azure Synapse Analytics
- Azure SQL Database
- Azure Data Lake Storage (ADLS)
- Strong programming skills in Python, PySpark, Spark, SQL, Scala, Java, and Hive.
- Experience designing, developing, and maintaining scalable data pipelines.
- Knowledge of Azure Virtual Machines, Azure Storage, and Azure Networking.
- Experience with Infrastructure as Code (IaC) using ARM templates or Terraform.
- Proficiency in PowerShell, Python, or similar scripting languages.
- Understanding of DevOps practices, CI/CD pipelines, and cloud security best practices.
- Strong problem-solving, analytical thinking, and attention to detail.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, Azure SQL Database, and Synapse Analytics.
- Design, implement, and manage cloud-based applications and infrastructure.
- Develop Infrastructure as Code to automate cloud resource provisioning and management.
- Create and maintain scripts for automation and deployment.
- Monitor and optimize cloud resources for performance and cost efficiency.
- Collaborate with DevOps and security teams to implement secure and scalable cloud architectures.
- Troubleshoot and resolve issues related to Azure services, data pipelines, and infrastructure.
Preferred Qualifications
- Microsoft Azure certifications, such as AZ-104 or AZ-303.
- Experience with cloud infrastructure automation and management.
- Strong communication, adaptability, and teamwork skills.