Senior Azure Databricks Architect
- California Soft Tech INC.
24 Days Ago
NA
C2C
King of Prussia-PA
6-12 Years
Required Skills: Azure Databricks architecture, Azure Databricks administration, Azure Databrick operations, Schema design, Catalog design, RBAC, Lineage, VNets, Private Link, NSGs, Key Vault, Entra ID, Terraform, CI/CD, Databricks Certified Professional, PySpark, SQL, Delta Lake, Delta Live Tables, Azure Data Factory
Job Description
Focus:
Azure tenant-to-tenant migration, Databricks platform separation, Unity Catalog governance, security/networking, IaC, cutover execution
MUST-HAVES
- 5+ yrs hands-on Azure Databricks architecture, administration, and operations (8+ yrs cloud data platform overall)
- Unity Catalog or Hive Metastore governance - schema/catalog design, external locations, RBAC, lineage
- Migration leadership - tenant-to-tenant/carve-out preferred, Hive Metastore-to-Unity Catalog migration also considered
- Azure networking and security - VNets, Private Link, NSGs, Key Vault, Entra ID, managed identities
- Terraform (Bicep/ARM acceptable)
- CI/CD - Azure DevOps or GitHub Actions
NICE-TO-HAVE
- Databricks Certified Professional or Azure Solutions Architect Expert
- M&A / carve-out / divestiture experience
- PySpark, SQL, Delta Lake, Delta Live Tables, Azure Data Factory
- Asset Bundles, Lakehouse Federation, FinOps, governance automation
