Databricks Architect
  • K Anand Corporation
12 Hours Ago
NA
W2
Remote
15-20 Years
Required Skills: Databricks, Azure, AI
Job Description
Requirements

• 15+ years in software and data architecture (5+ as lead or lead architect role), Spark SQL and PySpark, Databricks agents, AI/BI and Genie, Power BI, SQL Server, Azure, and a healthcare or risk-adjustment background.
• Proven expertise in designing and implementing enterprise data platforms using modern lakehouse architectures on Databricks.
• Strong experience with distributed data processing and modern lakehouse technologies (e.g., Spark SQL, PySpark, Unity Catalog, Delta/Iceberg formats, Python, etc.).
• Experience building agents utilizing Databricks Agentic, AI/BI Dashboard, and Genie Spaces capabilities.
• Deep knowledge of data modeling, ETL/ELT design, and data warehousing and BI (Power BI) reporting concepts.
• Experience with relational and NoSQL databases (e.g., SQL Server, PostgreSQL, MongoDB, Cassandra, Hive).
• Experience supporting AI/ML, predictive analytics, and agentic models.
• Background in healthcare, risk adjustment, or regulated domains.
• Hands-on experience with cloud platforms (Azure preferred; AWS or Google Cloud Platform also acceptable).
• Strong understanding of event-driven architecture, microservices, and data integration patterns.
• Experience with CI/CD pipelines, automated testing, and DevOps practices.
• Experience with Agile/Scrum and modern software delivery methodologies.
• Proven ability to troubleshoot complex system issues and optimize performance across distributed systems.
• Strong communication, stakeholder management, and leadership skills.

Jobseeker

Looking For Job?
Search Jobs

Recruiter

Are You Recruiting?
Search Candidates