Databricks Engineer
- Diverse Lynx LLC
1 Days Ago
NA
C2C
Raleigh-NC
10-15 Years
Required Skills: Databricks ,Apache Spark , SQL, Python ,Scala
Job Description
Must Have Technical/Functional Skills
• Databricks and Apache Spark
• SQL and data analysis
• ETL/ELT development and optimization
• Data modeling and performance tuning
• Python or Scala
• Azure cloud-based data platforms
• Production support and operational monitoring
Roles & Responsibilities
• Design, develop, and deploy scalable ETL/ELT pipelines using Databricks, Spark, and PySpark.
• Build and optimize SQL-based data transformation and analytics solutions.
• Collaborate with product owners, data architects, analysts, and business teams on data models and workflows.
• Develop Delta Lake structures and enterprise data pipelines.
• Implement job orchestration, monitoring, and data quality controls.
• Maintain CI/CD pipelines for Databricks notebooks, jobs, and workflows.
• Support Azure-based cloud data platforms and ensure reliable, high-performing data operations.
