Required Skills: Databricks, AWS Cloud, Infrastructure, Machine learning, , Apache Spark, Delta Lake, S3, EC2, Lambda, Glue, EMR, SageMaker
Job Description
Role: ML Engineer – Databricks & AWS Cloud Infrastructure
Location: Malvern, PA
Type: Contract
Experience: 8+ Years (Preferred)
Interview: Video Interview
Required Skills:
• Strong experience with Machine Learning model development, deployment, and optimization.
• Hands-on expertise with Databricks, Apache Spark, and Delta Lake.
• Strong experience with AWS Cloud services including S3, EC2, Lambda, Glue, EMR, SageMaker, and IAM.
• Proficiency in Python and ML libraries such as Scikit-learn, TensorFlow, or PyTorch.
• Experience building scalable data pipelines and ETL processes.
• Strong understanding of MLOps, CI/CD pipelines, and model lifecycle management.
• Experience with SQL and large-scale distributed data processing.
• Knowledge of cloud security, monitoring, and performance optimization.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and collaboration skills.
Responsibilities:
• Design, develop, and deploy machine learning models and AI solutions on AWS.
• Build and optimize scalable data pipelines using Databricks and Spark.
• Collaborate with data engineers, architects, and business stakeholders to understand requirements and deliver solutions.
• Implement MLOps best practices for model deployment, monitoring, and retraining.
• Optimize cloud infrastructure for performance, scalability, and cost efficiency.
• Develop data ingestion, transformation, and feature engineering frameworks.
• Monitor production ML workloads and troubleshoot performance issues.
• Ensure security, governance, and compliance standards are followed.
• Document technical solutions and support knowledge-sharing initiatives.
• Stay current with emerging ML, Databricks, and AWS technologies and recommend improvements.