Data Lead, Senior Data Engineer
- Visionary Innovative Technology Solutions LLC.
3 Days Ago
NA
W2, C2C
Chicago-IL, Charlotte NC-NC
10-16 Years
Required Skills: Python, PySpark, AWS Glue, Apache Airflow, MWAA, Snowflake
Job Description
We are seeking an experienced Data Lead / Senior Data Engineer to serve as a technical anchor for a modern data platform. The ideal candidate will have strong hands-on experience designing and developing scalable ETL/ELT pipelines using Python/PySpark, AWS Glue, Apache Airflow/MWAA, and Snowflake.
Key Responsibilities
- Design, develop, and maintain end-to-end ETL/ELT data pipelines.
- Build and manage workflows using Apache Airflow/AWS MWAA.
- Develop scalable data solutions using Python, PySpark, AWS Glue, and Snowflake.
- Perform Snowflake performance tuning and optimization.
- Collaborate with stakeholders to translate business requirements into technical solutions.
- Provide technical leadership, code reviews, and mentorship to developers.
- Support production operations and troubleshoot critical data pipeline issues.
- Participate in Agile/Scrum ceremonies, sprint planning, and JIRA task management.
- Contribute to data architecture, technical roadmaps, and platform improvements.
- Maintain technical and design documentation.
Required Skills
- 10 + years of experience in Data Engineering or related roles.
- Strong hands-on experience with Python/PySpark and SQL.
- Extensive experience with AWS Glue, S3, IAM, and MWAA/Airflow.
- Strong experience with Snowflake, SnowSQL, and performance tuning.
- Excellent understanding of ETL/ELT frameworks and data platforms.
- Experience with JIRA and Agile/Scrum methodologies.
- Strong communication, leadership, and stakeholder-management skills.
Preferred Skills
- Experience with DBT.
- Knowledge of Star Schema and Snowflake Schema data modeling.
- Experience supporting enterprise production data platforms.
- Previous experience leading or mentoring Data Engineering teams.
