Required Skills: SQL, Big Query, Gen AI
Job Description
Role: Data Engineer Lead (Python, Airflow, Talend)
Need local to TX
Job Description:
Python, ETL, Apache Airflow, Talend, Control-M, BigQuery, SQL, GCP Composer.
Strong Python expertise given the jobs on Composer are written in Python only.
Resources with experience on Talend and migration project experience.
10+ years experience in designing and developing Extract, Transform & Load (ETL) data pipelines
5+ years experience of ETL on Google Cloud Platform (GCP).
5+ years experience of ETL using Dataflow / Python
3+ years experience on Google Cloud Storage (GCS)
3+ years experience on Composer / Airflow
3+ years experience on BigQuery or PostgreSQL
Strong understanding, knowledge, and experience on ETL concepts
Expertise in writing complex SQLs
Strong Python data processing expertise
Strong understanding on knowledge on Databases
Good to have knowledge on GenAI