TekJobs - Easiest way to find your next right candidate

129 Days Ago

Offered Rate NA

Tax Type NA

Work location Los Angeles-CA, Atlanta-GA, Dallas-GA

Experience 8-18 Years

Position: Senior Data Engineer
Experience: 10+ years
Location: Texas, Georgia, California
Employment Type: W2

Key Responsibilities:

Design, develop, and maintain scalable batch and real-time data pipelines for large-scale distributed systems.
Lead the architecture and development of robust data solutions using Google Cloud Platform (GCP).
Work extensively with BigQuery, Dataflow, Pub/Sub, and Google Cloud Storage (GCS) for data processing and storage.
Utilize the Hadoop Big Data Ecosystem (HDFS, Hive, Pig, HBase, YARN) for data management and analytics.
Write efficient, scalable code using Python and Scala for data engineering and automation.
Perform SQL-based data manipulation, transformation, and analysis to support business insights.
Build and optimize batch and real-time streaming data pipelines.
Ensure CI/CD pipeline integration for seamless deployment and maintenance of data applications.
Troubleshoot performance bottlenecks and optimize data systems for efficiency.
Mentor and lead a team of engineers, driving innovation in data engineering best practices.

Requirements:

10+ years of experience in designing and implementing large-scale data pipelines.
Proficiency in GCP tools like BigQuery, Dataflow, Pub/Sub, and GCS.
Strong hands-on experience with Hadoop, Hive, Pig, HBase, and YARN.
Expert in Python and Scala for scripting and data engineering.
Solid knowledge of SQL for data transformation and query optimization.
Experience with real-time and batch data processing frameworks.
Familiarity with CI/CD pipelines for continuous deployment and automation.
Excellent problem-solving skills to troubleshoot complex data system issues.
Leadership and mentoring experience in guiding engineering teams.