Required Skills: GCP Data Architecture, BigQuery, Data Engineering, Storage Solutions, Integration, Security, Cloud Strategy, Leadership
Job Description
A GCP Data Architect job description involves designing, building, and maintaining scalable data pipelines on Google Cloud Platform (GCP), utilizing services like BigQuery, Dataflow, PySpark, Cloud Storage, Pub/Sub, and Composer, focusing on data ingestion, transformation (ETL/ELT), warehousing, quality, and governance, collaborating with teams, and ensuring efficient, secure data flow for analytics. Key skills include strong SQL/Python, data modeling, and experience with big data technologies.
Core Responsibilities
-
Design, build, and maintain robust data pipelines for batch and streaming data using GCP tools.
-
Implement data extraction, transformation (using Dataflow, Dataproc), and loading processes.
-
Build and manage data models and storage solutions, primarily in BigQuery.
-
Ensure data quality, security, compliance, and integrity.
-
Work with data scientists, analysts, and stakeholders to understand needs and deliver solutions.
-
Monitor pipeline performance, troubleshoot issues, and optimize for cost and efficiency.