GCP Data Engineer
- Infinics
2 Days Ago
NA
W2
Hartford-CT
8-9 Years
Required Skills: BigQuery, Cloud Storage, Cloud Functions, Cloud Run
Job Description
GCP Data Engineer with AI
Core Skills & Technologies:
Python (strong OOP practices, modular and reusable components)
Google Cloud Platform (GCP): BigQuery, Cloud Storage, Cloud Functions, Cloud Run
ETL/ELT & Data Pipelines: Cloud Dataflow, Cloud Composer (Airflow), Pub/Sub
Streaming & Real‑Time Systems: event‑driven architectures
Data Warehousing & Modeling: schema design, performance optimization (partitioning, clustering, materialized views)
Containers & Platforms: Docker, Kubernetes
APIs & Integrations: REST APIs, Swagger/OpenAPI, external system ingestion (APIs, flat files)
CI/CD & DevOps: Git, Cloud Build, GitHub Actions, Jenkins
Observability: Cloud Monitoring, Cloud Logging, Error Reporting
Security & Compliance: IAM, access controls, data governance; CVE remediation with a focus on automation
Big Data & Cloud Architecture (GCP preferred; AWS/Azure acceptable)
AI / ML‑enabled services (Gemini and Vertex AI)
Jira, SAFe / Agile delivery practices
Experience with GitHub Copilot / AI‑assisted development is a plus
Familiarity with integration and functional testing preferred.
Consider below instructions while sourcing the profile.
This is primarily a GCP Data Engineer / Python Engineer role with strong experience in building data pipelines, cloud-based applications, and AI-enabled solutions.
Must-Have Skills
✅ Strong Python programming (OOP concepts, reusable code, clean coding practices)
✅ Google Cloud Platform (GCP)
- BigQuery
- Cloud Storage
- Cloud Functions
- Cloud Run
✅ Data Engineering
- ETL/ELT pipelines
- Dataflow
- Airflow (Cloud Composer)
- Pub/Sub
✅ Real-Time Data Processing
- Event-driven architecture
- Streaming data pipelines
✅ BigQuery/Data Warehouse
- Schema design
- Partitioning
- Clustering
- Performance optimization
✅ Docker & Kubernetes
✅ REST APIs & integrations
✅ CI/CD
- Git
- GitHub Actions
- Jenkins
- Cloud Build
✅ Monitoring & Logging
- Cloud Monitoring
- Cloud Logging
✅ Security
- IAM roles
- Access management
- Data governance
- CVE remediation
Preferred Skills
⭐ Vertex AI / Gemini
⭐ GitHub Copilot
⭐ Integration & Functional Testing
⭐ Agile / SAFe
