Required Skills: (GCP) Data Engineer, Git, CI/CD pipeline, DevOps principles, UNIX
Job Description
Position Summary
We are seeking a highly skilled and motivated Google Cloud Platform (GCP) Data Engineer to join our dynamic and growing team. In this role, you will be responsible for designing, building, and maintaining scalable and secure data pipelines and systems on GCP. Your work will ensure that data flows efficiently from diverse sources to analytics platforms and reporting tools, empowering data-driven decision-making across the organization.
Required Qualifications
Experience in designing and building data engineering solutions in GCP cloud environments
3+ years of hands-on experience with Google Cloud Platform services like Big Query, Dataflow, Pub/Sub, and Cloud Storage
3+ years of hands-on experience building modern data pipelines with GCP platform
3+ years of experience with reporting/analytic tools
3+ years of experience with Query optimization, data structures, transformation, metadata, dependency, and workload management
3+ years of experience with SQL, NoSQL
3+ years of experience in data engineering with a focus on microservices-based data solutions
3+ years of containerization (Docker, Kubernetes) and CI/CD for data pipeline
3+ years of experience with Python (or a comparable scripting language)
3+ years of experience with Big data and cloud architecture
3+ years of experience with deployment/scaling of apps on containerized environment (Kubernetes,)
3+ years of experience with real-time and streaming technology (Kafka, Spark Streaming)
Preferred Qualifications
Experience with Git, CI/CD pipeline, and other DevOps principles/best practices
Experience with bash shell scripts, UNIX utilities & UNIX Commands
Ability to leverage multiple tools and programming languages to analyze and manipulate data sets from disparate data sources
Knowledge of API development
Experience with complex systems and solving challenging analytical problems
Strong collaboration and communication skills within and across teams
Knowledge of data visualization and reporting
Experience with schema design and dimensional data modeling
Google Professional Data Engineer Certification
Knowledge of microservices
Previous healthcare experience and domain knowledge
Experience designing, building, and maintaining data processing systems
Experience architecting and building data warehouse and data lakes
Education
Bachelor's degree or equivalent work experience