Data Engineer
19 Days Ago
NA
NA
Remote
9-18 Years
Job Description
Key Skills:
SQL,GCP, BIGQUERY, ORACLE,TERADATA, PYTHON
Details of the role:
Key responsibilities:
- Design and develop data pipelines and ETL processes using Google BigQuery, Informatica PowerCenter, and Informatica Intelligent Cloud Services (IICS) to extract, transform, and load data from various sources into data warehouses.
- Collaborate with data architects, business analysts, and stakeholders to understand data requirements, define data models, and design data integration solutions that meet business needs.
- Implement data quality checks, data profiling, and data cleansing processes to ensure data accuracy, completeness, and consistency across data sources.
- Optimize and tune data pipelines for performance, scalability, and reliability, leveraging best practices and industry standards.
- Develop and maintain data warehouse schemas, data marts, and data models to support reporting, analytics, and business intelligence (BI) initiatives.
- Monitor and troubleshoot data integration jobs, identify and resolve data processing issues, and implement proactive monitoring and alerting mechanisms.
- Document data integration processes, data lineage, and metadata to support data governance, compliance, and regulatory requirements.
- Stay updated with emerging data technologies, tools, and trends, and evaluate and recommend new solutions to enhance data engineering capabilities.
- Provide technical guidance, mentorship, and support to junior data engineers, fostering a culture of continuous learning and knowledge sharing.
- Collaborate with cross-functional teams, including data scientists, BI developers, and business users, to deliver end-to-end data solutions that drive business insights and decision-making.
Required Skills:
- Bachelor's degree in Computer Science, Information Systems, or related field; Master's degree is a plus.
- Minimum of 7 years of experience as a Data Engineer, with expertise in Google BigQuery, Informatica PowerCenter, and Informatica Intelligent Cloud Services (IICS).
- Strong proficiency in SQL, data modeling, and ETL development, with hands-on experience in designing and implementing complex data integration solutions.
- Solid understanding of data warehousing concepts, data architecture principles, and data governance best practices.
- Experience with cloud platforms such as Google Cloud Platform (GCP) or similar cloud environments is highly desirable.
- Excellent analytical, problem-solving, and troubleshooting skills, with a focus on delivering high-quality data solutions.
- Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and stakeholders.
- Relevant certifications in Informatica or Google Cloud technologies are a plus.
