Senior Big Data Engineer
- ClifyX Inc.
2 Days Ago
NA
C2C
Greenwood Village-CO
10-12 Years
Required Skills: ETL, SQL, AWS, BigData, Python, Scala
Job Description
⦁ Expertise in data engineering languages such as Scala (preferred) or Java, with proficiency in Python
⦁ Experience with BigData tools, particularly Spark, and familiarity with Hadoop ecosystems
⦁ Proficiency in building and managing ETL pipelines
⦁ Experience with cloud platforms like AWS, including services such as S3, Lambda, Redshift, and EMR
⦁ Strong understanding of relational databases and SQL, and familiarity with NoSQL databases
⦁ Knowledge of data architecture, data warehousing, and data marts
⦁ Experience in implementing monitoring solutions and deployment pipelines for data applications
⦁ Ability to work with distributed systems and manage data storage solutions
⦁ Demonstrated ability and desire to continually expand skill set, and learn from and teach others
Top 3 responsibilities you would expect the Subcon to shoulder and execute:
⦁ Design, develop, and maintain scalable ETLELT pipelines for processing large volumes of structured and unstructured data.
⦁ Create and optimize complex SQL queries, stored procedures, and data models.
⦁ Collaborate with business stakeholders, analysts, architects, and application teams to understand data requirements.
⦁ Experience with BigData tools, particularly Spark, and familiarity with Hadoop ecosystems
⦁ Proficiency in building and managing ETL pipelines
⦁ Experience with cloud platforms like AWS, including services such as S3, Lambda, Redshift, and EMR
⦁ Strong understanding of relational databases and SQL, and familiarity with NoSQL databases
⦁ Knowledge of data architecture, data warehousing, and data marts
⦁ Experience in implementing monitoring solutions and deployment pipelines for data applications
⦁ Ability to work with distributed systems and manage data storage solutions
⦁ Demonstrated ability and desire to continually expand skill set, and learn from and teach others
Top 3 responsibilities you would expect the Subcon to shoulder and execute:
⦁ Design, develop, and maintain scalable ETLELT pipelines for processing large volumes of structured and unstructured data.
⦁ Create and optimize complex SQL queries, stored procedures, and data models.
⦁ Collaborate with business stakeholders, analysts, architects, and application teams to understand data requirements.
