Required Skills: Hadoop, Hive, Spark, python, SQL based systems
Job Description
Hadoop and PySpark Data Engineer
Required Skill and Experience:
Experience in data warehousing architectural approaches.
Sound understanding and experience with Hadoop ecosystem (Cloudera).
Experience in working with a Big Data implementation in production environment.
Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell scripting.
Experience in orchestration tool like Autosys, Airflow.
Sound knowledge of relational databases (SQL) and experience with large SQL based systems.
Understanding of Agile methodologies and technologies