Kafka Pyspark Developer
- Nityo Infotech
2 Days Ago
NA
Yearly
Charlotte NC-NC, Plano-TX
6-10 Years
Required Skills: Tableau, Hadoop, Hive, Spark, python,
Job Description
Required Skill and Experience
- Experience in building real-time data streaming applications and event-driven systems using Apache Kafka.
- Sound understanding and experience with Hadoop ecosystem (Cloudera).
- Experience in working with a Big Data implementation in production environment.
- Experience with Big Data technologies like Hadoop, Hive, Spark, python, etc.
- Experience in python and Unix shell scripting. Experience in orchestration tool like Autosys, Airflow.
- Knowledge of relational databases (SQL) and experience with large SQL based systems.
- Understanding of Agile methodologies and technologies "
Preferred Skill and Experience
- Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand.
- Knowledge and experience with Cloud and containerization technologies
- Experience with data visualization tools like Tableau
