Hadoop Architect
- Fixity Technologies
5 Days Ago
NA
Yearly
Plano-TX
12-15 Years
Required Skills: HDFS, Hive, Spark, Ozone, Hadoop data lifecycle management
Job Description
Key Responsibilities
· Monitor and resolve HDFS and Ozone related issues.
· Investigate cluster performance, storage utilization, and capacity concerns.
· Manage quota requests, storage allocation, and capacity planning.
· Support platform maintenance and perform integration activities.
· Coordinate with application teams during incident and problem management.
· Create and maintain operational documentation, runbooks, and knowledge articles.
Required Technical Skills
· Strong experience with the Hadoop ecosystem:
o HDFS
o Hive
o Spark
o Ozone
· Hive Metastore management and table/partition maintenance.
· Hadoop data lifecycle management.
· Data ingestion, ETL processes, and data validation.
· Shell scripting and Python automation.
· Cloudera Data Platform (CDP) or similar Hadoop distributions.
· Strong SQL and data analysis skills.
Desired / Preferred Skills
· Experience supporting large-scale Hadoop environments with multi-petabyte storage.
· Knowledge of distributed storage architecture and data replication.
· Capacity management, storage forecasting, and quota governance.
· Platform onboarding, integration, and decommissioning.
· Familiarity with cloud platforms (Azure, AWS, or GCP).
· Experience with monitoring tools such as Cloudera Manager, Grafana, Splunk, or Prometheus.
· Strong analytical and problem-solving skills with root cause analysis.
