Required Skills: SQL, ETL, Data Pipelines, Shell Scripting, Linux
Job Description
Technical Skills Required
· Job Scheduling & Workflow Monitoring:
Hands-on experience with enterprise schedulers such as Control-M, Tidal, or equivalent tools
· ETL Knowledge:
Strong understanding of ETL processes, data workflows, and pipeline architectures
· SQL:
Proficiency in writing complex queries, debugging, and performance tuning
· Shell Scripting (Bash):
Experience in writing automation scripts for operational efficiency
· Linux:
Solid understanding of Linux commands, file systems, and permissions
· AWS Services:
Working knowledge of AWS components including S3, EMR, and EC2
Key Responsibilities
· Monitor and support production data pipelines to ensure smooth and uninterrupted operations
· Troubleshoot job failures and perform detailed root cause analysis (RCA)
· Manage and optimize long-running jobs to improve performance and efficiency
· Configure and manage job scheduling workflows and dependencies using Control-M or similar schedulers
· Provide support for AWS-based data infrastructure and associated services
· Collaborate with cross-functional teams to resolve incidents and ensure timely issue resolution