Database Developer
- B2TECHSOFT LLC
31 Days Ago
NA
NA
Alpharetta-GA
10-12 Years
Required Skills: Oracle , Pyspark , Databricks
Job Description
Exp Level: Min 10+ Years
- Expert-level proficiency in PySpark and Databricks.
- The client will conduct a coding test, focusing specifically on PySpark.
Skills Required:
1. RDBMS Expertise:
• Profound knowledge and hands-on experience in RDBMS - Oracle and PostgreSQL.
• Strong understanding of database architecture, design, and performance optimization.
• Expertise in SQL for creating queries, stored procedures, and views.
2. Database Migration:
• Experience in database migrations ( preferred Oracle to PostgreSQL).
• Ability to perform data mapping, conversion, and validation.
• Proficient in using tools and scripts to automate migration processes.
3. Data Engineering & Analysis:
• Proficiency in Databricks for big data processing and analytics.
• Skilled in Python and PySpark for data manipulation and analysis.
• Capability to develop and optimize ETL processes.
4. Job Scheduling & Automation:
• Experience with setting up and maintaining Databricks jobs for periodic reporting.
• Familiar with workflow orchestration tools for task automation.
5. Performance Optimization:
• Skilled in performance tuning and troubleshooting of PostgreSQL and Oracle databases.
• Experience in indexing, query optimization, and caching strategies.
6. Cloud Platforms:
• Familiarity with cloud-based database services and infrastructure specially on AWS.
Responsibilities:
1. Database Design & Development:
• Design and develop robust database solutions that meet data storage and retrieval requirements.
• Create scripts and procedures to automate routine database tasks.
2. Migration & Implementation:
• Lead the migration process from Oracle to PostgreSQL, ensuring data integrity and minimal downtime.
• Develop comprehensive migration plans and execute them proficiently.
3. Support & Maintenance:
• Monitor database performance and implement necessary improvements.
4. Reporting & Analytics:
• Develop and maintain Databricks jobs for generating business reports and analytics.
• Provide insights from data analysis to support decision-making.
