Data Engineer (Python, AWS)
- Reliant vision
20 Days Ago
NA
NA
Newark-NJ
4-6 Years
Job Description
Role: Data Engineer( Python + AWS)
Location: Jersey City, NJ (Local)
C2C
Location: Jersey City, NJ (Local)
C2C
Only Locals
Job Description
• Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
• Develops secure high-quality production code, and reviews and debugs code written by others
• Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems
• Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development
• Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems.
• Design and develop data pipelines to ingest, store, and process data from multiple sources
• Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture.
• Contributes to software engineering communities of practice and events that explore new and emerging technologies
• Adds to team culture of diversity, equity, inclusion, and respect
• Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
• Develops secure high-quality production code, and reviews and debugs code written by others
• Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems
• Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development
• Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems.
• Design and develop data pipelines to ingest, store, and process data from multiple sources
• Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture.
• Contributes to software engineering communities of practice and events that explore new and emerging technologies
• Adds to team culture of diversity, equity, inclusion, and respect
Required qualifications, capabilities, and skills
• Formal training or certification on data engineering concepts and 3+ years of applied experience
• Practical Experience in one or more programming language(s), such as Python, Java
• Experience with SQL-based technologies (e.g., MySQL/ Oracle DB)
• Hands-on practical experience delivering data pipelines
• Proficient in all aspects of the Software Development Life Cycle
• Understanding of agile methodologies such as CI/CD, Applicant Resiliency, and Security
• Demonstrated proficiency and experience with cloud-native distributed systems
• Ability to develop reports, dashboards, and processes to continuously monitor data quality and integrity
• Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages
• Experience with statistical data analysis and ability to determine appropriate tools and data patterns to perform analysis
• Demonstrated knowledge of software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.)
• Working knowledge of bitbucket and JIRA
