Required Skills: Python, Python Automation, GitLab, GitLab automation, Data modeling using Databricks, AWS, Starburst, Immuta, Collibra, Tableau, Unit Testing, DevOps, SQL
Job Description
Job Title: Software Engineering Solution Support (Python)
Location : Richmond, VA (Local candidates preferred)
C2C: Yes
Duration: 12 months with possible extension
Job Description:
- We are seeking a hands-on, experienced Software Engineer with strong expertise in Python, Python automation, and GitLab automation to integrate with cross-functional program and solution delivery teams.
- This role involves designing, developing, and maintaining robust, efficient data pipelines to ingest, transform, catalog, and deliver curated, high-quality data from diverse sources.
- The candidate will help build common structures and reusable libraries, while promoting best practices such as automated testing, code reviews, and documentation.
- Responsibilities include troubleshooting issues during testing and validation, supporting data migration efforts, and working within a CI/CD pipeline environment on an AWS-based technology stack.
- Experience with Databricks, and collaboration with DevOps, database teams, and data modeling efforts, is highly preferred.
Required Skills:
- Experienced and Proficiency in Python, Python automation, GitLab, GitLab automation, data modeling using Databricks, and AWS is required. Experience with Starburst, Immuta, Collibra, Alteryx, Tableau, and unit testing is a plus. The ideal candidate will have a background in corporate DevOps environments, with hands-on experience in automated deployments and unit testing.
- Experienced and Proficiency in Python, Python automation, GitLab, GitLab automation, and AWS is required.
Job Duties:
- Use Python to implement repeatable automated operations to migrate data.
- Perform GitLab automation.
- Lead adoption of best practices such as automated testing, documentation, and code reviews.
- Proactively troubleshoots and resolve issues during testing and validation activities.
- Completed assigned stories to include the following:
- Design
- Structured query language (“SQL”) orchestration
- Data ingestion pipeline builds
- Coding to include pair programming
- Code reviews
- Documentation including data models
- Automated tests
- Automation, logging, and alerting
- Troubleshooting and defect resolution
- Support data migration
- Experience with the cloud stack.
- Deploying monitoring and alerting for data pipelines, data stores and implementing auto remediation wherever possible to ensure the availability and reliability of data systems.
- Employing security, testing and automation first strategy and adhering to data engineering best practices.
Job Requirements - Bachelor’s degree in Computer Science/related field , 5+ years of experience
Desired Skills & Experience
-
5 to 8 Years of Experience with Proficiency in Python, Python automation, GitLab, GitLab automation, data modeling using Databricks, and AWS is required.
-
Experience with data modeling using Databricks, Starburst, Immuta, Collibra, Alteryx, Tableau, and unit testing is a plus.
-
The ideal candidate will have a background in corporate DevOps environments, with hands-on experience in automated deployments and unit testing.