Senior Data Engineer
- Prudent
56 Days Ago
NA
NA
Irving-TX
9-15 Years
Required Skills: Azure Data Factory, Data bricks, data modeling, DB architecture, SQL server
Job Description
Job Role: Sr. Data Engineer
Job location: Onsite - Irving Texas 75039
Duration: Direct Hire (Full-time)
Contract-to-hire, on-site (not a hybrid role)
Job Description Attached
Must Have: Azure Data Factory, Data bricks, data modeling/DB architecture, & SQL server
Good to have: automotive/insurance industry experience, NetSuite or other ERP systems (APIs), & relevant certification(s)
Recruiting Process: 1. Assessment, 2. Initial Teams interview with data team, 3. Final in-person or Teams interview with CFO
As a member of the Data and Analytics team, the Sr. Data Engineer role will contribute to the success in both the daily operations and long-term strategy of the organization’s data assets. The optimal candidate brings a business-centric mindset to data architecture efforts and has a track record of being a growth enabler.
Job Responsibilities:
- Design, build & maintain scalable data pipelines in Azure to ensure availability, reliability, scalability, security, and privacy.
- Actively contribute to both data & application governance initiatives by designing and implementing policies, procedures, and best practices.
- Implement API-based integrations to support continuing increases in data volume and complexity.
- Collaborate with report developers/analysts and business teams to improve data models that feed BI tools and increase data accessibility.
- Build and maintain the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and APIs.
- Assist in the design of processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it
- Troubleshoot data pipeline related issues and oversee their resolution.
- Identify ways to improve data reliability, efficiency, and quality.
- Collaborate with all business units and development teams to develop strategy for long term data platform architecture.
- Identify and integrate external data sources from various source formats.
- Assist and oversee other projects as assigned.
Qualifications/Skills:
- Mastery in converting raw data into valuable datasets
- Familiarity with one or more DevOps tools (Git, Jenkins, CI/CD, Jira)
- Excellent prioritization skills
- Excellent problem solving and troubleshooting skills
- Process oriented with great documentation skills
- Excellent oral and written communication skills with a keen sense of customer service
Education/Experience:
- BS or MS degree in Computer Science or related field
- 5+ years of database architecture and dimensional data modeling
Preferred Experience:
- 5+ years of data migration activities
- 5+ years of Python and SQL experience
- 3+ years working in an Agile development environment pairing DevOps with CI/CD pipelines.
- 3+ years with data processing systems in Azure (Data Factory, Data Lake storage, DataBricks, Event Hubs)
Nice to have:
- Experience in assisting Master Data Management efforts, including metadata management.
- Experience in automotive repair and/or insurance industries
- Microsoft DP-203 certification or Cloud certification on any platform
- Experience supporting integrations in/out of ERP systems (ie. NetSuite, SAP)
