Senior Data Engineer
  • UniqueHire Consulting LLC
3 Days Ago
NA
W2
Seattle-WA
8-10 Years
Required Skills: API , Agile , Amazon EC2, Amazon Redshift, Amazon S3, Amazon Web Services , C# , Data Engineering , Data Extraction , Data Management , Data Processing , Data Flow
Job Description
As the Sr. Data Engineer you will build, manage, integrate, and optimize reservoirs for data in support of delivering relevant information for business consumption promoting advances in predictive analytics and machine learning. You'll develop, construct, test and maintain designs for databases and large-scale data processing systems in support of underlying business, solution, and enterprise architectures. This role supports and maintains pipelines delivering relevant data sets for business consumption and analysis. While working closely with architects to determine which data management systems are appropriate and with the business to determine what data is needed for analysis. This individual will wrestle with problems associated with database integration and unstructured data sets toward the ultimate goal of providing clean, usable data and Master data to whomever may require it.
 
Responsibilities
  • Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
  • Working knowledge of modern data architectures and trends such as Data Mesh, Data Lakehouse, etc.
  • Working knowledge of Master Data Management Reltio preferred
  • Research, analyze, recommend and select technical approaches for solving exciting and sophisticated development and integration problems
  • Build and maintain automated methods of orchestrating data flows and products while supervising data quality and the status of related infrastructure
  • Implement additional project components (API interfaces) for accessibility
  • Implement secure cloud data solutions which align to privacy and security controls
  • Enable and support data and analytics capabilities and technologies, ensuring functional specifications meet or exceed established business and functional requirements, technical standards, quality
Qualifications:
  • A passion for all things data; understanding how to work with it at scale, and more importantly, knowing how to get the most out of it
  • Contribute to the overall data platform architecture and evolution
  • Experience with data concepts (SQL, NoSQL, Normalization) and working with sophisticated data structures
  • Experience with Infrastructure-as-code tools such as Cloud Formation and Terraform
  • Experience in designing and implementing cloud data solutions using a broad range of AWS technologies (e.g. EC2, EMR, DMS, GLUE, S3, Lake Formation, Redshift, VPC, IAM, CloudWatch, SQS, Lambda, CloudTrail, Systems Manager, KMS, Kinesis Streams)
  • Experience in MDM (Master Data Management) implementation involving platforms like Reltio, Informatica etc.
  • Proficiency in one or more of the following scripting languages; SQL, Python, Scala, C#, or Go
  • Solid understanding of scripting languages such as bash or PowerShell
  • Track record of successfully building scalable Data Lake solutions that connects to distributed data storage using multiple data connectors
  • Must have a background in data engineering – Data Warehouse, ETL/ELT and BI experience
  • Serve as an authority; envision and integrate emerging data technologies, anticipate new trends to tackle sophisticated business and technical problems
  • Working experience with various stream analytics technologies
  • Familiarity with modern engineering practices, including agile development, CI/CD and DevOps.

Jobseeker

Looking For Job?
Search Jobs

Recruiter

Are You Recruiting?
Search Candidates