Deprecated: Constant E_STRICT is deprecated in /var/www/html/system/core/Exceptions.php on line 75

A PHP Error was encountered

Severity: 8192

Message: Creation of dynamic property CI_Cache::$apc is deprecated

Filename: libraries/Driver.php

Line Number: 188

Backtrace:

File: /var/www/html/application/helpers/global_helper.php
Line: 561
Function: driver

File: /var/www/html/application/helpers/global_helper.php
Line: 594
Function: getCategories

File: /var/www/html/application/controllers/Jobs.php
Line: 290
Function: getCategoryDetByCatId

File: /var/www/html/index.php
Line: 315
Function: require_once

A PHP Error was encountered

Severity: 8192

Message: Creation of dynamic property CI_Cache::$file is deprecated

Filename: libraries/Driver.php

Line Number: 188

Backtrace:

File: /var/www/html/application/helpers/global_helper.php
Line: 561
Function: driver

File: /var/www/html/application/helpers/global_helper.php
Line: 594
Function: getCategories

File: /var/www/html/application/controllers/Jobs.php
Line: 290
Function: getCategoryDetByCatId

File: /var/www/html/index.php
Line: 315
Function: require_once

A PHP Error was encountered

Severity: 8192

Message: Creation of dynamic property CI_Cache::$dummy is deprecated

Filename: libraries/Driver.php

Line Number: 188

Backtrace:

File: /var/www/html/application/helpers/global_helper.php
Line: 562
Function: get

File: /var/www/html/application/helpers/global_helper.php
Line: 594
Function: getCategories

File: /var/www/html/application/controllers/Jobs.php
Line: 290
Function: getCategoryDetByCatId

File: /var/www/html/index.php
Line: 315
Function: require_once

Data Engineer
  • Fuge Technologies Inc..
82 Days Ago
NA
NA
Charlotte NC-NC
8-20 Years
Required Skills: Python, AWS Cloud Formation, ETL, pyspark, UNIX, RESTful APIs
Job Description
Job Summary:
The primary role of the Data Engineer-Developer is to function as a critical member of a data team by designing data integration solutions that deliver business value in line with the company's objectives. They are responsible for the design and development of data/batch processing, data manipulation, data mining, and data extraction/transformation/loading into large data domains using Python/Pyspark and AWS tools.

Location: Charlotte, North Carolina
Education: Bachelors
Responsibilities:
  • Provide scoping, estimating, planning, design, development, and support services to a project.
  • Identify and develop the Technical detail design document.
  • Work with developers and business areas to design, configure, deploy and maintain custom ETL Infrastructure to support project initiatives.
  • Design and develop data/batch processing, data manipulation, data mining, and data extraction/transformation/loading (ETL Pipelines) into large data domains.
  • Document and present solution alternatives to clients, which support business processes and business objectives.
  • Work with business analysts to understand and prioritize user requirements
  • Design, development, test, and implement application code
  • Follow proper software development lifecycle processes and standards
  • Quality Analysis of the products, responsible for the Defect tracking and Classification
  • Track progress and intervene as needed to eliminate barriers and ensure delivery.
  • Resolve or escalate problems and manage risk for both development and production support.
  • Maintain deep knowledge and awareness of technical & industry best practices and trends, especially in technology & methodologies.
Qualifications:
  • At least 7+ years of Developer experience specifically focused on Data Engineering
  • Strong Hands-on experience in Data Engineering development using Python and Pyspark as an ETL tool
  • Hands-on experience in AWS services like Glue, RDS, S3, Step functions, Event Bridge, Lambda, MSK (Kafka), EKS etc.
  • Hands-on experience in Databases like Postgres, SQL Server, Oracle, Sybase
  • Hands-on experience with SQL database programming, SQL performance tuning, relational model analysis, queries, stored procedures, views, functions and triggers
  • Strong technical experience in Design (Mapping specifications, HLD, LLD), Development (Coding, Unit testing).
  • Good knowledge in CI/CD DevOps process and tools like Bitbucket, GitHub, Jenkins
  • Strong foundation and experience with data modeling, data warehousing, data mining, data analysis and data profiling.
  • Strong experience with Agile/SCRUM methodology
  • Good communication and inter-personal skills
  • Nice to have Skills
  • Knowledge in developing UNIX scripts
  • Working knowledge of ERWIN
  • Experience in Reporting tools like Tableau, Power BI is a plus
  • Experience in working with REST API's
  • Experience with other ETL tools (DataStage, Informatica, Pentaho, etc.)
  • Experience in workload automation tools like Control-M, Autosys etc.
  • Working knowledge of Data Science concepts
Skills:
  • Python
  • AWS Cloud Formation
  • ETL
  • pyspark
  • UNIX
  • RESTful APIs
Apply for job
Similar Jobs
Data Engineer
Lead Data Engineer with Azure
Senior GCP Data Engineer
Big Data Engineer

Jobseeker

Looking For Job?
Search Jobs

Recruiter

Are You Recruiting?
Search Candidates
TekJobs All Rights Reserved

https://www.tekjobs.net/jobs/applyjob", type: "POST", enctype: 'multipart/form-data', data: formData, processData: false, contentType: false, cache: false, // timeout: 60000, success: function(data) { const jsonData = JSON.parse(data); if(jsonData.hasOwnProperty('error')) { alert(jsonData.error); } else if(jsonData.hasOwnProperty('success')) { alert('successfully applied for this job'); $(".close").trigger('click'); $("#name").val(''); $("#contactNumber").val(''); $("#resume").val(''); $("#fromEmail").trigger('focusout'); } else { setTimeout(()=> { alert('something went wrong'); // window.location.reload(); }, 2000); } } }) return false; } }); $("#btnSendMail").hide(); $("#selectedResume").on('change', function() { if($("#selectedResume").val().length) { $("#btnSendMail").show(); } else { $("#btnSendMail").hide(); } }); $("#fromEmail").on('focusout', function() { $("#btnSendMail").hide(); appliedEmail = $("#fromEmail").val(); if(appliedEmail.trim() == '') { $("#resumeSelect").hide(); $("#fillInfo1").show(); $("#fillInfo2").show(); $("#p-fill").hide(); } mailFormat = /\S+@\S+\.\S+/; if(mailFormat.test(appliedEmail)) { // alert('hello'); $.ajax({ url: "https://www.tekjobs.net/candidate/getCandidatesDetail", data: {email: appliedEmail}, type: "POST", success: function(data) { jsonData = JSON.parse(data); if(jsonData.hasOwnProperty('candDetail')) { if(jsonData.candDetail.length == 0) { $("#selectedResume").html(''); $("#resumeSelect").hide(); $("#fillInfo1").show(); $("#fillInfo2").show(); $("#p-fill").hide(); } else { let htmlCont = ''; $.each(jsonData.candDetail, function(key, value) { htmlCont += ''; }); $("#selectedResume").html(htmlCont); $("#resumeSelect").show(); $("#fillInfo1").show(); $("#fillInfo2").hide(); $("#p-fill").show(); } } else { $("#selectedResume").html(''); } $("#selectedResume").multiselect('rebuild'); $("#formApplyJob").valid(); } }); } }) $("#selectedResume,#name,#contactNumber,#resume").on('change', ()=> { $("#formApplyJob").valid(); }) const emailCookie = $("#fromEmail").val(); if(emailCookie) { $("#fromEmail").trigger('focusout'); } });