OnBenchMark Logo

Data Engineer

No of Positions  No of Positions:   1

location Location: Remote

date Tentative Start Date:   May 13, 2024

Work From Work From : Any Location

rate Rate : $ 6  -  15 (Hourly)

experience Experience : 4 to 5 Year

Job Applicants : 10
Job Views : 129
You have successfully applied. Company will contact you soon.
Name : {{jobapplydata.name}}
Company Name : {{jobapplydata.cname}}
Email  {{jobapplydata.email}} |   Send Email   {{emaildata.total}}
Phone {{jobapplydata.phone}} | Call
You have successfully applied. Need to upgrade your plan to view contact details of client. Upgrade Plan
Job Category : Information Technology & Services
Duration : 6-12  Month
Key Skills Required Skills
Data Engineering AWS Python ETL Athena Lambda
Description

 

Data Engineer

Contract Remote Remote 5+ years

Mandatory Technical Skills:

ETL AWS Python SQL

Job Description

As a Contract Data Engineer, you will be responsible for designing, implementing, and optimizing data systems to support our data lake/data mesh infrastructure and data processing needs. We are looking for an individual who possesses strong technical skills, problem-solving abilities, and a passion for data engineering, with a specific emphasis on AWS, AWS Glue, and data lake expertise.

 

Responsibilities:

 

* Design, implement, and optimize data systems to support our data mesh infrastructure.

 

* Utilize AWS Glue for data extraction, transformation, and loading (ETL) processes.

 

* Refactor and improve existing data systems for enhanced efficiency and performance.

 

* Collaborate closely with product development and production support teams to meet their data engineering requirements.

 

* Participate actively in peer code reviews to maintain code quality and consistency.

 

* Diagnose and resolve production issues, offering corrective measures and workarounds when necessary.

 

* Continuously assess key performance indicators (KPIs) and identify opportunities for improvements and optimizations within our data mesh.

 

Job Requirements:

 

* Strong understanding of AWS services and AWS Glue, Athena and Lambda Functions

 

* Minimum of 5 years of relevant experience in data engineering.

 

* Strong understanding of complex data architecture, especially for data lake environments.

 

* Proficiency in ETL concepts within modern data applications.

 

* Excellent SQL skills, with a focus on PostgreSQL and query optimization.

 

* Proficiency in Python programming.

 

* Familiarity with MongoDB is a plus.

 

* Familiarity with agile development practices.

 

* Demonstrated ability in analysis and design of data systems.

 

Desired Qualifications:

 

* Experience in building data systems with real-time data streams (e.g., Kafka, Kinesis).

 

* Bachelor of Science degree in a technical major (Computer Science, Engineering, Mathematics) or equivalent industry experience.

 

* Familiarity with other ETL tools (Pentaho, Informatica, SSIS, etc.).

 

* Knowledge or experience with microservices and messaging systems.

 

* Experience with supply chain management is a plus

Privacy Policy

Copyright© Cosette Network Private Limited All Rights Reserved
Submit Query
WhatsApp Icon
Loading…

Loading