Senior Data Engineer

No of Positions: 3

Location: New Delhi

Tentative Start Date: April 27, 2022

Work From : Offsite

Rate : $ 10 - 20 (Hourly)

Experience : 8 to 10 Year

Job Applicants : 9

Job Views : 202

You have successfully applied. Company will contact you soon.

Name : {{jobapplydata.name}}

Company Name : {{jobapplydata.cname}}

{{jobapplydata.email}} | Send Email {{emaildata.total}}

{{jobapplydata.phone}} | Call

Upgrade Plan

You have successfully applied. Need to upgrade your plan to view contact details of client. Upgrade Plan

Job Category : Information Technology & Services

Duration : 3-6 Month

Required Skills

AWS Spark Flink DynamoDB Kubernetes Java Scala AWS Cloud services

Description

The Senior Data Engineer is responsible for the development of high-performance, distributed computing solutions using technologies like Apache Spark, Apache Flink/Storm/Kafka Streams, Kafka, NoSQL database, and other distributed systems based on the needs of the organization.

Your Qualifications

Bachelor's Degree or Master's Degree in Computer Science or related field with 8-10 years of experience.
Expertise in handling huge datasets with deep experience in AWS, Spark, Flink, DynamoDB, Cassandra, NoSQL, etc.
Experience with data pipeline orchestrating tools: Airflow, Luigi, etc.
Experience with container orchestration tools like Kubernetes. (Must have)
Experience with AWS cloud services: S3, EMR, RDS, Redshift, Lambda.
Strong programming skills in at least one of the following: Java, Scala.
Experience in building scalable complex data pipelines in the production system.
Understanding of stream processing with good knowledge of Kafka and either Kafka Streams/Spark streaming/Storm or Flink.
Knowledge of software engineering best practices CI/CD, log aggregation/monitoring/alerting for a production system.
Must have a good command of authoring SQL.