Data Engineer (CDP)

  • No. of positions: 2
  • Remote
  • Last Active Date : 22 Oct, 2021

Budget

₹281,000 - ₹309,000 (Monthly)

Experience

7 to 10 Years

Work From

Any

Job Duration

6-12 Months

Required Skills

PythonJavapysparkhadoopNiFiKuduClouderaspark

Job Description

About Project:

  • The client is developing this application on CDP 7.1.7


Experience:

  • Total Experience: 8-10 Years
  • Big Data experience: >5 Years


Must-Have (Hands-on Experience):

  • Hadoop, SDLC, Python/JAVA, PySpark, HBASE
  • Cloudera
  • NiFi/Kafka/Spark, Spark streaming
  • Hbase/Phoenix
  • Yarn
  • Kudu
  • Impala
  • HDF to CDP Migration
  • Hands-on experience in the implementation of ETL solutions
  • Must possess complete hands-on experience in anyone RDBMS such as AWS Redshift SQL Server Oracle
  • Strong knowledge of SQL and procedural languages such as T SQL, PL SQL, etc.
  • Hands-on experience on anyone of the ETL tools such as AWS Glue, Informatica, IBM DataStage, SSIS, Talend, etc.
  • Hands-on experience with Apache Nifi, Trifacta, AWS Glue
  • Hands-on experience in Query Tuning, Performance Tuning for large scale ETL solutions
  • Must have experience in Data Discovery and Data Mining
  • Must have a good understanding of relational dimension and modelling
  • Exposure to designing modeling tools such as Erwin ERStudio, VISIO, Power Designer


Lead Soft Skills :

  • Must have very good oral and written communication skills
  • Must have experience in presenting technical topics to large audiences
  • Escalate issues, risks, and decisions to all stakeholders as necessary and develop mitigating actions
  • Effectively communicate with cross-functional teams to expedite resolutions of issues
Submit Query icon