Data Engineer (CDP)

No of Positions  No of Positions:   2

location Location: Remote

date Tentative Start Date:   October 27, 2021

Work From Work From : Any Location

rate Rate : $ 20  -  22 (Hourly)

experience Experience : 7 to 10 Year

Posted: 30+ Days ago
Job Applicants : 1
Job Views : 115
Job Category : Information Technology & Services
Duration : 6-12  Month
Key Skills Required Skills
Python Java pyspark hadoop NiFi Kudu Cloudera spark
Description

About Project:

  • The client is developing this application on CDP 7.1.7


Experience:

  • Total Experience: 8-10 Years
  • Big Data experience: >5 Years


Must-Have (Hands-on Experience):

  • Hadoop, SDLC, Python/JAVA, PySpark, HBASE
  • Cloudera
  • NiFi/Kafka/Spark, Spark streaming
  • Hbase/Phoenix
  • Yarn
  • Kudu
  • Impala
  • HDF to CDP Migration
  • Hands-on experience in the implementation of ETL solutions
  • Must possess complete hands-on experience in anyone RDBMS such as AWS Redshift SQL Server Oracle
  • Strong knowledge of SQL and procedural languages such as T SQL, PL SQL, etc.
  • Hands-on experience on anyone of the ETL tools such as AWS Glue, Informatica, IBM DataStage, SSIS, Talend, etc.
  • Hands-on experience with Apache Nifi, Trifacta, AWS Glue
  • Hands-on experience in Query Tuning, Performance Tuning for large scale ETL solutions
  • Must have experience in Data Discovery and Data Mining
  • Must have a good understanding of relational dimension and modelling
  • Exposure to designing modeling tools such as Erwin ERStudio, VISIO, Power Designer


Lead Soft Skills :

  • Must have very good oral and written communication skills
  • Must have experience in presenting technical topics to large audiences
  • Escalate issues, risks, and decisions to all stakeholders as necessary and develop mitigating actions
  • Effectively communicate with cross-functional teams to expedite resolutions of issues