OnBenchMark Logo

Kumar (RID : g8qolgbrr9oa)

designation   Data Engineer

location   Location : Chennai, India,

experience   Experience : 7.5 Year

rate   Rate: $15 / Hourly

Availability   Availability : Immediate

Work From   Work From : Offsite

designation   Category : Information Technology & Services

Shortlisted : 4
Total Views : 86
Key Skills
Python SQL Spark Selenium JAVA Kafka
Discription

CAREER OBJECTIVE:

Contribute resourcefully by being part of a progressive team having an inspiring work ambience and there by getting an opportunity to work with talented professionals.

Executive Summary

  • Experience in Big data and Hadoop Ecosystems (development).
  • Experience in Cloudera as Hadoop Developer.
  • Worked in several Hadoop ecosystems like Spark, Hive, Hdfs, Sqoop,MapReduce
  • Experience in data Ingestion tools like SQOOP.
  • Excellent interpersonal and communication skills, creative, research-minded, technically competent and result oriented with Problem solving and leadership skills.
  • Experience in Azure services like Azure Logic Apps and Azure Databricks, Azure Datalake.
  • Completed certification on Apache Spark Streaming 3 with Scala on Udemy.
  • Completed certification on Apache Spark 3 with Scala on Udemy.
  • Excellent debugging and troubleshooting skills, with an enthusiastic attitude to support and resolve customer problems.
  • Excellent knowledge in Automation using JAVA and Selenium.

Skills on Big Data & Hadoop Eco-Systems(Development)

  • Good understanding of HDFS and MapReduce concepts with Architecture.
  • Good understanding of Data Ingestion Tools like Spark.
  • Good knowledge and Hands on experience with Hadoop Eco Systems like Hive, Sqoop, Spark.
  • Good knowledge and Hands on experience with Spark(Also Streaming).

POC in Hadoop’s Advanced components

  • Fetching data from server in real time and placing it in Kafka.
  • Exported data from Kafka to Hdfs.

Asset Management Warehousing Hadoop

  • Created Hive Warehouse tables using Hive.
  • Joining large datasets using Spark/Hive
  • Transformed the data using Spark/Hive.
  • Joined various hive tables using Hive and generated output table in Hive.

Key Skills / Area of Expertise

  • Excellent knowledge of Hadoop components( HDFS)
  • Excellent knowledge of data ingestion tools Sqoop.
  • Excellent concept Spark and Hive for Transformations.
  • Good knowledge of Advanced tools Kafka, Spark.
  • UNIXSHELL SCRIPTING

Trainings attended

  • Undergone Big Data and Hadoop Ecosystems training at Cognizant.
  • Undergone Apache Spark 3 training at Cognizant.
  • Undergone Apache Spark Streaming training at Cognizant.
  • Undergone training in Scala at Cognizant.
  • Undergone training in Databricks at Mindtree.

PROFESSIONAL EXPERIENCE:

Web Tech Squad, Bangalore (29th November 2021-Till Date)

Designation: Senior Data Engineer(Data Engineering)

Mindtree, Bangalore (16th March 2021-26th November 2021)

Designation: Azure Data Engineer (Module Lead)

Cognizant, Chennai (20th May 2019-12th March-2021)

Designation: Hadoop Developer (Associate)

Infosys Limited, Bhubaneswar, India

Designation: Systems Engineer (9th May 2015 –10th May 2019)

PROJECT PROFILE

Project : Data Migration and Data Validation

Duration : November 2021 to till date

Employer : Web Tech Squad, Bangalore.

PROJECT DESCRIPTION

Project is about migrating data from Oracle to Hadoop ecosystem by using Spark and Hive.

ROLES AND RESPONSIBILITIES IN THE PROJECT

  • Importing data from Oracle and then doing validation of the data.
  • Applying Business logic using Spark SQL with the help of programming language Python.
  • Creating managed table and store all transformed data in Functional layer.
  • Have scheduled the jobs and monitoring the jobs using Databricks jobs .
  • Pointing existing Tableau dashboards to Datalake to get data from the table.
  • Monitoring logs of all the services in Kibana and for Kafka topic monitoring in Grafana.
  • Creating document of all the services used in the project for Knowledge transfer.

PROJECT PROFILE

Project : Data processing and validation</

 
Matching Resources
My Project History & Feedbacks
Copyright© Cosette Network Private Limited All Rights Reserved
Submit Query
WhatsApp Icon
Loading…

stuff goes in here!