CAREER OBJECTIVE:
Contribute resourcefully by being part of a progressive team having an inspiring work ambience and there by getting an opportunity to work with talented professionals.
Executive Summary
- Experience in Big data and Hadoop Ecosystems (development).
- Experience in Cloudera as Hadoop Developer.
- Worked in several Hadoop ecosystems like Spark, Hive, Hdfs, Sqoop,MapReduce
- Experience in data Ingestion tools like SQOOP.
- Excellent interpersonal and communication skills, creative, research-minded, technically competent and result oriented with Problem solving and leadership skills.
- Experience in Azure services like Azure Logic Apps and Azure Databricks, Azure Datalake.
- Completed certification on Apache Spark Streaming 3 with Scala on Udemy.
- Completed certification on Apache Spark 3 with Scala on Udemy.
- Excellent debugging and troubleshooting skills, with an enthusiastic attitude to support and resolve customer problems.
- Excellent knowledge in Automation using JAVA and Selenium.
Skills on Big Data & Hadoop Eco-Systems(Development)
- Good understanding of HDFS and MapReduce concepts with Architecture.
- Good understanding of Data Ingestion Tools like Spark.
- Good knowledge and Hands on experience with Hadoop Eco Systems like Hive, Sqoop, Spark.
- Good knowledge and Hands on experience with Spark(Also Streaming).
POC in Hadoop’s Advanced components
- Fetching data from server in real time and placing it in Kafka.
- Exported data from Kafka to Hdfs.
Asset Management Warehousing Hadoop
- Created Hive Warehouse tables using Hive.
- Joining large datasets using Spark/Hive
- Transformed the data using Spark/Hive.
- Joined various hive tables using Hive and generated output table in Hive.
Key Skills / Area of Expertise
- Excellent knowledge of Hadoop components( HDFS)
- Excellent knowledge of data ingestion tools Sqoop.
- Excellent concept Spark and Hive for Transformations.
- Good knowledge of Advanced tools Kafka, Spark.
- UNIXSHELL SCRIPTING
Trainings attended
- Undergone Big Data and Hadoop Ecosystems training at Cognizant.
- Undergone Apache Spark 3 training at Cognizant.
- Undergone Apache Spark Streaming training at Cognizant.
- Undergone training in Scala at Cognizant.
- Undergone training in Databricks at Mindtree.
PROFESSIONAL EXPERIENCE:
Web Tech Squad, Bangalore (29th November 2021-Till Date)
Designation: Senior Data Engineer(Data Engineering)
Mindtree, Bangalore (16th March 2021-26th November 2021)
Designation: Azure Data Engineer (Module Lead)
Cognizant, Chennai (20th May 2019-12th March-2021)
Designation: Hadoop Developer (Associate)
Infosys Limited, Bhubaneswar, India
Designation: Systems Engineer (9th May 2015 –10th May 2019)
PROJECT PROFILE
Project : Data Migration and Data Validation
Duration : November 2021 to till date
Employer : Web Tech Squad, Bangalore.
PROJECT DESCRIPTION
Project is about migrating data from Oracle to Hadoop ecosystem by using Spark and Hive.
ROLES AND RESPONSIBILITIES IN THE PROJECT
- Importing data from Oracle and then doing validation of the data.
- Applying Business logic using Spark SQL with the help of programming language Python.
- Creating managed table and store all transformed data in Functional layer.
- Have scheduled the jobs and monitoring the jobs using Databricks jobs .
- Pointing existing Tableau dashboards to Datalake to get data from the table.
- Monitoring logs of all the services in Kibana and for Kafka topic monitoring in Grafana.
- Creating document of all the services used in the project for Knowledge transfer.
PROJECT PROFILE
Project : Data processing and validation</