OBJECTIVE

In quest of a challenging position in the organization that offers me generous opportunities to explore & outshine as Technical Analyst while accomplishing personal, professional as well as organizational goals.

SYNOPSIS

Competent B.Tech professional around 5.3 Years of work experience in IT, with 3.7 years as Data Engineer. Possess good overall perspective of the system to help interpret and explain motivations for requirements to the team members and thereby gain their acceptance and commitment to objectives. Deep understanding of Computer applications domain with good quantitative, analytical & logic building abilities; Adroit at analyzing the organization requirements, highly ethical, trustworthy and discreet.

In-depth knowledge of the procedures of SDLC.

Exposure in development of solutions for Big Data using the Hadoop eco system

(HDFS, Hive, Scala, Spark,Pyspark, SQL). Comfortable to work in a team .

Highly adaptable in quickly changing technical environments.

Worked on AWS cloud .

CAREER GRAPH

Data Engineer – (Nov-2021 – Present)
Senior Associate Developer –Digitas India (Nov-2019 – Oct-2021)
Software Engineer – Fourth signal India Pvt Ltd. (July 2017 – Sep 2019)

COR E COMPETENCI ES

Operating system : Windows , Linux Language : Scala ,Python, SQL Database :MySQL

Tools : Eclipse ,Jira , Putty, FileZilla, Intellij

Hadoop System : HDFS, Sqoop , Hive ,Apache Spark, Pyspark Version Control : Git

Cloud : AWS

PROJECTS WORKED ON

Project Name: VBP-RM (Risk Manager) Nov 2022 - Present

The purpose of this project is to capture, measure and analyze healthcare claim to better manage population health program. Finding the risk cost and finding way to optimize the same metrics. There is different engine whose output is the feed for RM Engine like QRE and Q2T and WARP stages.

Project Role: Big Data Engineer

Roles & Responsibilities

Understanding stored procedure in MYSQL and converting that into spark Scala code..
Creating dataflow by understanding business logic and orchestrating based on frequency of data to execute as batch job monthly once.
Creating the UDF based on the requirement.
Making the query optimized to save the cost and time.
Defined Partitions on filetype since that optimized process of spark task across executors.
Worked on pipeline orchestration on DATA ADVOCATE.
Providing data to Superset team to view that in frontend and did transformation and calculation according to the business needs to display data in dashboard.

Technologies: Spark, Scala, Spark-SQL, Python, AWS

Project Name: DDL (Digitas Data Lake) Nov 2019 - Sep 2021

Digitas limited has different brands associated with it , so in this we are dealing with the data of different brands this project is being created to facilitate their Data Science team to work on multiple business management use cases. Data is being pulled from multiple diverse data sources then dumped into the staging area, Using Spark, we will implement business logic on staging data.

Project Role: Big Data Engineer

Roles & Responsibilities

Performed Import and Export of data into HDFS and Hive using Sqoop and managed data within the environment.
Involved in creating Hive tables, data loading and writing hive queries.
Handled and worked on Spark Application to process data sets.
Managed Hive Tables and created child tables based on partitions.
Involved in working on the Data Analysis, Data Quality and data profiling for handling the business that helped the Business team.

Technologies: Hadoop, HDFS, Hive, Sqoop, Spark, Scala, SQL.

Project Name: UDB(Ultratech Data Bridge) Aug 2018– Sep 2019

In ultratech they have different kind of data which are related to their business management and their market investment , which are flows to the DB in regular basis , so through this project implementation their business leaders and financial leader collaborating the analysis of the data and helps to take any business decision through clear understanding .

Project Role: Data Engineer

Roles & Responsibilities

Effectively interacted with team members and business users for requirements gathering.
Implementing partioning and bucketing using hive table for more efficient data storage and searching.
Worked on hive queries for creating and querying hive tables to retrieve useful analytics information .
Analyzing the bugs and identifying its root cause in the application and creatingdefects for same.
Defect fixing and support for System testing and acceptance testing teams.
Communication with multifunctional teams, programmers and Technical staff atall levels.
Analysed and played an important role for solving production tickets, where have Provided the accurate analysis of the applications behavior.

Technologies: Hadoop, HDFS, Hive, HBase, Sqoop ,Mysql, SQL