Anurag (RID : 131k8lmir758v)

Data Engineer

Location : Delhi, India

Experience : 7 Year

Rate: $12 / Hourly

Availability : Immediate

Work From : Offsite

Category : Information Technology & Services

Shortlisted : 1

Total Views : 68

Key Skills

Data Engineer Snowflake AWS .Net Azure

Discription

PROFILE SNAPSHOT

A reliable, hardworking and motivated individual with a strong desire to move forward, face new challenges and expand the skill set. A competent professional with over 7 years of experience in Application Development, System Integration, Service, Delivery and Project Management.
Data engineer with 4.5+ years of experience in building data pipelines, data management and processing system, along with an experience of 3+ years as a Full Stack Developer wherein worked on coding, testing, integration and guided the developer team.
Information concerning the current dataﬂows was gathered from a variety of sources; Azure storage accounts, the conﬁg database, Databricks databases set up in the diﬀerent zones of the data lake and Databricks scripts. Implementing real‑time data pipelines to process data by integrating raw records from diﬀerent data sources.
Working on creating Alerts and Monitors in Datadog as well as AWS Cloudwatch.
Good Exposure to Agile working environment and experience working with Version control systems such as Git.

AREAS OF EXPERTISE

Snowﬂake | ETL || Python | Asp.Net | Asp.Net Core | Postgres | SQL Server | Spark | Pandas | AWS Services (S3, Redshift, Glue, Lambda, App ﬂow, Cloudwatch) | Azure data factory | Azure Data Lake Microsoft Azure |KAFKA|Apache Flink | Database Warehousing | Modeling

TECHNICAL SKILLS

Programming Language

Python, C#

Web Technologies

Angular, React JS, Java script

Database

SNOWFLAKE, SQL SERVER,MySQL, Postgresql

Frameworks

Asp.Net , Asp.Net Core

Cloud Computing

AWS, Azure

Web/Application Server

IIS

ETL/ELT

Matilion, Azure Data Factory,Fivertran,DBT

Database Tools

SQL Developer, DBvisualizer, pgAdmin, MySQL Workbench

Repository Tools

Git & GitHub, Tortoise

Other Tools

Power BI

KEY DELIVERABLES

#1 Project: Spotlight Client: N/A | Role: Lead Data Engineer | Environment: Snowﬂake, Azure Databricks, ADF,DBT,KAFKA, Airﬂow,Airbyte, Django Rest Framework.

The system is designed to provide a comprehensive view of ﬁnancial data as it moves through diﬀerent systems and workﬂows, allowing auditors to identify any anomalies or errors that may indicate non-compliance with regulatory requirements. The system can be customized to meet the unique needs of diﬀerent ﬁnancial organizations, and can be conﬁgured to generate alerts or notiﬁcations when potential compliance issues are detected.

#2 Project: PRET A Manager Client: N/A | Role: Senior Data Engineer | Environment: Snowﬂake, Azure Databricks,KAFKA, ADF,Azure EventHub,Azure Functions,Azure Data lake.

Information concerning the current dataﬂows and ﬁnancial transactions was gathered from a variety of sources; Azure storage accounts, the conﬁg database, Databricks databases set up in the diﬀerent zones of the data lake and Databricks scripts.

Read Data(Raw) from the stream(EventHub) and using python and pyspark code ﬂatten the particular message and after Data Quality check we need to insert into snowﬂake.
Insert data into diﬀerent layer using Stream , Stored Procedure in SNOWFLAKE.
Write views according to the ﬁnancial transaction between diﬀerent layer in snowﬂake with the tax of diﬀerent part of country.

#3 Project: Companion Protect Client: N/A | Role: Senior Data Engineer | Environment: Snowﬂake, Azure Databricks, Azure Data Lake , ADF.

Migrating ETL processes and data from the Postgres database to the .Snowﬂake database using the Matillion tool. Implementing real‑time data pipelines to process data by integrating raw records from diﬀerent data sources.
Implementing real‑time data pipelines to process data by integrating raw records from diﬀerent data sources.

#4 Project: Medhas | Client: Sunpharma | Role: Project Lead & SME | Environment: Asp.Net, ReactJs, SQL, Entity Framework|

Administered the design, development, testing, troubleshooting and debugging of the software; requirement gathering from the client side. Carried out the system study and coordinating with team members for product documentation, system design & integration.

Provided post‑implementation, application maintenance and enhancement support to the client with regard to the product /software application.

PRIOR PROJECTS

Fame in City –

This e-commerce application allows an individual to buy any authentic souvenir of any particular state. It is built using Asp.Net(Api-Backend), React(Frontend) and SQL

Server(2012) and Snowﬂake as Database.

Teave

This software allow schools to digitally monitor the daily activities along with managing all the resources and
information on a single platform. It is built in Asp.Net(WebForm) and SQL Server as a database.