Azure Data Engineer
Location : Vadodara, India
Experience : 5 Year
Rate: $21 / Hourly
Availability : Immediate
Work From : Offsite
Category : Information Technology & Services
WORK EXPERIENCE
Senior Data Engineer
06/2022 - Present,
Achievements/Tasks
Design and Build an Industry standard ETL using SSIS, for Data Warehousing. (SSIS) Building Azure Architecture for Data Warehouse solutions using Terraform IaaS and
GitHub for CI/CD pipelines for workflows. Develop Data Pipeline with Azure Data Factory and Azure Databricks using customised PySpark scripts.
Involved in Debugging, Monitoring and Maintenance of existing BI solutions (SSIS, SSRS,SSAS, SQL Server) SQL Server 2019.
Optimising distributed parallel processing framework in order to process large datasets with different technologies. Understand & Research planet products business to develop ML algorithm for the opportunity of increasing revenue using Azure ML, AWS Sagemaker, scikit-learn. Collaborate with Data Science team to develop ML and Deep Leaning Models to achieve payment fraud detection algorithms and recommendation system. Work with architects on extending existing ML libraries and frameworks.
Senior Application Engineer
04/2020 - 06/2022,
ONESOURCE GTM - SaaS platform for International Global Trade Management.
Innovator of the year | SME of TechOps Team Designed, developed & optimized highly complex workflow interfaces, with flexible & scalable data and robust ETL architecture by utilizinK & Hadoop technologies to support ONESOURCE clients application and business users. Automated manual & monotonous tasks by making an centralized data warehouse
with star and snowflake schema collaborating with product development team to save users efforts by 75%. Built architecture for high scalability streaming system.
Research & Analysis on database of global trade networks to tune query performance by optimizing Indexes of Transactional & Analytical workloads Creating/Modifying Stored Procedures, Triggers, Routines, Views, Functions, SSIS packages and complex SQL scripts to facilitate projects & business operations.
Proposed innovative ideas on implementation of 6-data points requirement gathering over ONESOURCE GTM Application to facilitate support operations to reduce
data load times up to 80%. Worked on migration of ONESOURCE GTM Products from on-prem to cloud databases & good experience working with Azure DF, Data lake storage, AWS S3, AWS Lambda & AWS Glue.
SKILLS
CERTIFICATIONS
Microsoft Certified: Azure Data Engineer
Cleared DP-203, AI-900 and DP-900 Microsoft Exams
Data Warehouse Architect
Implementing Data Warehouse in Microsoft SQL
Server 2019
AWS Certified: Cloud Practitioner
Data Engineer
An Independent, self-motivated, versatile & proactive Technology Development professional & Data
Science enthusiast with more thanof experience in IT industry skilled in Data
Engineering Operations | Data Warehousing | Data Analytics | Data Integrations | Data
Architect | SQL Development with a good grasp on Python, Java, C++, Core Data Structures &
Algorithms, and Databases. A confident effective Communicator, Team Player, Innovator,
Thinker and Learner possessing can-do attitude.
Agile Methodologies
Research & Development SDLC
Process Automations Python
Big Data Analytics T-SQL
Data Modelling & Schemas
Data Transformations SSMS
Kibana Azure Data Factory
XML Configurations SSIS Java
AzureData APIs NoSQL
Azure Data Lake & Blob Storage
Hadoop AWS ETL
Azure AI & Automated ML
ElasticSearch
Hive/HBase Workflows Development
Web APIs PySpark NoSQL
Data Warehousing Terraform
Spark
Azure Synapse Analytics (DW), Azure SQL DB
Confidential
Confidential
Snowflake
Parth
6years
Volleyball Trekking Expeditions
WORK EXPERIENCE
Ambassador - Information Security
04/2019
{{contact.cdata.phone}}
{{contact.cdata.email}}
View Resume
