Data Engineer
Location : Bengaluru , India
Experience : 5 Year
Rate: $15 / Hourly
Availability : Immediate
Work From : Offsite
Category : Information Technology & Services
WORK EXPERIENCE
Senior Data Engineer
Visionkrid Studio Pvt Ltd
06/2022 - Present,
Achievements/Tasks
Design and Build an Industry standard ETL using SSIS, for Data Warehousing. (SSIS)
Building Azure Architecture for Data Warehouse solutions using Terraform IaaS and GitHub for CI/CD pipelines for workflows. Develop Data Pipeline with Azure Data Factory and Azure Databricks using customised PySpark scripts. Involved in Debugging, Monitoring and Maintenance of existing BI solutions (SSIS, SSRS,SSAS, SQL Server) SQL Server 2019.
Optimising distributed parallel processing framework in order to process large datasets with different technologies.
Senior Application Engineer
04/2020 - 06/2022,
ONESOURCE GTM - SaaS platform for International Global Trade Management. Innovator of the year | SME of TechOps Team
SKILLS
Team Leadership
Agile Methodologies
Research & Development SDLC
Process Automations Python
Big Data Analytics T-SQL
Data Modelling & Schemas C#
Data Transformations SSMS
Kibana Azure Data Factory
XML Configurations SSIS Java
AzureData APIs NoSQL
Azure Data Lake & Blob Storage
Hadoop AWS ETL
Designed, developed & optimized highly complex workflow interfaces, with flexible & scalable data and robust ETL architecture by utilizing Spark & Hadoop technologies to support ONESOURCE clients application and business users. Automated manual & monotonous tasks by making an centralized data warehouse with star and snowflake schema collaborating with product development team to save users efforts by 75%. Built architecture for high scalability streaming system. Research & Analysis on database of global trade networks to tune query performance by optimizing Indexes of Transactional & Analytical workloads
Azure AI & Automated ML
ElasticSearch MapReduce
Hive/HBase Workflows Development
Web APIs PySpark NoSQL
Data Warehousing Terraform
Creating/Modifying Stored Procedures, Triggers, Routines, Views,
Functions, SSIS packages and complex SQL scripts to facilitate projects
& business operations.
Proposed innovative ideas on implementation of 6-data points requirement
gathering over ONESOURCE GTM Application to facilitate support operations to reduce data load times up to 80%. Worked on migration of ONESOURCE GTM Products from on-prem to cloud databases Azure Synapse Analytics (DW), Azure SQL DB & good experience working with Azure DF, Data lake storage, AWS S3, AWS
CERTIFICATIONS
Microsoft Certified: Azure Data Engineer
Cleared DP-203, AI-900 and DP-900 Microsoft Exams
Data Warehouse Architect
Implementing Data Warehouse in Microsoft
SQL Server 2019
AWS Certified: Cloud Practitioner
Lambda & AWS Glue.
WORK EXPERIENCE
Ambassador - Information Security
04/2019 - 04/2021,
Information Security Ambassador - Vadodara Site
Development over security applications by different methodologies and contribution towards cloud technology collaborated with DevOps. Performed security checks on existing architecture in order to prevent breach of data.
{{contact.cdata.phone}}
{{contact.cdata.email}}
View Resume
