Azure Data Engineer
Location : Chennai, India,
Experience : 7 Year
Rate: $20 / Hourly
Availability : Immediate
Work From : Offsite
Category : Information Technology & Services
Project Lead with ~7 years of experience in designing architecture and developing high quality Business Intelligence solutions using MSBI and Microsoft Azure technologies.
Significant experience with SQL Server, SSIS, SSAS and Power BI
Experience in Azure SQL, Azure Data Factory, Azure Data Lake, Azure Databricks, Logic Apps, Azure Functions and Python.
Leading a team and Project for more than 5 years and responsible for daily calls with On-site POCs to provide updates and to get new requirements.
Core team member of organization's internal functional area initiatives.
Senior Lead Data Engineer
Involved in Business requirement document walkthrough and client calls to understand functionality
Designed a stable architecture for Project
Involved in planning and development of ETL pipelines using ADF Unblocking the team members in requirements and technical issues Designed Azure Data Factory Pipelines to move data to Azure Data Lake Implemented ADF Pipelines to pull data from different sources
Accessed Azure Data Lake files data in Azure Data bricks using mount points Implemented Business logics in Spark SQL/Pyspark to populate required tables Handled cleansing, aggregations and transformations in Spark
Implemented Azure Functions with Python to pull data from APIs and scheduled these Azure Functions in Azure Data Factory
Implemented end to end logging framework for Azure Data factory pipeline Designed of Data warehouse for stable implementation.
Integrated Azure Data Factory for scheduling Jobs and Triggering other related Job. Extensively used Azure Key Vaults to configure the connections in Linked services Created Logic Apps to trigger the mail notification from ADF Pipelines.
Implemented Stored Procedures business logic in Azure SQL Data warehouse.
Created CI/CD pipelines for ADF, Azure SQL Datawarehouse and Azure SQL Database deployment in ADO
Deployed Pipeline and code to multiple environments using CI/CD pipeline Validated the data at overall and every dimension level.
Written test cases to validate data in ADO
Project Lead with 7.8+ years of experience in designing architecture and developing high quality Business Intelligence solutions using MSBI and Microsoft Azure technologies.
Significant experience with SQL Server, SSIS, SSAS and Power BI
Experience in Azure SQL, Azure Data Factory, Azure Data Lake, Azure Databricks, Logic Apps, Azure Functions and Python.
Leading a team and Project for more than 5 years and responsible for daily calls with On-site POCs to provide updates and to get new requirements.
Core team member of organization's internal functional area initiatives.
{{contact.cdata.phone}}
{{contact.cdata.email}}
View Resume
