Senior Data Engineer
Marlabs Innovation Pvt Bangalore Solution design using Microsoft Azure services and related tools. Design of enterprise data models and Data Warehouse solutions. Developed the Azure Data Factory pipelines for transforming external data using data flows and Data bricks notebooks. Developed logic apps to trigger email notification whenever the pipeline got failed using web activity. Experienced with Azure logic apps to schedule, automate, and orchestrate tasks. Hands-on experience troubleshooting, configuring Azure services like Azure Data factory, Azure Data Lake Designed complex data intensive reports in Power BI utilizing various graph features such as gauge, funnel Working knowledge in JSON, Parquet, CSV, EXCEL, Structured, Unstructured data and other data sets
Altruist Technologies Pvt Bangalore Developed the pipelines in Azure Data factory for various scenarios to meet business requirement using blob storage and ingesting the data into azure synapse analytics Implemented Copy activity, Custom Azure Data Factory Pipeline Activities Created Azure key vault for storing connection string details, certificates and used the key vaults in Azure Data factory while creating linked services Processed the fixed width files using derived column activity and loaded into ADLS/ azure synapse analytics using copy activity Self-hosted integration runtime has been created to copy the files form Onpremises VM using various activities like metadata, for each and copy and loaded into ADLS GEN2 and azure synapse analytics Involved in performance tuning of pipelines in Azure Data factory
Senior ETL Developer
Hinduja global Solutions Trivandrum Experience in developing SSIS solutions for extracting, cleaning, transforming and loading data Created SSIS packages to implement error/failure handling with event handlers, row redirects, and logging Hands-on experience in ETL, ELT, handling a large volume of data and files Experience with SSIS performance tuning using counters, error handling, event handling, re-running of failed SSIS packages Troubleshoot integration and SQL Server-related issues in the integration environments Proficient in T-SQL Queries, Dynamic-queries, sub-queries, and complex joins for generating Complex Stored Procedures, Triggers, User-defined Functions, Views and Cursors Oversaw the complete ETL process.