Azure Data Engineer
Location : Bengaluru, India
Experience : 5 Year
Rate: $15 / Hourly
Availability : 2 Week
Work From : Any
Category : Information Technology & Services
Project#1
Client: Optum
Duration: May 2020 - Till date
Team Size: 5
Roles and Responsibilities:
• Good hands-on Azure resources creation and maintenance
• Worked on Databricks and created notebook for the transformation of data with Pyspark
• Databricks level code deployments doing from one branch to another branch
• Worked on Eventhub to capture streaming data and loading into SQL DB
• Worked on synapse analytics like creating pipelines and data movement
• Have hands on actions and transformation using RDD and dataframes in pyspark
• Doing Performance tuning on Pyspark and T-SQL if any notebook running slow.
• Created IR, Linked services, Data Set and Pipelines according to requirement and transform
the data from Azure blob
• Worked to move the data transform from On-Premises SQL database table to Azure SQL database
by using ADF
• Scheduled Jobs in Flows and ADF Pipelines.
• Doing transformation with mapping dataflow multiple inputs, outputs, schema modifiers, row
modifier.
• Created automated workflows with the help of triggers
• Created logic apps to gets the notification if any pipeline got failed
• Creating containers and generating the SAS keys, Access Key and providing access on
containers
• Configured and adding policies on server to maintains Secrete key, Access Policies under
Azure Key Vaults for Storage, ADF and different services in Azure.
• Created ADF pipelines to move Azure SQL db to Cosmos db.
• Mount the ADLS Gen2 into the Databricks level.
• Knowledge on various Cloud service models, including IaaS, PaaS and supporting
deployment models, including Private, Public, and Hybrid cloud
Project#2
Client: Optum (IBAG)
Duration: Sept 2018 – May 2020
Team Size: 6
Roles and Responsibilities:
• Worked on Microsoft Azure IaaS, PaaS SQL db, Managed instance and ADF
• Created SQL storage account and created container in blob storage
• Created Recovery vaults for production and non-prod to take backup of databases
• Created users and groups on Azure active directory.
• Provisioning access as per the request and optimizing privileges.
• Worked on SQL db and elastic pools and much hands on PaaS Managed instance.
• Created SQL db for single application on Azure
• Hands on PaaS migration.
• Migrated around 450 databases from IaaS to PaaS MI (2017 version)
• Worked on DB encryption on PaaS MI and instance level.
• Configured vulnerable assessment on databases and alerts.
• Taken proper action on alerts.
• Hands on Azure data factory and move SSIS packages from IaaS.
• Worked on tickets, issue and troubleshooting failed jobs.
• Worked on Disk space issues.
{{contact.cdata.phone}}
{{contact.cdata.email}}
View Resume
