You have successfully applied. Need to upgrade your plan to view contact details of client.
Shortlisted : 3
Total Views : 202
Key Skills
Azure Data Factory
Azure Databricks
SQL Server
Discription
Excellent knowledge of ADF building components –Integration Runtime, Linked Services, Data Sets, Pipelines, Activities
Designed and developed data ingestion pipelines from on-premises to different layers into the ADLS using Azure Data Factory (ADF V2)
Experience with integration of data from multiple data sources
Knowledge on Data Extraction from On-Premises Sources and Delta Extraction methods from Source Systems to ADLS
Extensively Worked on Copy Data activity
Worked on Get Metadata Activity, lookup, Store Procedure, Foreach, IF and execute Pipeline activities
Knowledge on Data Extraction from On-Premises Sources and Delta Extraction methods from Source Systems to ADLS
Implemented dynamic pipeline to extract the multiple files into multiple targets with the help of a single pipeline
Manage data recovery for Azure Data Factory Pipelines
POC using ADLCOPY to copy BLOB to ADLS and ADLS to ADLS
Pipeline execution methods (Debub vs Triggers)
Writing the SQL queries using Joins, Co-Related Queries, and Sub-Queries
Monitor and manage Azure Data Factory
Deployed the code with help of the CI/CD process.
Using python for data transformation techniques
Use filter () to return the rows that match a predicate,
aggregations using agg () and count Distinct ()
Compare the Data Frame and SQL query physical plans
Extensively used ETL methodology for supporting Data Extraction, Transformation, and processing of data from sources like (Oracle, SQL Server, Teradata) using Azure Data Factory into Azure Data Lake Storage
Experience with integration of data from multiple data sources
Involved in production support activities
Good team player with excellent communication and interpersonal skills