OnBenchMark Logo

R. Pavan (RID : 1gdlal1m5xx)

designation   Senior Consultant

location   Location : Hyderabad, India

experience   Experience : 8 Year

rate   Rate: $16 / Hourly

Availability   Availability : Immediate

Work From   Work From : Offsite

designation   Category : Information Technology & Services

Shortlisted : 3
Total Views : 141
Key Skills
Azure Data Factory Azure Databricks SQL Server
Discription
  • Excellent knowledge of ADF building components –Integration Runtime, Linked Services, Data Sets, Pipelines, Activities
  • Designed and developed data ingestion pipelines from on-premises to different layers into the ADLS using Azure Data Factory (ADF V2)
  • Experience with integration of data from multiple data sources
  • Knowledge on Data Extraction from On-Premises Sources and Delta Extraction methods from Source Systems to ADLS
  • Extensively Worked on Copy Data activity
  • Worked on Get Metadata Activity, lookup, Store Procedure, Foreach, IF and execute Pipeline activities
  • Knowledge on Data Extraction from On-Premises Sources and Delta Extraction methods from Source Systems to ADLS
  • Implemented dynamic pipeline to extract the multiple files into multiple targets with the help of a single pipeline
  • Manage data recovery for Azure Data Factory Pipelines
  • POC using ADLCOPY to copy BLOB to ADLS and ADLS to ADLS
  • Pipeline execution methods (Debub vs Triggers)
  • Writing the SQL queries using Joins, Co-Related Queries, and Sub-Queries
  • Monitor and manage Azure Data Factory
  • Deployed the code with help of the CI/CD process.
  • Using python for data transformation techniques
  • Use filter () to return the rows that match a predicate,
  • aggregations using agg () and count Distinct ()
  • Compare the Data Frame and SQL query physical plans
  • Extensively used ETL methodology for supporting Data Extraction, Transformation, and processing of data from sources like (Oracle, SQL Server, Teradata) using Azure Data Factory into Azure Data Lake Storage
  • Experience with integration of data from multiple data sources
  • Involved in production support activities
  • Good team player with excellent communication and interpersonal skills
  • Play a key role in the development team
 
Matching Resources
My Project History & Feedbacks
Copyright© Cosette Network Private Limited All Rights Reserved
Submit Query
WhatsApp Icon
Loading…

stuff goes in here!