OnBenchMark Logo

Anil (RID : qzyclk2e452f)

designation   Data Engineer

location   Location : Hyderabad, India,

experience   Experience : 2.5 Year

rate   Rate: $12 / Hourly

Availability   Availability : Immediate

Work From   Work From : Offsite

designation   Category : Information Technology & Services

Shortlisted : 1
Total Views : 100
Key Skills
Data Engineer Azure Pyspark SQL Azure Pyspark ETL Python
Discription

Data Engineer

Experienced Azure Data Engineer with 2.5+ years of professional experience in developing secure, cost-efficient data solutions. Successfully designed and implemented 3+ projects through the entire development cycle, driving down storage costs by 25%, increasing customer satisfaction by 20%, streamlining integration and profiling processes by 40%, and more. Proven ability to architect automated environments for optimal data assets and resources, leveraging essential tools such as Azure Cloud, SQL Server and Python.

Summary:

  • Worked as a Data Engineer on a complex data project with billions of assets under management
  • Administered and maintained ETL pipelines in Azure Data Factory and Synapse.
  • Analyzed and implemented data warehouse solutions using Azure services and Snowflake.
  • Developed Spark/Databricks pipelines in Python for data transformation and data processing.
  • Coordinated with cross-functional teams to develop data models and business intelligence solutions.
  • Maintained and optimized data warehouse performance, ensuring data integrity and accuracy.
  • Supported BI development team in maintaining data warehouse and pipeline development best practices.
  • Followed Agile delivery methodologies and CI/CD pipelines to ensure timely delivery of solutions.
  • Enriched ADF pipelines to extract, transform, and load data from various sources, including Microsoft CRM Dynamics and multiple healthcare EMR systems
  • Directed Databricks and PySpark to transform and aggregate data in the bronze, silver, and gold layers of the Lakehouse design pattern
  • Successfully completed the migration on time and under budget, resulting in significant cost savings for the client
  • Devised scripts in Python to automate the migration process, resulting in a 50% reduction in migration time
  • Collaborated with the data analytics team to integrate their reporting needs using Power BI and SSRS
  • Utilized IaC tooling to manage the infrastructure.
  • Contributed to the strategic direction of the project and helped achieve successful project completion within the given timeframe

Roles and Responsibilities:

  • Built a cloud-based data warehouse solution for a networking company using Azure Data Factory, Azure Synapse.
  • Created dimensional data modelling and optimized performance using query and workload optimization techniques. Resulted in increased data accuracy and efficiency.
  • Calculated the development of an event-driven architecture for a healthcare company using Azure services and Databricks.
  • Optimized PySpark pipelines for data processing & transformation, resulting in improved data quality & reduced data processing time.
  • Collaborated with a retail company to develop a real-time data streaming solution using Azure services and event-driven architecture.
  • Generated and implemented data models using Data Vault 2.0 methodology, resulting in improved scalability & flexibility of the solution.
  • Designed and developed cloud-based solutions using Azure Data Factory, Azure Data Lake, Azure Databricks, and Azure Synapse.
  • Extracted data from Microsoft CRM Dynamics and integrated it into the data pipeline.
    • Projected the lakehouse architecture using Medallion design patterns and implemented delta extraction for optimized data processing

Professional Experience

Working as Sr.Software engineer for Zensar technologies since Jan 2021 - till now

Worked as Software developer for Accenture solutions pvt ltd from the period April 2017 to Dec 2018

Worked as SQL developer/Software developer for Knoah solutionsinc(now as Intouchcx) from the period 2015 June to 2016 June

Technical Skills

Languages

T-SQL, SQL, Pyspark, Python

Databases

MS SQL Server 2016

Cloud

Azure/Cloud Platform experience (Azure Data Lake, Data Factory, Database, SQL Server)

Career Summary

Client: Cisco Nov2021 – present

Skill : Azure data engineer, SQL, Pyspark, Databricks

Domain : Networking

Role :Azure data engineer

Description :Cisco is an American multinational technology conglomerate corporation headquartered in San

Jose, California. Integral to the growth of Silicon Valley, Cisco develops, manufactures, and sells networking

Hardware, software, telecommunication equipment and other high technology services and products

 
Matching Resources
My Project History & Feedbacks
Copyright© Cosette Network Private Limited All Rights Reserved
Submit Query
WhatsApp Icon
Loading…

stuff goes in here!