OnBenchMark Logo

Meghana

Data Engineer 1
placeholder
Location Hyderabad
view-icon
Total Views84
availability
Shortlist0
back in time
Member since30+ Days ago
 back in time
Contact Details
phone call {{contact.cdata.phone}}
phone call {{contact.cdata.email}}
Candidate Information
  • User Experience
    Experience 1.5 Year
  • Cost
    Hourly Rate$5
  • availability
    AvailabilityImmediate
  • work from
    Work FromOffsite
  • check list
    CategoryEngineering & Design
  • back in time
    Last Active OnJuly 21, 2024
Key Skills
Data AnalysisPythonDatabaseETLMicrosoft AzureSparkSQL
Education
2017-2021

Bachelor of Technology(Computer and Communication Engineering)
Manipal Institute of Technology

Summary

Work Experience

Data Engineer                                             Fractal Analytics                         August, 2021 –June, 2022

Procter & Gamble

Key member of the data engineering team for a project with a multi-national CPG client. The goal was to help build a global sales dashboard that covers 11+ countries over NA, APAC and EMEA regions. The dashboard analyzesthe performance of the client’s grooming products in the global market to help improve/expandits marketing and sales agendas in major focus areas bytracking a plethora of KPIs, characteristic of each country, over different time periods.

·        Developed and maintained multiple Pyspark notebooks to clean and transform data coming from various countries/regions for both online as well as offline KPIs.

·        Debugged and maintained Pyspark code to ensure it is performance optimized and parameterized and modularized the codes wherever necessary.

·        Developed separate ETL pipelines for each region that were responsible for running corresponding notebooks for individual sets of metrics and subsequently load data into SQL database from which it would be pulled by PowerBI dashboard.

·        Worked with multiple KPIs like Share of Shelf, Share of Feature, Availability, Share of Volume, Share of Wallet, Reviews and Ratings, Content Description, Share of Search, etc for both online and offline sales.

·        Worked with multiple time period calculations like PxMS, FYs, IYA, DYA etc.

Technologies: Azure Databricks, Azure DataFactory, Azure SQL Database, Azure Data Lake Gen 2, Pyspark, Azure DevOps for CI/CD

 

Humana

Worked in the Health and Life Sciences domain to build an internal accelerator dashboard to be used as reference scale for any Healthcare client’s dashboarding needs. Work centered around Social Determinants of Health (SDoH) and aligns with US healthcare client.

·        Wrote multiple Pyspark notebooks in Databricks/Jupyter that were responsible for creating different tables for staging and reporting layers in the data pipeline that would eventually be used as inputs for the Power BI dashboard.

·        Debugged and maintained Pyspark code to ensure it is performance optimized and parameterized and modularized the codes wherever necessary.

·        Modified existing source connections in Power BI dashboards to point to the ADLS location where the final files were stored and made changes in dashboard wherever necessary.

·        Validated the dashboard and provided a user guide documentation for the same.

Technologies: Azure Databricks and Jupyter notebooks, Azure Data Lake Gen 2, Pyspark, Power BI.

Software Engineering Intern                           BlackRock Inc                         January, 2021 – July, 2021

Worked on Release Process Automation tasks involving automating and updating/improving the existing processes, to meet the changing business needs, carried out by the Change Management team across Blackrock’s biggest product group.

·        This involved working with scripts in Python, Perl and SQL to generate weekly business reports and send automated emails with updated agendas for the team to carry out timely review procedures.

·        In addition, also helped carry out expedite analysis to figure out appropriate lead times for review packets and suggested changes accordingly.

·        Created an internal dashboard for the team using Pyspark for data accumulation, preprocessing and processing for backend operations and Angular frontend for displaying the charts and infographics.

Technologies: Azure, JIRA, SQL, Python scripting, Perl scripting, PySpark, Angular.

Copyright© Cosette Network Private Limited All Rights Reserved
Submit Query
WhatsApp Icon