OnBenchMark Logo

Magudeeswaran

Lead Data Engineer
placeholder
Location Chennai
view-icon
Total Views62
availability
Shortlist0
back in time
Member since30+ Days ago
 back in time
Contact Details
phone call {{contact.cdata.phone}}
phone call {{contact.cdata.email}}
Candidate Information
  • User Experience
    Experience 4.5 Year
  • Cost
    Hourly Rate$6
  • availability
    AvailabilityImmediate
  • work from
    Work FromOffsite
  • check list
    CategoryInformation Technology & Services
  • back in time
    Last Active OnMay 11, 2024
Key Skills
SQLPL/SQLPython
Summary

Latent View Analytics

Lead Data Engineer                                                                                         Chennai, IN | Sep '21 - Present

Project: Fiserv (MSMO)

Objective:MSO is the anomaly detection project; we use to move the data from SQL server to Hadoop and do the transformation activities and create the final transformed table which can help the Data science team to create an effective model to get insight out of it.

·        Developed Spark programs using Pythonto execute the data quality rules on top of the Hive tables.

·        Performing data processing using PySpark when we get the data from other sources

.

·        Performed Data enrichments such as filtering, pivoting, format modeling, sorting and aggregation using Hive.


·        Created DAGs to automate the ETL/ELT process inAirflow.

Copyright© Cosette Network Private Limited All Rights Reserved
Submit Query
WhatsApp Icon