OnBenchMark Logo

Pradeep (RID : a49xldlhrf77)

designation   Software developer

location   Location : Hyderabad, India

experience   Experience : 9.5 Year

rate   Rate: $18 / Hourly

Availability   Availability : Immediate

Work From   Work From : Any

designation   Category : Information Technology & Services

Shortlisted : 1
Total Views : 88
Key Skills
Java scala Spark Microservices kafka SQL AWS
Discription

P R A D E E P

Summary

Total experience of 9.5 years in Software development and Data Team Lead for 2.5+ years of experience. Architected, designed and implemented data pipelines in Fintech domain and the advertising domain that were envisioned and implemented from the ground up. Leading a 7+ team to deliver data pipeline and developing microservices worked on developing big data jobs and ETL's.

Technology And Skills

  • Java, Scala, Spark, Microservices, Map Reduce, Kafka, Vertica, SQL, Data Modelling, Amazon web services.

Project details

Data pipeline for transaction data lake in AWS

    • Built a Data lake on AWS to land any form of data backed by strong and agile analytics pipeline
    • Led the team to centralize data for 4 different business units of US Payment Processing. This centralized data covering millions of transactions for Paysafe will be used for Business Intelligence, Advanced Analytics, and Reporting.
    • Delivered a config driven spark ETL framework to ingest data from S3 to Vertica DB.

Data pipeline for Merchant Data model in AWS

    • Built dimensional model on a snowflake schema, with dimensions surrounding the fact table.
    • Designed pipeline to ingest data into datawarehouse dimensional model including dimensions and facts.
    • Led the team to centralize data from 5 different sources of Paysafe Merchant data. This data covering merchant data and onboarding application data used for analysis of process efficiency and reports.

MicroServices- Sema4 Get Data

    • Collect patient data from multiple providers which will be used for Research Purpose and to generate CCD.
    • Designed system using MicroServices, Spring Boot,Hibernate and Google Cloud Platform.
    • Achieved data transfer between services with in internal and external systems through REST and Google PubSub.

Big data - Opera Media Works AdMarvel

    • AdMarvel is a mobile Ad Management optimization platform it will generate 7-10TB logs every day and data will be uploaded to AWS S3.
    • Created Hadoop Map Reduce and Spark EMR jobs to process the Ad Server logs and load into Redshift,Mysql and S3.
    • This data used for reporting, analytics and analysis performance of campaigns.

 

Streming data pipeline - Interest-based targeting AdMarvel AMP

    • It is a platform which gathers information about the users, categorizes users based on different categories, create audience segments and target the audience segment for campaigns.
    • Strem data from App servers using Kafka and update in No SQL AeroSpike DB.
    • Developed config driven java application to Load data of users and their interests received from third party partners into AeroSpike DB.
    • Developed scalable java job to refresh elastic search to calculate Audience reach.

Professional Summary

July 2018 – Present Aug 2017 – July 2018

Nov 2014 - Aug 2017

Dec 2012 - Nov 2014

Education

Bachelor of Engineering Intermediate

Deltacubes Technologies

Pramati Technologies

Talentica Cognizant Institution VIT University

Narayana Junior College

Team Lead

Senior Software Developer Senior Software Engineer Software Engineer

YEAR 2012

2008

 
Matching Resources
My Project History & Feedbacks
Copyright© Cosette Network Private Limited All Rights Reserved
Submit Query
WhatsApp Icon
Loading…

stuff goes in here!