Abhishek

System Engineer
placeholder
Location Delhi
view-icon
Total Views16
availability
Shortlist0
back in time
Member since30+ Days ago
 back in time
Contact Details
phone call {{contact.cdata.phone}}
phone call {{contact.cdata.email}}
Candidate Information
  • User Experience
    Experience 9 Year
  • Cost
    Hourly Rate$11
  • availability
    Availability1 Month
  • work from
    Work FromAny
  • check list
    CategoryInformation Technology & Services
  • back in time
    Last Active OnJune 25, 2022
Key Skills
Apache Hadoop Elastic SearchpythonJavaScriptMySQL
Summary
  • Algorithm developed, and solution written for Recommender system, for one of the product developed for media domain.
  • Developed Reporting system for Data analysis platform. Keeping in focus future advanced analytics requirement having use of machine learning and mathematical formulations
  • Developed a data analysis Platform for my current project using microservice architecture. In which I developed Data Integration solution developed single-handedly used Apache Airflow used layer architecture. In DI I am downloading data from Amazon redshift to AWS s3 bucket. From there I migrated data load files to GCS (Google cloud storage) from there I loaded files into LNRR dataset tables using the load truncate approach then data extracted from LN table filed during the process. Inserted into OD dataset into various tables as required with rules taking care of avoiding duplicate. Then various tables in downstream datasets were refreshed using SQL operations with new data available in OD [IN, TG, VW] Developed most metrics for the front end. Got a spot award for the same. Here in this project, we have given various metrics radio domain. Currently managing the project

Big Data Assignment is done in which:

setup apache Hadoop environment in my system including Apache Hadoop 2.7.3 Hdfs, hive server 2, Apache NIFI

, MySQL,

Elk stack(Elastic Search,Kibana, Logstash)

                    2. I build a data flow in Apache NIFI that ingest data from Facebook into Hadoop

                    3. Same data should be inserted in Elastic Search

Copyright : 2022 – OnBenchMark All Right Reserved.