OnBenchMark Logo

Deep (RID : x1l8lk82uulz)

designation   Jr. Data Engineer

location   Location : Ahmedabad, India

experience   Experience : 1 Year

rate   Rate: $8 / Hourly

Availability   Availability : 1 Week

Work From   Work From : Offsite

designation   Category : Information Technology & Services

Shortlisted : 0
Total Views : 83
Key Skills
Data Engineer Python MySQL Mongo Postgres Docker
Discription

Project Experience Store-Sales-Project It is the ETL POC project in Which we have store data files which firstly go for cleaning and after that the Transformed file send to the respective user Mail

Responsibilities:

• Design and implement flow.

• Convert Unstructured Data to structured

• Discuss and resolve bugs and implement new features.

Environment: Visual Studio Code, Git, Docker

Technology:Python, MySQL and Postgres Database,Docker, Apache Airflow Streaming Data To S3 It is the Real Time pipeline (POC Project) in which there are multiple sources (Mongo, Postgres, MySQL, Files) from which continuous data are shared which will be Handled by CDC debezium. After that Kafka broker stores that data In Respective Topics. From topics that data will be structured through Ksql or spark and finally send that data to the S3 Bucke

 

 
Matching Resources
My Project History & Feedbacks
Copyright© Cosette Network Private Limited All Rights Reserved
Submit Query
WhatsApp Icon
Loading…

stuff goes in here!