Jr. Data Engineer
Location : Ahmedabad, India
Experience : 1 Year
Rate: $8 / Hourly
Availability : 1 Week
Work From : Offsite
Category : Information Technology & Services
Project Experience Store-Sales-Project It is the ETL POC project in Which we have store data files which firstly go for cleaning and after that the Transformed file send to the respective user Mail
Responsibilities:
• Design and implement flow.
• Convert Unstructured Data to structured
• Discuss and resolve bugs and implement new features.
Environment: Visual Studio Code, Git, Docker
Technology:Python, MySQL and Postgres Database,Docker, Apache Airflow Streaming Data To S3 It is the Real Time pipeline (POC Project) in which there are multiple sources (Mongo, Postgres, MySQL, Files) from which continuous data are shared which will be Handled by CDC debezium. After that Kafka broker stores that data In Respective Topics. From topics that data will be structured through Ksql or spark and finally send that data to the S3 Bucke