Data Engineer
Location : Indore, India
Experience : 9 Year
Rate: $17 / Hourly
Availability : Immediate
Work From : Offsite
Category : Information Technology & Services
Data Engineer
EXPERIENCE SUMMARY
file systems into Hadoop using Hive, spark, Python, Pyspark, Sqoop, and SFTP/SCP
PROJECT #1:
Project : StitcherX
Client : Stitcher
Environment : Spark SQL, Python, Pyspark, Talend, ELK, Airflow,
Role : Data Engineer
Duration : (Sep-2021 to till date)
Brief description of the project:
StitcherX project mainly gets the ingested data from the Bigquery to redshift using talend jobs.Once the data is available in the redshift will be curated for the business requirement.all the services are running on aws and for scheduling the jobs we are using airflow.
Responsible for:
Python in Glue.
Requirement.
PROJECT #2:
Project : Nitro advanced analytics
Client : Mashreq Bank
Environment : Spark SQL, Python, Hive, Pyspark, Oracle and SQL server
Role : Big data Developer
Subject Area : Banking & Finance
Duration : (Jul-2020 to Aug-2021)
Brief description of the project:
The nitro project is to inje
{{contact.cdata.phone}}
{{contact.cdata.email}}
View Resume
