Data Engineer Python with AWS
Location : Noida
Experience : 5 Year
Rate: $16 / Hourly
Availability : Immediate
Work From : Offsite
Category : Information Technology & Services
Confidential
The client is the leading provider of comprehensive waste management servicesin North America serving over 20 million customers through collection, landfill,transfer, recycling and other lines of business. The project is to performDiscovery, Design Assessment and implementation of migration from the existinglegacy data warehousing environment built using Netezza, Control M andInformaticatoacloud-basedwarehousing solution.
Technologies: Snowflake, AWS, DBT, Matillion, Informatica, Git and GitHub,Internaltoolkit.
The project is to develop data warehouse for different formats (CSV, JSON, RDBMS,API calls etc.) of data generated by company during manufacturing and testingprocess of healthcare related devices and equipment. The aim was to setup a well-governed Data platform in a secured environment for advanced data analytics andvisualization.
onboardingrequestfulfilledwithoutdependenciesonDataSourceOwner’sTeam.
Technologies:AWS(Glue,Redshift,Athenaetc),Spark,Kafka,Airflowetc
Duration : Oct2019 –July2021
The project was to implement and support investigative application for financialcrime detection, anti- money laundering and customer risk assessment. It provides acomprehensive view of the client by analysing and flagging their demographic andgeographiccharacteristics.
filteringcriteria'ssuchasitsbackground,homecountry,etc.
Technologies:Spark,Scala,Kafka,Autosys,YAML,Hive,SBT,TeamCity,XLRelease.