OnBenchMark Logo

Arvind (RID : 14ppblmq1cmqu)

designation   Senior Associate

location   Location : Bengaluru, India

experience   Experience : 7 Year

rate   Rate: $14 / Hourly

Availability   Availability : Immediate

Work From   Work From : Any

designation   Category : Information Technology & Services

Shortlisted : 3
Total Views : 59
Key Skills
Hadoop AWS Cloud Spark Scala Code Azure Devops JSON XML CSV
Discription
  • WorkExperience:

    Working as a Senior Associate withDeltacubes Technologiesfrom Nov’2021 to Till dateDesignation:SeniorAssociate

  • Integration/MigrationoftheSparkand ScalaCodetotransformdatafromAWS S3toRedshift.
  • Creating and Managing job through Amazon Glue Studio to transform the data from Source to Target.
  • Can create job through AWS Glue(Serverless Integration service)) data catalog and can schedule the scripts.
  • Scheduled AWS Crawlers to read data from S3 Buckets and loading the Metadata to AWS Glue.
  • Used AWS CloudWatch to create the event when the crawlers jobs get succeeded and successfully load data from S3 to Redshift.
  • Redshifthasbothmergeandraw layer.
  • Rawlayer will havealltheduplicatedataandmergelayer willhaveonlytheuniqueentrythathasbeenhandledinthe code.
  • DataloadhappensthroughtheSparkJarcreationandsubmissioninAWSEMRCluster.AWS S3isalsousedversioning thedata incaseofdeleteintheoriginalfile.
  • Have also Migrated the data from On-premises to AWS Cloud Services.
  • Used ETL Transformation for IICS for data Migration from Teradata to Snowflake.
  • Used PowerCenter for designing the mapping , tasks and Task flow in IICS.
 
Matching Resources
My Project History & Feedbacks
Copyright© Cosette Network Private Limited All Rights Reserved
Submit Query
WhatsApp Icon
Loading…

stuff goes in here!