OnBenchMark Logo

FARIDH (RID : pp3lo79ysq5)

designation   GCP Developer

location   Location : TAMILNADU, India

experience   Experience : 5.2 Year

rate   Rate: $17 / Hourly

Availability   Availability : Immediate

Work From   Work From : Offsite

designation   Category : Information Technology & Services

Shortlisted : 1
Total Views : 37
Key Skills
GCP HADOOP PYTHON SQL JAVA SCALA
Discription

M0HAMMED       FARIDH     S

DATA     ENGINEER

 

 

 

CONTACT

 

 

 

 

EDUCAT10NDETAILS

BachelorsinEngineering-YEAR2013-2017 Anna UniversityAffiliated

DhanalakshmiSrinivasanEngineeringcollege

 

CERTIFICATION

  • MicrosoftCertifiedAzureData Engineer DP203
  • Microsoft CertifiedAzure AdministratorAZ104
  • NIELIT-DatascienceandMachine LearningCertified

 

 

T E C H N I C A L S K I L L S

 

BIGDATA FRAMEWORKS

  • ApacheSpark
  • Hadoop
  • Sqoop
  • Hive
  • Hbase

 

PROGRAMMING LANGUAGES

  • Python
  • SQL
  • Java
  • Scala

 

DATABASES and DATAWAREHOUSE

  • Databricks DeltaLake
  • BigQuery
  • HDFS
  • Synapse Analrics

 

ETL & DATA VISUALISATION

  • Azure DataFactory
  • Looker
  • Airflow
  • POWERBI
  • SSIS

 

CLOUD & DEVOPS TECHNOLOGIES

  • GCP
  • Azure
  • Git
  • Docker ,GKS

 

P R O 3 E C T S O V E R V l E W

Confidential- Data Ingestion and Sync Process

  • NativeSaaSCICDtoolwithEnhancingDataSyncLogicbyPrioritizingDatasets Using Dataproc Cluster and Bigquery
  • DeploymentusingSparkwithSpinnakerensuresthatupdatescanbemadewith minimalorzerodowntimeforcontinuousTimestampandMetricLogsusing GCSBucket
  • Spinningupreal-timedatastreamingPipelinewithGoogleCloudPub/Subto collectuserinteractioneventsandstoreitinDatalake
  • UsedApacheAirflowtoautomatetheextraction,transformation,loading,and analysisofdatawithDataprocSparkJobs

Confidential - Argo CD

  • CreateastagingareainGCStostoretherawdatawithUsingdataingestion APlsintegratedwithcustomspinnakerWebUI
  • CreateDAGsinAirflowthatexecutethesequeriesonadefinedscheduleor based ontriggers
  • ImplementDataprocclustertoperformbatchprocessingandanalysis
  • Spark'sdataprocessinganddatavalidationAPIsfordataqualityandvalidation processes,includingdataprofiling,datacleansing,anddatavalidationrules
  • UseAirflowcustomPythonscripttomonitortheDBserverandingestnewdata files intoGCS
  • Ensurethatonlyauthorizedusershaveaccesstodataateachstageofthe

transformation

Confidential - Canary Data Migration

AutomateDataprocclustercreationanddeletionasneededfordataprocessing tasks

  • SQLquerieswithtriggersinBigQuerytoperformadvancedanalytics,generate

reports, and visualize data using Google Data Studio.

  • Implement errorhandlingandfaulttolerancemechanismstohandledataerrors, processingfailures

Revolut & EU Banking Chart

  • WorkflowOrchestration:GoogleCloudComposerallowsyoutodefine,schedule, andmanageworkflowsasdirectedacyclicgraphs
  • ConfiguredRBACandACLsenhancedatasecurityandcompliance,helpingto protect sensitiveinformation
  • SynchronizedatabetweenanFTPserverandHadooptoensurereal-timedata backup
  • Ingestingdatafromvarioussources,creatingdynamicdatasetsusingRDDs

Tron8 - Spark Deployment

  • CondumedloadtestingandperformancetuningforSparkStreamingjobsto optimizedataprocessingandreducelatency
  • consolidatetheprocesseddatasetstotheproductionserverforanalysisviaFTP andUC4toscheduleandautomatetheexecutionofdata

Insight Board POC MVP Project

  • SparkJobwithApplydynamicfiltering,aggregations,enrichments
  • SettingupanHDFSclustertostorerawdatafromtheOracleCRMsource systemandDesigningdatastagingprocessformovingdatafromthesource systemsOracleCRMandMySQLtoHDFS

Procurement Data Optimization (Pharmaceutical)

  • UtilizeOracleDataPumporcustomETLscriptstoloaddataefficientlySchedule loadingjobstorunatappropriateinterval
  • Implementbusinesslogicanddatavalidationrulesaspartofthetransformation
  • DevelopandmaintainadynamicdataingestionframeworkusingApacheSpark
  • EndtoEndDocumentationonDataModelingImplementationwithdetailed Descriptive Business usecase

 

W0RKEXPERIENCE DATAENGINEER

Confidential , Bangalore ClientProjectsandDomain

 

 

 

 

 

 

April 2022 - May 2023

 

    1. Spinnaker - Enterprise Cloud SaaS - Fintech /Banking
    2. Warner - Entertainment Media - ArgoCD
    3. Nestle & Digilink -Retail

 

  • Implementedscalabledatain
 
Matching Resources
My Project History & Feedbacks
Copyright© Cosette Network Private Limited All Rights Reserved
Submit Query
WhatsApp Icon
Loading…

stuff goes in here!