Jr Data Engineer
Location : Ahmedabad
Experience : 1 Year
Rate: $8 / Hourly
Availability : 1 Week
Work From : Offsite
Category : Information Technology & Services
ShubhamGupta
Jr.Dataengineer
11+MonthsofExperienceasaDataEngineer.Good
programmingskillsinPython.GoodknowledgeofMongoDB,
MySQL,PostgresandMSSQLServerdatabases.Have
experienceinimplementingusefulAWSserviceslikeEC2,S3,
andAthena.
ProjectExperience
Store-Sales-Project:2weeks
ItistheETLPOCprojectinWhichwehavestoreddatafiles
whichfirstgoforcleaningandafterthat,theTransformedfile
sendtotherespectiveuserMail
Responsibilities:
•Designandimplementflow.
•ConvertUnstructuredDatatostructured
•Discussandresolvebugsandimplementnewfeatures.
Environment:VisualStudioCode,Git,Docker
Technology:Python,MySQLandPostgresDatabase,Docker,
ApacheAirflow
StreamingDataToS3:1months
ItistheRealTimepipeline(POCProject)inwhichthereare
multiplesources(Mongo,Postgres,MySQL,Files)fromwhich
continuousdataaresharedwhichwillbehandledbyAIRBYTE.
AfterthatKafkabrokerstoresthatdataInRespectiveTopics.
Fromtopicsthatdatawillbestructuredthroughpandas-python
andfinallysendthatdatatotheS3Bucket.
Responsibilities:
•Designandimplementflow.
•ConvertUnstructuredDatatostructured
•Discussandresolvebugsandimplementnewfeatures.
Environment:VisualStudioCode,docker,Git,Airbyte
Technology:Python,MySQL,Mongo,Postgres,Airbyte,
Docker,Kafkabroker,Pandasql,Boto3,kafka-python,Pandas
andShellScript
www.solutionanalysts.com1
ImplementingETLusingPython:3weeks
ETListheprocessofextractinghugevolumesofdatafromavarietyofsourcesandformats
andconvertingittoasingleformatbeforeputtingitintoadatabaseordestinationfile.Some
ofyourdataisstoredinCSVfiles,whileothersarestoredinJSONfiles.Youmustgatherall
ofthisinformationintoasinglefilefortheAItoread.BecausetheAIcanonlyreadCSVdata
inasinglelargefile,youmustfirstloadit.
Responsibilities:
•Designandimplementflow.
•ImportingCOVID-19datasetandpreparingitforanalysisbydroppingcolumnsand
aggregatingrows.
•CreateETLJob
•Managingdatabasechanges
•VisualizingouranalysisresultsusingReact
Environment:JupyterNoteBook,VisualStudioCode,Git
Technology:Python,DynamoDB,Pandas,Boto3
OnusInventory:3months
ONUSINVENTORYisn’tjustaboutmanagingstock;it’saboutsynchronizingthealcohol
industryatalllevels,streamingprocessesandfosteringacooperativeenvironment.Receive
Inventoryinseconds;Takecustomersfromanywhereacrossthestore;Oneclick-send
PurchaseOrderstoyourwholesalersdirectlyfromthePOS.
Responsibilities:
•CreatefunctionsfordataCleaningandTransforming
•
Verifieddatabycodeormanuallywhichisgeneratedbyscraping
Environment:JupyterNoteBook,WPS2019
Technology:Python,Pandas
www.solutionanalysts.com2
{{contact.cdata.phone}}
{{contact.cdata.email}}
View Resume
