Designed and implemented effective database solutions and models to store and retrieve data,Designed, and developed analytical data structures. Contributed to internal activities for overallprocessimprovements,efficiencies,andinnovation.
Worked on designing, Implementing and maintaining structure, semistructured data pipelines usingAWSGlue,AWSLambda,AWSS3,AWSKinesis,KafkaandPySpark.
Worked on designing and implementing near to real-time streaming data pipelines using PySparkintegrationwithKafka
Developed automation scripts using shell scripting and stored procedures to optimize and streamlinedatabase processes, Skilled in setting up and monitoring Master-Slave replication in AWS RDS MySQLdatabases.
Worked on development of data pipelines for Reporting and Analytics requirements using readreplicas,definingphysicaldatastructures/modelsforRedshift/RDS.
WorkedonworkingonERDusingDraw-iodesigningtool,shorteningthetime-consumingprocessesofDatabase by automation using shell script and Stored procedures, worked on development of storedprocedures for Summary project, query optimization and performance tuning of MySQL queries fordevelopers.
InvolvedinthedevelopmentanddeploymentofETLJobsforclients,modeling,processing,transferring& representation of Datasets through visualization using ETL, AWS & tableau.