Sudheer (RID : 15cyvlmzzq374)

AWS Data Engineer

Location : Delhi, India,

Experience : 8 Year

Rate: $18 / Hourly

Availability : Immediate

Work From : Offsite

Category : Information Technology & Services

Shortlisted : 1

Total Views : 56

Key Skills

AWS SQL Python Performance Tuning Database Modeling OracleDB PostgresDB Airﬂow Snowﬂake AWS & GCP Dynamic & Advanced SQL DWH Concepts Data Pipeline Design

Discription

EXPERIENCE

NOV2021-PRESENT

Ledacriticaldataengineeringproject,receivingrawdatainJSONformatandimplementing a streamlined workﬂow. Developed AWS Lambda functions to clean andtransformtheﬁlesintoParquet,enhancingdatastorageandqueryperformance.
Orchestrated data loading into Redshift using AWS Glue, ensuring seamless integrationandenablingeﬃcientanalysisandreporting.Theprojectinvolveddesigninganautomatedprocesstohandlelargevolumesofdata,optimizingingestionspeed.
Spearheaded the development of a robust data model based on Dimensional Modelingprinciples.CreatedmultipledimensionsandfactswithinRedshift,enablingcomprehensive and insightful data analysis for business stakeholders across variousdomains.
Identiﬁedprocessimprovementopportunitiesandimplementeddatavalidationmechanisms during the cleansing phase, ensuring data accuracy and integrity throughouttheprojectlife-cycle.Thisenhancedthereliabilityofdownstreamanalyticsanddecision-makingprocesses.
Optimized the ETL pipeline by leveraging parallel processing techniques and resourceallocation strategies, signiﬁcantly reducing data transformation and loading times. Thisimprovementenhancedoverallsystem performance and increased data processingeﬃciency.
Implemented incremental loading techniques to process and load only new or modiﬁeddata,minimizingprocessingtimeandincreasingtheproject'sscalability.Thisapproach

Reducedunnecessaryprocessing,enablingfasterdataavailabilityforanalyticsandreporting.

XYZ,Bangalore—DataEngineer

SEP2018-NOV2021

Ledreal-timedataingestionusingGooglePub/SubandSnow-pipe,automatingdataloadingintoSnowﬂake.
OrchestratedPub/SubandSnowﬂakeintegrationforoptimizedandscalabledataingestion.
DesignedacomprehensivedimensionalmodelinSnowﬂakeforadvancedanalytics.
Implemented proactive monitoring for eﬃcient pipeline management and enhanced datareliability.
Collaboratedtodelivertailoreddatamodelsalignedwithbusinessneeds.
Ensureddataaccuracythroughrigorousvalidationpractices.
Establishedcleardocumentationanddatalineageforeffectivedatagovernance.

Project Details

Title : AWS Project

Duration : 24 (Month)

role and responsibileties :

Led a critical data engineering project, receiving raw data in JSON format and implementing a streamlined workﬂow. Developed AWS Lambda functions to clean and transform the ﬁles into Parquet, enhancing data storage and query performance.
Orchestrated data loading into Redshift using AWS Glue, ensuring seamless integration and enabling eﬃcient analysis and reporting. The project involved designing an automated process to handle large volumes of data, optimizing ingestion speed.
Spearheaded the development of a robust data model based on Dimensional Modeling principles. Created multiple dimensions and facts within Redshift, enabling comprehensive and insightful data analysis for business stakeholders across various domains.
Identiﬁed process improvement opportunities and implemented data validation mechanisms during the cleansing phase, ensuring data accuracy and integrity throughout the project life-cycle. This enhanced the reliability of downstream analytics and decision-making processes.
Optimized the ETL pipeline by leveraging parallel processing techniques and resource allocation strategies, signiﬁcantly reducing data transformation and loading times. This improvement enhanced overall system performance and increased data processing eﬃciency.
Implemented incremental loading techniques to process and load only new or modiﬁed data, minimizing processing time and increasing the project's scalability.

Description :

Proﬁcient in database modeling, data warehousing, and Unix. Skilled in cloud platforms (AWS, GCP) and proﬁcient with Snowﬂake for eﬃcient data processing. Diverse industry experience in Banking, Media, and Investment Banking. Strong ability to design, develop, and optimize data pipelines and architectures. Collaborative team player delivering high-quality projects on time and within budget. A results-oriented professional driving eﬃciency and enabling data-driven decision-making.

Name	Amount	Days	Action
Premium	15000	30	Pay Now
Enterprise	40000	30	Pay Now

Sudheer (RID : 15cyvlmzzq374)

EXPERIENCE

stuff goes in here!