AWS Data Engineer
Location : Jaipur
Experience : 4 Year
Rate: $16 / Hourly
Availability : Immediate
Work From : Offsite
Category : Information Technology & Services
EmployinganarrayofAWSservices–includingS3,EC2,Glue,Lambda,RDS,Redshift,Athena, CloudWatch, SQS, SNS, VPC, IAM andEMR.
ProficiencyinPython,SQL,PySpark,andSpark-SQL,enablingrobustdataanalysisandprocessing.
EXpertiseinAWSGlue,craftingPySparkscriptsforvariousETLtasks,whileensuringefficientETL job organization through Airflow
ImplementingautomatedGluejobtriggersusingLambdafunctions.
AppliedAthenatoexecuteanalyticalqueriesandperformdatatransformationsondatahoused within the S3 storage.
Effectivelymanagingvariousfileformats(Text,CSV,JSON,Parquet)withSQLforseamlessdata transformation and querying.
Establishingreliabledataqualitychecksandstrategies.
Proficiencyinfundamentaldatabaseprinciples,includinganin-depthgraspofconceptslike Normalization, Fact Tables, Dimension Tables, and OLAP/OLTP systems.
SQLconceptsencompassingviews,subqueries,joins,Datamanipulation,windowfunctions,and date operations.
FamiliaritywithSparkconcepts,includingarchitecture,advancedjoins,performance optimization, RDDs, Data frames, and Slowly Changing Dimensions.
Additionally,asoundunderstandingofqueryengines,schemacatalogingengines,and Warehousing tools like Athena and Redshift.
TakinganactiveroleinAgilepractices