Big data developer
Location : Pune, India
Experience : 4 Year
Rate: $8 / Hourly
Availability : 1 Week
Work From : Offsite
Category : Information Technology & Services
3+ experience in Hadoop and big data development.Experience in Developing and implementing datapipelines that extracts, transforms and loads data into aninformation product that helps to inform the organizationinreachingstrategicgoals.
ExperienceindevelopingscriptsinPythonandSpark-SQLfor faster processing of data. Import the data fromdifferent sources like HDFS/HBase into SparkRDD.Investigate and analyze alternative solutions to datastoring, processing etc. to ensure most streamlinedapproachesareimplemented.
ExperiencewithallflavorofHadoopdistributions,includingCloudera
ExperienceinimportingandexportingdatausingApacheSqoop from Relational Data Base Systems to HDFS andvice-versa.
DesigningandcreatingHiveexternaltablesusingsharedmeta-store instead of derby with dynamic partitioningandbuckets.
GoodpythonandApacheSparkknowledgewithpythonprogrammingandonscalasparktoo.
HavinggoodexposureonSpark(RDD)anditsworkingfunctionality.
Strong Knowledge on Spark architecture and itsintegrationslikeSparkSQL,DataFramesandDatasets.ProficientinperformingSQLqueries
Experienced Scrum Process and Agile Methodologies.KnowledgeofAWS-S3,EMR,RDS,EC2,Athena,GlueandIAM
1YearOFExperienceInGCP(GoogleCloudStorage,Dataproc,Bigquery),Airflow
{{contact.cdata.phone}}
{{contact.cdata.email}}
View Resume
