Big Data Engineer
Location : hyderabad, India
Experience : 6 Year
Rate: $11 / Hourly
Availability : 1 Week
Work From : Offsite
Category : Information Technology & Services
Around 5.6 years of professional experience in software development using Python and Big data technologies called Pyspark.
● Good knowledge of Object Relational Mappers SQL Alchemy.
● Very good experience in writing SQL Queries
● Experience in handling ETL(Extract,Transform,Load) Pipeline Process
● A very good experience in Datawarehouse and maintaning Databases
● A very Good Work Experience in Datahub like Jenkine,Docker
● A very good Experience in Doing Frameworks like Pyspark and Django
● A very good work experience in Hadoop Frameworks
● A very Good work Experience in Airflow
● Hands on experience in writing Unit Test cases
● A Very Good Experience in Microsoft Azure,Databricks
● A Very good experience in CI/CD Pipelines
● Strong experience in Google Cloud Platform( BigQuery,Kubernets,Synapse)
● A good work work experience AWS cloud services(Glue,Lambda,Athena,Reddshift,EMR,EC2,S3)
● Experienced in working with various python ides like Jupyter, PyCharm
● Good database programming Knowledge in writing MySQL queries.
● Analyzed the SQL scripts and designed it by using PySpark SQL for faster performance
● Involved in Importing/Exporting data in to RDBMS.
● Good Knowledge in Spark-Core, Spark-SQL and PySpark.
● Strong hands-on writing Web Scraping scripts in Beautiful Soup, Request.
● Good knowledge in Data Visualization libraries like Matplotlib.
● Experience on python data analysis libraries like Pandas, Numpy.
● Good knowledge of establishing Different Databases like Snowflake,SQL and NO SQL using Python.
● Comprehensive problem-solving abilities, ability to deal with people diplomatically, willingness to learn, Team player, hard worker with good communication skills.
{{contact.cdata.phone}}
{{contact.cdata.email}}
View Resume
