BigData Engineer

  • No. of positions: 5
  • Last Active Date : 17 Jan, 2023

Budget

₹63,000 - ₹94,000 (Monthly)

Experience

4 to 6 Years

Work From

Any

Job Duration

Long-Term

Job Applied

4

Required Skills

HadoopAWSETLHDFS YARN, Spark, Hive and Hbase.

Job Description

Job Title: BigData Engineer

Reporting to: Technical Lead

Location: India

Requirements:

Our ideal candidate will have the following responsibilities:

● Owning and delivering installation and configuration of AI products.

● Participating in solution architecture discussions to estimate hardware sizing.

● Analysing defects and conducting effective triaging.

● Working closely with engineering, product, solution architects in resolving

defects.

● Proactively participating in product release cycle and signing off on client

releases.

● Supporting current ETL designs and coding to resolves defects on existing

solutions

● Translating data access, transformation, and movement requirements into

functional requirements and mapping designs.

● Developing logical and physical data flow models for ETL applications.

● Communicating effectively with the client and manage expectations.

Requirements:

Must-Have

● 2+ years of experience with big data application stack including HDFS, YARN,

Spark, Hive and Hbase.

● 1+ years of experience in AWS Cloud Setup

● 1+ years of experience in Enterprise SW installation especially packagesGood to Have

● 1- or 2-year experience in ETL in Big Data Hadoop environment

(Hive/HBase

knowledge). Experience in shell scripting or python.

● 2+ years of experience in Hadoop Big Data Projects. Experience with

developing, tuning, and debugging code, python/shell scripts loading into

Hive,MariaDB, MySQL.

● Experience setting up enterprise security solutions including setting up active

directories, firewalls, SSL certificates, Kerberos KDC servers, etc.

● Experience working with CI/CD tools like Jenkins and various test report and

coverage. Defining and automating the build, versioning, and releaseprocesses

for complex enterprise products and Client interaction.

● Knowledge of python and hands-on coding experience is a plus.

Desired Non-technical Requirements:

● Good verbal and written communication skills.

● Team Player.

● Strong desire to work with startups.

Compensation & Job Perks:

• Opportunity to build AI and Analytics products for Global Markets

• Opportunity to innovate, Learn and Grow

• Attractive variable compensation package

Submit Query icon