Data Engineer

No of Positions  No of Positions:  4

location Location:Bengaluru

date Tentative Start Date:  April 25, 2021

Work From Work From :Onsite

rate Rate : $12-18(Hourly)

experience Experience :6to10Year

Job Category :Information Technology & Services
Duration :Long-Term
Key Skills Required Skills
Hadoop PythonIBM MQ TibcoKafka/RabbitMQ
Description

Development and Testing:

·       Configuration and development of data pipelines to move and/or optimize data assets

·       Perform data modeling and prepare data in databases for reporting through various analytics tools under the supervision of a Senior Data Engineer/Lead Data Engineer

·       Develop technical solutions utilizing big data and cloud based technologies

·       Support testing by fixing defects and making necessary back end design changes, apply test driven development principles to automate build and regression testing

·       Ensure adherence development and architecture standards and best practices. 

·       Provide necessary technical support through all phases of testing and incident handling after deployment.

·       Provide support for product solutions as part of a DevOps model

·       Assess and help drive adoption of new technologies and methods within the team .

·       Build prototype to prove out concepts working under the Architects guidance

·       Contribute ideas and/or code that improves core software infrastructure, patterns and standards

 

 

Solution Analysis and Design:

  • Participate in discussions with businesses, application and process owners, and product team members to design solutions for the big data and Advanced Analytics solutions in line with requirements
  • Assist in the decision-making process related to architecting solutions
  • Ensure the solution designed and built is supportable as part of a DevOps model
  • Assist in creating documents that ensure consistency in development. 

 

Similar Job/Project
QA ,Automation ,REST/SOAP ,java ,python
Hadoop ,Spark ,Java or Python ,Data Analytics Architecture ,cloud-native database technologies ,data management ,Data Modelling ,Data Science , Data Engineering ,Data Visualization ,Data Strategy and Cloud service
Python ,Data Science , Data Analytics , Data Structures ,
Java ,Spring ,s ,Spring Boot ,Angular 2 ,React JS ,MongoDB ,MySQL ,Kafka/RabbitMQ ,Redis
Python ,Responsive Web Design / Development(RWD) ,Python Framework ,machine learning ,artificial Intelligent
Java ,Kafka/RabbitMQ
Python ,Django ,HTML ,Jquery ,AWS or Azure ,Docker , Kubernetes
Data Science ,Python ,Data Engineer ,Big Data ,Machine Learning
Python R, SQL, MS-Excel and Hive
Machine Learning ,Deep Learning ,Neutral Work ,Python ,Django ,matpplotlib ,Numpy ,TensorFlow ,MongoDB
Machine Learning ,Python ,NLP ,Natural Language Processing
shell python, ruby, batch, power shell ,Chef infrastructure ,DB2 Sybase, Oracle ,github agile, CI/CD ,SAP ,SAP Netweaver ,SAP HANA DB2, SQL, Sybase IQ/ASE ,IBM Cloud AWS, Azure ,IBM Cloud Cloud Architecture
shell python ruby, batch, power shell ,Chef infrastructure ,DB2 Sybase Oracle, ,github agile CI/CD, ,SAP ,SAP Netweaver ,SAP HANA DB2 SQL, Sybase IQ/ASE, ,IBM Cloud AWS Azure,
AWS ,Python
python ,shell ,java microservices ,test cases ,Test Plan
Devops ,AJAX, Web Technologies, JavaScript ,AWS or Azure ,Java ,Linux ,Unix ,terraform ,Python
Python ,debugging ,Jenkins ,pipelines ,build & execution
Automation Task force ,Quality Assurance , API testing ,Python ,Javascript , CICD ,Jenkins ,AWS ,Automated API Testing
Technical Skills • 7 to 10 years of experience in java middle-tier applications in a J2EE environment • Strong familiarity with API management micro-services, Java/J2EE application stacks • Strong experience working in an Agile/Scrum environment • Experience in large scale applications – either public facing web applications or applications with large numbers of concurrent users. • Experience with either on-line or in-store retail selling applications Deep hands-on experience with the following technologies: • Deep technical hands-on experience creating and consuming REST API services with JSON • Experience developing and deploying solutions in major cloud platform (AWS, Azure, etc.). • Experience with Docker, or related container-oriented technologies (i.e. Docker Enterprise Edition, Kubernetes, etc.). • Comfortable implementing continuous integration / continuous delivery process for applications using technologies such as Jenkins and Git. • Experience with Test Driven Development, including writing and implementing automated unit, system, and integration tests. • Experience with PostgresDB and/or Oracle12c. Ability to define tables, create SQL queries, etc. • Experience building micro-services using Spring Boot • Experience using Unix command line and Bash/Shell/Python scripting to automate tasks, etc. • Experience with Subversion (SVN) and GIT source control; Maven and Ant; JIRA, Confluence, BitBucket, Grails, web security experience such as WS-Security; Eclipse based IDEs (or IntelliJ) • Experience with testing tools like Junit, Gatling, wiremockfor automated tests • Experience with designing and conducting performance/stress tests on applications, analyzing and leveraging these results to improve application throughput and response time. • Practical knowledge of New Relic, Splunt, DynamoDB are preferred but not required.
splunk admin , nagios ,Linux ,Oracle ,VB Script ,Python ,HTML ,splunk sme ,JavaScript
Java Python, PERL, SQL, Shell Scripting, HTML, CGI and XML. ,Integration with enterprise applications using Web service KAFKA, ELASTIC Search and REST API. ,Database Administration (MySQL Oracle, DB2, MongoDB). ,Expert knowledge in architecture design, development experience of IBM Tivoli Netcool Fault Management product suite – Impact, APM, ICAM, Omnibus , Netcool probes, COGNOS Reporting, Business Insights (ICABI), and ITNM. ,Strong working knowledge of Log Analytics NOI, and building correlation rules
Java Applet ,Python ,PHP ,Core Php ,Scripting Languages such as PHP ,Cake PHP ,AJAX, Web Technologies, JavaScript ,Drupal ,WordPress ,full stack development ,Responsive Design ,CSS and related JS frameworks
.Net Core JavaScript and/or other high-level programming and scripting languages such as Power-Shell, Bash, SQL, .NET, Java, Python, PHP, Ruby, PERL, C++, etc. ,Azure IaaS PaaS and SaaS , SQL Server Azure SQL, Azure Data Lake, HD Insights, Hadoop, Cloudera, MongoDB, MySQL, Neo4j, Cassandra, Couchbase