Projects: Project: 4# Client: Bank Of America Title: SDP (Strategic Data Platform Ingestion) Role: Data Engineer Work Location: Hyderabad Environment & Tools: Cloudera, Winzip,HDFS, Hive, Hue, GIT-bigbucket, SparkSql, Scala, AutoSys, Teradata,Eclipse-Scala IDE Description: Bank of America is one of the leading banking services in America, BOFA wants to develop a utility which can support all types of file formats for data ingestion and bring all the data into hadoop. BOFA wants to create a platform for end users to query the data from distributed environment tables (Hive/Impala) instead of checking in files. Roles and Responsibilities:
● Design and develop the data ingestion frameworks using spark-scala and hadoop.
● Implement solutions for problems arising out of large-scale data processing.
● Attend/drive various architectural, design and status calls with multiple stakeholders.
● Ensure end-to-end ownership of all tasks being aligned.
● Design, build & maintain efficient, reusable & reliable code.
● Test implementation, troubleshoot & correct problems.
● Monitor the ingestion jobs and support on any failures.
● Capable of working as an individual contributor and within a team too.
● Maintained GIT bigBucket for code check-in.
● involved in deployments and preparing deployment instructions.
● Ensure high quality software development with complete documentation and traceability.
● Involved in sprint grooming and planning sessions and client DEMO sessions.
● Fulfill organizational responsibilities. (sharing knowledge & experience with other teams/ groups) Project: 3# Client: Commonwealth bank of Australia Title : CCB (connected corporate banking) Role: Data Engineer Work Location: Chennai Environment & Tools: Cloudera, Winzip, oracle, SQL Developer ,HDFS, Hive, Hue, GIT, SparkSql, Scala, SBT, AutoSys, Teradata Description: commonwealth bank of Australia is one of the leading banking services in Australia, for CBA all their loan related information and the business functionality will handled by finstra connected corporate banking (CCB) and managed service (SaaS) all existing facilities & loans are maintained in Finestra legacy machines (FACIT & MATRIX). due to the unbearable cost they want to migrate their legacy machines to LoanIQ module with CCB, that will be support for both Domestic and international lending products. as the part of phase-1 all their 188 tables will be ingested in to Hadoop layer. All this tables will get processed in different layers in Hadoop system and results data sent to downstream users in the form of extracts and finial data will sent to GDW. Roles and Responsibilities:
● Design, develop, test, maintain, document program and implementing code in accordance with user requirements, and system and technical specifications.
● Developing SparkSQL as per the business requirements.
● load the data intermediate in multiple layers as hive external partition tables, and managing all tables.
● processing the intermediate records and sending the extracts to downstream users.
● Proficient in building Hive queries to validate processed data.
● sending extracts to downstream users as per their requirements.
● loading the data from Hadoop layer to Teradata on daily bases.
● Maintained GIT for code check-in.
● involved in technical dress rehearsal activities
● Performed benchmarking test.
● involved in deployments(UAT and PROD) and preparing deployment instructions.
● As the part of pre deployment involved in unit testing and capturing the results.
● Involved in sprint grooming and planning sessions and client DEMO sessions.
No Job have been added
{{contact.cdata.phone}}
{{contact.cdata.email}}
View Resume