Rohan

Objective

Seeking a professional career in a lively and challenging environment of software design and development, to work with excellence by best utilizing my skills to attain company’s objective

Professional Summary

• Overall 10.3 years of Total Experience in the IT Industry. Presently designated as Engineer with American Express India Private Limited.

• Hold good experience in Data warehousing/ETL, Database where the responsibilities comprise of understanding business request, promote them into technical solutions leveraging Spark/Scala, further solely represent the India tech team of 10 Engineers & Contracted Engineers.

• Co-ordinating with Business users(Product Owners’s) to understand the requirements, bifurcate into ‘Features’ & ‘User stories’,further design, code & implement into Spark/Scala based ETL framework.

• Pre-Holding 8+ years of American Express system, Data & Technology knowledge help serve to deploy various Migration project in American Express supporting as Full time Employee. Considerably leveraged Hadoop Big Data, Hive, Spark Dataframes, Spark SQL with Scala programming language to re-write the production based ETL processed functioning in IBM Infosphere Datastage 11.7.

• Well accustomed to Data warehousing concepts with initial experience in working on IBM Infosphere Datastage 8.X,11.7, Control-M, SQL, UNIX – Shell Scripting, Sqoop Import/Export tools etc.

• Certified IBM Datastage developer with working experience in Banking & Financial Services domain of 9.6 years. Presently persuing Spark certification to enhance the expertise.

• Experiensed in Spark/Scala coding Spark dataframe, Spark SQL based processes for transforming, extracting, integrating and loading data in Yellow bricks Database.

• Strong exposure to Agile development practices futher incorporating good knowledge of DevOps related practices such as Jenkins, CI/CD – XL Release, Bitbucket, GitHub Etc.

• Developed Data Completeness framework in Spark/Scala to capture record/Process validation from Data Audit standpoint.

• Coded Scala testing process for automated Unit testing.

• Expertise on System analysis, Designing, Developing, Testing, Implementing referring CI/CD etc.

• Documentation and execution of a project, with SDLC and Agile-Scrum Methodologies in Enhancement, Maintenance and Development Projects.

Professional Experience Organisation : American Express India Private Limited Nov 2019 – Till Date

Role : Engineer 1

Project Name : POA Migration (Datastage to Apache Spark/Scala Migration)

Location : Bangalore,Karnataka,INDIA

Analyse the BAU process in E3 Datastage further re-design the system, to be deployed in prod replicating the ETL transformation in Apache Spark/Scala programming language. Lead the team to share & support on domain & process expertise

. Accountability

Working as primary coordinator for India team to implement the POA migration on Bigdata platform.

Extensively involved in Datastage Process analysis, articulate BAU process dependency, further re-design the system reflecting in Conceptual flow & source to target Data mapping sheets.

Creation of Data Flow Diagram (DFD), High Level and Detail Level Flow diagram to incorporate the Data flow from BAU datastage flow.

Coded Spark Dataframe/Spark SQL based Scala programs and supportive shell Utility holding the complex business logic of Data transfer to YB tables.

Develop Sqoop jobs for moving the data to and fro in an automated manner on daily basis. Developed Data Completeness framework in Scala to capture record/Process validation.

Coded automated Scala testing framework leveraging ‘asserts’ etc for automated Unit testing that further ensure 80+% of total code coverage.

Performed SIT testing on the code further updating the latest version on Bitbucket/GitHub. Deployed the productionised code version to Platinum environment leveraging CI/CD (XL -Release