Data Modelling Data UpdationAWS Apache Hadoop PySpark Spark–SQL PySpark Hive Sqoop HbaseSQL PL/SQL Python
Summary
Database Engineer with 14+ years of overall experience in IT industry with in Solution & Technical Architecture, Designing, Developing and implementing solutions across Job Portal, ERP, Retail & E Commerce Industries.
Working with AWS products and tools (EC2, S3, LAMBDA)
As data architects,data collection, usage, management and integration. responsible for organization's overall data strategyand visualizing the blueprint of the complete framework that data engineers build.
Hands o experience in data migration from Structured /Unstructured database to structure database DB2 or MySQL.
Expertise in Big Data technologies and HADOOP eco systems like Map Reduce framework using with YARN, Hive, SQOOP.
Experience in working with Databases like Hive, Oracle 10g, Oracle 11g and My SQL, Maria and DB2
Hands on experience on NoSQL Database like Mongo DB and Hbase.
Hands on experience inApache PySparkwith Python (Spark core-RDD, SPARK Data Frame and Data set).
Hands on experience in IDElikefunctional language Python along with Pandas libraries and Spark SQL and having knowledge of R.
Hands on experience in Pentaho DI (ETL tool).
Good working experience in COGNOS Studio and COGNOS Frame Work Manager.
Proficient in complex query design and tuning, database integration with middleware and web applications.
Expertise in working on scripting languages like UNIX shell scripting, Python and Python with Pandas.
Sound knowledge and competency in Agile Methodology and have good understanding on Version one tool (Agile based tool).
Good experience in Oracle database for query optimization, SQL-Loader, Data import/ export, Hot Backup, Cold Backup and database streaming configuration.
Experience in Data Modeler SQL Developertool for design database architecture.
Extensively worked in process improvement within and across the team.