AWS Data Engineer
Location : hyderabd, India, ,
Experience : 13 Year
Rate: $30 / Hourly
Availability : Immediate
Work From : Offsite
Category : Information Technology & Services
I have over 14+ Years of Experience in Big Data, Cloud platforms, AWS, Data Science, and Various ETL tools, and Lead & manage project teams throughout the project lifecycle and provide them support & guidance on technical and project-related issues. Moving data from various sources to EDW. Created tables as per our database design using partitions and index organization tables. Writing stored procedures, functions, packages, and triggers Conducted daily monitoring and maintenance of the database, including the creation of daily reports, free and used space, lock report, and database listener. Taking Hot/Cold Backups and RMAN Backups. SQL Query Optimization using Auto trace.
Technical Summary
Operating Systems : Windows 9x/2000, XP, Linux, Unix
Cloud Platform : AWS, Cloudera, Microsoft Azure
RDBMS : Oracle 9i to 11g, SQL Server2000 to 2008, My SQL , DB2, PostgreSQL
NoSQL : MongoDB, Cassandra, Redshift, Dynamo DB
Programing Language : Java, Python, Scala (with spark), PY Spark
Scripting : Lambda, Shell
ETL Tool : Talend Enterprise Edition – 5.3, SSIS, ODI, Data Stage
Analysis Tool : SISENSE Prism, Oracle OLAP, SSAS
Reporting Tools : SISENSE Web, APEX Reports, SSRS
Certifications : AWS Solution Architect, AWS Data Analytics Specialty MongoDB, Talend Open Studio Data Integration
Certificates did so far
Talend Open studio
Mondo DB DBA
AWS Certified Data Analytics - Specialty certificate
AWS Certified Solutions Architect
Career History
Currently working as Sr. Project Manager in Delta cubes Technologies from 2010
Worked as Database Developer in Indus Business Systems from 2008 to 2010
Key Competencies
Project: Affiliate Management system
Role: Data warehouse Architect
Affiliate marketing is the process by which an affiliate earns a commission for marketing another company’s products. The affiliate simply searches for a product they enjoy, then promotes that product and earns a piece of the profit from each sale they make. The sales are tracked via affiliate links from one website to another. We have implemented the data warehouse system to the client and implemented end to end automation system for integration from OLTP to the OLAP system. Using OLAP systems merchants can identify their sales and commission details
Responsibilities:
§ Developed PY Spark framework using GCP Data proc to migrate SQL Server, and Sales Force Databases. The framework can be used for All types of databases.
§ Developed terraform script to create Big Query External tables using Cloud Storage location
§ Gathering data warehouse requirements in close coordination with cross-functional teams; developing AWS Glue Jobs to integrate OLTP into Distributed system
Project: Corporation Management system
Role: ETL Architect
The Commercial Recording Division files and maintains legally required records showing the formation of and fundamental changes to corporations, limited liability companies, limited liability partnerships, limited partnerships, and other businesses. The division disseminates that information to the general public, the business, banking, and legal communities.+.
Responsibilities:
Project: EDW
Role: Sr. BI Developer
It is a matchmaker that links clients to consumers; creating relationships that end profitably forever after. It’s all about creating meaningful relationships with everyone we work with: clients, customers, and our team members.
Responsibilities:
§ Implementation of various types of SCD through TOS
§ Scheduling jobs through TAC, shell script, and batch files