Abhishek Kumar Mishra
Experience Summary
- Strong Programming skills in Python and Pyspark, and have developed many projects.
- Designed, developed, and maintained ETL pipelines using AWS Glue to extract, transform, and load data from various sources to Amazon Redshift.
- Implement data transformations, data cleansing, and data enrichment processes as part of ETL to ensure data quality and consistency.
- Collaborated closely with data scientists, analysts, and business stakeholders to understand data requirements and provide timely data access.
TECHNICAL SKILLS
-
- AWS Services: EC2, S3, Redshift, Iam, Lambda, Glue, Athena, DynamoDB, EMR
- GCP Services: Compute Engine, Iam, BigQuery, Data Studio
- Programming Languages: Python, SQL, Pyspark
- Reporting tools: Looker Studio, Power Bi
Work Experience
Confidential (Data engineer) (Dec 2021-Present)
Working as Data Engineer. Design and implement highly scalable and available Big Data solutions using AWS services including S3, Redshift, Athena, Glue, and Lambda. - Develop and deploy ETL pipelines using pyspark, and other Big Data tools to extract, transform and load data into the data Warehouse.
- Ingest data from diverse sources into Amazon S3 and subsequently process it for use in analytics and reporting.
- Design, develop, and maintain ETL pipelines using AWS Glue for data extraction, transformation, and loading.
- Manage and optimize Amazon Redshift data warehouse clusters, including schema design, performance tuning, and query optimization.
- Set up and configure CloudWatch alarms and monitoring for ETL jobs, data pipelines, and data warehouse performance.
- Identify and implement improvements to enhance data pipeline efficiency.
Confidential (Data engineer) (Nov 2020- dec 2021)
- Design and implement highly scalable and available Big Data solutions using AWS services including S3, Redshift, Athena, Glue, and Lambda. - Develop and deploy ETL pipelines using pyspark, and other Big Data tools to extract, transform and load data into the data lake. - Create and maintain data models and schemas using tools like Glue and Athena to enable self-service data access for business users. - Collaborate with cross-functional teams including Data Scientists, Data Analysts, and Business stakeholders to understand their requirements and provide solutions.
Confidential (Data Analyst) (Feb 2017-oct 2020)
- Developed Python scripts to extract, clean, and preprocess large datasets from various sources, and databases.
- Utilized SQL queries to filter, aggregate, and join data tables, optimizing data retrieval efficiency and accuracy.
- Created interactive and informative dashboards using Google Data Studio, visualizing key performance indicators and trends for both internal teams and clients.
Additional Responsibilities & Achievements
- certification of python programming language
- Participation Certificate of Cyber Security and Ethical Hacking by Crezone Technology.
EDUCATIONAL QUALIFICATION
Graduation (BCA) (2011-2014)
Fairfield institute of management and technology (FIMT) affiliated (GGSIPU-NewDelhi)
Senior Secondary Examination UP Board (2009-2011)
Higher Secondary Examination UP Board (2007-2009)
LANGUAGES KNOWN
Language Known include: English, Hindi