No of Positions: 3
Location: Thiruvananthapuram
Tentative Start Date: July 10, 2023
Work From : Offsite
Rate : $ 10 - 12 (Hourly)
Experience : 3 to 4 Year
DevOps : Focus on Azure Data Factory, Snowflake, SQL, and stored procedures might include
the following:
Job Description:
We are seeking a highly skilled and experienced DevOps Engineer/Data Engineer to join our team. As a DevOps Engineer, you will be responsible for ensuring the smooth and efficient
operation of our data infrastructure, with a specific focus on Azure Data Factory, Snowflake, SQL, and stored procedures. You will work closely with our development, operations, and data teams to design, build, and maintain the systems and processes that enable the seamless flow of data across our organization.
Responsibilities:
- Design, develop, and maintain data pipelines using Azure Data Factory to extract, transform, and load data from various sources into Snowflake.
- Collaborate with data engineers and analysts to understand data requirements and translate them into efficient and scalable solutions.
- Create and optimize SQL queries, stored procedures, and functions to support data transformation, aggregation, and reporting needs.
- Monitor and troubleshoot data pipelines and data quality issues to ensure high availability and data integrity.
- Implement and maintain data governance practices, including access control, data privacy, and compliance.
- Automate deployment and release processes using CI/CD tools and techniques to ensure efficient and reliable delivery of data pipelines and infrastructure changes.
- Collaborate with cross-functional teams to drive continuous improvement, implement best practices, and ensure scalability and performance of the data infrastructure.
- Stay up to date with emerging technologies and trends in the DevOps and data engineering space and recommend appropriate tools and methodologies to enhance our data processes.
Qualifications:
- Strong experience working with Azure Data Factory, Snowflake, SQL, and stored procedures.
- Proficiency in writing efficient SQL queries, stored procedures, and functions for data manipulation and reporting.
- Experience with data integration, ETL/ELT processes, and data modeling concepts.
- Knowledge of cloud computing principles and experience working with Azure or other cloud platforms.
- Hands-on experience with CI/CD tools such as Azure DevOps, Git, Jenkins, or similar.
- Familiarity with data governance, security, and compliance best practices.
- Strong problem-solving and troubleshooting skills with the ability to analyze and resolve complex technical issues.
- Excellent communication and collaboration skills with the ability to work effectively in a team environment.