Senior ETL Engineer

Job Description

We are seeking a highly skilled and experienced Senior ETL Engineer with strong expertise in Azure, Azure Data Factory, and Apache Spark. The ideal candidate will play a key role in designing, developing, and
optimizing scalable ETL pipelines and data integration workflows that power enterprise-level data platforms.

Roles & Responsibilities

Roles and Responsibilities
• Design, develop, and maintain robust ETL processes using Azure Data Factory, Apache Spark, and other relevant tools.
• Work closely with data architects and business analysts to understand data requirements and translate them into technical solutions.
• Optimize data transformation workflows for performance and scalability.
• Build and support data pipelines for ingesting, processing, and delivering structured and unstructured data from various sources.
• Implement best practices for data governance, security, and monitoring across Azure services.
• Ensure quality and integrity of data through validations and error handling.
• Collaborate across teams to support data warehousing and analytics initiatives.

Skills

Qualifications and Skills
• 7–10 years of experience in ETL development and data integration.
• Strong hands-on experience with Azure Data Factory and other Azure data services.
• Deep understanding of Apache Spark and distributed data processing.
• Experience with SQL and performance tuning.
• Familiarity with data modeling concepts, data lakes, and data warehousing.
• Solid understanding of CI/CD pipelines and version control tools.
• Knowledge of Azure-based security, storage, and networking is a plus.
• Excellent problem-solving skills and ability to work in a fast-paced environment.

Preferred Qualifications:
• Microsoft Certified: Azure Data Engineer Associate
• Experience working in Agile/Scrum methodologies
• Exposure to tools like Databricks, Synapse Analytics, or Snowflake is a plus