79 Etl Engineer jobs in the United Arab Emirates

Job Title: Data Engineering Specialist

We are seeking a skilled Data Engineering Specialist to join our team in Dubai.

This is an exciting opportunity for a seasoned professional with expertise in designing, developing, and maintaining robust data pipelines using Python. The ideal candidate will have hands-on experience with Snowflake, SQL databases, and Apache Airflow, as well as strong skills in Shell scripting.

Key Responsibilities:

• Design and develop data pipelines to support business operations and analytics using Python.
• Integrate APIs using Python to fetch, process, and transform data for various use cases.
• Work with SQL databases, including PostgreSQL, MySQL, MS SQL Server, and Oracle, to perform data transformations, migrations, and optimizations.
• Build and manage data warehouses using Snowflake to ensure high performance and scalability.
• Implement and manage workflows using Apache Airflow to automate data pipeline orchestration.
• Develop and maintain Shell scripts to automate tasks and streamline processes.

Requirements:

• Strong proficiency in Python with experience in API integration and data processing.
• Hands-on experience with Snowflake, including schema design, data modeling, and performance optimization.
• Proficiency in Apache Airflow for managing and orchestrating workflows.
• Strong skills in Shell scripting for automation and system management.
• Solid understanding of designing and maintaining ETL/ELT pipelines.
• Strong analytical and problem-solving skills to handle complex data challenges.
• Excellent communication skills to work effectively with cross-functional teams.

Bonus Points:

• Familiarity with cloud-based platforms, such as AWS or Azure.
• Experience with DevOps practices and tools.
• Knowledge of data security best practices.

As a dynamic and innovative organization, we are committed to empowering the next generation of leaders. Our National Graduate Programme is designed exclusively for UAE Nationals, providing an 18-month journey that combines tailored rotations, mentorship, and development opportunities.

In Phase 1, you will explore our business through three customized 3-month rotations, gaining multi-dimensional exposure and practical insights. In Phase 2, you'll dive deeper into a final 9-month strategic assignment, gaining leadership experience, solving real-world challenges, and driving meaningful impact.

Focus Area: Data Engineering

Data Management and Engineering Expertise

Through rotations in Data Engineering, Data Products, and Data Integrity, you will develop expertise in designing, building, and maintaining robust data infrastructures and solutions. You will play a pivotal role in ensuring data quality, accessibility, and actionable insights that support strategic business decisions and innovation.

Requirements:

• Academic background in IT, Information Security, or Data Engineering
• Strong analytical and technical problem-solving skills
• Knowledge of data architecture, pipelines, and governance
• Attention to detail and commitment to data quality
• Passion for leveraging data to drive business value and innovation

Benefits:

• Enriching, real-world assignments
• Leadership exposure and mentorship
• Development opportunities tailored to your journey
• Access to a competitive benefits package including healthcare, child education contributions, remote work flexibility, and exclusive employee discounts

Empowering Emirati Talent:

We believe in the power of diverse perspectives and inclusive workplaces. We are proud to support the development of UAE National talent and are committed to empowering the next generation of leaders.

As a Quant Developer, you will contribute to the development of trading systems using KDB/Q and Python.

• Develop systematic backtesting, visualization, and trading platforms for global equity strategies
• Collaborate with senior PMs to implement efficient backtester tools and design trading systems
• Ensure reliability, scalability, and timely execution of trading systems
• Mentor junior developers and promote best practices

1. 3-5+ years' experience in developing algorithmic trading systems in systematic equity markets
2. Substantial KDB/Q and Python programming experience
3. Good knowledge of modern data science tools stacks, including Jupyter, pandas, numpy, sklearn, and machine learning expertise
4. Bachelor's or Master's degree in Computer Science, Mathematics, Statistics, or related STEM field from a reputable institution
5. Familiarity with parallel computing tools such as Slurm

1. Dynamic compensation package and excellent career growth opportunities
2. Collaborative culture and an energetic engineering atmosphere
3. Opportunities to build and share knowledge with industry-leading engineers

Data Engineering Specialist

A seasoned professional in data engineering with a strong background in designing and implementing end-to-end data pipelines using cloud platforms.

• Design, develop, and optimize Extract, Transform, Load (ETL) workflows for effective migration and transformation.
• Maintain data ingestion processes from diverse sources such as Salesforce, Oracle databases, PostgreSQL, and MySQL.
• Implement and maintain ETL processes and data pipelines to ensure efficient data extraction, transformation, and loading.
• Leverage Snowflake as the data warehouse solution for managing large volumes of structured and unstructured data.

This is an opportunity to work on complex data engineering projects, collaborating with cross-functional teams to deliver high-quality solutions.

Shape the Future of Data Engineering

We're seeking a seasoned data engineering expert to lead our efforts in building a cutting-edge data foundation. As a key member of our team, you'll have the opportunity to design and implement scalable data systems that support real-time and batch analytics and operations.

• Data Architecture Expertise : You'll be responsible for architecting data systems that ensure data quality, speed, and scalability, using GCP, Airflow, BigQuery, dbt, and Dataflow.
• Pipeline Development : You'll build end-to-end pipelines to deliver high-quality data products, working closely with cross-functional teams to ensure seamless collaboration.
• Data Governance : You'll establish robust data governance and quality rules to promote transparency, trust, and compliance throughout the organization.
• Leadership and Collaboration : As a leader, you'll work with teams to drive impactful data products and initiatives, fostering a culture of innovation and excellence.

This is an exciting opportunity to join a fast-scaling company and make a meaningful impact on its growth and success. If you're passionate about data engineering and want to take your skills to the next level, we encourage you to apply.

Requirements:

• GCP Expertise : Proven experience with Google Cloud Platform, including BigQuery, Dataflow, Airflow, dbt, and Python.
• Advanced SQL Skills : Strong expertise in advanced SQL querying and performance tuning.
• Collaboration and Leadership : Ability to work effectively with cross-functional teams and lead by example.

What We Offer:

• Autonomy and Ownership : You'll have the freedom to drive strategy and make decisions that impact the company's growth and success.
• Continuous Learning : We prioritize professional development and offer opportunities for growth and learning.

About Us:

We're a dynamic and forward-thinking organization dedicated to delivering innovative solutions and driving business growth. Our mission is to empower our customers with cutting-edge technology and expertise.

Are you an expert in building robust data pipelines? We are seeking a Senior Data Engineer to lead our data engineering efforts and design, build, and maintain reliable data flows.

About the Role

• This is a key position that requires hands-on experience with modern tools and frameworks for data engineering.

Critical outcomes for the next 6–12 months include:

• Establishing robust data quality frameworks and monitoring.
• Building and optimizing end-to-end data pipelines across multiple systems.
• Enabling faster, more reliable insights for analytics and AI-driven projects.

Key Responsibilities:

• Owning the full data pipeline lifecycle, from source integration to data quality validation.
• Building and shipping data infrastructure improvements weekly that unlock business value.
• Proactively identifying data gaps and integration opportunities across our systems.
• Implementing robust data quality checks and monitoring to ensure reliable analytics.

Requirements:

• 6+ years of experience in data engineering, ETL development, or related roles.
• Strong expertise in building and managing data pipelines using modern tools and frameworks.
• Proficiency in SQL, Python, and data workflow orchestration platforms (e.g., Airflow, dbt).
• Experience with cloud data platforms such as AWS, GCP, or Azure.

Benefits:

• Opportunity to work with cutting-edge technologies and innovative solutions.
• Collaborative and dynamic team environment.
• Competitive salary and benefits package.

Join Our Team

We are seeking a skilled Data Engineer to join our team in the UAE.

• Design and develop scalable data models using various techniques such as star schema and snowflake schema.
• Develop and maintain database stored procedures and query language scripts using PL/SQL, Java, and SQL.
• Utilize ETL tools like Informatica and Microsoft SSIS to extract, transform, and load data.
• Work with business intelligence tools such as SAP Business Objects and Microsoft Power BI to create interactive dashboards.
• Have hands-on experience with core banking systems, preferably Finacle HPS or Power Card.

• Strong analytical and problem-solving skills.
• Excellent written and verbal communication skills in English.
• Ability to collaborate effectively within a team environment.

• Understanding of the UAE Banking Regulatory Framework Submissions (BRF).
• Familiarity with the Central Bank of the UAE's Supervisory Technology initiative and its objectives.
• Experience in automating regulatory reporting processes.

The selected candidate will be expected to work full-time on site. The joining time frame is within two weeks.

Terms and Conditions:

The employee must adhere to all company policies and procedures.

Remote Work:

No

Employment Type:

Full-time

We are seeking a seasoned Data Engineer to join our dynamic team. As a key member of our organization, you will be responsible for designing, implementing, and optimizing data pipelines and infrastructure to support cutting-edge AI systems.

Your primary objective will be to ensure the efficient collection, storage, processing, and analysis of large-scale data, enabling us to unlock valuable insights and drive innovation across various domains.

Key Responsibilities:

• Design, develop, and maintain scalable and reliable data pipelines to ingest, transform, and load diverse datasets from various sources, including structured and unstructured data, streaming data, and real-time feeds.
• Implement robust data integration processes to seamlessly integrate data from different sources, ensuring consistency, reliability, and data quality for analytics and AI use cases.
• Design and optimize data storage solutions, including relational databases, NoSQL databases, data lakes, and cloud storage services, to efficiently store and manage large volumes of data for AI and machine learning model consumption.
• Optimize data processing and query performance to enhance system scalability, reliability, and efficiency, leveraging techniques such as indexing, partitioning, caching, and parallel processing—especially for AI model training and inference pipelines.
• Implement data governance frameworks to ensure data security, privacy, integrity, and compliance with regulatory requirements, including data encryption, access controls, and auditing.
• Monitor data pipelines and infrastructure components, proactively identify and address issues, and perform routine maintenance tasks to ensure system stability and reliability across AI and data science environments.

Requirements:

• Pipeline Development: Expertise in designing and implementing complex data pipelines and infrastructure solutions that support advanced analytics and AI initiatives.
• Data Integration: Proficiency in integrating data from various sources, ensuring consistency, reliability, and data quality for analytics and AI use cases.
• Performance Optimization: Ability to optimize data processing and query performance to enhance system scalability, reliability, and efficiency.
• Data Governance: Experience in implementing data governance frameworks to ensure data security, privacy, integrity, and compliance with regulatory requirements.
• Collaboration: Strong communication and collaboration skills to work effectively with cross-functional teams.

Why Join Us?

• Impact: Be part of a dynamic team that is shaping the future of AI and making a meaningful impact on industries and society.
• Innovation: Work on cutting-edge projects at the intersection of AI, data engineering, and machine learning, leveraging the latest technologies and methodologies.
• Culture: Join a culture of curiosity, excellence, and collaboration, where your ideas are valued, and your contributions are recognized and rewarded.

Seniority level : Mid-Senior level

Employment type : Full-time

Job function : Information Technology

Industries : IT Services and IT Consulting

Keyword : DataEngineer

As the Head of Data Engineering, you will be responsible for designing, implementing, and maintaining a robust, scalable, and compliant data architecture that supports our exchange’s operations, analytics, and regulatory reporting requirements. You will lead a team of data engineers, ensuring high availability, security, and performance of our data infrastructure. You will work closely with stakeholders across technology, compliance, risk, and product teams to develop data pipelines, warehouses, and real-time analytics capabilities.

This is a strategic yet hands-on role where you will drive data engineering best practices, scalability, and automation while ensuring compliance with regulatory data requirements for a financial services entity.

Data Architecture & Strategy :

1. Define and own the data architecture strategy for the exchange, ensuring it is scalable, secure, and regulatory-compliant.
2. Design and implement data modeling, governance, and security frameworks to meet financial and regulatory requirements.
3. Architect real-time and batch processing data pipelines to handle trade data, order books, user activity, and market analytics.
4. Optimize data storage and retrieval for performance and cost efficiency, leveraging cloud-based and hybrid solutions.
5. Build and maintain ETL / ELT data pipelines for operational, analytical, and compliance-related data.
6. Ensure high data quality, reliability, and availability through robust monitoring, alerting, and data validation techniques.
7. Manage and enhance data warehouses, data lakes, and streaming platforms to support business intelligence and machine learning use cases.
8. Oversee database design and optimization for transactional and analytical workloads (e.g., Aurora, Redis, Kafka).
9. Implement data lineage, metadata management, and access control mechanisms in line with compliance requirements.

Compliance, Security & Risk Management :

1. Work closely with compliance and risk teams to ensure data retention policies, audit trails, and reporting mechanisms meet regulatory requirements (e.g., FATF, AML, GDPR, MiCA).
2. Implement encryption, anonymization, and access control policies to safeguard sensitive user and transaction data.
3. Support fraud detection and risk monitoring through data analytics and alerting frameworks.

Leadership & Team Management :

1. Lead, mentor, and grow a small team of data engineers, fostering a culture of collaboration, innovation, and accountability.
2. Drive best practices in data engineering, DevOps for data, and CI / CD automation for analytics infrastructure.
3. Collaborate with software engineers, DevOps, data analysis, and product teams to integrate data solutions into the broader exchange ecosystem.

Technical competencies and skills :

1. Proven experience in data architecture and engineering, preferably within a regulated financial or crypto environment.
2. Strong proficiency in SQL, Python, or Scala for data engineering.
3. Experience with cloud-based data platforms (AWS, GCP, or Azure) and orchestration tools (Airflow, Prefect, Dagster).
4. Hands-on experience with real-time data processing (Kafka, Pulsar, Flink, Spark Streaming).
5. Expertise in data warehousing solutions (Snowflake, BigQuery, Redshift, Databricks).
6. Strong understanding of database design, indexing strategies, and query optimization.
7. Experience implementing data governance, lineage, and cataloging tools.
8. Familiarity with blockchain / crypto data structures and APIs is a plus.

Leadership & Strategic Skills :

1. Experience leading and mentoring a team of data engineers.
2. Ability to design data strategies that align with business goals and regulatory requirements.
3. Strong cross-functional collaboration skills with compliance, risk, and technology teams.
4. Ability to work in a fast-paced, high-growth startup environment with a hands-on approach.

Industry & Compliance Knowledge :

1. Experience in regulated financial markets, fintech, or crypto is highly preferred.
2. Familiarity with financial data standards, KYC / AML reporting, and regulatory requirements related to data handling.

Preferred Qualifications :

1. Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.
2. Certifications in cloud data engineering (AWS / GCP / Azure), data governance, or security are a plus.
3. Experience working in a crypto exchange, trading platform, or high-frequency trading environment is an advantage.

At M2, we believe in a workplace where talent, dedication, and passion are the only factors that count, regardless of gender, background, age, and other characteristics. We embrace diversity because we know that it fuels innovation, fosters creativity, and drives success. So, if you're ready to join a team where your potential is truly valued, welcome aboard!