70 Etl Processes jobs in the United Arab Emirates

Job Title: Data Engineering Specialist

We are seeking a skilled Data Engineering Specialist to join our team in Dubai.

This is an exciting opportunity for a seasoned professional with expertise in designing, developing, and maintaining robust data pipelines using Python. The ideal candidate will have hands-on experience with Snowflake, SQL databases, and Apache Airflow, as well as strong skills in Shell scripting.

Key Responsibilities:

• Design and develop data pipelines to support business operations and analytics using Python.
• Integrate APIs using Python to fetch, process, and transform data for various use cases.
• Work with SQL databases, including PostgreSQL, MySQL, MS SQL Server, and Oracle, to perform data transformations, migrations, and optimizations.
• Build and manage data warehouses using Snowflake to ensure high performance and scalability.
• Implement and manage workflows using Apache Airflow to automate data pipeline orchestration.
• Develop and maintain Shell scripts to automate tasks and streamline processes.

Requirements:

• Strong proficiency in Python with experience in API integration and data processing.
• Hands-on experience with Snowflake, including schema design, data modeling, and performance optimization.
• Proficiency in Apache Airflow for managing and orchestrating workflows.
• Strong skills in Shell scripting for automation and system management.
• Solid understanding of designing and maintaining ETL/ELT pipelines.
• Strong analytical and problem-solving skills to handle complex data challenges.
• Excellent communication skills to work effectively with cross-functional teams.

Bonus Points:

• Familiarity with cloud-based platforms, such as AWS or Azure.
• Experience with DevOps practices and tools.
• Knowledge of data security best practices.

**Job Title:** Data Engineering Specialist

The Role

As a Data Engineering Specialist, you will play a pivotal role in transforming complex data landscapes into actionable business insights. Your expertise will enable you to rapidly convert diverse new data sources into datasets that support our overarching business intelligence and analytics goals.

Main Responsibilities:

• Evaluate new data sources from SAP and Non-SAP systems
• Rapidly convert these data sources into datasets
• Develop and support the integration of new data streams into our Azure Data platform
• Ensure data is accessible, reliable, and structured for business insight generation

Required Skills and Qualifications:

• Expertise in data engineering and technical integration
• Ability to evaluate diverse data sources and convert them into usable datasets
• Familiarity with Azure Data platform and its features
• Excellent analytical and problem-solving skills

Benefits:

You will directly impact our ability to make data-driven decisions and maintain our competitive edge in the marketplace. Your contributions will be invaluable in driving business growth and success.

Others:

We offer a dynamic work environment and opportunities for professional growth and development.

As a dynamic and innovative organization, we are committed to empowering the next generation of leaders. Our National Graduate Programme is designed exclusively for UAE Nationals, providing an 18-month journey that combines tailored rotations, mentorship, and development opportunities.

In Phase 1, you will explore our business through three customized 3-month rotations, gaining multi-dimensional exposure and practical insights. In Phase 2, you'll dive deeper into a final 9-month strategic assignment, gaining leadership experience, solving real-world challenges, and driving meaningful impact.

Focus Area: Data Engineering

Data Management and Engineering Expertise

Through rotations in Data Engineering, Data Products, and Data Integrity, you will develop expertise in designing, building, and maintaining robust data infrastructures and solutions. You will play a pivotal role in ensuring data quality, accessibility, and actionable insights that support strategic business decisions and innovation.

Requirements:

• Academic background in IT, Information Security, or Data Engineering
• Strong analytical and technical problem-solving skills
• Knowledge of data architecture, pipelines, and governance
• Attention to detail and commitment to data quality
• Passion for leveraging data to drive business value and innovation

Benefits:

• Enriching, real-world assignments
• Leadership exposure and mentorship
• Development opportunities tailored to your journey
• Access to a competitive benefits package including healthcare, child education contributions, remote work flexibility, and exclusive employee discounts

Empowering Emirati Talent:

We believe in the power of diverse perspectives and inclusive workplaces. We are proud to support the development of UAE National talent and are committed to empowering the next generation of leaders.

As a Quant Developer, you will contribute to the development of trading systems using KDB/Q and Python.

• Develop systematic backtesting, visualization, and trading platforms for global equity strategies
• Collaborate with senior PMs to implement efficient backtester tools and design trading systems
• Ensure reliability, scalability, and timely execution of trading systems
• Mentor junior developers and promote best practices

1. 3-5+ years' experience in developing algorithmic trading systems in systematic equity markets
2. Substantial KDB/Q and Python programming experience
3. Good knowledge of modern data science tools stacks, including Jupyter, pandas, numpy, sklearn, and machine learning expertise
4. Bachelor's or Master's degree in Computer Science, Mathematics, Statistics, or related STEM field from a reputable institution
5. Familiarity with parallel computing tools such as Slurm

1. Dynamic compensation package and excellent career growth opportunities
2. Collaborative culture and an energetic engineering atmosphere
3. Opportunities to build and share knowledge with industry-leading engineers

Data Engineering Specialist

A seasoned professional in data engineering with a strong background in designing and implementing end-to-end data pipelines using cloud platforms.

• Design, develop, and optimize Extract, Transform, Load (ETL) workflows for effective migration and transformation.
• Maintain data ingestion processes from diverse sources such as Salesforce, Oracle databases, PostgreSQL, and MySQL.
• Implement and maintain ETL processes and data pipelines to ensure efficient data extraction, transformation, and loading.
• Leverage Snowflake as the data warehouse solution for managing large volumes of structured and unstructured data.

This is an opportunity to work on complex data engineering projects, collaborating with cross-functional teams to deliver high-quality solutions.

Shape the Future of Data Engineering

We're seeking a seasoned data engineering expert to lead our efforts in building a cutting-edge data foundation. As a key member of our team, you'll have the opportunity to design and implement scalable data systems that support real-time and batch analytics and operations.

• Data Architecture Expertise : You'll be responsible for architecting data systems that ensure data quality, speed, and scalability, using GCP, Airflow, BigQuery, dbt, and Dataflow.
• Pipeline Development : You'll build end-to-end pipelines to deliver high-quality data products, working closely with cross-functional teams to ensure seamless collaboration.
• Data Governance : You'll establish robust data governance and quality rules to promote transparency, trust, and compliance throughout the organization.
• Leadership and Collaboration : As a leader, you'll work with teams to drive impactful data products and initiatives, fostering a culture of innovation and excellence.

This is an exciting opportunity to join a fast-scaling company and make a meaningful impact on its growth and success. If you're passionate about data engineering and want to take your skills to the next level, we encourage you to apply.

Requirements:

• GCP Expertise : Proven experience with Google Cloud Platform, including BigQuery, Dataflow, Airflow, dbt, and Python.
• Advanced SQL Skills : Strong expertise in advanced SQL querying and performance tuning.
• Collaboration and Leadership : Ability to work effectively with cross-functional teams and lead by example.

What We Offer:

• Autonomy and Ownership : You'll have the freedom to drive strategy and make decisions that impact the company's growth and success.
• Continuous Learning : We prioritize professional development and offer opportunities for growth and learning.

About Us:

We're a dynamic and forward-thinking organization dedicated to delivering innovative solutions and driving business growth. Our mission is to empower our customers with cutting-edge technology and expertise.

We are seeking a skilled Data Engineer to join our team in the UAE.

• Design and develop scalable data models using various techniques such as star schema and snowflake schema.
• Develop and maintain database stored procedures and query language scripts using PL/SQL, Java, and SQL.
• Utilize ETL tools like Informatica and Microsoft SSIS to extract, transform, and load data.
• Work with business intelligence tools such as SAP Business Objects and Microsoft Power BI to create interactive dashboards.
• Have hands-on experience with core banking systems, preferably Finacle HPS or Power Card.

• Strong analytical and problem-solving skills.
• Excellent written and verbal communication skills in English.
• Ability to collaborate effectively within a team environment.

• Understanding of the UAE Banking Regulatory Framework Submissions (BRF).
• Familiarity with the Central Bank of the UAE's Supervisory Technology initiative and its objectives.
• Experience in automating regulatory reporting processes.

The selected candidate will be expected to work full-time on site. The joining time frame is within two weeks.

Terms and Conditions:

The employee must adhere to all company policies and procedures.

Remote Work:

No

Employment Type:

Full-time

Join to apply for the Head of Data Engineering role at M2

Join to apply for the Head of Data Engineering role at M2

As the Head of Data Engineering, you will be responsible for designing, implementing, and maintaining a robust, scalable, and compliant data architecture that supports our exchange's operations, analytics, and regulatory reporting requirements. You will lead a team of data engineers, ensuring high availability, security, and performance of our data infrastructure. You will work closely with stakeholders across technology, compliance, risk, and product teams to develop data pipelines, warehouses, and real-time analytics capabilities.

As the Head of Data Engineering, you will be responsible for designing, implementing, and maintaining a robust, scalable, and compliant data architecture that supports our exchange's operations, analytics, and regulatory reporting requirements. You will lead a team of data engineers, ensuring high availability, security, and performance of our data infrastructure. You will work closely with stakeholders across technology, compliance, risk, and product teams to develop data pipelines, warehouses, and real-time analytics capabilities.

This is a strategic yet hands-on role where you will drive data engineering best practices, scalability, and automation while ensuring compliance with regulatory data requirements for a financial services entity.

• Data Architecture & Strategy
  • Define and own the data architecture strategy for the exchange, ensuring it is scalable, secure, and regulatory-compliant.
  • Design and implement data modeling, governance, and security frameworks to meet financial and regulatory requirements.
  • Architect real-time and batch processing data pipelines to handle trade data, order books, user activity, and market analytics.
  • Optimize data storage and retrieval for performance and cost efficiency, leveraging cloud-based and hybrid solutions.
• Data Engineering & Infrastructure
  • Build and maintain ETL/ELT data pipelines for operational, analytical, and compliance-related data.
  • Ensure high data quality, reliability, and availability through robust monitoring, alerting, and data validation techniques.
  • Manage and enhance data warehouses, data lakes, and streaming platforms to support business intelligence and machine learning use cases.
  • Oversee database design and optimization for transactional and analytical workloads (e.g., Aurora, Redis, Kafka).
  • Implement data lineage, metadata management, and access control mechanisms in line with compliance requirements.
• Compliance, Security & Risk Management
  • Work closely with compliance and risk teams to ensure data retention policies, audit trails, and reporting mechanisms meet regulatory requirements (e.g., FATF, AML, GDPR, MiCA).
  • Implement encryption, anonymization, and access control policies to safeguard sensitive user and transaction data.
  • Support fraud detection and risk monitoring through data analytics and alerting frameworks.
• Leadership & Team Management
  • Lead, mentor, and grow a small team of data engineers, fostering a culture of collaboration, innovation, and accountability.
  • Drive best practices in data engineering, DevOps for data, and CI/CD automation for analytics infrastructure.
  • Collaborate with software engineers, DevOps, data analysis, and product teams to integrate data solutions into the broader exchange ecosystem.
• Technical Competencies And Skills
  • Proven experience in data architecture and engineering, preferably within a regulated financial or crypto environment.
  • Strong proficiency in SQL, Python, or Scala for data engineering.
  • Experience with cloud-based data platforms (AWS, GCP, or Azure) and orchestration tools (Airflow, Prefect, Dagster).
  • Hands-on experience with real-time data processing (Kafka, Pulsar, Flink, Spark Streaming).
  • Expertise in data warehousing solutions (Snowflake, BigQuery, Redshift, Databricks).
  • Strong understanding of database design, indexing strategies, and query optimization.
  • Experience implementing data governance, lineage, and cataloging tools.
  • Familiarity with blockchain/crypto data structures and APIs is a plus.
• Leadership & Strategic Skills
  • Experience leading and mentoring a team of data engineers.
  • Ability to design data strategies that align with business goals and regulatory requirements.
  • Strong cross-functional collaboration skills with compliance, risk, and technology teams.
  • Ability to work in a fast-paced, high-growth startup environment with a hands-on approach.
• Industry & Compliance Knowledge
  • Experience in regulated financial markets, fintech, or crypto is highly preferred.
  • Familiarity with financial data standards, KYC/AML reporting, and regulatory requirements related to data handling.
• Preferred Qualifications
  • Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.
  • Certifications in cloud data engineering (AWS/GCP/Azure), data governance, or security are a plus.
  • Experience working in a crypto exchange, trading platform, or high-frequency trading environment is an advantage.

At M2, we believe in a workplace where talent, dedication, and passion are the only factors that count, regardless of gender, background, age, and other characteristics. We embrace diversity because we know that it fuels innovation, fosters creativity, and drives success. So, if you're ready to join a team where your potential is truly valued, welcome aboard

Director

Full-time

Engineering and Information Technology

Referrals increase your chances of interviewing at M2 by 2x

Get notified about new Head of Engineering jobs in Dubai, Dubai, United Arab Emirates .

Dubai, Dubai, United Arab Emirates 17 hours ago

Head of Engineering & Planning (Emirati Talent)

Regional Technical Manager - Engineering and Projects

Head of Engineering - Dubai- Emerging Blockchain Innovation - Oxford Knight

Senior Manager - Technical Services - Dubai Parks and Resorts - Dubai Holding Entertainment

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

Direct message the job poster from Edison Smart

Web3, Crypto & Blockchain Recruiter | Helping Leading Companies Hire Top Talent | Retired Professional Rugby Player

Position : Head of Data Engineering Location : Dubai / Abu Dhabi (Relocation support available)

Employment Type : Full-Time | Senior Leadership

We are conducting a confidential executive search for a Head of Data Engineering to join one of the world's fastest-growing digital asset trading platforms, serving millions of users globally with multi-billion daily trading volumes. This is a rare opportunity to lead a world-class data organization, driving scalability, reliability, and innovation in a high-performance environment.

Key Responsibilities :

• Lead and scale the Data Engineering function, overseeing global teams responsible for data pipelines, storage, and real-time processing at massive scale.
• Design and implement a robust, future-proof data architecture to support analytics, AI / ML initiatives, risk management, and next-generation trading products.
• Collaborate with Product, Engineering, Quant, and Business teams to ensure data availability, integrity, and accessibility across all platforms.
• Build and optimize large-scale distributed data systems, ensuring ultra-low latency and high fault tolerance.
• Drive data strategy and best practices, focusing on governance, lineage, and security across all datasets.
• Manage global stakeholders, providing thought leadership in data engineering, tooling, and emerging technologies.
• Hire, mentor, and inspire top-tier data engineering talent to support exponential growth.

Key Requirements :

About Edison Smart

Edison Smart is a global provider of specialized recruitment solutions, supporting the technology industry's most innovative companies. Headquartered in the UK, we connect talent with opportunity, driving the 'Industry 4.0' revolution. With over 30 years of experience, Edison Smart partners with forward-thinking organizations to help achieve their strategic growth goals while fostering groundbreaking technological advancements.

Seniority level

Seniority level

Executive

Employment type

Employment type

Full-time

Job function

Job function

Finance

Industries

Banking, Financial Services, and IT Services and IT Consulting

Referrals increase your chances of interviewing at Edison Smart by 2x

Sign in to set job alerts for "Head of Engineering" roles.

Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates 5 days ago

Head of Engineering - Linux Platform & Automation

Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates 4 days ago

Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates 4 days ago

Abu Dhabi Emirate, United Arab Emirates 1 week ago

Director of Engineering - LXR Eastern Mangroves Abu Dhabi (Pre-Opening)

Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates 5 days ago

Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates 1 month ago

Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates 3 months ago

Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates 2 months ago

Senior Manager - Software Quality Assurance

Abu Dhabi Emirate, United Arab Emirates 1 week ago

Abu Dhabi Emirate, United Arab Emirates 1 week ago

Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates 6 days ago

Al Zahiyah, Abu Dhabi Emirate, United Arab Emirates 2 days ago

Abu Dhabi Emirate, United Arab Emirates 1 week ago

Abu Dhabi Emirate, United Arab Emirates 4 weeks ago

Head of Engineer- Civil & Structural (Substation)

Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates 4 months ago

Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates 4 days ago

Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates 4 days ago

Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates 5 days ago

Field Protection Engineer- Abu Dhabi, UAE

Abu Dhabi Emirate, United Arab Emirates 3 days ago

Lead Onshore Commissioning Engineer (Offshore WHT's , Subsea Cable & Piping)

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

J-18808-Ljbffr