605 Azure Data Engineer jobs in the United Arab Emirates

We are looking for a highly skilled Senior Azure Data Engineer with extensive experience in building and managing modern data pipelines using the Azure ecosystem. The ideal candidate will have strong hands-on expertise in Azure Data Factory, Databricks, Synapse Analytics, and Python/PySpark.

Payroll : HTC Global

Location : Remote

Key Responsibilities:

• Design and implement end-to-end data pipelines on Azure platform.
• Work with Azure Data Factory, Databricks, Synapse, and other Azure services.
• Write efficient Python and PySpark code for data transformation.
• Implement data ingestion from diverse sources including APIs, SFTP, and messaging platforms.
• Optimize performance of ETL/ELT jobs and manage medallion architecture (bronze/silver/gold layers).
• Design and implement data models and data warehouse architecture.
• Collaborate with BI teams to enable data access via Power BI and other tools.
• Mentor junior team members and promote best practices.
• Ensure security, reliability, and performance of data infrastructure.
• Participate in Agile/Scrum ceremonies and contribute to sprint planning and delivery.

Required Skills:

• 8+ years of total IT experience, with 5+ years in Azure data engineering.
• Expertise in ADF, Azure Databricks, Synapse, ADLS Gen2.
• 3+ years of hands-on experience with Python/PySpark.
• Solid SQL skills and data modeling expertise.
• Working knowledge of Power BI, APIs, and SFTP.
• Understanding of Agile delivery methodologies.
• Experience with CI/CD pipelines and source control (Git/Azure DevOps).
• Strong analytical and communication skills.

Preferred:

• DP-200 / DP-201 / DP-203 certification.
• Experience with Cosmos DB, Event Hub, or other Azure messaging services.

We are looking for a highly skilled Senior Azure Data Engineer with extensive experience in building and managing modern data pipelines using the Azure ecosystem. The ideal candidate will have strong hands-on expertise in Azure Data Factory, Databricks, Synapse Analytics, and Python/PySpark.Payroll : HTC Global Location : Remote Key Responsibilities:

• Design and implement end-to-end data pipelines on Azure platform.

Required Skills:

• 8+ years of total IT experience, with 5+ years in Azure data engineering.
• Expertise in ADF, Azure Databricks, Synapse, ADLS Gen2.
• 3+ years of hands-on experience with Python/PySpark.
• Solid SQL skills and data modeling expertise.
• Working knowledge of Power BI, APIs, and SFTP.
• Understanding of Agile delivery methodologies.
• Experience with CI/CD pipelines and source control (Git/Azure DevOps).
• Strong analytical and communication skills.

Preferred:

• DP-200 / DP-201 / DP-203 certification.
• Experience with Cosmos DB, Event Hub, or other Azure messaging services.

Job Types: Full-time, Permanent

PCS Gulf excels in IT and financial consulting, driven by the belief that optimal solutions arise from a diverse network of experts collaborating across IT, Finance, and business strategy. Our seasoned team remains industry leaders, staying updated on the latest trends. We provide innovative, cutting-edge solutions tailored to clients' needs, drawing from vast industry exposure. Collaborating closely, we craft comprehensive solutions addressing all aspects of business. With a stellar track record and proficiency, we empower clients, from startups to large corporations, to realize their full potential. At PCS Gulf, our unwavering dedication is to deliver tangible results.

Responsibilities:

• You are detailed reviewing and analysing structured, semi-structured and unstructured data sources for quality, completeness, and business value.
• You design, architect, implement and test rapid prototypes that demonstrate value of the data and present them to diverse audiences.
• You participate in early state design and feature definition activities.
• Responsible for implementing robust data pipeline using Microsoft, Databricks Stack.
• Responsible for creating reusable and scalable data pipelines.
• You are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.

Requirements:

• Advanced working knowledge and experience with relational and non-relational databases.
• Experience building and optimizing Big Data data pipelines, architectures, and data sets.
• Strong experience in Azure Datafactory, Databricks, Eventhub, Python, PySpark, Azure Synapse and SQL.
• Azure Devops experience to deploy the ADF pipelines.
• Minimum 3-5 years of experience.
• Knowledge/Experience with Azure cloud stack.

As a Senior Azure Data Engineer, you will be a key member of our data engineering team responsible for designing, implementing, and optimizing data pipelines and solutions on the Azure cloud platform. You will play a crucial role in building and maintaining data infrastructure, ensuring data availability, reliability, and performance. This position requires a strong background in Azure data services, ETL processes, and a commitment to best practices in data engineering.

Main Duties & Responsibilities:

The role must execute the following core responsibilities:

• Design, develop, and maintain end-to-end data pipelines, leveraging Azure Data Factory, Azure Databricks, and other Azure data services.
• Implement efficient data extraction, transformation, and loading (ETL) processes.
• Experience in building end to end architecture for Data Lakes, Data Warehouses and Data Marts
• Collaborate with data architects and other stakeholders to design scalable and robust data solutions.
• Ensure data integration across various source systems and data stores.
• Perform data transformation, cleansing, and enrichment to support analytics and reporting needs.
• Optimize data processing for performance and scalability.
• Leverage Azure cloud services, such as Azure SQL Data Warehouse, Azure Synapse Analytics, and Azure Data Lake Storage, to build and manage data solutions.
• Implement best practices for Azure resource management and cost optimization.
• Implement data governance policies and ensure data security and compliance with industry standards.
• Manage access controls, encryption, and auditing.
• Monitor data pipelines and infrastructure performance, identifying and resolving bottlenecks.
• Continuously optimize data processes for efficiency.
• Maintain comprehensive documentation of data pipelines, architecture, and configurations.
• Share knowledge and mentor junior team members.

Qualification/ Experience:

• Bachelor's or master's degree in computer science, Information Technology, or a related field.
• 5 to 10 years of experience in data engineering with a focus on Azure cloud technologies.
• Expert in Azure Data Factory, Azure Databricks, Azure SQL Data Warehouse, and Azure Data Lake Storage.
• Strong SQL and scripting skills for data manipulation and automation.
• Knowledge of data warehousing concepts, data modeling, and data integration patterns.
• Expertise in Python & PySpark development, DWH, Data Integration, Cloud, Architecture, Design, Data Modelling, Cloud data warehouse like Azure Synapse, Snowflake analytical warehouse
• Familiarity with data governance and compliance standards.
• Excellent problem-solving and troubleshooting skills.
• Strong communication and collaboration skills.
• Microsoft Certified: Azure Data Engineer Associate
• Microsoft Certified: Azure Solutions Architect Expert

The Data Engineer will build and maintain data pipelines, storage layers, and data products based on the architecture design while meeting organizational requirements. This role involves working closely with the end client and a team of backend engineers, cloud engineers, and data analysts to enable seamless data integration and build robust data platforms on Azure Cloud.

Key Responsibilities

Overall Responsibilities

• Design, develop, and manage data pipelines on Microsoft Azure for internal and external data sources.
• Develop ingestion frameworks for both batch and real-time data.
• Ensure data pipelines are optimized for reliability and scalability.
• Ensure the scalability, security, and performance of cloud architecture while aligning with business goals.
• Collaborate closely with solution architects, backend developers, and data governance specialists.

Technical Responsibilities

• Collaborate with business stakeholders to translate functional requirements into scalable technical solutions.
• Hands-on experience with Azure Databricks platform for building end-to-end data solutions.
• Proficient in Azure Data Services, including Azure Data Factory and Azure SQL Database.
• Experience with Microsoft Fabric is a must.
• Build and optimize data lake zones (raw, curated, consumption).
• Develop business and dataflow logic for data processing using PySpark, T-SQL, and Stored Procedures.
• Implement message queues using Azure Service Bus.
• Integrate cloud-based solutions with on-premises systems.
• Implement Infrastructure as Code (IaC) using Terraform for automated and consistent provisioning.
• Strong understanding of Azure architecture components compute, storage, networking, and security.
• Optimize cloud storage solutions for both performance and cost.
• Establish monitoring and logging solutions using Azure Monitor, Log Analytics, Application Insights, and third-party tools.
• Configure automated scaling solutions to handle workload fluctuations.
• Create and maintain comprehensive architecture documentation, including diagrams, processes, and technical specifications.

Job Title :
Azure Data Engineer

Duration :
6 to 9 Month

Notice Period :
Immediate

Education & Certifications:

1.   Bachelor's or Master's degree in Computer Science, Information Systems, or related field.

2. Microsoft Azure certifications
(e.g., DP-203: Data Engineering on Microsoft Azure) preferred.

Experience :

EXPERIENCE

• 5–10 years
  of experience in data engineering or similar roles.
• Working knowledge of
  Azure Data Factory
  ,
  Azure Data Lake
  , and
  Azure SQL
  .
• Familiarity with
  ETL/ELT concepts
  and
  data integration techniques
  .
• Strong understanding of
  SQL
  and basic scripting (Python or PowerShell preferred).
• Good grasp of
  data modeling concepts
  ,
  data types
  , and
  file formats
  (e.g., CSV, JSON, Parquet).
• Ability to work in a collaborative team environment and follow agile delivery methodologies.
• Exposure to
  Azure Synapse Analytics
  ,
  Databricks
  , or
  Power BI
  .
• Familiarity with
  source control
  systems like Git and CI/CD tools (Azure DevOps).
• Knowledge of
  basic cloud networking, identity, and security
  in Azure.

KEY ACCOUNTABILITIES

1. Develop, test, and maintain
   data pipelines
   using:
2. Azure Data Factory (ADF)
3. Azure Data Lake Storage (Gen2)
4. Azure SQL
   , and/or
   Azure Synapse
5. Assist in building and deploying
   ETL/ELT workflows
   for structured and semi-structured data sources.
6. Collaborate with data analysts, data scientists, and business teams to gather data requirements and implement solutions.
7. Ensure data accuracy, integrity, and availability across systems.
8. Monitor and troubleshoot pipeline executions and performance issues.
9. Follow best practices for
   data governance, security
   , and
   access control
   within the Azure ecosystem.

Document technical designs, workflows, and deployment steps

As a Senior Azure Data Engineer, you will be a key member of our data engineering team responsible for designing, implementing, and optimizing data pipelines and solutions on the Azure cloud platform. This position requires a strong background in Azure data services, ETL processes, and adherence to best practices in data engineering.

• Design, develop, and maintain end-to-end data pipelines, leveraging Azure Data Factory, Azure Databricks, and other Azure data services.
• Implement efficient data extraction, transformation, and loading (ETL) processes.
• Build end-to-end architecture for Data Lakes, Data Warehouses, and Data Marts.
• Collaborate with data architects and stakeholders to design scalable and robust data solutions.
• Ensure data integration across various source systems and data stores.
• Perform data transformation, cleansing, and enrichment to support analytics and reporting needs.
• Optimize data processing for performance and scalability.
• Leverage Azure cloud services, such as Azure SQL Data Warehouse, Azure Synapse Analytics, and Azure Data Lake Storage, to build and manage data solutions.
• Implement best practices for Azure resource management and cost optimization.
• Implement data governance policies and ensure data security and compliance with industry standards.
• Manage access controls, encryption, and auditing.
• Monitor data pipelines and infrastructure performance, identifying and resolving bottlenecks.
• Continuously optimize data processes for efficiency.
• Maintain comprehensive documentation of data pipelines, architecture, and configurations.
• Share knowledge and mentor junior team members.

• Bachelor's or master's degree in computer science, Information Technology, or a related field.
• 5 to 10 years of experience in data engineering with a focus on Azure cloud technologies.
• Expert in Azure Data Factory, Azure Databricks, Azure SQL Data Warehouse, and Azure Data Lake Storage.
• Strong SQL and scripting skills for data manipulation and automation.
• Knowledge of data warehousing concepts, data modeling, and data integration patterns.
• Expertise in Python & PySpark development, DWH, Data Integration, Cloud, Architecture, Design, Data Modelling, and Azure Synapse/Snowflake analytics.
• Familiarity with data governance and compliance standards.
• Excellent problem-solving and troubleshooting skills.
• Strong communication and collaboration skills.
• Microsoft Certified: Azure Data Engineer Associate
• Microsoft Certified: Azure Solutions Architect Expert

• Contract

Location: Abu Dhabi, United Arab Emirates (Abu Dhabi Emirate).

There is something special about Elcome. We attract and retain exceptionally talented people to work in our marine business. We take care of our employees. We believe the words “Welcome to Elcome” should apply to our employees just as much as to our customers. Apply to join us.

For employees who decide to build a career at Elcome, the growth opportunities are excellent and rewarding. There are incredible career opportunities available and we are committed to promoting from within for all our employees.

Find your internship opportunities with us and apply.

Ensuring a healthy and safe work environment for all employees is a top priority for Elcome. We aim to make safety a part of everything we do. We have workplace safety programs in place at regular intervals to ensure that our high safety standards and procedures are clearly communicated and observed on-the-job. As an important member of our team, you will be trained to identify and report any potential issues, and encouraged to offer suggestions to improve health and safety.

Hundreds of people have joined us during our 50-year history, and some have left for other opportunities or have set up small businesses in the same industry. However many do remain with us for careers spanning 15 to 25 years. Our employees who choose to stay with us have a common reason – we work as a family, for our families. Our average employee tenure (years of service) is currently 12.4 years, which can be considered as one of the highest in private companies in the Middle East within our industry.

• Produce designs for monitoring and control systems in accordance with latest marine standards and regulations
• Demonstrate knowledge of products available locally
• Design complete hardware and configure software for systems such as PLC’s
• Present cost-effective customized solutions
• Collaborate with internal teams, onsite engineers and customers

Candidate must be adept in PLC programming, Electrical CAD, E-Tap, power analysis software. Light level/lumen calculation experience will be considered advantageous.

As an apprentice, the candidate will be introduced to various automation control systems such as Alarm Monitoring Systems (AMS), Power Management System (PMS), Bridge Maneuvering System (BMS), environmental solutions, surveillance, and safety monitoring equipment. The prospective candidate will gain first-hand experience in the field as they visit vessels, perform inspections and complete on-board jobs. Moreover, the candidate will gain exposure to globally acclaimed manufacturers and new technologies. This internship role may lead to a permanent position within the organization.

At Elcome, you will join an exceptional group of people who are committed to developing the services and solutions that differentiate us in the maritime industry. Submit your credentials to join us.

There is something special about Elcome. We attract and retain exceptionally talented people to work in our marine business. We take care of our employees. We believe the words "Welcome to Elcome" should apply to our employees just as much as to our customers. Apply to join us.

For employees who decide to build a career at Elcome, the growth opportunities are excellent and rewarding. There are incredible career opportunities available and we are committed to promoting from within for all our employees.

Find your internship opportunities with us and apply.

Ensuring a healthy and safe work environment for all employees is a top priority for Elcome. We aim to make safety a part of everything we do. We have workplace safety programs in place at regular intervals to ensure that our high safety standards and procedures are clearly communicated and observed on-the-job. As an important member of our team, you will be trained to identify and report any potential issues, and encouraged to offer suggestions to improve health and safety.

Hundreds of people have joined us during our 50-year history, and some have left for other opportunities or have set up small businesses in the same industry. However many do remain with us for careers spanning 15 to 25 years. Our employees who choose to stay with us have a common reason – we work as a family, for our families. Our average employee tenure (years of service) is currently 12.4 years, which can be considered as one of the highest in private companies in the Middle East within our industry.

• Produce designs for monitoring and control systems in accordance with latest marine standards and regulations
• Demonstrate knowledge of products available locally
• Design complete hardware and configure software for systems such as PLC's
• Present cost-effective customized solutions
• Collaborate with internal teams, onsite engineers and customers

Candidate must be adept in PLC programming, Electrical CAD, E-Tap, power analysis software. Light level/lumen calculation experience will be considered advantageous.

As an apprentice, the candidate will be introduced to various automation control systems such as Alarm Monitoring Systems (AMS), Power Management System (PMS), Bridge Maneuvering System (BMS), environmental solutions, surveillance, and safety monitoring equipment. The prospective candidate will gain first-hand experience in the field as they visit vessels, perform inspections and complete on-board jobs. Moreover, the candidate will gain exposure to globally acclaimed manufacturers and new technologies. This internship role may lead to a permanent position within the organization.

At Elcome, you will join an exceptional group of people who are committed to developing the services and solutions that differentiate us in the maritime industry. Submit your credentials to join us.

OneBullEx is a crypto futures exchange startup built for speed, reliability, and innovation. Our platform offers advanced futures trading capabilities, including AI-powered 300 SPARTANS trading bots for automated, high-precision strategies. Leveraging cutting-edge AI and machine learning, we deliver real-time performance even during high-volatility market conditions. We combine a user-focused interface with transparent risk management, empowering traders to navigate the fast-moving digital asset markets with confidence.

We are seeking a Data Architecture & Data Pipeline Engineer to design, build, and scale our data infrastructure, ensuring it is reliable, efficient, and cost-effective.

Mission

Build and operate OneBullEx's data lakehouse foundation and data pipelines to provide a robust data infrastructure that empowers analytics and business use cases.

Key Responsibilities

• Lakehouse Architecture – Design and implement enterprise-grade lakehouse architecture to support both structured and semi-structured data.
• Data Ingestion & CDC – Build multi-source data ingestion pipelines (on-chain data, trading data, operational logs, etc.), including real-time and change-data-capture (CDC) mechanisms.
• Data Processing & Orchestration – Develop batch and streaming jobs with workflow orchestration, ensuring scalability, reliability, and performance of data pipelines.
• Data Services – Deliver APIs, data marts, and metric services that make data accessible and actionable for product and business teams.
• Cost & Observability – Implement cost-optimization practices, monitoring, alerting, and auditing systems to ensure efficiency and transparency across the data platform.

Requirements:

• 3–7 years of experience in big data engineering or data platform development.
• Strong expertise in SQL and data modeling (dimensional modeling, star/snowflake schemas)
• Hands-on experience with the Alibaba Cloud ecosystem (OSS, Kafka, Flink, MaxCompute, Hologres, DataWorks) or equivalent big data platforms.
• Solid understanding of both batch and streaming data processing, with proven ability to design and optimize end-to-end pipelines.
• Strong cross-functional collaboration and communication skills, with the ability to translate business needs into scalable data solutions.

Why Join OneBullEx?

• Strategic Leadership – Play a central role in building and scaling a global crypto exchange from the ground up.
• Team Impact – Shape the culture and operational backbone of a company at the forefront of digital asset trading.
• Growth Potential – Join a leadership team with a clear roadmap for international expansion.
• Attractive Package – Competitive compensation and relocation support.