149 Data Engineer jobs in Dubai

The Data Engineer will be responsible for developing semantic models on top of the Data Lake/Data Warehouse to fulfill the self-service BI foundation requirements. This includes data extraction from various data sources and integration into the central data lake/data warehouse using enterprise platforms like Informatica iPaaS.

1. Designing data warehouse data models based on business requirements.
2. Designing, developing, and testing both batch and real-time Extract, Transform and Load (ETL) processes required for data integration.
3. Ingesting both structured and unstructured data into the SMBU data lake/data warehouse system.
4. Designing and developing semantic models/self-service cubes.
5. Performing BI administration and access management to ensure access and reports are properly governed.
6. Performing unit testing and data validation to ensure business UAT is successful.
7. Performing ad-hoc data analysis and presenting results in a clear manner.
8. Assessing data quality of the source systems and proposing enhancements to achieve a satisfactory level of data accuracy.
9. Optimizing ETL processes to ensure execution time meets requirements.
10. Maintaining and architecting ETL pipelines to ensure data is loaded on time on a regular basis.

1. 5 to 8 years of overall experience.
2. Proven experience in the development of dimensional models in Azure Synapse with strong SQL knowledge.
3. Minimum of 3 years working as a Data Engineer in the Azure ecosystem specifically using Synapse, ADF & Data bricks.
4. Preferably 3 years of experience with data warehousing, ETL development, SQL Queries, Synapse, ADF, PySpark, and Informatica iPaaS for data ingestion & data modeling.

Join to apply for the Data Engineer role at DataScience Middle East

As a Software Engineer, you will undertake the responsibility of crafting, advancing, sustaining, and refining SAS-based solutions.

This position necessitates close collaboration with compliance and fraud teams in banking industry & other data management / analysts departments in the governmental sector, as well as business users and IT personnel, to execute efficient strategies and solutions.

• Design and build powerful real-time solutions for the banking & government industry.
• Partner with analysts and business users to translate their needs into effective scenarios and parameters.
• Empower users through documentation and training on the software applications.
• Stay up-to-date on the latest real time / data solutions trends and technologies.

Fresh graduate or up to 1 year of experience in data engineering, software development, or a related field.

• Proficiency in Python for data manipulation, scripting, and automation.
• Strong knowledge of relational databases (e.g., MySQL, PostgreSQL, or Oracle).
• Familiarity with database query optimization and management.
• Basic knowledge of Linux for managing scripts, handling file systems, and troubleshooting system-related issues.
• Familiarity with real-time data processing tools such as Apache Kafka.
• Excellent communication and teamwork abilities.

• Entry level

• Other

• Information Technology

• IT Services and IT Consulting

Join to apply for the Data Engineer role at Dicetek LLC .

• Strong backend experience with Python, FastAPI/Flask.
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience Working Airflow And Other Scheduling Tools.
• Well versed with REST.
• Strong analytic skills related to working with unstructured datasets.
• Automation unit testing and, preferably TDD.
• Understanding the CI/CD cycle
• Experience with AWS cloud services: EC2, EMR, RDS, Redshift
• Familiar with GitHub, Gitlab or BITbucket
• Experience in building new systems from scratch and integrating with the existing

• Not Applicable

• Contract

• Information Technology

• IT Services and IT Consulting

• Dubai, United Arab Emirates

Tyde Digital, a trusted business optimization consultancy, is looking for a highly analytical and detail-oriented Data Engineer to join our rapidly growing team.

At Tyde, we collaborate with businesses across diverse industries and regions, helping them enhance four key areas of their operations : - people, processes, technology, and data . Our goal is to empower organizations with data driven decision-making, enabling them to achieve their strategic objectives.

As a Data Engineer, you'll play a pivotal role in designing, managing, and optimizing data infrastructure. You'll work closely with Business Analysts and Data Analysts to transform complex data into actionable insights, driving meaningful and measurable outcomes for our clients.

Who We're Looking For

Tyde Digital is home to problem-solvers, innovators, and strategic thinkers. If you're passionate about business transformation, thrive in a collaborative setting, and are driven by results, you'll fit right in.

• Adaptability in a fast-moving environment
• Proactive problem-solving mindset
• Strong analytical and data-driven decision-making skills
• Meticulous attention to detail
• Commitment to delivering exceptional value to clients
• True passion and pride in the work we deliver

Key Responsibilities

• Data Pipeline Development : Design and implement scalable and efficient architecture for data pipelines, ensuring seamless data flow across multiple endpoints.
• Technical Customizations : Deploy technical customizations to pre-packaged software solutions.
• Micro-service and API Development : Create and deploy micro-services and APIs to facilitate data transfer and integration between various systems.
• Data Transformation : Perform data transformation activities, including data cleansing, data mining, and data processing, utilizing a variety of technologies and tools.
• C ontinuous Improvement : Collaborate with cross-functional teams to drive changes and enhancements based on data-driven findings.
• Data Mapping : Identify and present key performance indicators (KPIs) based on existing data points and datasets.
• Solution Development : Design and implement end-to-end data-driven solutions tailored to business requirements, integrating tools, platforms, and custom logic to address specific operational challenges.

Involvement In

• Collecting Requirements from Clients : Identify and present key gaps and opportunities for business optimization from the client.
• Creating Data-Driven Insights : Provide valuable insights derived from data analysis and contribute to strategic decision-making processes.
• Reporting and Visualization : Develop reporting tools using a range of Business Intelligence (BI) tools such as Power BI, Tableau, QlikView, and others.
• KPI Identification : Identify and present key performance indicators (KPIs) based on existing data points and datasets.

Requirements

• Bachelor's degree in a relevant field (e.g., Computer Science, Data Science, Information Technology) or equivalent experience.
• 2+ years of experience in data engineering or a related role.
• Proven experience in data engineering or a related role.
• Strong programming skills in languages such as Python, C#, or Java.
• Experience in extracting applicable data from databases using SQL.
• Experience in cloud computing platforms (AWS / GCP / Azure).
• Experience with BI tools like Power BI, Tableau, or similar platforms.
• Strong problem-solving abilities and attention to detail.
• Ability to work collaboratively in a cross-functional team environment.
• Knowledge of data governance and security best practices is a plus.
• Excellent verbal and written communication skills.
• Excellent data visualization and communication skills.
• Experience with Power Platform Development applications.
• Experience with custom SharePoint applications and workflows.

We are in a critical phase of growth, which brings incredible opportunities but also unique challenges. Our projects span multiple geographies, often requiring travel and periods of time abroad to ensure seamless delivery and deep client engagement. At the same time, our biggest project isn't just client-facing it's also internal. We are constantly refining and improving our own systems and processes to ensure that as we scale, we remain agile and effective.

The pace is fast, and so adaptability is key. However, the rewards of joining at this early stage are immense your work will have a direct impact on the company's future, and you'll be in a position to shape the culture, operations, and strategic direction of a business that's on a rapid growth trajectory.

Why Join Us

• Client-First Philosophy : We prioritize the goals of our clients, offering a fresh alternative to traditional consultancy approaches. No legacy-minded advice or pushy sales tactics just honest, results-driven solutions.
• Technology Agnostic Excellence : We're not here to sell software. We help businesses maximize their existing technology investments and identify the most suitable new tools when necessary.
• Data-Driven Innovation : We enable businesses to turn accurate, accessible, and actionable data into real-time insights, driving tangible business results.
• Sustainable Client Growth : Our solutions aren't just about solving today's challenges they're about setting the foundation for tomorrow's innovation and success.
• Career Advancement : Joining the business at this phase of growth provides opportunity for accelerated career development working closely with the founders.

Job Title: Data Engineer (PySpark)

___

About the Role

We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines that ensure high data quality and availability across the organization. This role requires a strong background in big data ecosystems, cloud-native tools, and advanced data processing techniques.

The ideal candidate has hands-on experience with data ingestion, transformation, and optimization on the Cloudera Data Platform, along with a proven track record of implementing data engineering best practices. You will work closely with other data engineers to build solutions that drive impactful business insights.

Responsibilities

1. Data Pipeline Development: Design, develop, and maintain highly scalable and optimized ETL pipelines using PySpark on the Cloudera Data Platform, ensuring data integrity and accuracy.
2. Data Ingestion: Implement and manage data ingestion processes from a variety of sources (e.g., relational databases, APIs, file systems) to the data lake or data warehouse on CDP.
3. Data Transformation and Processing: Use PySpark to process, cleanse, and transform large datasets into meaningful formats that support analytical needs and business requirements.
4. Performance Optimization: Conduct performance tuning of PySpark code and Cloudera components, optimizing resource utilization and reducing runtime of ETL processes.
5. Data Quality and Validation: Implement data quality checks, monitoring, and validation routines to ensure data accuracy and reliability throughout the pipeline.
6. Automation and Orchestration: Automate data workflows using tools like Apache Oozie, Airflow, or similar orchestration tools within the Cloudera ecosystem.
7. Monitoring and Maintenance: Monitor pipeline performance, troubleshoot issues, and perform routine maintenance on the Cloudera Data Platform and associated data processes.
8. Collaboration: Work closely with other data engineers, analysts, product managers, and other stakeholders to understand data requirements and support various data-driven initiatives.
9. Documentation: Maintain thorough documentation of data engineering processes, code, and pipeline configurations.

Qualifications

Education and Experience

1. Bachelor's or Master's degree in Computer Science, Data Engineering, Information Systems, or a related field.
2. 3+ years of experience as a Data Engineer, with a strong focus on PySpark and the Cloudera Data Platform.

Technical Skills

1. PySpark: Advanced proficiency in PySpark, including working with RDDs, DataFrames, and optimization techniques.
2. Cloudera Data Platform: Strong experience with Cloudera Data Platform (CDP) components, including Cloudera Manager, Hive, Impala, HDFS, and HBase.
3. Data Warehousing: Knowledge of data warehousing concepts, ETL best practices, and experience with SQL-based tools (e.g., Hive, Impala).
4. Big Data Technologies: Familiarity with Hadoop, Kafka, and other distributed computing tools.
5. Orchestration and Scheduling: Experience with Apache Oozie, Airflow, or similar orchestration frameworks.
6. Scripting and Automation: Strong scripting skills in Linux.

Soft Skills

1. Strong analytical and problem-solving skills.
2. Excellent verbal and written communication abilities.
3. Ability to work independently and collaboratively in a team environment.
4. Attention to detail and commitment to data quality.

Data Engineer (CRM) at Greenfix Property Care

We are seeking a skilled and detail-oriented Data Engineer to support a large-scale CRM migration project. The role involves designing migration strategy and executing processes to migrate customer, transactional, and engagement data from banking systems to the new CRM platform on cloud. The ideal candidate should have strong experience in data pipeline development, data quality management, and working closely with cross-functional teams, including CRM consultants, architects, and business stakeholders. A solid understanding of data governance, data quality, security best practices, and data privacy regulations is essential for this role.

• Design and implement scalable data migration solutions across platforms.
• Collaborate with solution architects and business analysts to define data requirements and mapping logic.
• Analyze existing data models and create migration strategies, including data cleansing, transformation, deduplication, and enrichment.
• Develop scripts and tools for data extraction and loading using various relevant technologies.
• Conduct data quality assessments and implement validation and reconciliation checks to ensure migration accuracy and completeness.
• Support testing activities such as data validation, user acceptance testing, and post-migration audits.
• Maintain documentation of data flows, transformation logic, and data dictionaries.
• Work closely with CRM vendors, system integrators, and internal IT teams to resolve migration-related issues.
• Strong understanding of data governance, quality, and security best practices and knowledge of data privacy regulations.

• Experience with CRM cloud platforms migration tools like KingswaySoft SSIS Integration Toolkit, Scribe Insight, or JitterBit Data Loader.
• Proficiency in SQL, data migration tools like Informatica PowerCenter, SnapLogic and scripting languages Python and PowerShell.
• Familiarity with CRM platforms like Salesforce or MS Dynamics and understanding of their data models.
• Experience with cloud platforms (Azure or AWS) is a plus.
• Strong understanding of data governance, quality, and security best practices.
• Excellent communication and problem-solving skills.

• Seniority level: Mid-Senior level
• Employment type: Full-time
• Job function: Information Technology
• Industries: Household Services

Referrals increase your chances of interviewing at Greenfix Property Care by 2x

Dubai, United Arab Emirates | Posted on 07/29/2025

myZoiis changing lives for the better for those who deserve it the most. We are an excitingfintech start-up aiming to promote financial inclusion globally. Our vision isto provide a level playing field to the unbanked and the underbanked inaccessing essential financial services in an affordable, convenient, andtransparent fashion. We are looking for smart, ambitious, and purpose-drivenindividuals to join us in this journey.Please apply via the link below ifyou are interested.

You will beworking in our Data Platform team, providing data capability for internal andproduct requirements for myZoi. You will be proactive and innovative and youwill be using 100% cloud technologies based on AWS and modern Open Sourcetooling to provide a real-time data infrastructure, allowing our teams to gainunprecedented insight into our wealth of application data. You will work with aworld-class team of Data Analysts and Engineers to provide best in classsolutions.

ArchitectAWS-Centric Data Solutions:

• Designand optimize high-performance data pipelines leveraging AWS native tools.
  
• Architectmodular, AI-ready data lake with a roadmap to ensure secure ingestion,transformation, and consumption workflows.
  
• Implementscalable streaming solutions that factor in performance, scalability and cost.
  

EmbedSecurity & Compliance Across AWS Workloads

• Buildand enforce data governance protocols aligned with relevant regulatory andcompliance requirements using AWS tools.
  
• Collaboratewith cybersecurity teams to implement IAM best practices, encryptionstrategies, and secure networking.
  
• Maintaintraceability and auditability for all data flows across the AWS stack.
  

Optimizefor Observability & Cost Efficiency:

• Workwith our Cloud Architect and SRE to deploy and fine-tune monitoring dashboardsusing Datadog and AWS CloudWatch for performance, anomaly detection, andsecurity event correlation.
  
• Continuouslyevaluate storage and compute cost optimization across S3, EC2, Redshift, andGlue workloads.
  

LeadThrough Influence and Collaboration:

• Partnerwith Data Science, Cloud Architect, Security and Engineering leads to aligncloud architecture with evolving business goals and priorities to ensurefuture-readiness.
  
• Mentorjunior engineers in AWS best practices, scalable design, and secure codingstandards.
  
• Leadinnovation across key Product initiatives.
  

Innovatewith Purpose:

• Evaluateand integrate AWS-compatible orchestration tools like Airflow, Lakeformation,ECS, EKS or Managed Workflows.
  
• Contributeto middleware and third-party orchestration strategies through secure APIs andevent-driven patterns.
  
• Designdata products based on requirements that focus on key use cases such as socialimpact related.
  

• Bachelor'sor Master's degree in Computer Science, Data Engineering, Software Engineeringor a related field.
  
• 8–10years of professional experience in data engineering, including 5+ yearsarchitecting on AWS underpinned by data governance. Mastery of AWS cloudservices (S3, Lambda, Glue, Redshift, Kinesis, Lake Formation, Crawler etc.).
  
• Deepexpertise in building scalable cloud-native solutions and managing secure datainfrastructure ensuring data governance.
  
• Strongcommand of compliance-driven architecture design and real-time monitoringstrategies.
  
• Goodunderstanding of compliance frameworks related to data privacy and informationsecurity.
  
• Excellentcommunication skills and a proven leadership in mentoring and ability to leadcross-functional initiatives.
  

• Proficiencywith agile tools (Jira).
  
• CloudInfrastructure & AWS Services: S3, Glue, Lambda, Redshift, Kinesis, IAM,CloudWatch, Lake Formation etc. Strong awareness of AWS security tools.
  
• DataOrchestration: Experience with Apache Airflow on ECS or AWS Managed Workflows.Familiarity with Step Functions and event-driven orchestration patterns.
  
• Streaming& ETL Pipelines: Expertise in Kinesis Data Streams and Kafka (AWS-hosted orcompatible). Proficiency in designing and optimizing ETL workflows using AWS.
  
• Monitoring& Observability: Awareness of or exposure to logs, alerting, monitoring,detection and tuning.
  
• Security& Governance: Awareness of or exposure to AWS KMS. In addition, buildinggovernance workflows with AWS Config and Lake Formation.
  
• DataModeling & Optimization: Extensive experience in design of AI-ready datalake with scalable ingestion and query performance.
  
• ProgrammingLanguages: Advanced coding in Python and SQL. Experience in Java and ETLprocesses is also preferred.
  

• Youhave strong communication skills, curiosity and are a quick learner.
  
• Youenjoy a creative fast paced agile world.
  
• Youenjoy mentoring and teaching other developers to create a world class cohesiveteam.
  
• Youenjoy making friends and having fun.
  

AtmyZoi we strive to create a both a product and a team that embraces equality,inclusion, diversity and freedom. We want people who can be themselves andbring their own brand of value to the team. Come and join us

Data Engineer role at Glow Beauty on Demand

We are seeking a skilled and experienced Data Engineer to join our data and analytics team within a dynamic healthcare environment. This role involves developing and maintaining data pipelines, designing data models, optimizing data storage, and supporting enterprise-wide analytics initiatives. The ideal candidate will have strong experience working with Snowflake and a solid understanding of healthcare data systems and terminology. This is a highly collaborative role that works closely with data analysts, data scientists, clinicians, and operational leaders.

• Design, build, and maintain scalable, efficient, and reliable data pipelines
• Develop and manage data models and schemas in Snowflake to support analytical and operational use cases
• Integrate data from various healthcare systems, including EMRs, billing systems, and third-party platforms
• Perform data cleansing, transformation, and enrichment to ensure data quality and usability
• Collaborate with analysts, data scientists, and stakeholders to understand data requirements and deliver solutions
• Implement and maintain data governance, privacy, and security protocols aligned with healthcare regulations
• Monitor, troubleshoot, and optimize pipeline performance and system reliability
• Develop automated testing and validation processes to ensure data integrity
• Document data flows, architecture, and processes for transparency and future maintenance
• Support data integration with BI and visualization tools like Power BI or Tableau
• Participate in code reviews and contribute to best practices in data engineering

• Bachelor's degree in Computer Science, Information Systems, Engineering, or related field
• Master's degree is a plus
• Prior experience working in the healthcare industry is required
• Certifications in data analytics or BI tools (e.g., Microsoft Power BI, Tableau, SQL, Python, or Google Analytics) are preferred

• Proficient in data analysis, statistics, and visualization tools and techniques
• Advanced Excel skills and working knowledge of SQL, Python, or R
• Experience with business intelligence platforms like Power BI, Tableau, or QlikView
• Strong understanding of data structures, relational databases, and data governance principles
• Ability to interpret and present complex data in a simple and meaningful way for business stakeholders
• Excellent problem-solving, critical thinking, and communication skills
• Detail-oriented with the ability to manage multiple tasks and tight deadlines
• Comfortable working in a fast-paced, cross-functional environment

• 5+ years of experience in a Data Engineering or similar role
• Hands-on experience with Snowflake including performance tuning and data modeling
• Strong SQL development skills
• Experience working with healthcare data, including familiarity with clinical, operational, and billing datasets
• Solid understanding of data governance, data quality, and security practices in a healthcare environment
• Experience with ETL/ELT tools and CDC tools (Fivetran)
• Knowledge of cloud platforms such as AWS, Azure, or GCP
• Experience building data pipelines using Python or similar scripting languages

• Mid-Senior level

• Full-time

• Information Technology

• Home Health Care Services

Join to apply for the Data Engineer (m/f/d) role at Halian

Get AI-powered advice on this job and more exclusive features.

We are seeking a highly skilled Data Engineer to join our growing data team. This is an exciting opportunity to design, build, and maintain robust data pipelines and data visualization solutions that will drive critical business insights.

• Design, develop, and maintain scalable ETL pipelines using SQL Server Integration Services (SSIS) and/or Informatica.
• Create and optimize data models for efficient data storage and retrieval.
• Develop interactive and insightful data visualizations and reports using Power BI Desktop and Power BI Service.
• Implement and manage Power BI gateways for secure and reliable data access.
• Write and optimize complex SQL queries, stored procedures, and perform database performance tuning.
• Collaborate with stakeholders to understand data requirements and deliver effective data solutions.

• 8-10 years of experience in the BI & Analytics domain with a focus on data engineering.
• Minimum 4 years of hands-on experience building ETL pipelines using SSIS and/or Informatica.
• Minimum 3 years of experience developing and deploying data visualizations using Power BI.
• Strong proficiency in database concepts, data modeling, and advanced SQL development.
• Proven track record of developing and deploying data integration and reporting solutions to production.
• Excellent analytical, problem-solving, and communication skills.

With over 28 years of experience, we understand that innovation is essential to providing agile, practical solutions that transform businesses and careers.

Our resourcing and smart services help you realize tomorrow's potential. Discover the amazing possibilities when you bring the right people and technologies together.

At Halian, we value diversity, equity, and inclusion (DEI). We are committed to connecting organizations with top talent from all backgrounds, ensuring everyone feels valued, respected, and empowered. We encourage applications from all qualified candidates, regardless of race, gender, disability, or other characteristics. By fostering diverse and inclusive workplaces, we drive innovation and better reflect the communities we serve.

• Location: Dubai, United Arab Emirates
• Seniority level: Mid-Senior level
• Employment type: Full-time
• Job function: Information Technology
• Industry: Staffing and Recruiting

Referrals increase your chances of interviewing at Halian by 2x.

Get notified about new Data Engineer jobs in Dubai, UAE .