What Jobs are available for Data Engineering Manager in the United Arab Emirates?

Python Engineer (Big Data) in Dubai: Design scalable backend systems, handle data pipelines, and use Big Data tech. Full-Time, experience required.

Description

Python Engineer (Big Data) in Dubai: Design scalable backend systems using Python, collaborate on data pipelines, and leverage Big Data tech like Hadoop and Spark. Experience required.

Location: Dubai, UAE
Type: Full-Time

Are you passionate about building scalable backend systems that handle vast amounts of data? Do you have a deep understanding of Python engineering and experience working with Big Data technologies? If so, we want to hear from you!

What You'll Do:

1. Design, build, and maintain scalable and robust backend services using Python.
2. Work on data pipelines, transforming large datasets into meaningful insights.
3. Collaborate with data scientists, engineers, and product teams to optimize system performance.
4. Leverage your knowledge in Big Data technologies (e.g., Snowflake, Hadoop, Spark, Kafka) to create data-driven solutions.
5. Ensure smooth data flow and storage across various systems, ensuring high availability and fault tolerance.
6. Continuously improve codebase quality through testing, peer review, and adherence to best practices.

What We're Looking For:

1. Proven experience as a Backend Engineer with a focus on Python.
2. Strong understanding of Big Data architectures and tools (e.g., Hadoop, Spark, Flink, etc.).
3. Experience with data engineering concepts, including ETL pipelines, data warehousing, and real-time streaming.
4. Proficiency in cloud platforms (AWS, GCP, Azure) and containerization technologies (Docker, Kubernetes).
5. Solid experience with relational and non-relational databases (e.g., PostgreSQL, MongoDB, Cassandra).
6. Problem-solving mindset with a strong ability to debug and optimize code.
7. Excellent communication skills and a team player.

Bonus Points:

1. Familiarity with machine learning models and data science workflows.
2. Experience with RESTful API design and microservices architecture.
3. Knowledge of DevOps tools and CI/CD pipelines.

Interested?

Seeking a Python Engineer in Dubai to build scalable backend systems, manage data pipelines, and leverage Big Data technologies like Hadoop and Spark. Requires cloud and database expertise.

Description

Are you passionate about building scalable backend systems that handle vast amounts of data? Do you have a deep understanding of Python engineering and experience working with Big Data technologies? If so, we want to hear from you!

What You'll Do:

1. Design, build, and maintain scalable and robust backend services using Python.
2. Work on data pipelines, transforming large datasets into meaningful insights.
3. Collaborate with data scientists, engineers, and product teams to optimize system performance.
4. Leverage your knowledge in Big Data technologies (e.g., Snowflake, Hadoop, Spark, Kafka) to create data-driven solutions.
5. Ensure smooth data flow and storage across various systems, ensuring high availability and fault tolerance.
6. Continuously improve codebase quality through testing, peer review, and adherence to best practices.

What We're Looking For:

1. Proven experience as a Backend Engineer with a focus on Python.
2. Strong understanding of Big Data architectures and tools (e.g., Hadoop, Spark, Flink, etc.).
3. Experience with data engineering concepts, including ETL pipelines, data warehousing, and real-time streaming.
4. Proficiency in cloud platforms (AWS, GCP, Azure) and containerization technologies (Docker, Kubernetes).
5. Solid experience with relational and non-relational databases (e.g., PostgreSQL, MongoDB, Cassandra).
6. Problem-solving mindset with a strong ability to debug and optimize code.
7. Excellent communication skills and a team player.

Bonus Points:

1. Familiarity with machine learning models and data science workflows.
2. Experience with RESTful API design and microservices architecture.
3. Knowledge of DevOps tools and CI/CD pipelines.

Python Engineer (Big Data) in Dubai: Design scalable backend systems using Python, collaborate on data pipelines, and leverage Big Data tech like Hadoop and Spark. Experience required.

Location: Dubai, UAE

Type: Full-Time

Are you passionate about building scalable backend systems that handle vast amounts of data? Do you have a deep understanding of Python engineering and experience working with Big Data technologies? If so, we want to hear from you!

What You'll Do:

1. Design, build, and maintain scalable and robust backend services using Python.
2. Work on data pipelines, transforming large datasets into meaningful insights.
3. Collaborate with data scientists, engineers, and product teams to optimize system performance.
4. Leverage your knowledge in Big Data technologies (e.g., Snowflake, Hadoop, Spark, Kafka) to create data-driven solutions.
5. Ensure smooth data flow and storage across various systems, ensuring high availability and fault tolerance.
6. Continuously improve codebase quality through testing, peer review, and adherence to best practices.

What We're Looking For:

1. Proven experience as a Backend Engineer with a focus on Python.
2. Strong understanding of Big Data architectures and tools (e.g., Hadoop, Spark, Flink, etc.).
3. Experience with data engineering concepts, including ETL pipelines, data warehousing, and real-time streaming.
4. Proficiency in cloud platforms (AWS, GCP, Azure) and containerization technologies (Docker, Kubernetes).
5. Solid experience with relational and non-relational databases (e.g., PostgreSQL, MongoDB, Cassandra).
6. Problem-solving mindset with a strong ability to debug and optimize code.
7. Excellent communication skills and a team player.

Bonus Points:

1. Familiarity with machine learning models and data science workflows.
2. Experience with RESTful API design and microservices architecture.
3. Knowledge of DevOps tools and CI/CD pipelines.

Interested?

We are looking for an experienced freelance trainer to conduct a 3-day workshop on Big Data Fundamentals for a professional audience in Abu Dhabi. The trainer should be able to deliver engaging, practical, and interactive sessions that combine theory with real-world applications.

This workshop aims to introduce participants to the core principles of big data, its tools, technologies, and how data-driven insights can enhance decision-making and business strategy.

Indicative Learning Areas:

• Understanding big data concepts and architecture
• Overview of data processing frameworks (e.g., Hadoop, Spark)
• Data storage, management, and analytics fundamentals
• Practical applications and case studies in business and technology

The final course content and detailed outline are expected to be provided by the trainer.

• Qualification in Data Science, Computer Science, IT, or related field
• Minimum 5 years of professional or training experience in data analytics or big data technologies
• Strong communication and facilitation skills
• Must be available to deliver the training in person at Yas Island, Abu Dhabi

Interested trainers are invited to apply with the following:

• Updated CV or professional profile
• Relevant training experience
• Proposed hourly rate (inclusive of course content preparation, outline development, and transport costs)

Course Title: Big Data FundamentalsLocation: Eton Abu Dhabi, Yas IslandDates: 3 days workshop

We are looking for an experienced Freelance Trainer to conduct a 3-day workshop on Big Data Fundamentals  for a professional audience in Abu Dhabi. The trainer should be able to deliver engaging, practical, and interactive sessions that combine theory with real-world applications.

This workshop aims to introduce participants to the core principles of big data, its tools, technologies, and how data-driven insights can enhance decision-making and business strategy.

Indicative Learning Areas:

Understanding big data concepts and architecture

Overview of data processing frameworks (e.g., Hadoop, Spark)

Data storage, management, and analytics fundamentals

Practical applications and case studies in business and technology

The final course content and detailed outline are expected to be provided by the trainer.

Qualification in Data Science, Computer Science, IT, or related field

Minimum 5 years of professional or training experience in data analytics or big data technologies

Strong communication and facilitation skills

Must be available to deliver the training in person at Yas Island, Abu Dhabi

Interested trainers are invited to apply with the following:

Updated CV or professional profile

Relevant training experience

Proposed hourly rate (inclusive of course content preparation, outline development, and transport costs)

Job Title: Senior Data Engineer - Big Data/ Hadoop Ecosystem

Job Type: Full-time

Location: On-site Dubai, Dubai, United Arab Emirates

Join our team as a Senior Data Engineer - Big Data/ Hadoop Ecosystem, where you will take the technical lead on pioneering data initiatives within the banking sector. Leveraging your expertise in the Hadoop ecosystem, you will architect, build, and optimize large-scale data systems while mentoring a talented team of data engineers. If you thrive in highly collaborative, asynchronous environments and are passionate about delivering robust data solutions, this role is for you.

• Design, develop, and optimize scalable data processing systems using the Hadoop ecosystem (HDFS, MapReduce, Hive, Pig, HBase, Flume, Sqoop) and other Big Data technologies.
• Lead, mentor, and inspire a team of data engineers, ensuring timely and high-quality project delivery.
• Engineer, tune, and maintain complex data pipelines in Java, MapReduce, Hive, and Spark, including implementing stream-processing with Spark-Streaming.
• Design and build efficient dimensional data models and scalable architectures to empower analytics and business intelligence.
• Oversee data integrity analysis, deployment, validation, and auditing of data models for accuracy and operational excellence.
• Leverage advanced SQL skills for performance tuning and optimization of data jobs.
• Collaborate with business intelligence teams to deliver industry-leading dashboards and data products.

• 10+ years of hands-on experience as a Big Data Engineer, with deep technical expertise in the Hadoop ecosystem (Cloudera preferred), Apache Spark, and distributed data frameworks.
• Proven experience leading backend/distributed data systems teams while remaining technically hands-on.
• Advanced proficiency in Java for MapReduce development, as well as strong skills in Python and/or Scala.
• Expertise in Big Data querying tools including Hive, Pig, and Impala.
• Strong experience with both relational (Postgres) and NoSQL databases (Cassandra, HBase).
• Solid understanding of dimensional data modeling and data warehousing principles.
• Proficient in Linux/Unix systems and shell scripting.

• Experience with Azure cloud services (Azure Data Lake, Databricks, HDInsight).
• Knowledge of stream-processing frameworks such as Spark-Streaming or Storm.
• Background in Financial Services or Banking industry, with exposure to data science and machine learning tools.

Join us to work collaboratively with our talented team of dynamic and passionate engineers to deliver capabilities that enable our customers to make a difference. You'll deploy and operate ArcGIS Velocity and ArcGIS Workflow Manager SaaS solutions. You will also have the opportunity to design, deploy, and operate next-generation real-time and big data GIS software-as-a-service (SaaS) capabilities for thousands of cloud users worldwide.

Our teams have a broad mix of experience levels and tenures that support an environment that promotes professional development. We care about your career growth and strive to assign projects based on what will help each team member develop into a better-rounded engineer and enable them to take on more complex tasks in the future.

Our team also puts a high value on work-life balance, and we understand that striking a healthy balance between your personal and professional life is crucial to your happiness and success here. We offer a flexible hybrid schedule so you can have a more productive and well-balanced life both in and outside of work.

• Collaborate with a team of SRE engineers to operate SaaS capabilities across multiple regions on the cloud platform
• Design, implement, configure, and utilize monitoring systems to monitor the health of SaaS products
• Manage infrastructure used for ArcGIS Velocity and ArcGIS Workflow Manager, respond to alerts, and troubleshoot problems to resolution
• Develop, implement, and maintain automation solutions for repetitive operational tasks, such as deployment pipelines, incident resolution, and scaling processes
• Design and implement the deployment and upgrade containerized micro-service components that, when combined, power Esri’s SaaS offerings
• Create and automate Git workflows to simplify code integration, testing, and infrastructure deployments
• Participate in technical spike efforts, bringing new innovative ideas to future versions of our software
• Troubleshoot the system incidents and provide root cause analysis reports
• Provide rotational on-call technical support

• 5+ years of experience managing Kubernetes (EKS), logging and monitoring (ELK, Prometheus), and container technologies (Docker)
• Proficient in using Terraform for automating infrastructure provisioning and management
• Ability to design and automate Git workflows for streamlined code integration, testing, and infrastructure deployment
• Ability to write scripts to deploy infrastructure and/or applications (Bash, Python, Terraform)
• Expert level understanding and experience with cloud computing platforms (AWS or Microsoft Azure)
• Strong knowledge of Linux Operating system administration, including troubleshooting, performance tuning, and shell scripting
• Proficient in cloud networking, including VPCs, subnets, security groups, and VPNs in platforms like AWS or Azure
• Skilled in identifying and resolving system and application issues through effective troubleshooting and root cause analysis
• Working knowledge of a source control and issue management system
• Bachelor’s in computer science, computer engineering, GIS, or information systems

• Experience designing, administering, and/or maintaining cloud environments, such as AWS or Azure, supporting 24×7 high-availability production environments
• Interest in working with GitOps principles to automate the deployment of applications on Kubernetes clusters
• Certifications: AWS Certified Solution Architect Associate, CKA/CKAD or similar
• Experience managing OpenSearch (datastore or logstore), and Kafka for managing distributed data streams and ensuring high availability in large-scale systems
• Ability to work with continuous integration and delivery best practices
• Knowledge of operating resilient, highly available, scalable, and performance SaaS capabilities
• Knowledge of Esri ArcGIS or other web mapping technologies
• Working knowledge of GitHub

#LI-DR5

#LI-Hybrid

At Esri, diversity is more than just a word on a map. When employees of different experiences, perspectives, backgrounds, and cultures come together, we are more innovative and ultimately a better place to work. We believe in having a diverse workforce that is unified under our mission of creating positive global change. We understand that diversity, equity, and inclusion is not a destination but an ongoing process. We are committed to the continuation of learning, growing, and changing our workplace so every employee can contribute to their life’s best work. Our commitment to these principles extends to the global communities we serve by creating positive change with GIS technology. For more information on Esri’s Racial Equity and Social Justice initiatives, please visit our website here .

If you don’t meet all of the preferred qualifications for this position, we encourage you to still apply!

Esri is an equal opportunity employer (EOE) and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status, or any other characteristic protected by law. If you need reasonable accommodation for any part of the employment process, please email and let us know the nature of your request and your contact information. Please note that only those inquiries concerning a request for reasonable accommodation will be responded to from this e-mail address.

Esri Privacy Esri takes our responsibility to protect your privacy seriously. We are committed to respecting your privacy by providing transparency in how we acquire and use your information, giving you control of your information and preferences, and holding ourselves to the highest national and international standards, including CCPA and GDPR compliance.

Join us at Enquo, where we're dedicated to harnessing the transformative power of data and technology. As leaders in technology and data solutions, we prioritize humanity in everything we do. Our mission is clear: to empower organizations to unlock the full potential of their data through cutting-edge technology and exceptional services.

We envision a brighter future, where technology ignites extraordinary achievements and drives profound transformation. Here at Enquo, challenges are opportunities, and our passionate team thrives on making meaningful impacts on society. With humility and a collaborative spirit, we leverage teamwork and creative thinking to deliver optimal and trustworthy solutions.

Asa purpose-driven company, were passionate about using data and technology as catalysts for positive change. Our vision extends to a world where everyone can harness the power of data to reach their fullest potential. At Enquo, honesty, trust, and empathy form the foundation of our simple business language. Were agile, adaptable, and committed to bridging any business need with innovative data solutions.

Join our journey, where curiosity and entrepreneurship drive us to explore uncharted territories and create solutions that truly matter. We foster a collaborative and inclusive environment, valuing every team member's contributions. If you're a talented, curious, and creative individual who thrives in a fast-paced, dynamic setting, we invite you to be part of our mission. Together, let's create new opportunities through data and technology, shaping a more humane future for all.

Enquo: fueling a better future through innovation, data, and technology.

The Master Data Management Lead will be responsible for defining, designing, and building dimensional databases to meet business needs. Assisting in the application and implementation procedures of data standards and guidelines coding structures and data replication to ensure access to and integrity of data sets.

• Excellent experience in Master Data Management including include Meta-Data Management, Data Migration, Data Security and Data Transformation/Conversion
• Experience in ETL processes and advanced SQL skills.
• Intermediate Requirements Gathering/Elicitation, Documentation, and Source to Target mapping skills.
• Working knowledge of Conceptual, Logical and Physical Data Modeling concepts as well as Database design concepts
• Practical experience working in an Agile Methodology

• Bachelor’s or master’s degree in computer science, Information Technology, or a related field.
• Proven experience in data quality management, with at least 8 years of experience in a leadership role.
• Strong understanding of data quality frameworks, tools, and methodologies.
• Proficiency in SQL and experience working with data profiling tools.
• Excellent analytical and problem-solving skills.
• Leadership and team management abilities.
• Effective communication and collaboration skills.
• Familiarity with data governance principles is a plus.