33 Big Data Technologies jobs in Dubai

Shape the Future of Data Engineering

We're seeking a seasoned data engineering expert to lead our efforts in building a cutting-edge data foundation. As a key member of our team, you'll have the opportunity to design and implement scalable data systems that support real-time and batch analytics and operations.

• Data Architecture Expertise : You'll be responsible for architecting data systems that ensure data quality, speed, and scalability, using GCP, Airflow, BigQuery, dbt, and Dataflow.
• Pipeline Development : You'll build end-to-end pipelines to deliver high-quality data products, working closely with cross-functional teams to ensure seamless collaboration.
• Data Governance : You'll establish robust data governance and quality rules to promote transparency, trust, and compliance throughout the organization.
• Leadership and Collaboration : As a leader, you'll work with teams to drive impactful data products and initiatives, fostering a culture of innovation and excellence.

This is an exciting opportunity to join a fast-scaling company and make a meaningful impact on its growth and success. If you're passionate about data engineering and want to take your skills to the next level, we encourage you to apply.

Requirements:

• GCP Expertise : Proven experience with Google Cloud Platform, including BigQuery, Dataflow, Airflow, dbt, and Python.
• Advanced SQL Skills : Strong expertise in advanced SQL querying and performance tuning.
• Collaboration and Leadership : Ability to work effectively with cross-functional teams and lead by example.

What We Offer:

• Autonomy and Ownership : You'll have the freedom to drive strategy and make decisions that impact the company's growth and success.
• Continuous Learning : We prioritize professional development and offer opportunities for growth and learning.

About Us:

We're a dynamic and forward-thinking organization dedicated to delivering innovative solutions and driving business growth. Our mission is to empower our customers with cutting-edge technology and expertise.

As the Head of Data Engineering, you will be responsible for designing, implementing, and maintaining a robust, scalable, and compliant data architecture that supports our exchange’s operations, analytics, and regulatory reporting requirements. You will lead a team of data engineers, ensuring high availability, security, and performance of our data infrastructure. You will work closely with stakeholders across technology, compliance, risk, and product teams to develop data pipelines, warehouses, and real-time analytics capabilities.

This is a strategic yet hands-on role where you will drive data engineering best practices, scalability, and automation while ensuring compliance with regulatory data requirements for a financial services entity.

Data Architecture & Strategy :

1. Define and own the data architecture strategy for the exchange, ensuring it is scalable, secure, and regulatory-compliant.
2. Design and implement data modeling, governance, and security frameworks to meet financial and regulatory requirements.
3. Architect real-time and batch processing data pipelines to handle trade data, order books, user activity, and market analytics.
4. Optimize data storage and retrieval for performance and cost efficiency, leveraging cloud-based and hybrid solutions.
5. Build and maintain ETL / ELT data pipelines for operational, analytical, and compliance-related data.
6. Ensure high data quality, reliability, and availability through robust monitoring, alerting, and data validation techniques.
7. Manage and enhance data warehouses, data lakes, and streaming platforms to support business intelligence and machine learning use cases.
8. Oversee database design and optimization for transactional and analytical workloads (e.g., Aurora, Redis, Kafka).
9. Implement data lineage, metadata management, and access control mechanisms in line with compliance requirements.

Compliance, Security & Risk Management :

1. Work closely with compliance and risk teams to ensure data retention policies, audit trails, and reporting mechanisms meet regulatory requirements (e.g., FATF, AML, GDPR, MiCA).
2. Implement encryption, anonymization, and access control policies to safeguard sensitive user and transaction data.
3. Support fraud detection and risk monitoring through data analytics and alerting frameworks.

Leadership & Team Management :

1. Lead, mentor, and grow a small team of data engineers, fostering a culture of collaboration, innovation, and accountability.
2. Drive best practices in data engineering, DevOps for data, and CI / CD automation for analytics infrastructure.
3. Collaborate with software engineers, DevOps, data analysis, and product teams to integrate data solutions into the broader exchange ecosystem.

Technical competencies and skills :

1. Proven experience in data architecture and engineering, preferably within a regulated financial or crypto environment.
2. Strong proficiency in SQL, Python, or Scala for data engineering.
3. Experience with cloud-based data platforms (AWS, GCP, or Azure) and orchestration tools (Airflow, Prefect, Dagster).
4. Hands-on experience with real-time data processing (Kafka, Pulsar, Flink, Spark Streaming).
5. Expertise in data warehousing solutions (Snowflake, BigQuery, Redshift, Databricks).
6. Strong understanding of database design, indexing strategies, and query optimization.
7. Experience implementing data governance, lineage, and cataloging tools.
8. Familiarity with blockchain / crypto data structures and APIs is a plus.

Leadership & Strategic Skills :

1. Experience leading and mentoring a team of data engineers.
2. Ability to design data strategies that align with business goals and regulatory requirements.
3. Strong cross-functional collaboration skills with compliance, risk, and technology teams.
4. Ability to work in a fast-paced, high-growth startup environment with a hands-on approach.

Industry & Compliance Knowledge :

1. Experience in regulated financial markets, fintech, or crypto is highly preferred.
2. Familiarity with financial data standards, KYC / AML reporting, and regulatory requirements related to data handling.

Preferred Qualifications :

1. Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.
2. Certifications in cloud data engineering (AWS / GCP / Azure), data governance, or security are a plus.
3. Experience working in a crypto exchange, trading platform, or high-frequency trading environment is an advantage.

At M2, we believe in a workplace where talent, dedication, and passion are the only factors that count, regardless of gender, background, age, and other characteristics. We embrace diversity because we know that it fuels innovation, fosters creativity, and drives success. So, if you're ready to join a team where your potential is truly valued, welcome aboard!

Join to apply for the Head of Data Engineering role at M2

3 weeks ago Be among the first 25 applicants

Join to apply for the Head of Data Engineering role at M2

Get AI-powered advice on this job and more exclusive features.

As the Head of Data Engineering, you will be responsible for designing, implementing, and maintaining a robust, scalable, and compliant data architecture that supports our exchange’s operations, analytics, and regulatory reporting requirements. You will lead a team of data engineers, ensuring high availability, security, and performance of our data infrastructure. You will work closely with stakeholders across technology, compliance, risk, and product teams to develop data pipelines, warehouses, and real-time analytics capabilities.

This is a strategic yet hands-on role where you will drive data engineering best practices, scalability, and automation while ensuring compliance with regulatory data requirements for a financial services entity.

Key Responsibilities

Data Architecture & Strategy :

• Define and own the data architecture strategy for the exchange, ensuring it is scalable, secure, and regulatory-compliant.
• Design and implement data modeling, governance, and security frameworks to meet financial and regulatory requirements.
• Architect real-time and batch processing data pipelines to handle trade data, order books, user activity, and market analytics.
• Optimize data storage and retrieval for performance and cost efficiency, leveraging cloud-based and hybrid solutions.

Data Engineering & Infrastructure :

Compliance, Security & Risk Management :

Leadership & Team Management :

Technical competencies and skills :

Leadership & Strategic Skills :

Industry & Compliance Knowledge :

Preferred Qualifications :

At M2, we believe in a workplace where talent, dedication, and passion are the only factors that count, regardless of gender, background, age, and other characteristics. We embrace diversity because we know that it fuels innovation, fosters creativity, and drives success. So, if you're ready to join a team where your potential is truly valued, welcome aboard!

Seniority level

Seniority level

Not Applicable

Employment type

Employment type

Full-time

Job function

Job function

Other

Referrals increase your chances of interviewing at M2 by 2x

Get notified about new Head of Engineering jobs in Dubai, Dubai, United Arab Emirates .

Dubai, Dubai, United Arab Emirates 21 hours ago

Director : Engineering Ports and Terminals - SSA Region

Head of Engineering (Relocate to Bangkok)

Dubai, Dubai, United Arab Emirates 7 hours ago

Dubai, Dubai, United Arab Emirates 7 hours ago

Head of Engineering, Architecture, and Delivery

Head of Engineering - Linux Platform & Automation

Dubai, Dubai, United Arab Emirates 7 hours ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

J-18808-Ljbffr

Job ID: 2969745 | PT Amazon Data Srvcs Indonesia

The Infrastructure Operations (Data Center) Team is the backbone of AWS, supporting the rapidly growing AWS business and customers 24/7. We are committed to maintain the physical infrastructure of AWS, ensuring the standards for operational performance in the areas of safety, security, availability, productivity, capacity, efficiency, and cost.

In the Infrastructure Operations (Data Center) Team, you will have the chance to work on the most advanced technologies in a DYNAMIC environment with expanding opportunities.

If you enjoy working in a strong and close-knit diverse team, Infrastructure Operations (Data Center) Team is the place to be

Data Center Engineering Operation (DCEO) is seeking for individuals who are motivated, self-starter, eager to learn, passionate and committed to join us. You will spend 9 months on the trainee program and by the end of it, your progression will be evaluated to see if you have what it takes to join our successful team and be a full time Amazonian.

About the team
About AWS

Diverse Experiences
AWS values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn't followed a traditional path, or includes alternative experiences, don't let it stop you from applying.

Why AWS?
Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that's why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.

Inclusive Team Culture
Here at AWS, it's in our nature to learn and be curious. Our employee-led affinity groups foster a culture of inclusion that empower us to be proud of our differences. Ongoing events and learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences, inspire us to never stop embracing our uniqueness.

Mentorship & Career Growth
We're continuously raising our performance bar as we strive to become Earth's Best Employer. That's why you'll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional.

Work/Life Balance
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there's nothing we can't achieve in the cloud.

• Graduated from Mechanical engineering, Electrical engineering, Instrumentation engineering or Physics engineering discipline

• Interest in maintenance of a Data Centre or Critical space facility

• Strong attention to detail and ability to prioritize in complex, fast-paced environment

• Degree/Diploma in Electrical & Electronics/Mechanical/Instrumentation/Physic related Engineering discipline

• Excellent English communication skills (both verbal and written)

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

Posted: June 5, 2025 (Updated about 2 hours ago)

Posted: June 12, 2025 (Updated about 2 hours ago)

Posted: June 12, 2025 (Updated about 3 hours ago)

Posted: June 12, 2025 (Updated about 4 hours ago)

Posted: February 26, 2025 (Updated about 4 hours ago)

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

A software development company is looking for a talented, long-term Lead DS Researcher.

We’re looking for a Lead Data Science Researcher who thrives in research-heavy environments and enjoys exploring uncharted territory with the support of a strong technical team.

This is a unique opportunity to drive forward new ideas and applications, not just optimize existing ones.

About the company

Company Top Remote Talent

The company is a team of experts providing analytical services to healthcare clients. You will join an international team of first class professionals who are passionate to create products that improve quality of medical services.

Responsibilities

You will lead a compact team of two data scientists, guiding them on high-impact research initiatives and experimental projects. Your role will involve pushing the boundaries of applied machine learning — especially in the context of medical and clinical data — and turning complex problems into innovative solutions.

Requirements

**What we’re looking for:**Exceptional analytical and statistical skills-comfortable with uncertainty, inference, and experimentation;

Strong background in different areas of ML (traditional classification and regression techniques, recommender systems, text data, clustering, etc.);

Solid experience with deep learning frameworks like PyTorch or TensorFlow;

Excellent Python skills (beyond Jupyter Notebooks) - ability to build clean, testable, production-ready code;

Familiarity with medical or life science data is a strong plus;

Expertise in SQL, Pandas, Scikit-learn, and modern data workflows;

Comfortable working in Google Cloud Platform (GCP) environments.

**Bonus points for experience with:**State-of-the-art NLP models, Transformers, Agentic Approaches for mixed (temporal and text) data analysis and summarization;

Experience with pipeline orchestration tools like Airflow, Argo, etc.;

Proven Experience with Anomaly Detection and Forecasting with explainability for temporal and mixed data;

Intermediate+ English — ability to participate in written discussions with international teams and clients.

Working conditions

**Benefits:**Join a mission-driven team working at the intersection of data, medicine, and impact;

Work on meaningful challenges with long-term value for public health and healthcare quality;

Collaborate with top-tier experts in a culture that values curiosity, autonomy, and innovation;

Fully remote-friendly setup with flexibility and trust at the core.

Log In Only registered users can open employer contacts.

A software development company is looking for a talented, long-term Lead DS Researcher.

We’re looking for a Lead Data Science Researcher who thrives in research-heavy environments and enjoys exploring uncharted territory with the support of a strong technical team.

This is a unique opportunity to drive forward new ideas and applications, not just optimize existing ones.

About the company

Company Top Remote Talent

The company is a team of experts providing analytical services to healthcare clients. You will join an international team of first class professionals who are passionate to create products that improve quality of medical services.

Responsibilities

You will lead a compact team of two data scientists, guiding them on high-impact research initiatives and experimental projects. Your role will involve pushing the boundaries of applied machine learning — especially in the context of medical and clinical data — and turning complex problems into innovative solutions.

Requirements

**What we’re looking for:**Exceptional analytical and statistical skills-comfortable with uncertainty, inference, and experimentation;

Strong background in different areas of ML (traditional classification and regression techniques, recommender systems, text data, clustering, etc.);

Solid experience with deep learning frameworks like PyTorch or TensorFlow;

Excellent Python skills (beyond Jupyter Notebooks) - ability to build clean, testable, production-ready code;

Familiarity with medical or life science data is a strong plus;

Expertise in SQL, Pandas, Scikit-learn, and modern data workflows;

Comfortable working in Google Cloud Platform (GCP) environments.

**Bonus points for experience with:**State-of-the-art NLP models, Transformers, Agentic Approaches for mixed (temporal and text) data analysis and summarization;

Experience with pipeline orchestration tools like Airflow, Argo, etc.;

Proven Experience with Anomaly Detection and Forecasting with explainability for temporal and mixed data;

Intermediate+ English — ability to participate in written discussions with international teams and clients.

Working conditions

**Benefits:**Join a mission-driven team working at the intersection of data, medicine, and impact;

Work on meaningful challenges with long-term value for public health and healthcare quality;

Collaborate with top-tier experts in a culture that values curiosity, autonomy, and innovation;

Fully remote-friendly setup with flexibility and trust at the core.

Log In Only registered users can open employer contacts.

We are seeking an experienced Senior Lead Data Scientist to join our team.

• Minimum 10+ years of overall experience with extensive experience in AI/ML or data science, with at least 2-3 years in a leadership role.
• Proven experience in banking or financial services is highly preferred.
• Hands-on with AI/ML frameworks (e.g., TensorFlow, PyTorch, Scikit-learn) and tools (Python, SQL, Spark).
• Experience with end-to-end model lifecycle management and MLOps.
• Proven leadership in managing high-performing AI/ML teams.
• Strong understanding of statistical modeling, machine learning, deep learning, and NLP.
• Experience deploying models in production (on-prem/cloud).
• Strategic thinking with strong stakeholder management and influencing capabilities.
• High level of ethics and regulatory awareness in deploying AI in banking.
• Excellent verbal and written communication skills.

Referrals increase your chances of interviewing by 2x.

Sign in to set job alerts for related roles.

We are currently seeking a skilled professional for our data science team. Below are the key requirements and responsibilities of this role.

The Senior Data Scientist will be responsible for leading complex data projects, developing predictive models, and analyzing large datasets to drive business decisions.

• Advanced knowledge of statistical and data mining techniques (regression, decision trees, clustering, neural networks)
• Knowledge of additional programming languages (Python, C, Java) is highly desirable
• Strong problem-solving and quantitative skills, with intellectual curiosity
• Proven leadership skills, with the ability to inspire others and create a followership
• Excellent communication skills, capable of conveying analytical and technical content clearly

1. Bachelor's degree in a quantitative field such as Computer Science, Engineering, Statistics, Mathematics
2. 8-10 years of hands-on experience in mathematical modeling within a business environment
3. Proven experience working with large datasets and relational databases (SQL)
4. Strong knowledge of one or more data science or decision science domains
5. Ability to articulate analytic processes from start to finish

• Joining timeframe: within 2 weeks, maximum 1 month
• Remote Work: No
• Employment Type: Full-time

Principle Responsibilities & Key Results Area

1. Identify innovation opportunities related to data and data processes to help clients implement fact-based decisioning within their cards and payments programs.
2. Focus on transaction data modeling and analytics for cards and payments products, collaborating with Business Managers, Consultants, and Data Scientists from Visa and client organizations to co-create and deploy data-driven solutions.
3. Work with regional and global Data Science teams to develop high-quality analytic products that support Visa's growth.
4. Create scalable frameworks for Gen AI and ML models.
5. Introduce cutting-edge tools and techniques to keep Visa at the forefront of Data Science advancements.
6. Develop innovative analytic methods to address complex business challenges.
7. Drive the commercialization of scalable assets such as models, dashboards, and solutions.
8. Collaborate with Technology and Data Engineering teams to leverage Visa's platforms and broader ecosystem for client needs.
9. Share and build global best practices and knowledge within the team.
10. Promote innovative, scalable ideas with market demand.
11. Ensure compliance with Model Risk Management, Visa Analytics Rules, and Global Privacy standards to maintain Visa's market reputation.
12. Coordinate with Data Engineering and Data Science teams and vendors to meet business needs, ensuring quality and performance.
13. Engage with VCA CEMEA Service Line Leads to identify market opportunities, gather requirements, and support go-to-market strategies.
14. Work with Global Practice Leads to incorporate best practices and leverage global solutions.
15. Manage relationships with external vendors and agencies, supervise deliveries, and support recruitment and onboarding.
16. Develop new tools and techniques in collaboration with teams and consultants for future activities.
17. Oversee project budgets and resources.
18. Coordinate with internal teams like Finance, Audit, Legal, Tax, and Sourcing to optimize vendor and client engagement processes.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Qualifications :

1. Minimum of 10 years of experience applying Machine Learning solutions to business problems, with production experience in model development.
2. Experience using GenAI to solve business challenges.
3. Postgraduate degree (Masters or PhD) in a quantitative field such as Statistics, Mathematics, Data Science, Operational Research, Computer Science, Informatics, Economics, or Engineering.
4. Experience in Card & Payments markets globally, especially in payments, retail banking, or retail merchant industries.
5. Strong understanding of Payments and Banking industry verticals.
6. Expertise in data, market intelligence, business intelligence, and AI tools, with the ability to incorporate new techniques.
7. Proven track record in commercializing analytical solutions.
8. Experience managing large projects with cross-functional teams, resource planning, and delivery.
9. Ability to present ideas and analyses effectively to diverse stakeholders.
10. Proven results delivery within scope, timeline, and budget.
11. Strong people and project management skills.

1. Expertise in distributed computing environments/big data platforms (Hadoop, Elasticsearch, etc.) and database systems (SQL, Hive, HBase, etc.).
2. Familiarity with Linux, Shell Scripting, and IDEs like Jupyter Notebooks.
3. Strong programming skills in Python, R, Scala, SQL.
4. Experience designing solution architectures with APIs and microservices.
5. Knowledge of techniques like Regression, Decision Trees, Neural Networks, and others listed.
6. Expertise in advanced data mining and statistical modeling techniques.

1. Integrity, maturity, and a constructive approach to challenges.
2. Role modeling Visa values.
3. Striving for excellence and results.
4. Sound judgment and decision-making aligned with business needs.
5. Resource allocation across multiple business lines and geographies.
6. Influencing senior management and stakeholders.
7. Change management leadership.
8. Fluency in English is mandatory.

Additional Information :

Visa is an EEO Employer. Qualified applicants will receive consideration without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, or protected veteran status. Visa also considers qualified applicants with criminal histories in accordance with EEOC guidelines and applicable laws.

Remote Work : No

Employment Type : Full-time