32 Big Data Technologies jobs in Dubai

As the Head of Data Engineering, you will be responsible for designing, implementing, and maintaining a robust, scalable, and compliant data architecture that supports our exchange's operations, analytics, and regulatory reporting requirements. You will lead a team of data engineers, ensuring high availability, security, and performance of our data infrastructure. You will work closely with stakeholders across technology, compliance, risk, and product teams to develop data pipelines, warehouses, and real-time analytics capabilities.

This is a strategic yet hands-on role where you will drive data engineering best practices, scalability, and automation while ensuring compliance with regulatory data requirements for a financial services entity.

Data Architecture & Strategy :

1. Define and own the data architecture strategy for the exchange, ensuring it is scalable, secure, and regulatory-compliant.
2. Design and implement data modeling, governance, and security frameworks to meet financial and regulatory requirements.
3. Architect real-time and batch processing data pipelines to handle trade data, order books, user activity, and market analytics.
4. Optimize data storage and retrieval for performance and cost efficiency, leveraging cloud-based and hybrid solutions.
5. Build and maintain ETL / ELT data pipelines for operational, analytical, and compliance-related data.
6. Ensure high data quality, reliability, and availability through robust monitoring, alerting, and data validation techniques.
7. Manage and enhance data warehouses, data lakes, and streaming platforms to support business intelligence and machine learning use cases.
8. Oversee database design and optimization for transactional and analytical workloads (e.g., Aurora, Redis, Kafka).
9. Implement data lineage, metadata management, and access control mechanisms in line with compliance requirements.

Compliance, Security & Risk Management :

1. Work closely with compliance and risk teams to ensure data retention policies, audit trails, and reporting mechanisms meet regulatory requirements (e.g., FATF, AML, GDPR, MiCA).
2. Implement encryption, anonymization, and access control policies to safeguard sensitive user and transaction data.
3. Support fraud detection and risk monitoring through data analytics and alerting frameworks.

Leadership & Team Management :

1. Lead, mentor, and grow a small team of data engineers, fostering a culture of collaboration, innovation, and accountability.
2. Drive best practices in data engineering, DevOps for data, and CI / CD automation for analytics infrastructure.
3. Collaborate with software engineers, DevOps, data analysis, and product teams to integrate data solutions into the broader exchange ecosystem.

Technical competencies and skills :

1. Proven experience in data architecture and engineering, preferably within a regulated financial or crypto environment.
2. Strong proficiency in SQL, Python, or Scala for data engineering.
3. Experience with cloud-based data platforms (AWS, GCP, or Azure) and orchestration tools (Airflow, Prefect, Dagster).
4. Hands-on experience with real-time data processing (Kafka, Pulsar, Flink, Spark Streaming).
5. Expertise in data warehousing solutions (Snowflake, BigQuery, Redshift, Databricks).
6. Strong understanding of database design, indexing strategies, and query optimization.
7. Experience implementing data governance, lineage, and cataloging tools.
8. Familiarity with blockchain / crypto data structures and APIs is a plus.

Leadership & Strategic Skills :

1. Experience leading and mentoring a team of data engineers.
2. Ability to design data strategies that align with business goals and regulatory requirements.
3. Strong cross-functional collaboration skills with compliance, risk, and technology teams.
4. Ability to work in a fast-paced, high-growth startup environment with a hands-on approach.

Industry & Compliance Knowledge :

1. Experience in regulated financial markets, fintech, or crypto is highly preferred.
2. Familiarity with financial data standards, KYC / AML reporting, and regulatory requirements related to data handling.

Preferred Qualifications :

1. Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.
2. Certifications in cloud data engineering (AWS / GCP / Azure), data governance, or security are a plus.
3. Experience working in a crypto exchange, trading platform, or high-frequency trading environment is an advantage.

At M2, we believe in a workplace where talent, dedication, and passion are the only factors that count, regardless of gender, background, age, and other characteristics. We embrace diversity because we know that it fuels innovation, fosters creativity, and drives success. So, if you're ready to join a team where your potential is truly valued, welcome aboard

In this pivotal role, you'll embark on an 18-month journey that empowers, challenges, and shapes you into a future leader.

You will explore the business through three tailored 3-month rotations, gaining multi-dimensional exposure and practical insights. In Phase 2, you'll dive deeper into a final 9-month strategic assignment, driving meaningful impact and solving real-world challenges.

This track immerses you in the critical domain of data management and engineering. Through rotations in Data Engineering, Data Products, and Data Integrity, you will develop expertise in designing, building, and maintaining robust data infrastructures and solutions.

• Key Requirements:
• Academic background in IT, Information Security, or Data Engineering
• Strong analytical and technical problem-solving skills
• Knowledge of data architecture, pipelines, and governance
• Attention to detail and commitment to data quality

Upon successful completion of the program, you'll be offered a permanent role at the next career level – the next phase of our Future Leader Journey.

• Enriching, real-world assignments
• Leadership exposure and mentorship
• Development opportunities tailored to your journey
• Access to a competitive benefits package including remote work flexibility and exclusive employee discounts

Job Summary

As the chief architect of data engineering, you will be responsible for designing and implementing a robust and scalable data architecture that supports operations, analytics, and regulatory reporting requirements.

You will lead a team of data engineers, ensuring high availability, security, and performance of our data infrastructure. You will work closely with stakeholders across technology, compliance, risk, and product teams to develop data pipelines, warehouses, and real-time analytics capabilities.

This is a strategic yet hands-on role where you will drive data engineering best practices, scalability, and automation while ensuring compliance with regulatory data requirements.

• Define and Own Data Architecture Strategy : Design and implement a data architecture strategy that ensures scalability, security, and regulatory compliance.
• Design and Implement Data Modeling, Governance, and Security Frameworks : Develop data modeling, governance, and security frameworks to meet financial and regulatory requirements.
• Architect Real-Time and Batch Processing Data Pipelines : Architect real-time and batch processing data pipelines to handle trade data, order books, user activity, and market analytics.
• Optimize Data Storage and Retrieval : Optimize data storage and retrieval for performance and cost efficiency, leveraging cloud-based and hybrid solutions.
• Build and Maintain ETL/ELT Data Pipelines : Build and maintain ETL/ELT data pipelines for operational, analytical, and compliance-related data.
• Ensure High Data Quality and Availability : Ensure high data quality, reliability, and availability through robust monitoring, alerting, and data validation techniques.
• Manage and Enhance Data Warehouses, Data Lakes, and Streaming Platforms : Manage and enhance data warehouses, data lakes, and streaming platforms to support business intelligence and machine learning use cases.
• Oversee Database Design and Optimization : Oversee database design and optimization for transactional and analytical workloads.
• Implement Data Lineage, Metadata Management, and Access Control Mechanisms : Implement data lineage, metadata management, and access control mechanisms in line with compliance requirements.

• Work Closely with Compliance and Risk Teams : Work closely with compliance and risk teams to ensure data retention policies, audit trails, and reporting mechanisms meet regulatory requirements.
• Implement Encryption, Anonymization, and Access Control Policies : Implement encryption, anonymization, and access control policies to safeguard sensitive user and transaction data.
• Support Fraud Detection and Risk Monitoring : Support fraud detection and risk monitoring through data analytics and alerting frameworks.

• Lead, Mentor, and Grow a Team of Data Engineers : Lead, mentor, and grow a small team of data engineers, fostering a culture of collaboration, innovation, and accountability.
• Drive Best Practices in Data Engineering : Drive best practices in data engineering, DevOps for data, and CI/CD automation for analytics infrastructure.
• Collaborate with Cross-Functional Teams : Collaborate with software engineers, DevOps, data analysis, and product teams to integrate data solutions into the broader exchange ecosystem.

• Proven Experience in Data Architecture and Engineering : Proven experience in data architecture and engineering, preferably within a regulated financial or crypto environment.
• Strong Proficiency in SQL, Python, or Scala : Strong proficiency in SQL, Python, or Scala for data engineering.
• Experience with Cloud-Based Data Platforms and Orchestration Tools : Experience with cloud-based data platforms (AWS, GCP, or Azure) and orchestration tools (Airflow, Prefect, Dagster).
• Hands-On Experience with Real-Time Data Processing : Hands-on experience with real-time data processing (Kafka, Pulsar, Flink, Spark Streaming).
• Expertise in Data Warehousing Solutions : Expertise in data warehousing solutions (Snowflake, BigQuery, Redshift, Databricks).
• Strong Understanding of Database Design, Indexing Strategies, and Query Optimization : Strong understanding of database design, indexing strategies, and query optimization.
• Experience Implementing Data Governance, Lineage, and Cataloging Tools : Experience implementing data governance, lineage, and cataloging tools.
• Familiarity with Blockchain/Crypto Data Structures and APIs : Familiarity with blockchain/crypto data structures and APIs is a plus.

• Experience Leading and Mentoring a Team of Data Engineers : Experience leading and mentoring a team of data engineers.
• Ability to Design Data Strategies that Align with Business Goals and Regulatory Requirements : Ability to design data strategies that align with business goals and regulatory requirements.
• Strong Cross-Functional Collaboration Skills : Strong cross-functional collaboration skills with compliance, risk, and technology teams.
• Ability to Work in a Fast-Paced, High-Growth Startup Environment : Ability to work in a fast-paced, high-growth startup environment with a hands-on approach.

• Experience in Regulated Financial Markets, Fintech, or Crypto : Experience in regulated financial markets, fintech, or crypto is highly preferred.
• Familiarity with Financial Data Standards, KYC/AML Reporting, and Regulatory Requirements : Familiarity with financial data standards, KYC/AML reporting, and regulatory requirements related to data handling.

Join to apply for the Manager of Data Engineering and Functional Consulting role at Dicetek LLC .

Get AI-powered advice on this job and more exclusive features.

• Bachelor's or Master's degree in Computer Science, Information Systems, Data Analytics, or a related field.
• Strong understanding of end-to-end data warehousing concepts, including data modeling, ETL/ELT, and data integration.
• Proficient in Azure Synapse, Databricks, Azure Data Factory, Snowflake, and Power BI for modern cloud-based data solutions.
• Skilled in handling structured, semi-structured (JSON, XML), and unstructured data across Azure and AWS platforms.
• Expertise in Power Query and Power M for advanced data transformation and reporting automation.
• Solid grasp of Agile methodologies, functional requirement gathering, and stakeholder communication.
• Familiar with metadata management, data lineage, and data quality principles to ensure trusted analytics.

Experience

• 10+ years of experience in designing, implementing, and optimizing end-to-end data warehouse solutions across cloud and on-premise ecosystems.
• Orchestrated enterprise DWH solutions using Azure Synapse, Databricks, and ADF, integrating structured and semi-structured data sources while ensuring lineage, auditability, and performance at scale.
• Translated business needs into scalable dimensional models and Power BI solutions, leveraging Power Query (M) scripting and DAX for self-service analytics.
• Designed and governed hybrid data pipelines across Azure and AWS, ensuring data consistency, compliance, and traceability from ingestion to visualization.
• Collaborated with stakeholders and engineering teams to define KPIs, automate reconciliations, and embed validation rules across ETL and reporting layers.
• Led multi-cloud integration of systems into a unified analytics layer, optimizing transformations with Databricks notebooks, ADF workflows, and parameterized datasets.
• Enabled real-time insights by architecting incremental refresh in Power BI and optimizing semantic models with measures, security, and models.
• Implemented data observability frameworks to proactively detect anomalies and ensure SLA adherence across reporting layers.

• Not Applicable

• Contract

• Engineering and Information Technology

• IT Services and IT Consulting

Referrals increase your chances of interviewing at Dicetek LLC by 2x.

Quantitative Developer

We are seeking a highly skilled Quantitative Developer to join our team.

This role requires someone who is extremely hard-working and dedicated to delivering high-quality solutions in every aspect of their work.

You will be working on building robust trading systems, designing and implementing trade automation systems to enhance trading efficiency and effectiveness, and collaborating with traders, researchers, and other developers to understand requirements and deliver solutions.

Careem is building the Everything App for the greater Middle East, making it easier than ever to move around, order food and groceries, manage payments, and more. Careem is led by a powerful purpose to simplify and improve the lives of people and build an awesome organisation that inspires. Since 2012, Careem has created earnings for over 2.5 million Captains, simplified the lives of over 70 million customers, and built a platform for the region’s best talent to thrive and for entrepreneurs to scale their businesses. Careem operates in over 70 cities across 10 countries, from Morocco to Pakistan.

What You'll Do

• Build a world-class team. Push your team to hone their craft, communicate expectations clearly, and build high trust through regular feedback.
• Drive world-class results. Prioritize mission-critical work, set aggressive timelines, and ensure the best ideas win by fostering an environment where all ideas are challenged.
• Design and develop robust, scalable, and high-performance data pipelines and ETL processes to extract, transform, and load data from various sources into our data warehouse or data lake.
• Monitor, troubleshoot, and resolve issues related to data quality, data consistency, and data integrity, ensuring the reliability and correctness of our data systems.
• Implement and maintain data governance practices and policies, ensuring compliance with data privacy and security regulations.
• Document data engineering processes, data flows, and system architectures to ensure knowledge sharing and maintain an up-to-date repository of technical documentation.
• Work closely with cross-functional teams, including software engineers and infrastructure teams, to optimize data infrastructure and ensure its seamless integration with other systems.

What You’ll Need

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience as a Data Engineer or in a similar role, working with large-scale data processing and ETL pipelines.
• Experience managing a team for more than 2+ years.
• Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment
• Strong programming skills in languages such as Python, Java, or Scala, with experience in data manipulation and processing frameworks like Apache Spark.
• Experience with SQL and database technologies (e.g., relational databases, SQL queries, data modeling).
• Familiarity with data integration and workflow management tools such as Apache Airflow
• Knowledge of data warehousing concepts and experience with data warehousing solutions is highly desirable.
• Strong analytical and problem-solving skills, with the ability to analyze complex data-related issues and propose effective solutions.

What we’ll provide you

We offer colleagues the opportunity to drive impact in the region while they learn and grow. As a full time Careem colleague, you will be able to:

• Work and learn from great minds by joining a community of inspiring colleagues.
• Put your passion to work in a purposeful organisation dedicated to creating impact in a region with a lot of untapped potential.
• Explore new opportunities to learn and grow every day.
• Work 4 days a week in office & 1 day from home, and remotely from any country in the world for 30 days a year with unlimited vacation days per year. (If you are in an individual contributor role in tech, you will have 2 office days a week and 3 to work from home.)
• Access to healthcare benefits and fitness reimbursements for health activities including gym, health club, and training classes.

*

indicates a required field

First Name *

Last Name *

Email *

Phone *

Location (City) *

Resume/CV *

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

Current Employer *

Current Job Title *

LinkedIn Profile *

How did you learn about a role at Careem? (tick all that apply) *

I saw the job posting on Linkedin and decided to apply

I saw the job posting on Careem’s Careers Page and decided to apply

I saw the job posting on Localized and decide to apply

A recruiter from Careem reached out to me and encouraged me to apply

A recruiter external to Careem reached out to me and encouraged me to apply

I had a conversation with a friend or acquaintance who works at Careem

I attended a University event or career fair and met a representative from Careem

I read about Careem in the news

Other

Have you seen Careem's content on social media? * Select.

If Yes, please specify the platform (tick all that apply) *

LinkedIn

Twitter

TikTok

Instagram

Other

What influenced your decision to apply for a role at Careem? (tick all that apply) *

Careem’s purpose and values

The career growth and development opportunities offered at Careem

Financial compensation and colleague benefits

The job description aligns with my skills and qualifications

Working with top talent at the organisation

Community of inspiring colleagues

The opportunity to drive impact

Other

Have you previously worked at Careem? * Select.

To which gender identity do you most identify: Select.

Voluntary Self-Identification

Completion of this question is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter.

As outlined in Careem’s Equal Employment Opportunity policy, we do not discriminate based on any protected group status under any applicable law.

The collection of demographic information is for internal purposes only i.e. equal employment opportunity monitoring as well as diversity initiatives.

A software development company is looking for a talented, long-term Lead DS Researcher.

We’re looking for a Lead Data Science Researcher who thrives in research-heavy environments and enjoys exploring uncharted territory with the support of a strong technical team.

This is a unique opportunity to drive forward new ideas and applications, not just optimize existing ones.

About the company

Company Top Remote Talent

The company is a team of experts providing analytical services to healthcare clients. You will join an international team of first class professionals who are passionate to create products that improve quality of medical services.

Responsibilities

You will lead a compact team of two data scientists, guiding them on high-impact research initiatives and experimental projects. Your role will involve pushing the boundaries of applied machine learning — especially in the context of medical and clinical data — and turning complex problems into innovative solutions.

Requirements

**What we’re looking for:**Exceptional analytical and statistical skills-comfortable with uncertainty, inference, and experimentation;

Strong background in different areas of ML (traditional classification and regression techniques, recommender systems, text data, clustering, etc.);

Solid experience with deep learning frameworks like PyTorch or TensorFlow;

Excellent Python skills (beyond Jupyter Notebooks) - ability to build clean, testable, production-ready code;

Familiarity with medical or life science data is a strong plus;

Expertise in SQL, Pandas, Scikit-learn, and modern data workflows;

Comfortable working in Google Cloud Platform (GCP) environments.

**Bonus points for experience with:**State-of-the-art NLP models, Transformers, Agentic Approaches for mixed (temporal and text) data analysis and summarization;

Experience with pipeline orchestration tools like Airflow, Argo, etc.;

Proven Experience with Anomaly Detection and Forecasting with explainability for temporal and mixed data;

Intermediate+ English — ability to participate in written discussions with international teams and clients.

Working conditions

**Benefits:**Join a mission-driven team working at the intersection of data, medicine, and impact;

Work on meaningful challenges with long-term value for public health and healthcare quality;

Collaborate with top-tier experts in a culture that values curiosity, autonomy, and innovation;

Fully remote-friendly setup with flexibility and trust at the core.

Log In Only registered users can open employer contacts.

Principle Responsibilities & Key Results Area

• Identify innovation opportunities around data and datarelated processes that will help our clients implement factbased decisioning processes within their cards and payments program
• Work entails heavy focus on transaction data modelling and analytics for cards and payments products Work with a broader team that consists of Business Managers Consultants and Data Scientists from both Visa and client organizations to strategies cocreate deploy and reap the benefits of datadriven solutions.
• Work with regional and global Data Science teams to develop highquality analytic products and solutions that promote Visas growth in the region.
• Focus on creating scalable framework for Gen AI ML models
• Keep Visa at the forefront of technological advancement in Data Science by introducing cuttingedge tools and techniques for generating business insights
• Develop nextgeneration analytic methods where existing tools and techniques are inadequate to address business challenges
• Drive commercialization of existing scalable assets (models dashboards solutions).
• Collaborate with internal Technology partners and Data Engineering function to best leverage Visas internal technology platforms data and the broader Visa ecosystem to support our clients technical data needs
• Develop share and build global best practices and knowledge management within the team
• Socialize innovative ideas and approaches that are scalable and have market demand
• Champion internal requirements around Model Risk Management Visa Analytics Rules and Global Privacy standards around client delivery to ensure that Visas highly regarded market standing is maintained
• Work closely with Data Engineering DS teams and vendors communicate the business stakeholders needs and ensure the development team delivers within established acceptance criteria including expected quality and performance.
• Drive strong collaboration with VCA CEMEA Service Line Leads (Portfolio Management Digital Risk Merchant & Acquiring Commercial) understanding the market landscape and demand identification of potential opportunities for scalable solutions collecting business requirements and supporting in market enablement and GotoMarket.
• Work with Global Practice Leads to incorporate best practice source analytical or other services and leverage global consulting solutions.
• Deliver and manage a network of external Vendor or agency partners.

  Maintain excellent relationship with vendor team atlarge supervising deliveries as needed.

  Assist in selecting recruiting inducting and onboarding of vendors

  Work with other teams and external consultants to develop new and improved tools and techniques for future Consulting activities.

• Manage the project budget and resources to perform all required duties.
• Liaise with VISA functional teams Finance Audit Legal Tax Sourcing to define and implement processes to optimize the daily engagement of vendors and the relationships with clients.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Qualifications :

Key Competencies

• Minimum of 10 years of expertise in applying Machine Learning solutions to business problems model development and production experience required
• Experience of using GenAIto solve business challenges
• Postgraduate degree (Masters or PhD) in a quantitative field such as Statistics Mathematics Data Science Operational Research Computer Science Informatics Economics or Engineering
• Experience working in one or more of the Card & Payments markets around the globe with specific responsibilities in payments retail banking or retail merchant industries
• Good understanding of Payments and the Banking industry including card verticals such as consumer credit consumer debit prepaid small business commercial and cobranded product
• Expert knowledge of data market intelligence business intelligence and AIdriven tools and technologies with demonstrated ability to incorporate new techniques to solve business problems
• Proven track record in commercializing analytical solutions.
• Experience planning organizing and managing multiple large projects with diverse crossfunctional teams including resource planning and delivery implementation Experience in presenting ideas and analysis to stakeholders whilst tailoring datadriven results to various audience levels
• Proven ability to deliver results within committed scope timeline and budget
• Very strong people/project management skills and experience

Technical Expertise

• Expertise in distributed computing environments / big data platforms (Hadoop Elasticsearch etc. as well as common database systems and value stores (SQL Hive HBase etc.
• Familiarity with both common computing environments (e.g. Linux Shell Scripting) and commonly used IDEs (Jupyter Notebooks).
• Strong programming ability in different programming languages such as Python R Scala and SQL
• Experience in drafting solution architecture frameworks that rely on APIs and microservices
• Proficient in some or all of the following techniques: Linear & Logistic Regression Decision Trees Random Forests KNearest Neighbors Markov Chain Monte Carlo Gibbs Sampling Evolutionary Algorithms (e.g. Genetic Algorithms Genetic Programming) Support Vector Machines Neural Networks etc.
• Expert knowledge of advanced data mining and statistical modeling techniques including Predictive modeling (e.g. binomial and multinomial regression ANOVA) Classification techniques (e.g. Clustering Principal Component Analysis factor analysis) Decision Tree techniques (e.g. CART CHAID)

Leadership Competencies

• Demonstrates integrity maturity and a constructive approach to business challenges
• Serves as a role model for the organization by implementing core Visa Values
• Strives for excellence and extraordinary results
• Uses sound insights and judgments to make informed decisions in line with business strategy and needs
• Able to allocate tasks and resources across multiple lines of businesses and geographies
• Able to influence senior management both within and outside Data Science
• Successfully persuading internal stakeholders to commit to bestinclass solutions when required
• Leverages change management leadership as required
• Fluency in English is mandatory.

Additional Information :

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race color religion sex national origin sexual orientation gender identity disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Remote Work :

No

Employment Type :

Fulltime

You will be responsible for gaining hands-on experience in the application of various methodologies used in analytical and data-driven techniques to optimize operations and enhance decision-making processes.

This opportunity is ideal for recent graduates or individuals with minimal professional experience who are passionate about using data science and analytics to drive business outcomes in a global sales environment. You will collaborate with senior team members and contribute to ongoing projects.