142 Big Data Technologies jobs in the United Arab Emirates

Job Title: Data Engineering Specialist

We are seeking a skilled Data Engineering Specialist to join our team in Dubai.

This is an exciting opportunity for a seasoned professional with expertise in designing, developing, and maintaining robust data pipelines using Python. The ideal candidate will have hands-on experience with Snowflake, SQL databases, and Apache Airflow, as well as strong skills in Shell scripting.

Key Responsibilities:

• Design and develop data pipelines to support business operations and analytics using Python.
• Integrate APIs using Python to fetch, process, and transform data for various use cases.
• Work with SQL databases, including PostgreSQL, MySQL, MS SQL Server, and Oracle, to perform data transformations, migrations, and optimizations.
• Build and manage data warehouses using Snowflake to ensure high performance and scalability.
• Implement and manage workflows using Apache Airflow to automate data pipeline orchestration.
• Develop and maintain Shell scripts to automate tasks and streamline processes.

Requirements:

• Strong proficiency in Python with experience in API integration and data processing.
• Hands-on experience with Snowflake, including schema design, data modeling, and performance optimization.
• Proficiency in Apache Airflow for managing and orchestrating workflows.
• Strong skills in Shell scripting for automation and system management.
• Solid understanding of designing and maintaining ETL/ELT pipelines.
• Strong analytical and problem-solving skills to handle complex data challenges.
• Excellent communication skills to work effectively with cross-functional teams.

Bonus Points:

• Familiarity with cloud-based platforms, such as AWS or Azure.
• Experience with DevOps practices and tools.
• Knowledge of data security best practices.

**Job Title:** Data Engineering Specialist

The Role

As a Data Engineering Specialist, you will play a pivotal role in transforming complex data landscapes into actionable business insights. Your expertise will enable you to rapidly convert diverse new data sources into datasets that support our overarching business intelligence and analytics goals.

Main Responsibilities:

• Evaluate new data sources from SAP and Non-SAP systems
• Rapidly convert these data sources into datasets
• Develop and support the integration of new data streams into our Azure Data platform
• Ensure data is accessible, reliable, and structured for business insight generation

Required Skills and Qualifications:

• Expertise in data engineering and technical integration
• Ability to evaluate diverse data sources and convert them into usable datasets
• Familiarity with Azure Data platform and its features
• Excellent analytical and problem-solving skills

Benefits:

You will directly impact our ability to make data-driven decisions and maintain our competitive edge in the marketplace. Your contributions will be invaluable in driving business growth and success.

Others:

We offer a dynamic work environment and opportunities for professional growth and development.

As a dynamic and innovative organization, we are committed to empowering the next generation of leaders. Our National Graduate Programme is designed exclusively for UAE Nationals, providing an 18-month journey that combines tailored rotations, mentorship, and development opportunities.

In Phase 1, you will explore our business through three customized 3-month rotations, gaining multi-dimensional exposure and practical insights. In Phase 2, you'll dive deeper into a final 9-month strategic assignment, gaining leadership experience, solving real-world challenges, and driving meaningful impact.

Focus Area: Data Engineering

Data Management and Engineering Expertise

Through rotations in Data Engineering, Data Products, and Data Integrity, you will develop expertise in designing, building, and maintaining robust data infrastructures and solutions. You will play a pivotal role in ensuring data quality, accessibility, and actionable insights that support strategic business decisions and innovation.

Requirements:

• Academic background in IT, Information Security, or Data Engineering
• Strong analytical and technical problem-solving skills
• Knowledge of data architecture, pipelines, and governance
• Attention to detail and commitment to data quality
• Passion for leveraging data to drive business value and innovation

Benefits:

• Enriching, real-world assignments
• Leadership exposure and mentorship
• Development opportunities tailored to your journey
• Access to a competitive benefits package including healthcare, child education contributions, remote work flexibility, and exclusive employee discounts

Empowering Emirati Talent:

We believe in the power of diverse perspectives and inclusive workplaces. We are proud to support the development of UAE National talent and are committed to empowering the next generation of leaders.

As a Quant Developer, you will contribute to the development of trading systems using KDB/Q and Python.

• Develop systematic backtesting, visualization, and trading platforms for global equity strategies
• Collaborate with senior PMs to implement efficient backtester tools and design trading systems
• Ensure reliability, scalability, and timely execution of trading systems
• Mentor junior developers and promote best practices

1. 3-5+ years' experience in developing algorithmic trading systems in systematic equity markets
2. Substantial KDB/Q and Python programming experience
3. Good knowledge of modern data science tools stacks, including Jupyter, pandas, numpy, sklearn, and machine learning expertise
4. Bachelor's or Master's degree in Computer Science, Mathematics, Statistics, or related STEM field from a reputable institution
5. Familiarity with parallel computing tools such as Slurm

1. Dynamic compensation package and excellent career growth opportunities
2. Collaborative culture and an energetic engineering atmosphere
3. Opportunities to build and share knowledge with industry-leading engineers

Data Engineering Specialist

A seasoned professional in data engineering with a strong background in designing and implementing end-to-end data pipelines using cloud platforms.

• Design, develop, and optimize Extract, Transform, Load (ETL) workflows for effective migration and transformation.
• Maintain data ingestion processes from diverse sources such as Salesforce, Oracle databases, PostgreSQL, and MySQL.
• Implement and maintain ETL processes and data pipelines to ensure efficient data extraction, transformation, and loading.
• Leverage Snowflake as the data warehouse solution for managing large volumes of structured and unstructured data.

This is an opportunity to work on complex data engineering projects, collaborating with cross-functional teams to deliver high-quality solutions.

Shape the Future of Data Engineering

We're seeking a seasoned data engineering expert to lead our efforts in building a cutting-edge data foundation. As a key member of our team, you'll have the opportunity to design and implement scalable data systems that support real-time and batch analytics and operations.

• Data Architecture Expertise : You'll be responsible for architecting data systems that ensure data quality, speed, and scalability, using GCP, Airflow, BigQuery, dbt, and Dataflow.
• Pipeline Development : You'll build end-to-end pipelines to deliver high-quality data products, working closely with cross-functional teams to ensure seamless collaboration.
• Data Governance : You'll establish robust data governance and quality rules to promote transparency, trust, and compliance throughout the organization.
• Leadership and Collaboration : As a leader, you'll work with teams to drive impactful data products and initiatives, fostering a culture of innovation and excellence.

This is an exciting opportunity to join a fast-scaling company and make a meaningful impact on its growth and success. If you're passionate about data engineering and want to take your skills to the next level, we encourage you to apply.

Requirements:

• GCP Expertise : Proven experience with Google Cloud Platform, including BigQuery, Dataflow, Airflow, dbt, and Python.
• Advanced SQL Skills : Strong expertise in advanced SQL querying and performance tuning.
• Collaboration and Leadership : Ability to work effectively with cross-functional teams and lead by example.

What We Offer:

• Autonomy and Ownership : You'll have the freedom to drive strategy and make decisions that impact the company's growth and success.
• Continuous Learning : We prioritize professional development and offer opportunities for growth and learning.

About Us:

We're a dynamic and forward-thinking organization dedicated to delivering innovative solutions and driving business growth. Our mission is to empower our customers with cutting-edge technology and expertise.

We are seeking a skilled Data Engineer to join our team in the UAE.

• Design and develop scalable data models using various techniques such as star schema and snowflake schema.
• Develop and maintain database stored procedures and query language scripts using PL/SQL, Java, and SQL.
• Utilize ETL tools like Informatica and Microsoft SSIS to extract, transform, and load data.
• Work with business intelligence tools such as SAP Business Objects and Microsoft Power BI to create interactive dashboards.
• Have hands-on experience with core banking systems, preferably Finacle HPS or Power Card.

• Strong analytical and problem-solving skills.
• Excellent written and verbal communication skills in English.
• Ability to collaborate effectively within a team environment.

• Understanding of the UAE Banking Regulatory Framework Submissions (BRF).
• Familiarity with the Central Bank of the UAE's Supervisory Technology initiative and its objectives.
• Experience in automating regulatory reporting processes.

The selected candidate will be expected to work full-time on site. The joining time frame is within two weeks.

Terms and Conditions:

The employee must adhere to all company policies and procedures.

Remote Work:

No

Employment Type:

Full-time

At General Motors we pride ourselves on designing, building and selling the world's best vehicles. We are seeking a new generation of visionaries to help launch bold engineering and business initiatives, and shape new directions for General Motors. As an intern you will gain hands-on career specific experiences to maximize your real-world potential.

Work Arrangement: This role is categorized as hybrid. This means the successful candidate is expected to report to the office at minimum three times per week or other frequency dictated by the business and two times per week remote.

Your Role:

As a Data Engineering and Analysis Intern, you'll have the opportunity to gain hands-on experience in data-driven decision-making and contribute to our global sales operations. You will collaborate with senior team members, work on data collection, analysis, and reporting, and help optimize business processes using data science techniques.

What You'll Do:

• Assist in gathering and preparing data from various sources
• Clean, transform, and analyze data to ensure quality and accuracy
• Support data analysis, hypothesis testing, and exploratory data analysis (EDA)
• Help build and validate predictive models using basic machine learning techniques
• Generate reports and create data visualizations to highlight business insights
• Collaborate with cross-functional teams (Sales, Finance, CRM, Omnichannel) to support data-driven solutions
• Contribute to business performance tracking, including dashboards and KPIs
• Participate in training and mentorship opportunities to enhance your technical skills

Your Skills & Abilities:

• Currently undergoing bachelor's or master's degree in data science, Data Engineering, Business Analytics, or a related field
• Basic knowledge of programming languages (Python preferred) and data analysis tools (e.g., SQL, Excel)
• Basic knowledge of data visualization tools (Power BI, Tableau) is a plus
• Completed coursework in AI, machine learning, deep learning, and natural language processing (NLP)
• Worked on academic projects involving generative models (like GPT-3, GANs) or reinforcement learning

What We Offer:

• Mentorship from experienced professionals in business and data
• Exposure to real-world data challenges and solutions
• Opportunity to contribute to meaningful projects that impact business outcomes

At General Motors we pride ourselves on designing, building and selling the world's best vehicles. We are seeking a new generation of visionaries to help launch bold engineering and business initiatives, and shape new directions for General Motors. As an intern you will gain hands-on career specific experiences to maximize your real-world potential.

Work Arrangement: This role is categorized as hybrid. This means the successful candidate is expected to report to the office at minimum three times per week or other frequency dictated by the business and two times per week remote.

Your Role:

As a Data Engineering and Analysis Intern, you’ll have the opportunity to gain hands-on experience in data-driven decision-making and contribute to our global sales operations. You will collaborate with senior team members, work on data collection, analysis, and reporting, and help optimize business processes using data science techniques.

What You'll Do:

• Assist in gathering and preparing data from various sources
• Clean, transform, and analyze data to ensure quality and accuracy
• Support data analysis, hypothesis testing, and exploratory data analysis (EDA)
• Help build and validate predictive models using basic machine learning techniques
• Generate reports and create data visualizations to highlight business insights
• Collaborate with cross-functional teams (Sales, Finance, CRM, Omnichannel) to support data-driven solutions
• Contribute to business performance tracking, including dashboards and KPIs
• Participate in training and mentorship opportunities to enhance your technical skills

Your Skills & Abilities:

• Currently undergoing bachelor's or master's degree in data science, Data Engineering, Business Analytics, or a related field
• Basic knowledge of programming languages (Python preferred) and data analysis tools (e.g., SQL, Excel)
• Basic knowledge of data visualization tools (Power BI, Tableau) is a plus
• Completed coursework in AI, machine learning, deep learning, and natural language processing (NLP)
• Worked on academic projects involving generative models (like GPT-3, GANs) or reinforcement learning

What We Offer:

• Mentorship from experienced professionals in business and data
• Exposure to real-world data challenges and solutions
• Opportunity to contribute to meaningful projects that impact business outcomes