540 Data Engineers jobs in the United Arab Emirates

Big Data Engineer

Dubai, Dubai Virtusa

Posted today

Job Viewed

Tap Again To Close

Job Description

Role: Senior Lead Software Engineer

Skill: Big Data Engineer

Experience: 7 Years

Strong functional knowledge and experience in the banking domain.

Develop and optimize data pipelines using Spark, Hive, and Python on Cloudera.

Develop real-time data workflows using Kafka.

Design and develop APIs for data access and integration.

Utilize Hue, Oozie, and other Cloudera tools for job orchestration and data access.

Deploy solutions on cloud platforms such as AWS, Azure, or GCP.

Required Skills and Experience:

Over 7 years of experience in Big Data engineering.

Hands-on experience with Cloudera Spark, Hive, Kafka, Python, Hue, and Ranger.

Strong understanding of distributed systems and cloud data services.

Proficient in API development and data security controls.

About Virtusa:

Join Virtusa and gain international experience working on leading Digital Transformation programs in the Middle East.

Virtusa is a rapidly growing IT services company with a presence in the UAE, KSA, Qatar, and Oman, working with top clients in banking, finance, travel, telecom, and enterprise sectors. We have received awards from Gartner, IDC, WfMC, and others for our exceptional work.

Be part of our award-winning team that values teamwork, quality of life, and professional growth. Join a global community of 30,000 professionals committed to your development, working on exciting projects with cutting-edge technologies.

#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Abu Dhabi, Abu Dhabi Apt Resources

Posted today

Job Viewed

Tap Again To Close

Job Description


Apt Resources is seeking an experiencedBig Data Engineer for agovernment client in Abu Dhabi . You will design and implement large-scale data solutions to support AI/ML initiatives and public sector digital transformation.

Key Responsibilities:

Data Pipeline Development :

  • Build robust data pipelines usingPython SQL/NoSQL and Airflow
  • DevelopETL/ELT processes for structured/unstructured data
  • Managedata lakes and optimize storage solutions

Data Infrastructure :

  • Design efficientdata models for analytics
  • Implementdata governance and quality frameworks
  • Work withcloud-based data platforms (Azure preferred)

AI/ML Support :

  • Prepare and process datasets for machine learning applications
  • Collaborate with ML teams on feature engineering
Requirements
  • 10-12 years of hands-on big data experience
  • Expertise in:
    • Python andSQL/NoSQL databases
    • Airflow for workflow orchestration
    • ETL/ELT pipeline development
    • Cloud data platforms (Azure AWS or GCP)
Benefits

To be discussed

#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Intern big data

AED40000 - AED60000 Y Mideast Data Systems

Posted today

Job Viewed

Tap Again To Close

Job Description

Exciting Internship Opportunity in Big Data & AI – UAE(Abu Dhabi)

We are looking for fresh graduates who are passionate about Big Data & AI to join as interns and kickstart their careers in this fast-growing field.

Eligibility Criteria:

  1. Currently in the UAE with a valid visa

  2. Recent graduate in Computer Engineering / Computer Science with a good GPA

  3. Eager to learn and willing to undertake an internship in the Big Data/AI domain

**Added Advantage: Knowledge of Python, SQL, and exposure to Big Data technologies**

What We Offer:

  1. Hands-on experience on real-world Big Data & AI projects

  2. Mentorship from industry professionals

  3. Strong foundation to build a long-term career in Data/AI

If you meet the above criteria and are excited to start your journey, please send your resume via DM or email.

Email:

Internship #FreshGraduates #UAE #Opportunities #Python #SQL #BigData #AI
This advertiser has chosen not to accept applicants from your region.

Big Data Developer

AED90000 - AED120000 Y Solutyics

Posted today

Job Viewed

Tap Again To Close

Job Description

Company Description

Solutyics was founded with a vision to shape a world where Data and AI create endless possibilities. Our team of experts is passionate about pushing boundaries to solve complex challenges and deliver solutions in AI, Machine Learning, Data Engineering, and Advanced Data Analytics. We prioritize understanding the unique needs of each client to provide tailored services that help them thrive. Our relationships with clients are built on forthrightness, honor, and a shared passion for success.

Role Description

This is a full-time on-site role for a Big Data Developer located in Abu Dhabi. The Big Data Developer will be responsible for designing and implementing data processing pipelines, managing and optimizing big data solutions, and ensuring data quality and integrity. The role includes extracting, transforming, and loading (ETL) data, developing data warehousing solutions, and collaborating with software development teams to create scalable data architectures.

Qualifications

  • Data Engineering and Big Data skills
  • Experience with Extract Transform Load (ETL) processes and Data Warehousing
  • Software Development skills
  • Strong analytical and problem-solving abilities
  • Excellent written and verbal communication skills
  • Ability to work collaboratively in a team-oriented environment
  • Experience with cloud platforms and big data technologies is a plus
  • Bachelor's degree in Computer Science, Data Science, or related field
This advertiser has chosen not to accept applicants from your region.

Big Data Specialist

Dubai, Dubai beBeeDataEngineer

Posted today

Job Viewed

Tap Again To Close

Job Description

Job Title: Data Engineer

We are seeking an experienced Data Engineer to join our organization. The successful candidate will be responsible for designing, building, and maintaining data pipelines and infrastructure.

About the Role

This is a key position that requires strong technical skills, excellent problem-solving abilities, and effective collaboration with cross-functional teams.

Key Responsibilities
  • Design, develop, and maintain scalable data pipelines
  • Build and manage data warehouses and data lakes
  • Implement data quality and data governance best practices
  • Work with data scientists and analysts to support their research and development projects
Requirements
  • Bachelor's degree in Computer Science, Engineering, or a related field
  • 3-5 years of experience in a data engineering role
  • Strong programming skills in Python, Java, or Scala
  • Experience with big data technologies such as Hadoop, Spark, and Kafka
  • Experience with cloud computing platforms such as AWS, Azure, or Google Cloud Platform
  • Experience with database systems such as SQL, PostgreSQL, and Cassandra
  • Excellent problem-solving and analytical skills
  • Strong communication and teamwork skills
Preferred Qualifications
  • Experience with SAS, Kubernetes, or Docker
  • Experience with machine learning and artificial intelligence
  • Experience with cloud-native development
This advertiser has chosen not to accept applicants from your region.

Big Data Developer

Dubai, Dubai Huns Info Pvt. Ltd.

Posted today

Job Viewed

Tap Again To Close

Job Description

Apache Spark: Strong experience in batch data processing, including RDD, Data Frames, Spark SQL, pySpark, and MLlib; streaming experience is an added advantage.

Cloud & Big Data Platforms: Experience with Databricks, Oracle DRCC, Hadoop, Hive, HBase, Pig and other big data technologies

Data Caching & Performance Optimization: Experience in improving data retrieval and processing performance.

Programming Skills: Strong in Java and Scala (Scala preferred).

Database Experience: Exposure to HDFS, Data Lake, PostgreSQL/MS SQL/SQL, and similar databases.

Data Security & Compliance: Experience with PII data handling, data masking, encryption, decryption, and related security measures.

Workflow Orchestration: Hands-on experience with Apache Airflow or Nifi.

Communication: Strong verbal and written communication skills, with the ability to collaborate across teams and explain technical concepts to non-technical stakeholders.

Secondary Skills

Apache Kafka: Basic hands-on experience is sufficient.

Deployment & Release Management: Experience in application deployment and production release processes.

CI/CD Pipelines : Exposer in designing, implementing, and managing continuous integration and continuous deployment pipelines using tools such as Jenkins, ArgoCD, and Azure CI/CD.

Data Ingestion Tools: Exposer with tools such as Apache Flume, Sqoop, or similar for large-scale data ingestion.

Apply :

Seniority level
  • Seniority level Mid-Senior level
Employment type
  • Employment type Contract
Job function
  • Job function Engineering and Information Technology
  • Industries IT Services and IT Consulting

Referrals increase your chances of interviewing at Huns Info by 2x

Get notified about new Big Data Developer jobs in Dubai, United Arab Emirates.

Dubai, Dubai, United Arab Emirates 22 hours ago

Dubai, Dubai, United Arab Emirates 8 hours ago

Dubai, Dubai, United Arab Emirates 1 year ago

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.

Big Data Specialist

Dubai, Dubai beBeeData

Posted today

Job Viewed

Tap Again To Close

Job Description

Role Overview

This position is for an accomplished data engineer with expertise in designing and developing large-scale data pipelines using Spark, Hive, and Python on Cloudera.

The ideal candidate will have hands-on experience with Cloudera tools such as Hue, Oozie, and Ranger.

A strong understanding of distributed systems and cloud data services is also essential for this role.

In addition to technical skills, the successful candidate will be able to deploy solutions on cloud platforms such as AWS, Azure, or GCP.

  • Design and develop real-time data workflows using Kafka.
  • Develop APIs for data access and integration.
  • Over 7 years of experience in Big Data engineering.
  • Proficient in API development and data security controls.

Virtusa is a rapidly growing IT company working with top clients in various sectors. Our award-winning team values teamwork, quality of life, and professional growth. We are seeking experienced professionals like you to join our team and contribute to our success.

This advertiser has chosen not to accept applicants from your region.
Be The First To Know

About the latest Data engineers Jobs in United Arab Emirates !

Big Data Architect

Dubai, Dubai beBeeData

Posted today

Job Viewed

Tap Again To Close

Job Description

Job Title: Senior Data Engineer - Big Data/ Hadoop Ecosystem

Role Overview

As a seasoned Senior Data Engineer , you will lead cutting-edge data initiatives in the banking sector, leveraging expertise in the Hadoop ecosystem to architect, build, and optimize large-scale data systems. Your mentorship skills will be invaluable as you guide a team of data engineers.

This role is perfect for individuals who thrive in collaborative environments and are passionate about delivering robust data solutions that drive business growth.

Main Responsibilities
  • Design, develop, and optimize scalable data processing systems using the Hadoop ecosystem (HDFS, MapReduce, Hive, Pig, HBase, Flume, Sqoop) and other Big Data technologies such as Java, MapReduce, Hive, and Spark.
  • Lead and mentor a team of data engineers to ensure timely and high-quality project delivery, fostering a culture of innovation and excellence.
  • Engineer, tune, and maintain complex data pipelines in Java, MapReduce, Hive, and Spark, including implementing stream-processing with Spark-Streaming.
  • Design and build efficient dimensional data models and scalable architectures to empower analytics and business intelligence, driving informed decision-making across the organization.
  • Oversee data integrity analysis, deployment, validation, and auditing of data models for accuracy and operational excellence, ensuring the highest standards of data quality.
  • Leverage advanced SQL skills for performance tuning and optimization of data jobs, maximizing system efficiency and throughput.
  • Collaborate with business intelligence teams to deliver industry-leading dashboards and data products that meet the evolving needs of stakeholders.
Required Qualifications
  • 10+ years of hands-on experience as a Big Data Engineer, with deep technical expertise in the Hadoop ecosystem (Cloudera preferred), Apache Spark, and distributed data frameworks.
  • Proven experience leading backend/distributed data systems teams while remaining technically hands-on, driving results-oriented projects that exceed expectations.
  • Advanced proficiency in Java for MapReduce development, as well as strong skills in Python and/or Scala, ensuring adaptability and flexibility in a rapidly changing environment.
  • Expertise in Big Data querying tools including Hive, Pig, and Impala, providing a competitive edge in data analysis and insights.
  • Strong experience with both relational (Postgres) and NoSQL databases (Cassandra, HBase), enabling seamless data integration and management.
  • Solid understanding of dimensional data modeling and data warehousing principles, driving data-driven decision-making and strategic business growth.
  • Proficient in Linux/Unix systems and shell scripting, ensuring effective system administration and maintenance.
Preferred Qualifications
  • Experience with Azure cloud services (Azure Data Lake, Databricks, HDInsight), facilitating cloud-based data management and scalability.
  • Knowledge of stream-processing frameworks such as Spark-Streaming or Storm, enabling real-time data processing and analytics.
  • Background in Financial Services or Banking industry, with exposure to data science and machine learning tools, enhancing data-driven business strategies.
This advertiser has chosen not to accept applicants from your region.

Big Data Innovator

Dubai, Dubai beBeeData

Posted today

Job Viewed

Tap Again To Close

Job Description

Job Opportunity

  • Apache Spark Expertise: We seek an individual with strong experience in batch data processing, including RDD, Data Frames, Spark SQL, and MLlib; knowledge of streaming experience is a plus.
  • Cloud & Big Data Specialist: Experience with Databricks, Oracle DRCC, Hadoop, Hive, HBase, Pig, and other big data technologies is essential.
  • Data Optimization Strategies: The ideal candidate will have expertise in improving data retrieval and processing performance.
  • Programming Proficiency: Strong programming skills in Java and Scala (Scala preferred) are necessary for this role.
  • Database Management: Familiarity with HDFS, Data Lake, PostgreSQL/MS SQL/SQL, and similar databases is required.
  • Security Compliance: Experience with handling PII data, data masking, encryption, decryption, and related security measures is crucial.
  • Workflow Orchestration: Hands-on experience with Apache Airflow or Nifi is highly desirable.
  • Communication Skills: Excellent verbal and written communication skills, with the ability to collaborate across teams and explain technical concepts to non-technical stakeholders, are essential for success in this role.
This advertiser has chosen not to accept applicants from your region.

Big Data Architect

Dubai, Dubai Mindtel

Posted today

Job Viewed

Tap Again To Close

Job Description

Total of 15 years of experience in architecture design of systems and 10 years of experience in architecture design of Big Data Platforms with the following skills:

  1. Proven experience in designing Big Data Platforms for both Infrastructure and Software Implementation.
  2. Good understanding of architecture Design Stage .

Responsibilities include:

  1. Preparing detailed deployment architecture documents of the Enterprise Big Data Platform (redesign of existing architecture).
  2. Supporting CART review of the solution architecture of the Enterprise Big Data Platform.
  3. Coordinating with Big Data Platform Technical specifications related to the Enterprise Big Data Platform infrastructure software stack, etc.
#J-18808-Ljbffr
This advertiser has chosen not to accept applicants from your region.
 

Nearby Locations

Other Jobs Near Me

Industry

  1. request_quote Accounting
  2. work Administrative
  3. eco Agriculture Forestry
  4. smart_toy AI & Emerging Technologies
  5. school Apprenticeships & Trainee
  6. apartment Architecture
  7. palette Arts & Entertainment
  8. directions_car Automotive
  9. flight_takeoff Aviation
  10. account_balance Banking & Finance
  11. local_florist Beauty & Wellness
  12. restaurant Catering
  13. volunteer_activism Charity & Voluntary
  14. science Chemical Engineering
  15. child_friendly Childcare
  16. foundation Civil Engineering
  17. clean_hands Cleaning & Sanitation
  18. diversity_3 Community & Social Care
  19. construction Construction
  20. brush Creative & Digital
  21. currency_bitcoin Crypto & Blockchain
  22. support_agent Customer Service & Helpdesk
  23. medical_services Dental
  24. medical_services Driving & Transport
  25. medical_services E Commerce & Social Media
  26. school Education & Teaching
  27. electrical_services Electrical Engineering
  28. bolt Energy
  29. local_mall Fmcg
  30. gavel Government & Non Profit
  31. emoji_events Graduate
  32. health_and_safety Healthcare
  33. beach_access Hospitality & Tourism
  34. groups Human Resources
  35. precision_manufacturing Industrial Engineering
  36. security Information Security
  37. handyman Installation & Maintenance
  38. policy Insurance
  39. code IT & Software
  40. gavel Legal
  41. sports_soccer Leisure & Sports
  42. inventory_2 Logistics & Warehousing
  43. supervisor_account Management
  44. supervisor_account Management Consultancy
  45. supervisor_account Manufacturing & Production
  46. campaign Marketing
  47. build Mechanical Engineering
  48. perm_media Media & PR
  49. local_hospital Medical
  50. local_hospital Military & Public Safety
  51. local_hospital Mining
  52. medical_services Nursing
  53. local_gas_station Oil & Gas
  54. biotech Pharmaceutical
  55. checklist_rtl Project Management
  56. shopping_bag Purchasing
  57. home_work Real Estate
  58. person_search Recruitment Consultancy
  59. store Retail
  60. point_of_sale Sales
  61. science Scientific Research & Development
  62. wifi Telecoms
  63. psychology Therapy
  64. pets Veterinary
View All Data Engineers Jobs