540 Data Engineers jobs in the United Arab Emirates
Big Data Engineer
Posted today
Job Viewed
Job Description
Role: Senior Lead Software Engineer
Skill: Big Data Engineer
Experience: 7 Years
Strong functional knowledge and experience in the banking domain.
Develop and optimize data pipelines using Spark, Hive, and Python on Cloudera.
Develop real-time data workflows using Kafka.
Design and develop APIs for data access and integration.
Utilize Hue, Oozie, and other Cloudera tools for job orchestration and data access.
Deploy solutions on cloud platforms such as AWS, Azure, or GCP.
Required Skills and Experience:
Over 7 years of experience in Big Data engineering.
Hands-on experience with Cloudera Spark, Hive, Kafka, Python, Hue, and Ranger.
Strong understanding of distributed systems and cloud data services.
Proficient in API development and data security controls.
About Virtusa:
Join Virtusa and gain international experience working on leading Digital Transformation programs in the Middle East.
Virtusa is a rapidly growing IT services company with a presence in the UAE, KSA, Qatar, and Oman, working with top clients in banking, finance, travel, telecom, and enterprise sectors. We have received awards from Gartner, IDC, WfMC, and others for our exceptional work.
Be part of our award-winning team that values teamwork, quality of life, and professional growth. Join a global community of 30,000 professionals committed to your development, working on exciting projects with cutting-edge technologies.
#J-18808-LjbffrBig Data Engineer
Posted today
Job Viewed
Job Description
Apt Resources is seeking an experiencedBig Data Engineer for agovernment client in Abu Dhabi . You will design and implement large-scale data solutions to support AI/ML initiatives and public sector digital transformation.
Key Responsibilities:Data Pipeline Development :
- Build robust data pipelines usingPython SQL/NoSQL and Airflow
- DevelopETL/ELT processes for structured/unstructured data
- Managedata lakes and optimize storage solutions
Data Infrastructure :
- Design efficientdata models for analytics
- Implementdata governance and quality frameworks
- Work withcloud-based data platforms (Azure preferred)
AI/ML Support :
- Prepare and process datasets for machine learning applications
- Collaborate with ML teams on feature engineering
- 10-12 years of hands-on big data experience
- Expertise in:
- Python andSQL/NoSQL databases
- Airflow for workflow orchestration
- ETL/ELT pipeline development
- Cloud data platforms (Azure AWS or GCP)
To be discussed
#J-18808-LjbffrIntern big data
Posted today
Job Viewed
Job Description
Exciting Internship Opportunity in Big Data & AI – UAE(Abu Dhabi)
We are looking for fresh graduates who are passionate about Big Data & AI to join as interns and kickstart their careers in this fast-growing field.
Eligibility Criteria:
Currently in the UAE with a valid visa
Recent graduate in Computer Engineering / Computer Science with a good GPA
Eager to learn and willing to undertake an internship in the Big Data/AI domain
**Added Advantage: Knowledge of Python, SQL, and exposure to Big Data technologies**
What We Offer:
Hands-on experience on real-world Big Data & AI projects
Mentorship from industry professionals
Strong foundation to build a long-term career in Data/AI
If you meet the above criteria and are excited to start your journey, please send your resume via DM or email.
Email:
Internship #FreshGraduates #UAE #Opportunities #Python #SQL #BigData #AIBig Data Developer
Posted today
Job Viewed
Job Description
Company Description
Solutyics was founded with a vision to shape a world where Data and AI create endless possibilities. Our team of experts is passionate about pushing boundaries to solve complex challenges and deliver solutions in AI, Machine Learning, Data Engineering, and Advanced Data Analytics. We prioritize understanding the unique needs of each client to provide tailored services that help them thrive. Our relationships with clients are built on forthrightness, honor, and a shared passion for success.
Role Description
This is a full-time on-site role for a Big Data Developer located in Abu Dhabi. The Big Data Developer will be responsible for designing and implementing data processing pipelines, managing and optimizing big data solutions, and ensuring data quality and integrity. The role includes extracting, transforming, and loading (ETL) data, developing data warehousing solutions, and collaborating with software development teams to create scalable data architectures.
Qualifications
- Data Engineering and Big Data skills
- Experience with Extract Transform Load (ETL) processes and Data Warehousing
- Software Development skills
- Strong analytical and problem-solving abilities
- Excellent written and verbal communication skills
- Ability to work collaboratively in a team-oriented environment
- Experience with cloud platforms and big data technologies is a plus
- Bachelor's degree in Computer Science, Data Science, or related field
Big Data Specialist
Posted today
Job Viewed
Job Description
We are seeking an experienced Data Engineer to join our organization. The successful candidate will be responsible for designing, building, and maintaining data pipelines and infrastructure.
About the RoleThis is a key position that requires strong technical skills, excellent problem-solving abilities, and effective collaboration with cross-functional teams.
Key Responsibilities- Design, develop, and maintain scalable data pipelines
- Build and manage data warehouses and data lakes
- Implement data quality and data governance best practices
- Work with data scientists and analysts to support their research and development projects
- Bachelor's degree in Computer Science, Engineering, or a related field
- 3-5 years of experience in a data engineering role
- Strong programming skills in Python, Java, or Scala
- Experience with big data technologies such as Hadoop, Spark, and Kafka
- Experience with cloud computing platforms such as AWS, Azure, or Google Cloud Platform
- Experience with database systems such as SQL, PostgreSQL, and Cassandra
- Excellent problem-solving and analytical skills
- Strong communication and teamwork skills
- Experience with SAS, Kubernetes, or Docker
- Experience with machine learning and artificial intelligence
- Experience with cloud-native development
Big Data Developer
Posted today
Job Viewed
Job Description
Apache Spark: Strong experience in batch data processing, including RDD, Data Frames, Spark SQL, pySpark, and MLlib; streaming experience is an added advantage.
Cloud & Big Data Platforms: Experience with Databricks, Oracle DRCC, Hadoop, Hive, HBase, Pig and other big data technologies
Data Caching & Performance Optimization: Experience in improving data retrieval and processing performance.
Programming Skills: Strong in Java and Scala (Scala preferred).
Database Experience: Exposure to HDFS, Data Lake, PostgreSQL/MS SQL/SQL, and similar databases.
Data Security & Compliance: Experience with PII data handling, data masking, encryption, decryption, and related security measures.
Workflow Orchestration: Hands-on experience with Apache Airflow or Nifi.
Communication: Strong verbal and written communication skills, with the ability to collaborate across teams and explain technical concepts to non-technical stakeholders.
Secondary Skills
Apache Kafka: Basic hands-on experience is sufficient.
Deployment & Release Management: Experience in application deployment and production release processes.
CI/CD Pipelines : Exposer in designing, implementing, and managing continuous integration and continuous deployment pipelines using tools such as Jenkins, ArgoCD, and Azure CI/CD.
Data Ingestion Tools: Exposer with tools such as Apache Flume, Sqoop, or similar for large-scale data ingestion.
Apply :
Seniority level- Seniority level Mid-Senior level
- Employment type Contract
- Job function Engineering and Information Technology
- Industries IT Services and IT Consulting
Referrals increase your chances of interviewing at Huns Info by 2x
Get notified about new Big Data Developer jobs in Dubai, United Arab Emirates.
Dubai, Dubai, United Arab Emirates 22 hours ago
Dubai, Dubai, United Arab Emirates 8 hours ago
Dubai, Dubai, United Arab Emirates 1 year ago
We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-LjbffrBig Data Specialist
Posted today
Job Viewed
Job Description
Role Overview
This position is for an accomplished data engineer with expertise in designing and developing large-scale data pipelines using Spark, Hive, and Python on Cloudera.
The ideal candidate will have hands-on experience with Cloudera tools such as Hue, Oozie, and Ranger.
A strong understanding of distributed systems and cloud data services is also essential for this role.
In addition to technical skills, the successful candidate will be able to deploy solutions on cloud platforms such as AWS, Azure, or GCP.
- Design and develop real-time data workflows using Kafka.
- Develop APIs for data access and integration.
- Over 7 years of experience in Big Data engineering.
- Proficient in API development and data security controls.
Virtusa is a rapidly growing IT company working with top clients in various sectors. Our award-winning team values teamwork, quality of life, and professional growth. We are seeking experienced professionals like you to join our team and contribute to our success.
Be The First To Know
About the latest Data engineers Jobs in United Arab Emirates !
Big Data Architect
Posted today
Job Viewed
Job Description
Job Title: Senior Data Engineer - Big Data/ Hadoop Ecosystem
Role OverviewAs a seasoned Senior Data Engineer , you will lead cutting-edge data initiatives in the banking sector, leveraging expertise in the Hadoop ecosystem to architect, build, and optimize large-scale data systems. Your mentorship skills will be invaluable as you guide a team of data engineers.
This role is perfect for individuals who thrive in collaborative environments and are passionate about delivering robust data solutions that drive business growth.
Main Responsibilities- Design, develop, and optimize scalable data processing systems using the Hadoop ecosystem (HDFS, MapReduce, Hive, Pig, HBase, Flume, Sqoop) and other Big Data technologies such as Java, MapReduce, Hive, and Spark.
- Lead and mentor a team of data engineers to ensure timely and high-quality project delivery, fostering a culture of innovation and excellence.
- Engineer, tune, and maintain complex data pipelines in Java, MapReduce, Hive, and Spark, including implementing stream-processing with Spark-Streaming.
- Design and build efficient dimensional data models and scalable architectures to empower analytics and business intelligence, driving informed decision-making across the organization.
- Oversee data integrity analysis, deployment, validation, and auditing of data models for accuracy and operational excellence, ensuring the highest standards of data quality.
- Leverage advanced SQL skills for performance tuning and optimization of data jobs, maximizing system efficiency and throughput.
- Collaborate with business intelligence teams to deliver industry-leading dashboards and data products that meet the evolving needs of stakeholders.
- 10+ years of hands-on experience as a Big Data Engineer, with deep technical expertise in the Hadoop ecosystem (Cloudera preferred), Apache Spark, and distributed data frameworks.
- Proven experience leading backend/distributed data systems teams while remaining technically hands-on, driving results-oriented projects that exceed expectations.
- Advanced proficiency in Java for MapReduce development, as well as strong skills in Python and/or Scala, ensuring adaptability and flexibility in a rapidly changing environment.
- Expertise in Big Data querying tools including Hive, Pig, and Impala, providing a competitive edge in data analysis and insights.
- Strong experience with both relational (Postgres) and NoSQL databases (Cassandra, HBase), enabling seamless data integration and management.
- Solid understanding of dimensional data modeling and data warehousing principles, driving data-driven decision-making and strategic business growth.
- Proficient in Linux/Unix systems and shell scripting, ensuring effective system administration and maintenance.
- Experience with Azure cloud services (Azure Data Lake, Databricks, HDInsight), facilitating cloud-based data management and scalability.
- Knowledge of stream-processing frameworks such as Spark-Streaming or Storm, enabling real-time data processing and analytics.
- Background in Financial Services or Banking industry, with exposure to data science and machine learning tools, enhancing data-driven business strategies.
Big Data Innovator
Posted today
Job Viewed
Job Description
Job Opportunity
- Apache Spark Expertise: We seek an individual with strong experience in batch data processing, including RDD, Data Frames, Spark SQL, and MLlib; knowledge of streaming experience is a plus.
- Cloud & Big Data Specialist: Experience with Databricks, Oracle DRCC, Hadoop, Hive, HBase, Pig, and other big data technologies is essential.
- Data Optimization Strategies: The ideal candidate will have expertise in improving data retrieval and processing performance.
- Programming Proficiency: Strong programming skills in Java and Scala (Scala preferred) are necessary for this role.
- Database Management: Familiarity with HDFS, Data Lake, PostgreSQL/MS SQL/SQL, and similar databases is required.
- Security Compliance: Experience with handling PII data, data masking, encryption, decryption, and related security measures is crucial.
- Workflow Orchestration: Hands-on experience with Apache Airflow or Nifi is highly desirable.
- Communication Skills: Excellent verbal and written communication skills, with the ability to collaborate across teams and explain technical concepts to non-technical stakeholders, are essential for success in this role.
Big Data Architect
Posted today
Job Viewed
Job Description
Total of 15 years of experience in architecture design of systems and 10 years of experience in architecture design of Big Data Platforms with the following skills:
- Proven experience in designing Big Data Platforms for both Infrastructure and Software Implementation.
- Good understanding of architecture Design Stage .
Responsibilities include:
- Preparing detailed deployment architecture documents of the Enterprise Big Data Platform (redesign of existing architecture).
- Supporting CART review of the solution architecture of the Enterprise Big Data Platform.
- Coordinating with Big Data Platform Technical specifications related to the Enterprise Big Data Platform infrastructure software stack, etc.