56 Data Pipelines jobs in Dubai

4 weeks ago Be among the first 25 applicants

BlackStone eIT is at the forefront of data-driven decision-making and innovation. We are currently looking for a talented and motivated Data Architect to join our dynamic team. As a Data Architect at BlackStone eIT, you will play a critical role in designing and implementing data solutions that support our strategic goals and enhance our clients' business processes.
Your responsibilities will include creating robust data architectures, ensuring data quality and integrity, and optimizing data flow across various systems. You will collaborate closely with stakeholders to understand their data needs and translate them into effective technical solutions. This position requires a mix of strong technical skills and the ability to communicate effectively with both technical and non-technical team members.
Key Responsibilities

• Design, develop, and manage scalable data architectures aligned with business goals
• Create and maintain data models, data flows, and integrated data solutions
• Collaborate with data engineers and data analysts to ensure seamless data integration and quality
• Implement data governance and best practices for data management
• Optimize database performance, ensuring efficient data storage and retrieval
• Stay current with emerging trends and technologies in data architecture
• Provide technical guidance and support to cross-functional teams
  

• Bachelor's or Master's degree in Computer Science, Information Systems, or a related field
• 5+ years of experience in data architecture or a related role
• Strong knowledge of data modeling concepts, database design, and data management best practices
• Experience with SQL and NoSQL databases
• Familiarity with ETL/ELT processes and data integration tools
• Excellent problem-solving skills and attention to detail
• Effective communication and collaboration skills
• Ability to work in a fast-paced environment and manage multiple priorities
  

• Paid Time Off
• Performance Bonus
• Training & Development

• Seniority level Mid-Senior level

• Employment type Contract

• Job function Information Technology
• Industries IT Services and IT Consulting

Referrals increase your chances of interviewing at BlackStone eIT by 2x

Get notified about new Data Specialist jobs in Dubai, Dubai, United Arab Emirates .

Global Village, Dubai, United Arab Emirates 2 days ago

Dubai, Dubai, United Arab Emirates 20 hours ago

Dubai, Dubai, United Arab Emirates 23 hours ago

Dubai, Dubai, United Arab Emirates 17 hours ago

Dubai, Dubai, United Arab Emirates 17 hours ago

Dubai, Dubai, United Arab Emirates 17 hours ago

We're unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

The successful Data Architecture Specialist will play a vital role in designing, implementing, and maintaining an organization's data architecture and strategy. This will involve ensuring that data is collected, stored, and processed efficiently and securely to support business intelligence, data analytics, and machine learning operations (MLOps) practices.

This position requires strong technical skills and knowledge of data engineering principles and practices. The ideal candidate will have experience in data warehousing, data modeling, and data integration, as well as expertise in MLOps and machine learning pipelines.

The Data Architecture Specialist will be responsible for:

• Designing robust, scalable data architectures that integrate data from various sources and support diverse analytical needs.
• Implementing data engineering pipelines for data extraction, transformation, and loading (ETL) processes.
• Enabling data intelligence and analytics by building and maintaining data warehouses, data marts, and data lakes.
• Supporting MLOps practices by collaborating with data scientists and machine learning engineers.

To be successful in this role, you will need:

• Extensive experience in data architecture design and implementation.
• Strong knowledge of data engineering principles and practices.
• Expertise in data warehousing, data modeling, and data integration.
• Experience in MLOps and machine learning pipelines.
• Proficiency in SQL and data manipulation languages.
• Experience with big data platforms and cloud-based infrastructure.

We offer a competitive salary package and flexible working hours, allowing you to manage your time effectively. You will also have the opportunity to work remotely and be part of a team that values collaboration and innovation.

We believe in building a positive and collaborative work environment where everyone feels valued and respected. We are committed to attracting talented individuals who share our passion for data architecture and MLOPs, and who are driven to deliver exceptional results.

We perform background checks on all potential employees as a standard part of our recruitment process. If you are a motivated and skilled professional looking for a new challenge, we encourage you to apply for this exciting opportunity.

Designing Data Pipelines and Architectures

A seasoned professional in data management is sought to spearhead the design, development, and maintenance of cutting-edge data pipelines and architectures.

The ideal candidate will possess strong technical skills in Python, SQL, Apache Airflow, PostgreSQL/MySQL, and Git/GitHub/GitLab.

• Develop efficient data storage solutions and optimize performance
• Implement robust data quality and governance practices

The successful candidate will collaborate with data scientists and analysts, automate workflows, monitor data pipelines, ensure data security and privacy, and manage data engineering infrastructure.

We are seeking a highly skilled and strategic leader to oversee our data platform initiatives on Amazon Web Services (AWS) with a strong emphasis on healthcare data, data lake strategy, and AI enablement.

This role requires expertise in designing and implementing enterprise-wide data architecture strategies that support interoperability, AI / ML readiness, and regulatory compliance. The ideal candidate will have hands-on experience architecting AWS-based data lakes and analytics pipelines, as well as a deep understanding of healthcare data standards (FHIR, HL7) and working with FHIR JSON objects in large-scale systems.

The Director of Data Architecture will be responsible for leading the evolution of our AWS-based data lake architecture, supporting structured, semi-structured, and unstructured data types—especially FHIR-formatted JSON healthcare data. They will design and maintain scalable, secure, and cost-effective data lakes using Amazon S3, AWS Glue, Athena, Redshift, and Lake Formation.

Main Responsibilities:

• Define and implement an enterprise-wide data architecture strategy that supports interoperability, AI / ML readiness, and regulatory compliance.
• Leverage Mountpoint for S3 to enable high-performance, POSIX-compliant access to S3 objects, including vectorized data files.
• Optimize data storage and retrieval strategies for performance and cost-efficiency, including partitioning, file formats (e.g., Parquet, ORC), and compression techniques.
• Collaborate with data science teams to implement embedding models, vectorization pipelines, and real-time inference architectures.
• Ensure conformance with healthcare interoperability standards and optimize for queryability and downstream analytics.
• Implement data normalization and enrichment pipelines for use in both clinical and operational contexts.

Qualifications:

• Bachelor's or Master's in Computer Science, Data Engineering, or related field.
• 8–12+ years of experience in data architecture with 3–5 years in a technical leadership role.
• Proven experience architecting AWS-based data lakes and analytics pipelines.
• Familiarity with open-source vector databases (e.g., FAISS, Weaviate) and MLOps pipelines.
• Experience in clinical systems integration, claims processing, or population health analytics.

What We Offer:

A competitive compensation package and opportunities for professional growth and development.

4 weeks ago Be among the first 25 applicants

BlackStone eIT is at the forefront of data-driven decision-making and innovation. We are currently looking for a talented and motivated Data Architect to join our dynamic team. As a Data Architect at BlackStone eIT, you will play a critical role in designing and implementing data solutions that support our strategic goals and enhance our clients' business processes.
Your responsibilities will include creating robust data architectures, ensuring data quality and integrity, and optimizing data flow across various systems. You will collaborate closely with stakeholders to understand their data needs and translate them into effective technical solutions. This position requires a mix of strong technical skills and the ability to communicate effectively with both technical and non-technical team members.
Key Responsibilities

• Design, develop, and manage scalable data architectures aligned with business goals
• Create and maintain data models, data flows, and integrated data solutions
• Collaborate with data engineers and data analysts to ensure seamless data integration and quality
• Implement data governance and best practices for data management
• Optimize database performance, ensuring efficient data storage and retrieval
• Stay current with emerging trends and technologies in data architecture
• Provide technical guidance and support to cross-functional teams
  

• Bachelor's or Master's degree in Computer Science, Information Systems, or a related field
• 5+ years of experience in data architecture or a related role
• Strong knowledge of data modeling concepts, database design, and data management best practices
• Experience with SQL and NoSQL databases
• Familiarity with ETL/ELT processes and data integration tools
• Excellent problem-solving skills and attention to detail
• Effective communication and collaboration skills
• Ability to work in a fast-paced environment and manage multiple priorities
  

• Paid Time Off
• Performance Bonus
• Training & Development

• Seniority levelMid-Senior level

• Employment typeContract

• Job functionInformation Technology
• IndustriesIT Services and IT Consulting

Referrals increase your chances of interviewing at BlackStone eIT by 2x

Get notified about new Data Specialist jobs in Dubai, Dubai, United Arab Emirates.

Global Village, Dubai, United Arab Emirates 2 days ago

Dubai, Dubai, United Arab Emirates 20 hours ago

Dubai, Dubai, United Arab Emirates 23 hours ago

Dubai, Dubai, United Arab Emirates 17 hours ago

Dubai, Dubai, United Arab Emirates 17 hours ago

Dubai, Dubai, United Arab Emirates 17 hours ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

Unlock your potential and drive data-driven decisions by joining our team as a Data Integration Specialist. We are seeking a highly skilled professional to develop and advance their skills in Informatica BDM and Hadoop with Spark and Hive.

• Design, Develop, and Deploy ETL Mechanisms: Utilize strong working knowledge of Oracle/Sybase/SQL Databases to design, develop, and deploy ETL mechanisms using Informatica Big Data Management 10.2.X, including push-down modes with Spark, Blaze, and Hive.
• Transform and Load Complex Data Sources: Transform and load complex data sources, including unstructured data and NoSQL sources, to drive business success.
• Expertise in Hive Database: Leverage expertise in Hive database, including Hive DDL, partitioning, and Hive Query Language, to create efficient data pipelines.
• Hadoop Ecosystem Understanding: Work with HDFS, Spark, and Hive to understand the Hadoop ecosystem and its applications in big data processing.
• Strong SQL/PLSQL Skills: Apply strong SQL/PLSQL skills to drive data-driven decisions and improve business outcomes.

Additional Requirements: Ability to understand requirements and write functional specifications, design documents, and mapping specifications.

This is a pivotal role that ensures the seamless flow of data between Coupa and Oracle ERP systems. A successful candidate will be responsible for implementing secure, accurate, and efficient API, REST/cXML, and file-based integrations.

• Design, develop, and manage OIC integrations for PO, invoice, GRN, supplier, and bank data.
• Automate payment workflows from Coupa to Oracle via various integration methods.
• Guarantee robust data mapping, error handling, and process automation techniques.
• Collaborate with stakeholders to ensure system enhancements and continuity.
• Maintain technical documentation and support materials to aid in knowledge sharing.

As a key member of our team, you will identify and implement integration improvements to optimize overall system performance.

• Minimum 10 years of total COUPA experience and 5+ years in integration development; 3+ years with OIC.
• Bachelor's or Master's degree in IT, Computer Science, or related field.
• Proven expertise in Coupa APIs, REST/cXML, XML, JSON, SOAP, and ERP integration (Oracle Fusion, SAP, Workday).
• Proficiency in OIC orchestration, adapters, XSLT, error handling, and monitoring techniques.
• Preferred certification in OIC certification.

This role offers numerous benefits and opportunities for growth and professional development. As a valued member of our team, you will have access to cutting-edge technology and collaborate with a talented group of professionals.

Our company values innovation, teamwork, and continuous improvement. We strive to create a collaborative and supportive work environment where individuals can grow and thrive.

We are seeking an experienced and skilled Informatica Big Data Management engineer to fill a key role in our team.

Role: Big Data Engineer. Location: United Arab Emirates. Employment type: Full-time.

• Design, develop and implement data integration solutions using Informatica Big Data Management (BDM).
• Collaborate with teams to ensure data pipelines are scalable, secure and compliant with industry standards.
• Participate in maintenance, troubleshooting and performance tuning of data integration jobs (including Oozie scheduling, Hive, HDFS usage and data partitioning).
• Contribute to the design and implementation of security controls, data governance and compliance measures (encryption, anonymization, data integrity, policy controls).
• Support agile, DevOps and CI/CD practices (GitHub, Jenkins) and troubleshoot distributed services in production.
• Engage in problem solving, design patterns implementation, and adherence to policies and best practices.
• Provide ongoing knowledge sharing and collaboration across multiple teams to improve productivity and effectiveness.

• Education: Degree or postgraduate in Computer Science or related field (or equivalent industry experience).
• Experience: Minimum 4+ years of development and design experience in Informatica Big Data Management.
• Extensive knowledge of Oozie scheduling, HQL, Hive, HDFS (including storage controllers) and data partitioning.
• Proficiency with SQL and NoSQL databases; Linux OS and shell scripting.
• Experience with design patterns, Agile, DevOps and CI/CD (GitHub, Jenkins) and troubleshooting in distributed services environments.
• Understanding of distributed systems resiliency and monitoring in production.
• Experience in designing, building, testing and implementing security controls and identifying security gaps; ability to recommend changes.
• Knowledge of data transfer security controls including CRON, ETLs, and JDBC-ODBC scripts.
• Basic networking concepts (DNS, Proxy, ACL) and troubleshooting.
• Awareness of data privacy, encryption, anonymization, data integrity and policy controls in large-scale infrastructures.
• Understanding of logging practices and avoidance of PII data exposure in logs; ability to implement secure logging practices.
• Ability to implement wrapper solutions for new/existing components to ensure compliance with industry standards.

• Excellent interpersonal and communication skills; ability to present ideas clearly to team, stakeholders and management.
• Positive attitude, collaboration, and ability to motivate and build trust within the team.
• Self-motivated, able to own and drive tasks with minimal supervision.

• Mid-Senior level

• IT Services and IT Consulting

We seek a highly skilled Business Intelligence Developer to drive the success of our enterprise data integration projects. This role is ideal for experienced professionals with strong technical expertise in ETL design and architecture, as well as experience in the banking domain.

• Design and develop efficient ETL solutions to support critical business intelligence processes.
• Develop detailed technical specifications for large-scale data integration projects.
• Collaborate with cross-functional teams to ensure seamless integration of data across multiple systems.
• Develop and maintain comprehensive documentation of project deliverables.

• 5+ years of hands-on experience with ETL development and data warehousing concepts.
• Strong knowledge of SQL/PLSQL programming languages.
• Excellent analytical, problem-solving, and communication skills.

• Bachelor's Degree in Computer Science, Information Technology, or related field.
• Professional certifications in data warehousing, business intelligence, or ETL design.