58 Reporting Engineer jobs in the United Arab Emirates
Senior Reporting Engineer
Posted 5 days ago
Job Viewed
Job Description
+ **Relocation Authorized: National/International - Camp**
+ **Telework Type: Full-Time Office/Project**
+ **Work Location: Abu Dhabi**
# Extraordinary teams building inspiring projects:
Since 1898, we have helped customers complete more than 25,000 projects in 160 countries on all seven continents that have created jobs, grown economies, improved the resiliency of the world's infrastructure, increased access to energy, resources, and vital services, and made the world a safer, cleaner place.
Differentiated by the quality of our people and our relentless drive to deliver the most successful outcomes, we align our capabilities to our customers' objectives to create a lasting positive impact. We serve the Infrastructure; Nuclear, Security & Environmental; Energy; Mining & Metals, and the Manufacturing and Technology markets. Our services span from initial planning and investment, through start-up and operations.
Core to Bechtel is our Vision, Values and Commitments . They are what we believe, what customers can expect, and how we deliver. Learn more about our extraordinary teams building inspiring projects in our Impact Report .
# Project Overview:
Bechtel is pursuing a significant new award of work in Egypt. The Project will cover the development of luxurious residential, commercial, and recreational spaces, tourism amenities, and economic zones. If successful, Bechtel's contract for the delivery of this project will be for project management and construction management services.
# Job Summary:
In this role, you will provide non-routine cost engineering/planning and scheduling needs to projects. You will establish stakeholder relationships, conduct schedule analysis and integrate activities, identify restraints, quantify risks, monitor cost and performance, recommend alternatives, and deliver training sessions and workshops. Your activities will synthesize project components into seamless execution.
# Major Responsibilities:
+ Coordinates non-routine cost engineering/planning and scheduling needs to projects
+ Coordinates with all departments to ensure understanding of total project schedule needs
+ Conducts project schedule analysis and studies of problem areas to determine criticality of schedule activities
+ Collects and analyzes alternatives for schedule improvement
+ Assists, when requested, in the development and review of schedule recovery plans, including evaluation of additional resources/costs required to affect such plans
+ Coordinates the development and accuracy of cost reports
+ Prepares specific budgets in accordance with prescribed standards and procedures
+ Leads risk workshops, interviews and information gathering as it relates to risk identification, review, and update
+ Carries out risk quantification activities as required
+ Delivers training sessions and facilitates workshops
# Education and Experience Requirements:
Requires bachelor's degree (or international equivalent) and 8-10 years of relevant experience or 12-14 years of relevant work experience
# Required Knowledge and Skills:
+ Proficient in PC operating systems and basic software applications.
+ Familiar with financial reporting systems, controller account codes, and relevant Controller instructions affecting Project Controls (such as Financial Status Reports and Earned Revenue Data).
+ Possess intermediate knowledge of engineering, procurement, contracts, construction, and startup processes at Bechtel.
+ Understand engineering and construction management through training or practical experience.
+ Capable of meeting deadlines and performing well under pressure.
# Total Rewards/Benefits:
For decades, Bechtel has worked to inspire the next generation of employees and beyond! Because our teams face some of the world's toughest challenges, we offer robust benefits to ensure our people thrive. Whether it is advancing careers, delivering programs to enhance our culture, or providing time to recharge, Bechtel has the benefits to build a legacy of sustainable growth. Learn more at Bechtel Total Rewards
# Diverse teams build the extraordinary:
As a global company, Bechtel has long been home to a vibrant multitude of nationalities, cultures, ethnicities, and life experiences. This diversity has made us a more trusted partner, more effective problem solvers and innovators, and a more attractive destination for leading talent.
We are committed to being a company where every colleague feels that they belong-where colleagues feel part of "One Team," respected and rewarded for what they bring, supported in pursuing their goals, invested in our values and purpose, and treated equitably. Click here to learn more about the people who power our legacy.
**_Bechtel is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity and expression, age, national origin, disability, citizenship status (except as authorized by law), protected veteran status, genetic information, and any other characteristic protected by federal, state or local law. Applicants with a disability, who require a reasonable accommodation for any part of the application or hiring process, may e-mail their request to_** ** **
Is this job a match or a miss?
Senior Reporting Engineer
Posted today
Job Viewed
Job Description
- Relocation Authorized:National/International - Camp
- Telework Type:Full-Time Office/Project
Since 1898, we have helped customers complete more than 25,000 projects in 160 countries on all seven continents that have created jobs, grown economies, improved the resiliency of the world's infrastructure, increased access to energy, resources, and vital services, and made the world a safer, cleaner place.
Differentiated by the quality of our people and our relentless drive to deliver the most successful outcomes, we align our capabilities to our customers' objectives to create a lasting positive impact. We serve the Infrastructure; Nuclear, Security & Environmental; Energy; Mining & Metals, and the Manufacturing and Technology markets. Our services span from initial planning and investment, through start-up and operations.
Bechtel is pursuing a significant new award of work in Egypt. The Project will cover the development of luxurious residential, commercial, and recreational spaces, tourism amenities, and economic zones. If successful, Bechtel’s contract for the delivery of this project will be for project management and construction management services.
Job Summary:In this role, you will provide non-routine cost engineering/planning and scheduling needs to projects. You will establish stakeholder relationships, conduct schedule analysis and integrate activities, identify restraints, quantify risks, monitor cost and performance, recommend alternatives, and deliver training sessions and workshops. Your activities will synthesize project components into seamless execution.
Major Responsibilities:- Coordinates non-routine cost engineering/planning and scheduling needs to projects
- Coordinates with all departments to ensure understanding of total project schedule needs
- Conducts project schedule analysis and studies of problem areas to determine criticality of schedule activities
- Collects and analyzes alternatives for schedule improvement
- Assists, when requested, in the development and review of schedule recovery plans, including evaluation of additional resources/costs required to affect such plans
- Coordinates the development and accuracy of cost reports
- Prepares specific budgets in accordance with prescribed standards and procedures
- Leads risk workshops, interviews and information gathering as it relates to risk identification, review, and update
- Carries out risk quantification activities as required
- Delivers training sessions and facilitates workshops
Requires bachelor's degree (or international equivalent) and 8-10 years of relevant experience or 12-14 years of relevant work experience
Required Knowledge and Skills:- Proficient in PC operating systems and basic software applications.
- Familiar with financial reporting systems, controller account codes, and relevant Controller instructions affecting Project Controls (such as Financial Status Reports and Earned Revenue Data).
- Possess intermediate knowledge of engineering, procurement, contracts, construction, and startup processes at Bechtel.
- Understand engineering and construction management through training or practical experience.
- Capable of meeting deadlines and performing well under pressure.
For decades, Bechtel has worked to inspire the next generation of employees and beyond! Because our teams face some of the world's toughest challenges, we offer robust benefits to ensure our people thrive. Whether it is advancing careers, delivering programs to enhance our culture, or providing time to recharge, Bechtel has the benefits to build a legacy of sustainable growth. Learn more at Bechtel Total Rewards
Diverse teams build the extraordinary:As a global company, Bechtel has long been home to a vibrant multitude of nationalities, cultures, ethnicities, and life experiences. This diversity has made us a more trusted partner, more effective problem solvers and innovators, and a more attractive destination for leading talent.
We are committed to being a company where every colleague feels that they belong-where colleagues feel part of "One Team," respected and rewarded for what they bring, supported in pursuing their goals, invested in our values and purpose, and treated equitably. Click here to learn more about the people who power our legacy.
Bechtel is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity and expression, age, national origin, disability, citizenship status (except as authorized by law), protected veteran status, genetic information, and any other characteristic protected by federal, state or local law. Applicants with a disability, who require a reasonable accommodation for any part of the application or hiring process, may e-mail their request to
#J-18808-LjbffrIs this job a match or a miss?
Performance and Reporting Engineer
Posted 8 days ago
Job Viewed
Job Description
Performance and Reporting Engineer
Job Description
Job Title: Performance and Reporting EngineerCompany: KBR-Abu DhabiProject: Water Transmission SchemeLocation: Abu DhabiExperience Required: 10+ years in EPC projects
Employment Type: Full-time, Contract
About Company
"Belong, Connect, Grow, with KBR!
The KBR team delivers future-forward science, technology and engineering solutions and mission-critical services that help governments and companies around the world accomplish their most important objectives, while also helping achieve their sustainability goals.
KBR Sustainable Technology Solutions provides holistic and value-added solutions across the entire asset life cycle. These include world-class licensed process technologies, differentiated advisory services, deep technical domain expertise, energy transition solutions, high-end design and engineering capabilities, and smart solutions to optimize planned and operating assets."
Kindly Note: We are currently in a stage bidding for a Water Transmission project and are optimistic about being awarded the contract. In preparation, we have initiated the process of reviewing, shortlisting, and interviewing potential candidates to ensure readiness. Upon confirmation of the project being awarded, we will begin mobilizing the selected candidates to commence project execution.
Job Purpose
This is a PMC role, and the Performance and Reporting Engineer will be responsible for the development, monitoring and reporting of KPI`s on large-scale water transmission programme in Abu Dhabi. There will be multiple Supervision Consultants and EPC`s appointed directly by the Client. This role involves strategic planning, resource management, and collaboration with various stakeholders to meet project objectives, timelines, and budget constraints.
Job Responsibilities
+ Develop and implement project performance metrics and KPIs across all lots.
+ Consolidate data from DELIVERY CONTRACTORS and SUPERVISION CONSULTANTS to create periodic performance reports for stakeholders.
+ Analyze trends and propose recommendations to improve program efficiency.
+ Ensure compliance with contractual and regulatory reporting requirements.
+ Facilitate performance review meetings and address action items
+ Review progress reports submitted by DELIVERY CONTRACTORS for technical accuracy and compliance.
Qualifications
+ Bachelor's degree in Engineering, Project Management of Business Administration.
+ 10+ years of experience in projects. At least 2 years in GCC region
Technical Skills
+ Analytical thinking
+ Teamwork
+ Attention to detail
+ Proficiency in data visualization tools like Power BI and advanced MS Excel.
Soft Skills
+ Strong problem-solving and decision-making skills.
+ Ability to work under pressure and manage multiple priorities effectively.
Is this job a match or a miss?
Data Engineer
Posted today
Job Viewed
Job Description
Property Monitor is the UAE’s leading real estate technology and market intelligence platform, recently acquired by Dubizzle Group. At Property Monitor, we empower developers, brokers, investors, and property professionals with authoritative data and powerful analytics, enabling them to make faster, smarter, and more informed decisions.
As part of Dubizzle Group, we are alongside five powerhouse brands - including market-leading platforms like Bayut and dubizzle trusted by over 123 million monthly users. Together, these brands shape how people buy, sell, and connect across real estate, classifieds, and services in the UAE and broader region.
The Data Engineer will help deliver world-class big data solutions and drive impact for the dubizzle business. You will be responsible for exciting projects covering the end-to-end data life cycle – from raw data integrations with primary and third-party systems, through advanced data modeling, to state-of-the-art data visualization and development of innovative data products.
You will have the opportunity to build and work with both batch and real-time data processing pipelines. While working in a modern cloud-based data warehousing environment alongside a team of diverse, intense and interesting co-workers, you will liaise with other teams– such as product & tech, the core business verticals, trust & safety, finance and others – to enable them to be successful.
In this role, you will:
- Raw data integrations with primary and third-party systems
- Data warehouse modelling for operational and application data layers
- Development in Amazon Redshift cluster
- SQL development as part of agile team workflow
- ETL design and implementation in Matillion ETL
- Real-time data pipelines and applications using serverless and managed AWS services such as Lambda, Kinesis, API Gateway, etc.
- Design and implementation of data products enabling data-driven features or business solutions
- Data quality, system stability and security
- Coding standards in SQL, Python, ETL design
- Building data dashboards and advanced visualisations in Periscope Data with a focus on UX, simplicity and usability
- Working with other departments on data products – i.e. product & technology, marketing & growth, finance, core business, advertising and others
- Being part and contributing towards a strong team culture and ambition to be on the cutting edge of big data
- Be able to work autonomously without supervision on complex projects
- Participate in the early morning ETL status check rota
Requirements:
- Top of class technical degree such as computer science, engineering, math, physics.
- 3+ years of experience working with customer-centric data at big data-scale, preferably in an online / e-commerce context
- 2+ years of experience with one or more programming languages, especially Python
- Strong track record in business intelligence solutions, building and scaling data warehouses and data modelling
- Experience with modern big data ETL tools is a plus (e.g. Matillion)
- Experience with AWS data ecosystem (or other cloud providers)
- Experience with modern data visualization platforms such as Sisense (formerly Periscope Data), Google Data Studio, Tableau, MS Power BI etc.
- Knowledge of modern real-time data pipelines is a strong plus (e.g. server less framework, lambda, kinesis, etc.)
- Knowledge or relational relational and dimensional data models
- Knowledge of terminal operations and Linux workflows
- World-class SQL skills across a variety of relational data warehousing technologies especially in cloud data warehousing (e.g. Amazon Redshift, Google BigQuery, Snowflake, Vertica, etc.)
- Ability to communicate insights and findings to a non-technical audience
What We Offer:
- A fast paced, high performing team.
- Multicultural environment with over 50 different nationalities
- Competitive Tax-free Salary
- Comprehensive Health Insurance
- Annual Air Ticket Allowance
- Employee discounts at multiple vendors across the emirates
- Rewards & Recognitions
- Learning & Development
Dubizzle Group is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
#J-18808-LjbffrIs this job a match or a miss?
Data Engineer
Posted today
Job Viewed
Job Description
Property Monitor is the UAE’s leading real estate technology and market intelligence platform, recently acquired by Dubizzle Group. At Property Monitor, we empower developers, brokers, investors, and property professionals with authoritative data and powerful analytics, enabling them to make faster, smarter, and more informed decisions.
As part of Dubizzle Group, we are alongside five powerhouse brands - including market-leading platforms like Bayut and dubizzle trusted by over 123 million monthly users. Together, these brands shape how people buy, sell, and connect across real estate, classifieds, and services in the UAE and broader region.
The Data Engineer will help deliver world-class big data solutions and drive impact for the dubizzle business. You will be responsible for exciting projects covering the end-to-end data life cycle – from raw data integrations with primary and third-party systems, through advanced data modeling, to state-of-the-art data visualization and development of innovative data products.
You will have the opportunity to build and work with both batch and real-time data processing pipelines. While working in a modern cloud-based data warehousing environment alongside a team of diverse, intense and interesting co-workers, you will liaise with other teams– such as product & tech, the core business verticals, trust & safety, finance and others – to enable them to be successful.
In this role, you will:
- Raw data integrations with primary and third-party systems
- Data warehouse modelling for operational and application data layers
- Development in Amazon Redshift cluster
- SQL development as part of agile team workflow
- ETL design and implementation in Matillion ETL
- Real-time data pipelines and applications using serverless and managed AWS services such as Lambda, Kinesis, API Gateway, etc.
- Design and implementation of data products enabling data-driven features or business solutions
- Data quality, system stability and security
- Coding standards in SQL, Python, ETL design
- Building data dashboards and advanced visualisations in Periscope Data with a focus on UX, simplicity and usability
- Working with other departments on data products – i.e. product & technology, marketing & growth, finance, core business, advertising and others
- Being part and contributing towards a strong team culture and ambition to be on the cutting edge of big data
- Be able to work autonomously without supervision on complex projects
- Participate in the early morning ETL status check rota
Requirements:
- Top of class technical degree such as computer science, engineering, math, physics.
- 3+ years of experience working with customer-centric data at big data-scale, preferably in an online / e-commerce context
- 2+ years of experience with one or more programming languages, especially Python
- Strong track record in business intelligence solutions, building and scaling data warehouses and data modelling
- Experience with modern big data ETL tools is a plus (e.g. Matillion)
- Experience with AWS data ecosystem (or other cloud providers)
- Experience with modern data visualization platforms such as Sisense (formerly Periscope Data), Google Data Studio, Tableau, MS Power BI etc.
- Knowledge of modern real-time data pipelines is a strong plus (e.g. server less framework, lambda, kinesis, etc.)
- Knowledge or relational relational and dimensional data models
- Knowledge of terminal operations and Linux workflows
- World-class SQL skills across a variety of relational data warehousing technologies especially in cloud data warehousing (e.g. Amazon Redshift, Google BigQuery, Snowflake, Vertica, etc.)
- Ability to communicate insights and findings to a non-technical audience
What We Offer:
- A fast paced, high performing team.
- Multicultural environment with over 50 different nationalities
- Competitive Tax-free Salary
- Comprehensive Health Insurance
- Annual Air Ticket Allowance
- Employee discounts at multiple vendors across the emirates
- Rewards & Recognitions
- Learning & Development
Dubizzle Group is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
#J-18808-LjbffrIs this job a match or a miss?
Data Engineer
Posted today
Job Viewed
Job Description
8. Education / Qualifications / Professional Training
Bachelor’s Degree in Computer Science or Management with 4+ years of experience in Vertica and equivalent Databases
- Vertica Certification is a plus.
- Experience with data visualization tools (e.g., Power BI, SAP BI, SAS, Tableau) for data reporting and dashboard creation is beneficial.
Above 4 yrs exp required in Vertica Database Functionalities
8.3 Technical Competencies- Bachelor’s degree in Computer Science, Information Technology, or a related field.
- Proven experience as a Data Engineer or similar role with hands-on expertise in designing and managing data solutions in Vertica.
- Strong proficiency in SQL and experience with data modeling and schema design in Vertica.
- In-depth knowledge of ETL processes and tools, particularly for data integration into Vertica.
- Familiarity with other big data technologies (e.g., Hadoop, Spark) and cloud platforms (e.g., AWS, Azure) is advantageous.
- Understanding of data warehousing concepts and best practices.
- Experience in performance tuning and optimization of Vertica databases.
- Familiarity with Linux environments and shell scripting for data-related automation tasks is a plus.
- Excellent problem-solving skills and the ability to handle large datasets effectively.
- Strong communication and collaboration skills to work effectively within a team-oriented environment.
- Self-motivated, with the ability to work independently and manage multiple tasks and projects simultaneously.
Is this job a match or a miss?
Data Engineer
Posted today
Job Viewed
Job Description
About the Role
We are an emerging AI-native product-driven, agile start-up under Abu Dhabi government AND we are seeking a motivated and technically versatile Data Engineer to join our team. You will play a key role in delivering data platforms, pipelines, and ML enablement within a Databricks on Azure environment.
As part of a stream-aligned delivery team, you’ll work closely with Data Scientists, Architects, and Product Managers to build scalable, high-quality data solutions for clients. You'll be empowered by a collaborative environment that values continuous learning, Agile best practices, and technical excellence.
Ideal candidates have strong hands-on experience in Databricks, Python, ADF and are comfortable in fast-paced, client-facing consulting engagements.
Skills and Experience requirements
1. Technical
- Databricks (or similar) e.g. Notebooks (Python, SQL), Delta Lake, job scheduling, clusters, and workspace management, Unity Catalog, access control awareness
- Cloud data engineering – ideally Azure, including storage (e.g., ADLS, S3, ADLS), compute, and secrets management
- Development languages such as Python, SQL, C#, javascript etc. especially data ingestion, cleaning, and transformation
- ETL / ELT – including structured logging, error handling, reprocessing strategies, APIs, flat files, databases, message queues, event streaming, event sourcing etc.
- Automated testing (ideally TDD), pairing/mobbing. Trunk Based Development, Continuous Deployment and Infrastructure-as-Code (Terraform)
- Git and CI/CD for notebooks, data pipelines, and deployments
2. Integration & Data Handling
- Experienced in delivering platforms for clients – including file transfer, APIS (REST etc.), SQL/NoSQL/graph databases, JSON, CSV, XML, Parquet etc
- Data validation and profiling - assess incoming data quality. Cope with schema drift, deduplication, and reconciliation
- Testing and monitoring pipelines: Unit tests for transformations, data checks, and pipeline observability
3. Working Style
- Comfortable leveraging the best of lean, agile and waterfall approaches. Can contribute to planning, estimation, and documentation, but also collaborative daily re-prioritisation
- Able to explain technical decisions to teammates or clients
- Documents decisions and keeps stakeholders informed
- Comfortable seeking support from other teams for Product, Databricks, Data architecture
- Happy to collaborate with Data Science team on complex subsystems
Nice-to-haves
- MLflow or light MLOps experience (for the data science touchpoints)
- Dbt / dagster / airflow or similar transformation tools
- Understanding of security and compliance (esp. around client data)
- Past experience in consulting or client-facing roles
Candidate Requirements
- 5–8 years (minimum 3–4 years hands-on with cloud/data engineering, 1–2 years in Databricks/Azure, and team/project leadership exposure)
- Bachelor’s degree in Computer Science, Data Engineering, Software Engineering, Information Systems, Data Engineering
Job Type: Full-time
BenefitsVisa, Insurance, Yearly Flight Ticket, Bonus scheme, relocation logistics covered
Interviewing process consists of 2 or 3 technical/behavioral interviews
#J-18808-LjbffrIs this job a match or a miss?
Be The First To Know
About the latest Reporting engineer Jobs in United Arab Emirates !
Data Engineer
Posted today
Job Viewed
Job Description
About the Role
We are seeking a motivated and technically versatile Data Engineer to join our team. You will play a key role in delivering data platforms, pipelines, and ML enablement within a Databricks on Azure environment.
As part of a stream-aligned delivery team, you’ll work closely with Data Scientists, Architects, and Product Managers to build scalable, high-quality data solutions for clients. You'll be empowered by a collaborative environment that values continuous learning, Agile best practices, and technical excellence.
Ideal candidates have strong hands-on experience in Databricks, Python, ADF and are comfortable in fast-paced, client-facing consultingengagements.
Skills and Experience requirements
- Databricks (or similar) e.g. Notebooks (Python, SQL), Delta Lake, job scheduling, clusters, and workspace management, Unity Catalog, access control awareness
- Cloud data engineering – ideally Azure, including storage (e.g., ADLS, S3, ADLS), compute, and secrets management
- Development languages such as Python, SQL, C#, javascript etc. especially data ingestion, cleaning, and transformation
- ETL / ELT – including structured logging, error handling, reprocessing strategies, APIs, flat files, databases, message queues, event streaming, event sourcing etc.
- Automated testing (ideally TDD), pairing/mobbing. Trunk Based Development, Continuous Deployment and Infrastructure-as-Code (Terraform)
- Git and CI/CD for notebooks, data pipelines, and deployments
2. Integration & Data Handling
- Experienced in delivering platforms for clients – including file transfer, APIS (REST etc.), SQL/NoSQL/graph databases, JSON, CSV, XML, Parquet etc
- Data validation and profiling - assess incoming data quality. Cope with schema drift, deduplication, and reconciliation
- Testing and monitoring pipelines: Unit tests for transformations, data checks, and pipeline observability
3. WorkingStyle
- Comfortable leveraging the best of lean, agile and waterfall approaches. Can contribute to planning, estimation, and documentation, but also collaborative daily re-prioritisation
- Able to explain technical decisions to teammates or clients
- Documents decisions and keeps stakeholders informed
- Comfortable seeking support from other teams for Product, Databricks, Data architecture
- Happy to collaborate with Data Science team on complex subsystems
Nice-to-haves
- MLflow or light MLOps experience (for the data science touchpoints)
- Dbt / dagster / airflow or similar transformation tools
- Understanding of security and compliance (esp. around client data)
- Past experience in consulting or client-facing roles
Candidate Requirements
- 5–8 years (minimum 3–4 years hands-on with cloud/data engineering, 1–2 years in Databricks/Azure, and team/project leadership exposure)
- Bachelor’s degree in Computer Science, Data Engineering, Software Engineering, Information Systems, Data Engineering
Disclaimer:
This job posting is not open to recruitment agencies. Any candidate profile submitted by a recruitment agency will be considered as being received directly from an applicant. Contango reserves the rights to contact the candidate directly, without incurring any obligations or liabilities for payment of any fees to the recruitment agency.
#J-18808-LjbffrIs this job a match or a miss?
Data Engineer
Posted today
Job Viewed
Job Description
Location : Dubai
Who Can Apply: Candidates who are currently in Dubai
Job Type: Contract
Experience: Minimum 8+ years
Job Summary:
We are looking for an experienced Data Engineer to design, develop, and optimize data pipelines, ETL processes, and data integration solutions. The ideal candidate should have expertise in AWS cloud services, data engineering best practices, open-source tools, and data schema design. The role requires hands-on experience with large-scale data processing, real-time data streaming, and cloud-based data architectures.
Key Responsibilities:
- Develop and Maintain Data Pipelines to process structured and unstructured data efficiently.
- Implement ETL/ELT Workflows for batch and real-time data processing.
- Optimize Data Processing Workflows using distributed computing frameworks.
- Ensure Data Integrity and Quality through data validation, cleaning, and transformation techniques.
- Work with AWS Cloud Services , including S3, Redshift, Glue, Lambda, DynamoDB, and Kinesis.
- Leverage Open-Source Tools like Apache Spark, Airflow, Kafka, and Flink for data processing.
- Manage and Optimize Database Performance for both SQL and NoSQL environments.
- Collaborate with Data Scientists and Analysts to enable AI/ML model deployment and data accessibility.
- Support Data Migration Initiatives from on-premise to cloud-based data platforms.
- Ensure Compliance and Security Standards in handling sensitive and regulated data.
- Develop Data Models and Schemas for efficient storage and retrieval.
Required Skills & Qualifications:
- 8+ years of experience in data engineering, data architecture, and cloud computing.
- Strong knowledge of AWS Services such as Glue, Redshift, Athena, Lambda, and S3.
- Expertise in ETL Tools , including Talend, Apache NiFi, Informatica, dbt, and AWS Glue.
- Proficiency in Open-Source Tools such as Apache Spark, Hadoop, Airflow, Kafka, and Flink.
- Strong Programming Skills in Python, SQL, and Scala.
- Experience in Data Schema Design , normalization, and performance optimization.
- Knowledge of Real-time Data Streaming using Kafka, Kinesis, or Apache Flink.
- Experience in Data Warehouse and Data Lake Solutions .
- Hands-on experience with DevOps and CI/CD Pipelines for data engineering workflows.
- Understanding of AI and Machine Learning Data Pipelines .
- Strong analytical and problem-solving skills .
Preferred Qualifications:
- AWS Certified Data Analytics – Specialty or AWS Solutions Architect certification.
- Experience with Kubernetes, Docker, and serverless data processing.
- Exposure to MLOps and data engineering practices for AI/ML solutions.
- Experience with distributed computing and big data frameworks.
Is this job a match or a miss?
Data Engineer
Posted today
Job Viewed
Job Description
The Data Engineer will be responsible for developing semantic models on top of the Data Lake/Data Warehouse to fulfill the self-service BI foundation requirements. This includes data extraction from various data sources and integration into the central data lake/data warehouse using enterprise platforms like Informatica iPaaS.
Key Responsibilities of Data Engineer- Designing data warehouse data models based on business requirements.
- Designing, developing, and testing both batch and real-time Extract, Transform and Load (ETL) processes required for data integration.
- Ingesting both structured and unstructured data into the SMBU data lake/data warehouse system.
- Designing and developing semantic models/self-service cubes.
- Performing BI administration and access management to ensure access and reports are properly governed.
- Performing unit testing and data validation to ensure business UAT is successful.
- Performing ad-hoc data analysis and presenting results in a clear manner.
- Assessing data quality of the source systems and proposing enhancements to achieve a satisfactory level of data accuracy.
- Optimizing ETL processes to ensure execution time meets requirements.
- Maintaining and architecting ETL pipelines to ensure data is loaded on time on a regular basis.
- 5 to 8 years of overall experience.
- Proven experience in the development of dimensional models in Azure Synapse with strong SQL knowledge.
- Minimum of 3 years working as a Data Engineer in the Azure ecosystem specifically using Synapse, ADF & Data bricks.
- Preferably 3 years of experience with data warehousing, ETL development, SQL Queries, Synapse, ADF, PySpark, and Informatica iPaaS for data ingestion & data modeling.
Is this job a match or a miss?