CrawlJobs Logo
Riverflex Logo Riverflex · IT - Software Development

Data Engineer - Automation & AI

United Arab Emirates, Abu Dhabi or Dubai · Job Posted January 10, 2026
Apply Position
Job Link Share

Job Description

Riverflex is partnering with a leading financial institution in the UAE on a strategic Proof of Concept focused on increasing data engineering productivity through automation and AI. We are seeking a Data Engineer – Automation & AI with strong GenAI and agent-based experience to own this PoC end-to-end, applying AI- and agent-assisted techniques to the design, migration, and development of AWS-based data pipelines. This role is explicitly focused on accelerating data engineering ways of working using AI, not solely on building pipelines. You will act as the internal lead on how AI should be applied in day-to-day data engineering, working closely with the partner’s Data Lead and embedded with the on-site engineering team. A key part of the scope is translating legacy SQL and stored procedures into modern AWS Glue pipelines, while defining practical AI patterns, tool and guardrails that scale beyond the PoC.

Job Responsibility

  • Data engineering & pipeline delivery: Design, build, and evolve AWS Glue–based data pipelines using Spark and SQL
  • Translate legacy SQL scripts and stored procedures into AWS Glue pipelines
  • Ensure migrated and newly built pipelines meet agreed standards for correctness, performance, and maintainability
  • AI-driven engineering acceleration: Apply Generative AI and agent-based techniques to accelerate data engineering tasks, including code generation/refactoring, pipeline dev. and standardisation
  • Own the design and implementation of AI-assisted tooling that integrates directly into day-to-day engineering workflows
  • Codify successful patterns, reusable tools, and recommended ways of working for scaling beyond the PoC
  • AI tooling & experimentation: Work hands-on with Python and LLM APIs to build pragmatic, internal DE tools
  • Design effective prompts & interaction patterns for code generation & transformation
  • Evaluate and work with enterprise-grade AI platforms (e.g. AWS Bedrock, Azure AI Foundry) using GPT-4 / Claude-class models
  • Define practical rules of thumb and guardrails (e.g. where automation works, where it breaks down, where human intervention is required)
  • Collaboration & ways-of-working: Work closely with data and platform engineers to (dis)prove automation hypotheses and identify where AI adds real productivity gains vs. noise
  • Document outcomes and recommendations from the PoC and provide clear guidance on how AI should (and should not) be used in data engineering at scale

Requirements

  • 6+ years of experience in data engineering or closely related engineering roles
  • Proven experience owning and shaping data engineering solutions, not only implementing individual pipelines
  • Strong hands-on experience with AWS-based data engineering, including: AWS Glue (jobs, transformations, orchestration), Spark (batch processing and transformations), Advanced SQL (complex logic, optimisation, performance tuning), End-to-end pipeline and workflow design
  • Solid (Python) engineering experience, including building reusable components and internal tooling
  • Demonstrated, practical experience applying Generative AI in engineering workflows, such as: Working with LLM APIs (e.g. AWS Bedrock, Azure AI Foundry, OpenAI), Prompt design for code generation, refactoring, and transformation, Understanding the limitations, failure modes, and risks of LLM-based automation
  • Experience designing AI-assisted engineering workflows or tools, for example: API-based services (e.g. FastAPI), MCP (or agent)-like orchestration patterns
  • Able to balance short-term PoC delivery with longer-term capability building
  • Experience in financial services or other regulated environments is a strong advantage
  • Ability to be based in the UAE for a minimum of 3 months, working full-time on-site (Abu Dhabi or Dubai)
Riverflex - All Job Offers

Looking for more opportunities?

Search for other job offers that match your skills and interests.

Suggested Tags: Frontend Developer Secretary Talent Manager Salesforce Administrator Data Analyst
Similar Jobs for

Data Engineer - Automation & AI

8 matching positions

Senior QA Automation Engineer – Data & AI Platforms

We are looking for a Senior QA Automation Engineer with strong expertise in test...
Location
Location
Pakistan , Lahore; Karachi; Islamabad
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in Software Quality Assurance and Test Automation
  • Strong expertise in Test Planning, Test Strategy, and Test Execution
  • Hands-on experience with Selenium, Pytest, and Python-based automation
  • Solid experience in API Testing (REST APIs, JSON, Postman / similar tools)
  • Proven experience integrating automation with CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions, etc.)
  • Experience testing Data platforms, ETL pipelines, and large-scale datasets
  • Exposure to AI/ML pipeline testing, including model validation and data quality checks
  • Strong understanding of SDLC, Agile/Scrum, and DevOps practices
  • Excellent analytical, debugging, and communication skills
Job Responsibility
Job Responsibility
  • Lead test planning, test strategy, and test execution for complex web, API, data, and AI/ML-driven systems
  • Design, develop, and maintain automation frameworks using Selenium and Pytest
  • Perform API testing (RESTful services) including functional, regression, and integration testing
  • Validate data pipelines, ETL workflows, and data quality checks across large datasets
  • Test AI/ML pipelines, including model validation, data drift, feature validation, and inference testing
  • Integrate automated test suites into CI/CD pipelines to enable continuous testing
  • Collaborate with DevOps teams to ensure quality gates in build and deployment pipelines
  • Perform root cause analysis and drive defect resolution with engineering teams
  • Ensure adherence to QA best practices, SDLC, and Agile methodologies
  • Mentor junior QA engineers and contribute to improving overall QA maturity
What we offer
What we offer
  • Work on cutting-edge Data and AI/ML platforms
  • Hybrid work model across Lahore, Karachi, and Islamabad
  • Opportunity to influence quality strategy at scale
  • Collaborative engineering culture with strong focus on automation and innovation
  • Fulltime
Read More
Arrow Right

Senior QA Automation Engineer – Data & AI Platforms

We are looking for a Senior QA Automation Engineer with strong expertise in test...
Location
Location
Pakistan , Lahore; Karachi; Islamabad
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in Software Quality Assurance and Test Automation
  • Strong expertise in Test Planning, Test Strategy, and Test Execution
  • Hands-on experience with Selenium, Pytest, and Python-based automation
  • Solid experience in API Testing (REST APIs, JSON, Postman / similar tools)
  • Proven experience integrating automation with CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions, etc.)
  • Experience testing Data platforms, ETL pipelines, and large-scale datasets
  • Exposure to AI/ML pipeline testing, including model validation and data quality checks
  • Strong understanding of SDLC, Agile/Scrum, and DevOps practices
  • Excellent analytical, debugging, and communication skills
Job Responsibility
Job Responsibility
  • Lead test planning, test strategy, and test execution for complex web, API, data, and AI/ML-driven systems
  • Design, develop, and maintain automation frameworks using Selenium and Pytest
  • Perform API testing (RESTful services) including functional, regression, and integration testing
  • Validate data pipelines, ETL workflows, and data quality checks across large datasets
  • Test AI/ML pipelines, including model validation, data drift, feature validation, and inference testing
  • Integrate automated test suites into CI/CD pipelines to enable continuous testing
  • Collaborate with DevOps teams to ensure quality gates in build and deployment pipelines
  • Perform root cause analysis and drive defect resolution with engineering teams
  • Ensure adherence to QA best practices, SDLC, and Agile methodologies
  • Mentor junior QA engineers and contribute to improving overall QA maturity
What we offer
What we offer
  • Work on cutting-edge Data and AI/ML platforms
  • Hybrid work model across Lahore, Karachi, and Islamabad
  • Opportunity to influence quality strategy at scale
  • Collaborative engineering culture with strong focus on automation and innovation
  • Fulltime
Read More
Arrow Right

Senior QA Automation Engineer – Data & AI Platforms

We are looking for a Senior QA Automation Engineer with strong expertise in test...
Location
Location
Pakistan , Lahore; Karachi; Islamabad
Salary
Salary:
Not provided
northbaysolutions.com Logo
NorthBay
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8+ years of experience in Software Quality Assurance and Test Automation
  • Strong expertise in Test Planning, Test Strategy, and Test Execution
  • Hands-on experience with Selenium, Pytest, and Python-based automation
  • Solid experience in API Testing (REST APIs, JSON, Postman / similar tools)
  • Proven experience integrating automation with CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions, etc.)
  • Experience testing Data platforms, ETL pipelines, and large-scale datasets
  • Exposure to AI/ML pipeline testing, including model validation and data quality checks
  • Strong understanding of SDLC, Agile/Scrum, and DevOps practices
  • Excellent analytical, debugging, and communication skills
Job Responsibility
Job Responsibility
  • Lead test planning, test strategy, and test execution for complex web, API, data, and AI/ML-driven systems
  • Design, develop, and maintain automation frameworks using Selenium and Pytest
  • Perform API testing (RESTful services) including functional, regression, and integration testing
  • Validate data pipelines, ETL workflows, and data quality checks across large datasets
  • Test AI/ML pipelines, including model validation, data drift, feature validation, and inference testing
  • Integrate automated test suites into CI/CD pipelines to enable continuous testing
  • Collaborate with DevOps teams to ensure quality gates in build and deployment pipelines
  • Perform root cause analysis and drive defect resolution with engineering teams
  • Ensure adherence to QA best practices, SDLC, and Agile methodologies
  • Mentor junior QA engineers and contribute to improving overall QA maturity
What we offer
What we offer
  • Work on cutting-edge Data and AI/ML platforms
  • Hybrid work model across Lahore, Karachi, and Islamabad
  • Opportunity to influence quality strategy at scale
  • Collaborative engineering culture with strong focus on automation and innovation
  • Fulltime
Read More
Arrow Right

Senior Data Engineer – Data Engineering & AI Platforms

We are looking for a highly skilled Senior Data Engineer (L2) who can design, bu...
Location
Location
India , Chennai, Madurai, Coimbatore
Salary
Salary:
Not provided
optisolbusiness.com Logo
OptiSol Business Solutions
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong hands-on expertise in cloud ecosystems (Azure / AWS / GCP)
  • Excellent Python programming skills with data engineering libraries and frameworks
  • Advanced SQL capabilities including window functions, CTEs, and performance tuning
  • Solid understanding of distributed processing using Spark/PySpark
  • Experience designing and implementing scalable ETL/ELT workflows
  • Good understanding of data modeling concepts (dimensional, star, snowflake)
  • Familiarity with GenAI/LLM-based integration for data workflows
  • Experience working with Git, CI/CD, and Agile delivery frameworks
  • Strong communication skills for interacting with clients, stakeholders, and internal teams
Job Responsibility
Job Responsibility
  • Design, build, and maintain scalable ETL/ELT pipelines across cloud and big data platforms
  • Contribute to architectural discussions by translating business needs into data solutions spanning ingestion, transformation, and consumption layers
  • Work closely with solutioning and pre-sales teams for technical evaluations and client-facing discussions
  • Lead squads of L0/L1 engineers—ensuring delivery quality, mentoring, and guiding career growth
  • Develop cloud-native data engineering solutions using Python, SQL, PySpark, and modern data frameworks
  • Ensure data reliability, performance, and maintainability across the pipeline lifecycle—from development to deployment
  • Support long-term ODC/T&M projects by demonstrating expertise during technical discussions and interviews
  • Integrate emerging GenAI tools where applicable to enhance data enrichment, automation, and transformations
What we offer
What we offer
  • Opportunity to work at the intersection of Data Engineering, Cloud, and Generative AI
  • Hands-on exposure to modern data stacks and emerging AI technologies
  • Collaboration with experts across Data, AI/ML, and cloud practices
  • Access to structured learning, certifications, and leadership mentoring
  • Competitive compensation with fast-track career growth and visibility
  • Fulltime
Read More
Arrow Right
New

AI Automation Engineer

AI Automation Engineer - London or Liverpool or Glasgow - Hybrid The Company ...
Location
Location
United Kingdom , London or Liverpool or Glasgow
Salary
Salary:
85000.00 GBP / Year
twentyai.com Logo
twentyAI
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Hands-on experience with Copilot Studio, Azure OpenAI, and the Microsoft Power Platform
  • Strong background in business process management
  • Strong understanding of AI workflows, RAG architectures, and AI governance
  • Knowledge of Azure, CI/CD, Git, and modern software engineering practices
  • Hands-on Python scripting experience is desirable
Job Responsibility
Job Responsibility
  • Building and deploying AI-powered agents and copilots using Microsoft technologies
  • Designing intelligent workflows leveraging Azure OpenAI, Copilot Studio, and Power Platform
  • Developing retrieval-augmented generation (RAG) solutions grounded in enterprise data
  • Integrating business systems through APIs, Microsoft 365 services, and cloud platforms
  • Working closely with stakeholders to identify automation opportunities and deliver measurable business value
  • Contributing to governance, best practices, reusable frameworks, and continuous improvement initiatives
  • Fulltime
Read More
Arrow Right

AI & Automation Engineer

FinXL by Randstad Digital focuses on developing client's Networking, Digital and...
Location
Location
Australia , North Sydney
Salary
Salary:
Not provided
finxl.com.au Logo
FinXL
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience in software-network engineering, automation or AI-ML roles
  • Strong programming skills for automation
  • Experience in the Software-Network Delivery process
  • Experience building automation workflows, scripts, or pipelines
  • Experience with AI-ML or Generative AI technologies
  • Experience building AI assistants and managing the lifecycle of the assistants
  • Experience in Generative AI - LLMs, prompt engineering, RAG
  • Experience in Cloud platforms, containerised applications - Red Hat Openshift
  • Experience in CI/CD & DevOps practices- Jenkins, Ansible, GitHub Actions, Python, ArgoCD
  • Experience in Data handling and processing
Job Responsibility
Job Responsibility
  • deliver real, production-grade solutions-from AI assistants to end-to-end automation pipelines
  • translate business and engineering challenges into practical AI or Automation use cases and solutions
  • Fulltime
Read More
Arrow Right

Ai & Automation Engineer

Robert Half is seeking an AI & Automation Engineer to support enterprise automat...
Location
Location
United States , Charlotte
Salary
Salary:
Not provided
https://www.roberthalf.com Logo
Robert Half
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Experience designing and implementing automation solutions within enterprise environments
  • Strong business analysis and requirements gathering experience
  • Ability to translate complex business processes into automated workflows
  • Experience with workflow automation, RPA, low-code/no-code platforms, or AI-driven automation tools
  • Strong understanding of process improvement methodologies, reporting, and data management
  • Excellent communication and stakeholder management skills
Job Responsibility
Job Responsibility
  • Partner with business, operations, and product stakeholders to identify automation opportunities and process improvements
  • Gather, document, and analyze business requirements for automation initiatives
  • Design, develop, and implement workflow automation solutions using approved automation and low-code platforms
  • Automate reporting, data synchronization, operational workflows, and other business processes
  • Create and maintain bots, workflows, and automated business solutions
  • Support testing, deployment, governance, and ongoing optimization of automation initiatives
  • Leverage AI technologies to improve decision-making, efficiency, and scalability
  • Collaborate with cross-functional teams to prioritize and deliver high-value automation projects
  • Monitor and enhance existing automation solutions to maximize performance and business impact
What we offer
What we offer
  • Medical
  • Vision
  • Dental
  • Life and disability insurance
  • 401(k) plan
Read More
Arrow Right

Working Student AI & Automation Engineer

Location
Location
Germany , Kirchheimbolanden
Salary
Salary:
Not provided
borgwarner.com Logo
BorgWarner
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Ongoing studies in (Business) Informatics, Computer Science, Data Science, or a comparable field
  • Strong enthusiasm for AI, AI Agents, Automation, and Digital Transformation, supported by initial academic or hands-on experience
  • Basic understanding of LLMs, generative AI, prompt engineering, and AI-assisted workflows
  • Initial experience with Microsoft Copilot, Power Platform (Power Automate, Power Apps), cloud-based AI services, or RPA/automation tools
  • Programming skills in Python, SQL, or R, ideally applied to data analysis, automation, or AI tasks, plus familiarity with REST APIs, data integration, or workflow orchestration
  • Confident use of MS Office
  • Strong written and spoken English
  • written and spoken German is beneficial
  • Team-oriented mindset combined with initiative, curiosity, motivation, and openness to new technologies
  • Strong problem-solving abilities, service- and solution-oriented thinking, and the ability to work independently and in a structured manner after onboarding
Job Responsibility
Job Responsibility
  • Support the analysis, design, development, and improvement of AI-driven and automated business processes, including identifying opportunities and evaluating innovative technologies
  • Contribute to implementing business use cases and prototypes with Microsoft Copilot, Power Automate, and Power Apps, including data preparation, quality checks, documentation, and basic analysis
  • Assist with research on Data Science, AI, and Process Automation, and support testing, validation, and optimization of AI models, workflows, and automation solutions
  • Collaborate in cross-functional projects, manage assigned tasks independently, and support internal communication and knowledge sharing on analytics, AI, and automation initiatives
  • Support user adoption and change management through demos, trainings, and guidance, ensuring all solutions meet governance, security, and compliance requirements
  • Parttime
Read More
Arrow Right